LeaderRebalancerTest.AddTserver: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:435: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
W20260811 16:07:15.784463 23037 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260811 16:07:15.819355 14579 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:15.820472 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1543) took 1343 ms. Trace:
I20260811 16:07:15.820824 22976 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.820861 13824 rpcz_store.cc:276] 0811 16:07:14.477003 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.962089 (+485086us) service_pool.cc:227] Handling call
0811 16:07:14.987339 (+ 25250us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.990504 (+  3165us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.990531 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.029176 (+ 38645us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.314756 (+285580us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:15.315380 (+   624us) log.cc:842] Serialized 14 byte log entry
0811 16:07:15.321500 (+  6120us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.321622 (+   122us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:15.820262 (+498640us) raft_consensus.cc:1671] finished
0811 16:07:15.820288 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.820413 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12539,"prepare.queue_time_us":268,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":8996,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":28359,"thread_start_us":157592,"threads_started":1,"wal-append.queue_time_us":367034}
I20260811 16:07:15.823549 14577 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:15.823648 23007 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.774024 22856 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.825871 23007 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.826138 22856 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.784123 22965 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.828805 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:15.801631 22901 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.215s	user 0.013s	sys 0.002s
I20260811 16:07:15.804121 13906 raft_consensus.cc:2354] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:15.804404 22903 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.805389 22942 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:15.812480 22855 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.812915 22860 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.708568 22546 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
W20260811 16:07:15.818236 22918 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.350s	user 0.014s	sys 0.000s
I20260811 16:07:15.822700 22900 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.803498 22931 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:15.743367 22832 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.846236 22926 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.814397 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
I20260811 16:07:15.878674 22918 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.884645 13908 raft_consensus.cc:2354] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
I20260811 16:07:15.886080 22918 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.853756 22583 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:15.887197 22583 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.889510 22583 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.890668 22832 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.857209 23020 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.859534 22546 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:15.891631 22546 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.892562 22546 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.893913 22546 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.854859 22942 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.896173 13909 raft_consensus.cc:2354] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:15.897034 23020 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.835495 22901 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.899614 22901 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.900367 13744 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:15.868714 22952 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:15.902455 22952 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.902927 22832 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:15.836848 22904 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.006s
I20260811 16:07:15.903534 22952 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.904501 13900 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260811 16:07:15.905040 13900 pending_rounds.cc:76] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 11
I20260811 16:07:15.905263 13900 pending_rounds.cc:97] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260811 16:07:15.905476 13900 raft_consensus.cc:2866] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:15.908617 22583 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.909421 22583 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.913105 22583 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.903484 22832 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.914744 22878 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:15.905041 22952 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.917476 22832 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:15.907018 22958 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.007s
W20260811 16:07:15.751678 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 346910us
I20260811 16:07:15.934116 22937 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.938771 22936 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:15.981204 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:15.993686 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.988358 23007 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:16.010499 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 327597us
W20260811 16:07:16.017746 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 329284us
W20260811 16:07:16.014087 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 246230us
I20260811 16:07:16.023092 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.981930 22583 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.025161 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.010435 22668 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:15.982012 22958 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.006942 22878 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.009853 23050 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260811 16:07:16.038120 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.006s	sys 0.030s
W20260811 16:07:16.038651 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.030s
I20260811 16:07:16.012603 22987 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.043804 13905 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.022610 22901 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:15.993598 22937 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.052695 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.026777 22936 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:07:16.040259 22314 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.012s
I20260811 16:07:16.028734 22904 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:16.038956 22941 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.083079 13909 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 21. Ops: []
I20260811 16:07:16.085057 13905 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260811 16:07:16.086592 13908 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:16.090982 13908 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.056275 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:16.056838 22829 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.004s
I20260811 16:07:16.098505 13742 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
W20260811 16:07:16.081723 22314 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.012s
I20260811 16:07:16.046617 22668 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.130419 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.131606 13908 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.039646 23020 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260811 16:07:16.039068 22583 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.136716 13908 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260811 16:07:16.139318 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.143682 13909 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:16.038667 22878 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.106302 22936 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:16.146435 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.077373 22903 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
W20260811 16:07:16.156515 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.013s	sys 0.032s
I20260811 16:07:16.077319 22901 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.056849 22911 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260811 16:07:16.139739 22812 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.154588 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:16.054140 22987 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.158322 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:16.159195 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 764506us
I20260811 16:07:16.107626 22941 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.149991 22918 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:16.157015 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.013s	sys 0.032s
I20260811 16:07:16.164851 13736 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
W20260811 16:07:16.158463 23044 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260811 16:07:16.100248 22965 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.173338 13909 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.179800 13817 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:16.174177 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.180971 13908 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:16.175372 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:16.176496 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.804s (SENT) [suppressed 39 similar messages]
I20260811 16:07:16.182017 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.182868 13908 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.177277 13826 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:16.187362 22869 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:16.188591 22869 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:16.188639 13817 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
W20260811 16:07:16.189209 23051 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260811 16:07:16.189543 22941 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:16.189968 23045 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260811 16:07:16.191262 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.172621 22812 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.193553 22958 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.193935 22812 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.196012 22878 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.187201 22918 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.197994 22987 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.199363 22918 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.199672 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.201233 14573 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:16.202379 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.203498 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.203588 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.203861 13823 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:07:16.204218 14574 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:16.204877 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.205380 14574 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEARNER]: Advancing to term 16
W20260811 16:07:16.205655 23056 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260811 16:07:16.206307 14573 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.189095 22869 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.207965 14582 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:16.212581 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.213486 13817 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:16.214365 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 190106us
I20260811 16:07:16.213122 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.217697 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.218526 14579 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.219184 13908 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:16.219632 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.220216 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.220949 13824 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260811 16:07:16.222394 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.214895 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.225610 13826 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:16.229529 14582 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:07:16.235085 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.236035 13824 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.235934 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.244169 14579 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:16.249993 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.255594 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.258644 13826 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:16.261247 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.265030 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.266520 13826 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:16.269321 13908 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:16.274930 13827 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:16.275492 13827 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:16.278560 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.279318 13818 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.273311 13824 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:16.284909 13825 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:07:16.285531 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.286190 13909 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:16.287256 22812 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:16.288290 23067 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:07:16.287890 22812 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.289937 23068 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260811 16:07:16.208119 22965 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.253526 22798 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.318452 13825 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:07:16.287024 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.222499 22912 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260811 16:07:16.319789 13825 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:07:16.317608 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.294359 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.346586 13825 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.346840 14579 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.321904 13827 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.323246 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.347868 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:16.348352 13820 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:16.294749 13818 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:16.324862 13826 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:16.325838 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.348795 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.327005 13824 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:07:16.252980 22901 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.349798 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.332484 22583 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.338255 14574 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:07:16.292186 22869 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.344345 22798 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.345280 23007 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.346167 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.348691 13817 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:16.319556 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.348548 13827 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:16.350915 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.351653 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.180866 22668 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.349481 13823 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:16.279474 22911 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:16.373611 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54121.9us
I20260811 16:07:16.376608 13826 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:16.252234 22856 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.263302 23020 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.359666 13824 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 19. Ops: []
I20260811 16:07:16.291869 23058 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.391573 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.405332 13821 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:16.405825 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.406477 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.406975 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.407419 13821 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.407799 13827 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260811 16:07:16.408613 13823 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:07:16.393173 22901 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.410053 22901 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.410548 22901 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.410722 22941 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.411361 22941 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.412356 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.413466 22941 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.413563 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:16.393860 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.394894 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:16.414168 13908 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.397527 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.405083 22856 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.416517 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.417332 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.414986 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.418104 13909 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:16.418574 13905 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:16.419407 23058 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.421173 22422 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:16.421597 22422 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.421813 22965 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.410640 22918 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260811 16:07:16.291226 22812 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.419826 13909 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260811 16:07:16.422494 22422 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.420396 23050 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260811 16:07:16.424585 22422 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.425988 22798 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.392027 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.411476 23015 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:16.404421 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.418061 22856 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.428612 13905 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260811 16:07:16.430497 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 408283us
I20260811 16:07:16.431411 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.432464 13824 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:16.403369 13789 connection.cc:232] RPC call timeout handler was delayed by -1.6499711909564212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3093s for a response
W20260811 16:07:16.433535 13789 connection.cc:232] RPC call timeout handler was delayed by -1.6437075131107122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260811 16:07:16.434396 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.435561 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3480) took 1836 ms. Trace:
I20260811 16:07:16.436101 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.437129 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:07:16.437826 13789 connection.cc:232] RPC call timeout handler was delayed by -1.633807513047941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260811 16:07:16.439193 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5933075130451471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260811 16:07:16.441438 13789 connection.cc:232] RPC call timeout handler was delayed by -1.591507513076067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260811 16:07:16.439942 13825 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.420459 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3052) took 1326 ms (client timeout 1718 ms). Trace:
W20260811 16:07:16.447127 13906 rpcz_store.cc:269] 0811 16:07:15.094501 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.214255 (+119754us) service_pool.cc:227] Handling call
0811 16:07:16.420281 (+1206026us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002c15d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.420405 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1309191040}
I20260811 16:07:16.448016 13825 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.435920 13901 rpcz_store.cc:276] 0811 16:07:14.632516 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.634293 (+  1777us) service_pool.cc:227] Handling call
0811 16:07:16.435370 (+1801077us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54003b01d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.435493 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1935892864}
I20260811 16:07:16.416599 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.429409 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1759) took 2528 ms. Trace:
I20260811 16:07:16.493089 13826 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:16.422932 22919 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.497157 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.500409 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.424321 23020 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.503971 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.506234 13824 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:16.511026 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.509038 13908 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.513244 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.422060 23058 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:16.513751 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 420209us
I20260811 16:07:16.511377 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.518042 13826 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:16.491784 22924 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.521085 22924 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.519840 22903 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.524647 22903 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.525192 22903 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:16.519961 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3054) took 1424 ms (client timeout 1881 ms). Trace:
W20260811 16:07:16.528342 13903 rpcz_store.cc:269] 0811 16:07:15.095113 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.214622 (+119509us) service_pool.cc:227] Handling call
0811 16:07:16.519749 (+1305127us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000c8354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.519895 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1084624768}
I20260811 16:07:16.530345 22924 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:16.530730 23069 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260811 16:07:16.537209 22860 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:16.392702 23007 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.429234 22968 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:16.540819 22968 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.541201 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44131.7us
I20260811 16:07:16.512355 22918 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.543053 22918 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.543334 22832 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:16.517388 13901 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:16.543778 13825 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:16.495915 22546 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260811 16:07:16.545393 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.546192 22546 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:16.546830 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.548256 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.549347 22621 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:16.549834 22621 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.550235 22621 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:16.550520 22903 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.551892 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.505525 22919 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.553328 22919 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.555429 22897 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:16.556075 22897 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.556553 22897 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.495571 22798 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:16.543447 22918 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.558180 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1673) took 1114 ms. Trace:
I20260811 16:07:16.543062 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:16.566283 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 149758us
I20260811 16:07:16.491348 22965 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:16.492659 22912 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:16.561199 14578 rpcz_store.cc:276] 0811 16:07:15.444285 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.479089 (+ 34804us) service_pool.cc:227] Handling call
0811 16:07:15.481078 (+  1989us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:15.494602 (+ 13524us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:15.494648 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.500303 (+  5655us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.600656 (+100353us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b48000606d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:07:16.078126 (+477470us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:16.111227 (+ 33101us) log.cc:842] Serialized 14 byte log entry
0811 16:07:16.497871 (+386644us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.497944 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:16.557744 (+ 59800us) raft_consensus.cc:1671] finished
0811 16:07:16.557909 (+   165us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:16.558101 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":399335,"prepare.queue_time_us":60635,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":49,"raft.queue_time_us":406309,"raft.run_cpu_time_us":1132,"raft.run_wall_time_us":97274,"spinlock_wait_cycles":14183808,"thread_start_us":457663,"threads_started":1,"wal-append.queue_time_us":936110}
I20260811 16:07:16.427511 22869 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:16.491573 22878 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:16.576231 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.577291 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.578394 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.582173 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.403445 22911 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.584573 22942 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.585170 22942 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.586356 22911 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.579749 22952 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:16.587589 22832 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:16.588536 22914 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:16.588771 23020 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.558756 22926 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.559626 22798 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.558223 22829 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.571516 23015 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:16.571607 22847 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.449535 22812 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.608165 13903 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260811 16:07:16.599054 22952 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:16.616472 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.599236 22829 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.608592 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.599815 22926 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.618718 22965 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.616631 22952 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.599841 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:16.619690 22952 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:16.620198 22926 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.619918 22965 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.617712 22829 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.620582 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.627679 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.629184 14574 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.617161 22901 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.633219 22901 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.618467 13908 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:16.628662 22798 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.598692 22878 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.613623 23015 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:16.635717 23015 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.635914 22878 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.624336 22812 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.640491 23054 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.640946 22812 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.640636 22829 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.641299 23054 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.599475 23065 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:16.643412 23065 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.643882 23065 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.594290 22924 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:16.646625 22546 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:16.590306 22912 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.598380 22903 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.593070 22942 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.660003 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.677572 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:16.595868 22951 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
W20260811 16:07:16.684702 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.016s	sys 0.023s
I20260811 16:07:16.667645 22829 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.694789 13908 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:16.658090 22911 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260811 16:07:16.624513 22847 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.691044 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.016s	sys 0.024s
I20260811 16:07:16.707204 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:16.707985 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84637.3us
I20260811 16:07:16.709741 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:16.808180 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98521.7us
I20260811 16:07:16.705060 22903 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:16.707412 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 530917us
I20260811 16:07:16.799722 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.819516 14579 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.820041 22621 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.813180 22903 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.824442 22903 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.828087 22936 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:16.828668 22936 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.829572 22936 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.830706 22936 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.833164 22847 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.835029 23015 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.836404 22931 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:16.836826 22931 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.837379 23015 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.837741 22931 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.813017 22924 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:16.839195 22918 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.839890 22924 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.840338 22924 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:16.841929 22918 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.780121 22941 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:16.843402 22941 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.843742 22931 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.844445 22941 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.813716 22901 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:16.814736 22919 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.708537 22912 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.827126 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1766) took 1123 ms. Trace:
W20260811 16:07:16.805974 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 405482us
I20260811 16:07:16.865039 14577 rpcz_store.cc:276] 0811 16:07:15.704065 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.742690 (+ 38625us) service_pool.cc:227] Handling call
0811 16:07:16.826926 (+1084236us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.827055 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":121029376}
I20260811 16:07:16.494050 14583 rpcz_store.cc:276] 0811 16:07:13.900591 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.074638 (+174047us) service_pool.cc:227] Handling call
0811 16:07:14.083930 (+  9292us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.084307 (+   377us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.084334 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.559178 (+1474844us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:15.562339 (+  3161us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.971425 (+409086us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:15.982265 (+ 10840us) log.cc:842] Serialized 14 byte log entry
0811 16:07:16.428836 (+446571us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b18000eae80. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:07:16.429061 (+   225us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.429161 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:16.429207 (+    46us) raft_consensus.cc:1671] finished
0811 16:07:16.429220 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:16.429350 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9467,"prepare.queue_time_us":20160,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":8102,"raft.queue_time_us":447968,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":44496,"spinlock_wait_cycles":43906688,"thread_start_us":408616,"threads_started":1,"wal-append.queue_time_us":425617}
I20260811 16:07:16.867488 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:16.866310 23054 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.869817 23005 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:16.868383 22897 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.873581 22952 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.868249 23065 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.881458 23065 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:16.881873 23059 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.457s	user 0.001s	sys 0.001s
W20260811 16:07:16.883396 22981 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260811 16:07:16.886569 22952 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.886583 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 3042) took 1517 ms. Trace:
I20260811 16:07:16.888643 13742 rpcz_store.cc:276] 0811 16:07:15.370679 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.371025 (+   346us) service_pool.cc:227] Handling call
0811 16:07:16.886375 (+1515350us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54002783d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.886516 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1622380416}
W20260811 16:07:16.892297 13904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3056) took 1795 ms (client timeout 1998 ms). Trace:
W20260811 16:07:16.892818 13904 rpcz_store.cc:269] 0811 16:07:15.097177 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.415942 (+318765us) service_pool.cc:227] Handling call
0811 16:07:16.892034 (+1476092us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.892225 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1490094976}
I20260811 16:07:16.894024 13905 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:16.870401 23005 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.848450 14579 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:16.858863 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.869620 22847 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260811 16:07:16.846989 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:16.870324 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.687762 14574 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260811 16:07:16.904242 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57346.7us
W20260811 16:07:16.904942 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:16.905525 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:16.906140 13871 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:16.906764 13871 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.898332 22668 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.040s	sys 0.046s
W20260811 16:07:16.909296 13871 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:16.911810 13706 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:16.912001 13871 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.913321 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.914054 13871 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.915220 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.897141 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46401.5us
W20260811 16:07:16.899055 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5231075130868703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260811 16:07:16.918381 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5150075131095946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
W20260811 16:07:16.919320 13789 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.866s (SENT)
W20260811 16:07:16.920207 13789 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.881s (SENT)
I20260811 16:07:16.920686 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.924332 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:16.909724 22668 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.042s	sys 0.047s
I20260811 16:07:16.931172 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.925529 14574 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:16.936100 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.936800 14582 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.934952 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:16.939405 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:16.939544 14578 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.939944 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.944903 14583 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:16.946079 14579 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.922142 22925 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:16.919512 22901 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:16.990684 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44084.1us
W20260811 16:07:16.991366 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 376862us
W20260811 16:07:16.952529 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:16.994781 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:07:16.952529 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 497904us
W20260811 16:07:16.996013 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:16.996399 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:16.996855 13871 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.998004 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.997028 13789 connection.cc:232] RPC call timeout handler was delayed by -1.4836829259293154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260811 16:07:16.998736 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:17.001688 13871 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:17.002900 14582 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
W20260811 16:07:16.998778 13789 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.978s (SENT)
I20260811 16:07:16.926357 22954 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:17.007067 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.952955 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.008539 14573 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:17.015420 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.018556 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:17.019315 13817 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:17.020012 13789 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.998s (SENT)
I20260811 16:07:17.021000 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:17.002449 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:17.023857 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:17.019909 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88876.1us
W20260811 16:07:16.995155 23076 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:07:16.990756 23058 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:16.943387 22908 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260811 16:07:17.025827 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.953014 22981 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.947034 22812 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:17.025043 23039 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.041s	sys 0.056s
I20260811 16:07:17.036368 13822 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260811 16:07:17.005631 22847 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.007898 22925 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.019294 22856 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.040664 13823 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260811 16:07:17.027835 22901 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260811 16:07:16.947983 23015 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.090s
I20260811 16:07:17.026575 22932 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:07:17.049291 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.021s
W20260811 16:07:17.049649 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.000s	sys 0.022s
W20260811 16:07:17.040228 23039 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.041s	sys 0.057s
I20260811 16:07:17.051560 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.054087 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:17.058617 13903 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.061645 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:17.065708 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:17.067938 13909 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:17.069103 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:17.069818 13909 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:17.073244 13909 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:07:17.075189 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:17.070050 13817 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:17.047607 22925 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:17.049001 22932 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.080482 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:17.077780 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:17.081410 13908 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:17.050412 22901 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.086905 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:17.088199 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61361.5us
I20260811 16:07:17.089195 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.950050 23054 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:17.034535 22918 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260811 16:07:17.081609 13822 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:17.059297 22422 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:17.098127 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78076.6us
I20260811 16:07:17.043411 22812 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.057641 22919 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.098956 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.106889 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.109156 13903 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:17.073014 23020 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:17.111047 14582 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260811 16:07:17.100078 13789 connection.cc:232] RPC call timeout handler was delayed by -1.4395829259883612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260811 16:07:16.990212 23005 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:17.111984 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76147.8us
I20260811 16:07:17.113242 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:17.112553 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3828829260310158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260811 16:07:17.066895 22897 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.104224 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:17.106412 14579 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260811 16:07:17.080118 22937 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.091750 22901 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:17.115540 13908 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:17.116554 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:17.047787 22917 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260811 16:07:17.087586 22932 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:17.042169 22981 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.127079 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.131770 13823 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.121034 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.121979 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:17.115268 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0822829259559512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
I20260811 16:07:17.124409 23085 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:17.124666 22951 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.125104 23054 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.094259 13909 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:17.046537 22847 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.057895 22856 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.127045 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.136746 14573 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:17.160101 14579 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.135874 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.161299 14582 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:17.139937 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.162228 14577 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:17.162298 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:17.141281 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.163494 14583 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:17.142254 22812 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:17.138813 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:17.181929 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47240.7us
I20260811 16:07:17.143422 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:17.146463 13871 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:17.119319 23082 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:17.141952 22924 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.196164 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.116734 23080 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:17.153383 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.154805 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:17.182860 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:17.185971 13871 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:17.128091 23020 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:17.187752 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.200273 14582 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:17.199950 23020 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.201643 23080 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:17.201961 14579 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:17.202121 23080 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.138103 23085 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.203272 23080 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:17.203474 23085 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:17.201951 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47182.6us
I20260811 16:07:17.213768 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.216957 23085 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.220377 13823 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:17.224538 14574 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260811 16:07:17.160589 22546 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.127168 22942 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260811 16:07:17.159940 23015 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:17.227725 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.186798 22952 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:17.219520 22812 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260811 16:07:17.242726 23092 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260811 16:07:17.244539 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 146058us
I20260811 16:07:17.188436 22951 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:17.240391 14577 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:17.276753 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 80419.5us
I20260811 16:07:17.243395 22847 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.293736 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.222136 23082 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:17.193578 22940 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260811 16:07:17.301970 22924 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.185043 23054 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.300005 14574 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:17.283392 22812 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:17.410607 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 257358us
I20260811 16:07:17.305539 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.275789 23015 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:17.396179 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:17.370610 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66688.9us
W20260811 16:07:17.421221 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 208379us
W20260811 16:07:17.418601 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 113142us
I20260811 16:07:17.369933 14579 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260811 16:07:17.419358 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.302505 22856 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.295094 23058 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:17.296147 23064 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.295377 22919 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:17.427470 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.300154 22422 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.271709 22546 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.430310 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.423348 23015 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:17.371259 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.377650 22847 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.423524 22812 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:17.438686 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.314572 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
W20260811 16:07:17.452507 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 334215us
I20260811 16:07:17.466583 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.296344 22952 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.439540 22942 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:17.476071 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c390fd23cec5435d81b38a50b2988a60 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:17.476789 22880 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:17.476256 22422 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:17.479920 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 108793us
I20260811 16:07:17.480464 22856 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.445159 22919 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.430178 23104 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:17.461952 22981 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.463969 23064 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:17.396571 23039 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260811 16:07:17.497895 23063 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:17.397258 23005 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260811 16:07:17.488538 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.276369 23098 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.256s
I20260811 16:07:17.446319 23110 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.084s
I20260811 16:07:17.504130 22919 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.504320 22918 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:17.429721 22951 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.546316 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.504635 23113 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:17.468879 22847 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.561797 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.511968 23063 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.522589 23104 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:17.519472 23020 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.519929 23085 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.428913 23082 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:17.579596 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113124us
W20260811 16:07:17.580631 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150368us
I20260811 16:07:17.582024 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.490603 22942 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.589239 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.594095 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.596179 13789 leader_election.cc:398] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20.
W20260811 16:07:17.597222 22931 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.753s	user 0.013s	sys 0.000s
I20260811 16:07:17.599642 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.558449 23113 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.572745 23111 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:17.592541 23088 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260811 16:07:17.509589 23101 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260811 16:07:17.584735 23090 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:17.598951 23085 raft_consensus.cc:2741] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
W20260811 16:07:17.646032 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 127129us
I20260811 16:07:17.616947 22912 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.675190 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1763) took 2050 ms. Trace:
I20260811 16:07:17.685371 14580 rpcz_store.cc:276] 0811 16:07:15.624970 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.625115 (+   145us) service_pool.cc:227] Handling call
0811 16:07:15.625496 (+   381us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:15.625783 (+   287us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:15.625819 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.626336 (+   517us) log.cc:842] Serialized 26 byte log entry
0811 16:07:16.080118 (+453782us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:16.881266 (+801148us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:17.648418 (+767152us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b1800558d00. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f
0811 16:07:17.648636 (+   218us) log.cc:842] Serialized 14 byte log entry
0811 16:07:17.674679 (+ 26043us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.674819 (+   140us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:17.674883 (+    64us) raft_consensus.cc:1671] finished
0811 16:07:17.674900 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:17.675088 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18786,"prepare.queue_time_us":68880,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":26895,"spinlock_wait_cycles":208335104,"thread_start_us":793607,"threads_started":2,"wal-append.queue_time_us":741111}
I20260811 16:07:17.564321 23099 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260811 16:07:17.617811 23113 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:17.699090 22907 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.642237 23005 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:17.702319 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 183718us
I20260811 16:07:17.643265 22931 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:17.700911 23085 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:17.724861 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.679803 22897 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:17.690346 23111 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.751163 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.645176 22940 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260811 16:07:17.694442 23054 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:17.764331 23059 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:07:17.715473 22912 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:17.765455 23112 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260811 16:07:17.765621 22952 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.689983 23115 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.719251 23005 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:17.767823 23100 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260811 16:07:17.766973 22942 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.761185 23039 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:17.748874 22856 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.610107 23064 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.774667 23085 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:17.835932 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 236388us
I20260811 16:07:17.826268 23054 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:17.858491 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.786624 23124 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.755618 23098 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260811 16:07:17.775341 22546 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:17.827230 23088 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260811 16:07:17.737884 22907 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.643566 23063 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.875619 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.841760 23005 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:17.838165 22940 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.881798 23110 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:17.774811 22897 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:17.861629 22936 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.031s	user 0.017s	sys 0.000s
W20260811 16:07:17.861029 22901 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.000s
W20260811 16:07:17.886798 23102 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260811 16:07:17.849355 23039 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.871515 23020 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:17.919572 13789 leader_election.cc:398] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
I20260811 16:07:17.919181 22940 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.891466 23054 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:17.909721 22942 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:17.931604 13789 leader_election.cc:401] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260811 16:07:17.859858 23099 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
W20260811 16:07:17.913427 23106 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260811 16:07:17.913300 23110 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.944555 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3142) took 1444 ms. Trace:
I20260811 16:07:17.820583 23111 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:17.881520 23085 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:17.935349 23103 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260811 16:07:17.920835 23125 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:17.940071 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3496) took 1561 ms. Trace:
I20260811 16:07:17.924773 22422 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Stepping down as leader of term 25
W20260811 16:07:17.961645 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 284001us
I20260811 16:07:17.925235 22847 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.965734 23135 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:17.907178 23101 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260811 16:07:17.967072 13821 rpcz_store.cc:276] 0811 16:07:16.500578 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.502543 (+  1965us) service_pool.cc:227] Handling call
0811 16:07:16.502863 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:16.993959 (+491096us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.993994 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:17.007861 (+ 13867us) log.cc:842] Serialized 26 byte log entry
0811 16:07:17.144068 (+136207us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:17.144114 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.144183 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:17.944239 (+800056us) raft_consensus.cc:1671] finished
0811 16:07:17.944273 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:17.944474 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":137074,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":599964,"threads_started":2,"wal-append.queue_time_us":394080}
I20260811 16:07:17.985996 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.847764 23115 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.976290 13906 rpcz_store.cc:276] 0811 16:07:16.378466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.506744 (+128278us) service_pool.cc:227] Handling call
0811 16:07:16.507092 (+   348us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:16.516909 (+  9817us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.516946 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:16.569947 (+ 53001us) log.cc:842] Serialized 52 byte log entry
0811 16:07:16.872656 (+302709us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:17.127458 (+254802us) log.cc:842] Serialized 14 byte log entry
0811 16:07:17.411978 (+284520us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.412070 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:17.939804 (+527734us) raft_consensus.cc:1671] finished
0811 16:07:17.939827 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:17.939998 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37248,"prepare.queue_time_us":226225,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":9294,"raft.queue_time_us":59532,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":31988,"spinlock_wait_cycles":73396992,"thread_start_us":706076,"threads_started":3,"wal-append.queue_time_us":559718}
I20260811 16:07:17.958281 23098 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:17.960844 22798 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.923653 22901 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.011759 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3493) took 1690 ms. Trace:
I20260811 16:07:18.012171 13905 rpcz_store.cc:276] 0811 16:07:16.321121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.431252 (+110131us) service_pool.cc:227] Handling call
0811 16:07:16.893793 (+462541us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:16.894499 (+   706us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.011541 (+1117042us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400301950. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:18.011687 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1062983936}
W20260811 16:07:18.013806 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 262734us
I20260811 16:07:17.975574 22936 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.888103 23124 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.973481 23122 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:17.985462 22422 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.029037 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.031206 23098 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:18.018015 23020 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.983825 23125 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:18.071120 23086 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260811 16:07:18.071938 23125 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.048483 23116 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:18.073186 23125 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.073297 23116 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.074388 22940 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.047574 23127 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:18.075479 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2525) took 1874 ms. Trace:
I20260811 16:07:17.988338 23136 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:18.049099 23105 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.076332 23136 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:18.076843 23136 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:18.076664 23105 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.078125 23138 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.080256 23085 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:18.080720 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:18.081188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 882091us
W20260811 16:07:18.058106 23080 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.851s	user 0.020s	sys 0.000s
I20260811 16:07:18.082752 23080 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.084137 22954 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:18.084851 22954 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.070287 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.051443 23122 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.076892 23079 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.084245 23115 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.028139 14580 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260811 16:07:18.060250 14583 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.075693 22940 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:18.009235 22847 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
W20260811 16:07:18.094148 22932 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.947s	user 0.014s	sys 0.000s
I20260811 16:07:17.947916 22912 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.098120 23053 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:17.989621 22942 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260811 16:07:18.075920 14575 rpcz_store.cc:276] 0811 16:07:16.201025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.201159 (+   134us) service_pool.cc:227] Handling call
0811 16:07:16.201488 (+   329us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:16.503516 (+302028us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.503563 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:16.504123 (+   560us) log.cc:842] Serialized 26 byte log entry
0811 16:07:16.919249 (+415126us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:16.919301 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.919381 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.075240 (+1155859us) raft_consensus.cc:1671] finished
0811 16:07:18.075265 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.075415 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":301472,"raft.queue_time_us":335922,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":414041,"threads_started":1,"wal-append.queue_time_us":1093866}
I20260811 16:07:17.995434 23099 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260811 16:07:18.085062 23080 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.053694 23128 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:07:18.096953 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 671279us
I20260811 16:07:18.053061 22936 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.058239 23098 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.069698 23133 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:17.970752 22856 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.018963 22798 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.128800 22932 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.195465 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3494) took 1838 ms. Trace:
I20260811 16:07:18.212926 14583 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260811 16:07:18.164593 23116 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.078691 23138 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.051911 23054 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:18.217222 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 135429us
I20260811 16:07:18.170572 14577 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260811 16:07:18.224805 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:18.116720 22919 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.001s
I20260811 16:07:17.983860 23039 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.069335 22907 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.174798 23128 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:18.122409 22940 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.176347 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.183264 23124 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.262362 13823 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:18.262812 13823 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:18.258561 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:18.208729 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.196117 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3154) took 1075 ms. Trace:
I20260811 16:07:18.213150 13907 rpcz_store.cc:276] 0811 16:07:16.357402 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.452354 (+ 94952us) service_pool.cc:227] Handling call
0811 16:07:16.516583 (+ 64229us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:16.573139 (+ 56556us) raft_consensus.cc:1520] Early marking committed up to index 16
0811 16:07:16.919596 (+346457us) log.cc:842] Serialized 14 byte log entry
0811 16:07:17.132322 (+212726us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:17.132373 (+    51us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:17.132420 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.481228 (+348808us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b1800292480. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:18.195165 (+713937us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:18.195234 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.195396 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23484,"prepare.queue_time_us":517754,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":5587,"raft.queue_time_us":47884,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":39772,"spinlock_wait_cycles":139907840,"thread_start_us":524889,"threads_started":2,"wal-append.queue_time_us":302415}
I20260811 16:07:18.022147 23110 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:18.184803 22880 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.000s
I20260811 16:07:18.163205 23053 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:18.291049 13902 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260811 16:07:18.193344 23052 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.218s	user 0.006s	sys 0.000s
W20260811 16:07:18.206859 22925 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.109s	user 0.013s	sys 0.003s
I20260811 16:07:18.239048 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.241534 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.241739 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.229844 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.295488 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.296680 13820 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:07:18.171444 23134 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
I20260811 16:07:18.190918 22901 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.202349 23126 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:18.206231 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 296375us
I20260811 16:07:18.189514 22897 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.187537 22968 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.200630 23111 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.258982 13825 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:07:18.196147 23113 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:18.269461 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 60782.6us
W20260811 16:07:18.270726 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 100025us
I20260811 16:07:18.263669 13823 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.330991 13823 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:18.269451 13822 rpcz_store.cc:276] 0811 16:07:17.120837 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:17.123212 (+  2375us) service_pool.cc:227] Handling call
0811 16:07:17.123669 (+   457us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:17.144777 (+ 21108us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:17.144810 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:17.144852 (+    42us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:17.144883 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.195880 (+1050997us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400125554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:18.195937 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.196057 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":47978240}
W20260811 16:07:18.226359 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.236090 23115 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.120781 23005 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.304850 13905 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.294010 13824 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:18.307610 13789 leader_election.cc:398] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:18.356796 13789 leader_election.cc:401] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260811 16:07:18.186942 23136 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.309047 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:18.360417 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51490.2us
I20260811 16:07:18.361068 23136 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:18.362603 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55126.6us
I20260811 16:07:18.363276 22931 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:18.321736 22925 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.365985 23124 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:18.366581 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:18.367110 23136 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:18.368292 22925 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:18.370867 23104 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.004s
I20260811 16:07:18.371357 23104 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:18.332901 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.175719 23144 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260811 16:07:18.171846 22422 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.376221 22798 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.258316 23128 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:18.339851 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.341831 23105 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.377959 22940 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.258080 22919 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.368932 22925 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:18.379364 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51410.9us
I20260811 16:07:18.380324 22919 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:18.380779 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.382249 22932 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.378973 22925 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.386890 23138 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:18.362473 23090 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.000s
I20260811 16:07:18.388618 23090 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:18.388902 23061 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.963s	user 0.000s	sys 0.003s
I20260811 16:07:18.380257 23104 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:18.393414 13823 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260811 16:07:18.393836 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1762) took 2770 ms. Trace:
I20260811 16:07:18.394694 22925 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.397382 22941 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:18.405581 13908 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260811 16:07:18.412122 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45555.4us
I20260811 16:07:18.413589 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.343572 22936 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.111562 23079 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.344695 23113 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.339553 23126 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.235560 23116 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260811 16:07:18.288681 23039 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:18.362706 22880 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:18.291767 22881 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:18.375998 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 149673us
I20260811 16:07:18.324978 23099 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.416065 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:18.442318 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.469094 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.470891 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.438110 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.217418 23133 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.394246 14581 rpcz_store.cc:276] 0811 16:07:15.623405 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.623574 (+   169us) service_pool.cc:227] Handling call
0811 16:07:15.623957 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:15.624226 (+   269us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:15.624263 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.655896 (+ 31633us) log.cc:842] Serialized 26 byte log entry
0811 16:07:16.010974 (+355078us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:16.153268 (+142294us) log.cc:842] Serialized 14 byte log entry
0811 16:07:16.499628 (+346360us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.499712 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.388273 (+1888561us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:18.393496 (+  5223us) raft_consensus.cc:1671] finished
0811 16:07:18.393615 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.393773 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":399204,"prepare.queue_time_us":17288,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":346419,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":8378112,"thread_start_us":435637,"threads_started":2,"wal-append.queue_time_us":750959}
I20260811 16:07:18.465440 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.475354 13821 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
W20260811 16:07:18.470402 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.472165 13824 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:18.393875 13823 pending_rounds.cc:76] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 12
I20260811 16:07:18.422744 23135 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:18.393417 23007 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.469094 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.477794 13823 pending_rounds.cc:97] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 15.13
W20260811 16:07:18.484411 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68471.3us
W20260811 16:07:18.469141 23015 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.994s	user 0.014s	sys 0.000s
I20260811 16:07:18.486282 13817 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:18.493170 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.494906 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.495658 14578 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:18.496857 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.497891 14574 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:18.505795 22907 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:18.506587 23156 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260811 16:07:18.506661 22907 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.507300 22907 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.288767 23098 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.509356 23098 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:18.509500 22907 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:18.511264 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69006.5us
W20260811 16:07:18.512822 13871 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:18.513237 13787 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:18.513698 13871 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.494139 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.488668 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.516031 14581 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:18.488776 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.434810 23122 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.482312 22680 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.517023 14583 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.524004 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.525168 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.525691 13905 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260811 16:07:18.526096 13905 pending_rounds.cc:76] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:07:18.526314 13905 pending_rounds.cc:97] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260811 16:07:18.526538 13905 raft_consensus.cc:2866] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:18.520947 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.525583 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.528236 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.529810 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.530956 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.532261 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.407002 23115 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.533356 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.524699 13821 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:18.545195 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.545298 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.492733 22942 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:18.558686 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.560874 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.536525 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.484767 13823 raft_consensus.cc:2866] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:18.563043 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.537446 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.563853 14573 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:07:18.528908 13905 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:18.565860 13905 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260811 16:07:18.562847 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.566192 13905 pending_rounds.cc:76] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:07:18.566417 13905 pending_rounds.cc:97] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260811 16:07:18.566612 13905 raft_consensus.cc:2866] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:18.538436 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.540179 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.542270 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.536175 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.568222 14583 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:18.548724 13824 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:18.569561 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:18.551452 13871 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.545994 13821 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:18.570178 13905 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260811 16:07:18.561636 13826 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:07:18.563931 14582 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.423689 23104 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:18.558979 13906 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 27.
I20260811 16:07:18.571980 13823 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.572640 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.572820 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.577910 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.574906 14581 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260811 16:07:18.575651 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.581887 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.582682 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:18.534121 23122 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.522306 23007 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:18.474054 22881 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.587769 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:07:18.544399 22314 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.475685 23099 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.514631 23015 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:18.605065 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.596308 14582 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:18.466779 23053 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.607250 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.608309 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.611464 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.614205 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.617215 13823 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:18.604410 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.532274 22680 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.593627 23138 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:18.623508 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:18.624230 23153 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.564286 22897 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260811 16:07:18.628602 23126 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.624502 22919 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260811 16:07:18.601946 22968 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:18.632982 22680 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.636368 23115 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.638482 23166 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:18.587395 23020 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260811 16:07:18.604789 23122 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:18.514056 23142 consensus_queue.cc:1159] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 21 status { last_received { term: 18 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]" } } last_received_current_leader { term: 0 index: 0 } }
W20260811 16:07:18.648630 13871 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.654904 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.643633 23005 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.640383 22869 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:07:18.606925 23007 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.616153 22314 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.753770 13823 raft_consensus.cc:2362] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20. Re-sending same reply.
I20260811 16:07:18.744518 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.656116 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:18.760084 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 111482us
W20260811 16:07:18.761512 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:18.764740 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.765198 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.622349 22932 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:07:18.641971 22954 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260811 16:07:18.751860 22869 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.767690 13825 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:18.779794 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.786720 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:18.779819 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.751905 23079 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:18.658003 22812 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.134s	user 0.012s	sys 0.003s
W20260811 16:07:18.760397 22918 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.203s	user 0.014s	sys 0.000s
W20260811 16:07:18.766465 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:18.788187 13826 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:18.793164 13823 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:18.710812 23116 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:18.764612 23115 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260811 16:07:18.650077 23138 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:18.777168 23139 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:18.805095 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.816016 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.816808 13823 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:18.797652 23171 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:18.795189 22940 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.820045 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.824419 13826 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:18.822880 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:18.767216 22968 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.805720 22918 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:18.827603 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 210593us
I20260811 16:07:18.829475 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.809492 23079 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260811 16:07:18.832722 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.830574 23171 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.835986 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.835805 13825 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:18.841071 13709 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.804s (SENT)
I20260811 16:07:18.850744 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.852258 13826 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.804983 22812 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.855489 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.860481 13823 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.810022 23116 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.793813 22954 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.844237 22919 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:18.849014 23015 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.826252 22869 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.867117 23138 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.884827 13818 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:18.886102 13818 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:18.883133 23015 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:18.887867 23015 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.888360 22968 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.888722 23015 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.890167 23015 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.890780 14580 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:18.891782 23152 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.840s	user 0.002s	sys 0.000s
I20260811 16:07:18.891867 22954 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.653839 23153 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.894034 23154 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.894562 23154 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.890172 23133 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.895224 23153 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.895866 22907 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.897342 22907 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.898103 23154 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.899467 22907 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.901513 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.903093 13823 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:18.880357 13826 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:18.909755 13820 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 26: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:18.831960 22940 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.918325 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3510) took 1050 ms. Trace:
I20260811 16:07:18.918867 13900 rpcz_store.cc:276] 0811 16:07:17.868434 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:17.868646 (+   212us) service_pool.cc:227] Handling call
0811 16:07:17.869038 (+   392us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:18.015566 (+146528us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:18.015621 (+    55us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:18.025781 (+ 10160us) log.cc:842] Serialized 52 byte log entry
0811 16:07:18.039718 (+ 13937us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:18.042716 (+  2998us) log.cc:842] Serialized 14 byte log entry
0811 16:07:18.111405 (+ 68689us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.112514 (+  1109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.891016 (+778502us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:18.910534 (+ 19518us) raft_consensus.cc:1671] finished
0811 16:07:18.918011 (+  7477us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.918240 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":64572,"prepare.queue_time_us":993,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":132228,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":10181,"spinlock_wait_cycles":142794496,"thread_start_us":151527,"threads_started":2,"wal-append.queue_time_us":25130}
I20260811 16:07:18.913695 13826 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260811 16:07:18.913565 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.914546 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.915525 14582 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260811 16:07:18.923552 14578 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.873703 23099 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.933445 14578 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:18.935887 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.937533 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:18.933609 23133 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260811 16:07:18.912297 22919 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:18.949584 23175 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:07:18.950137 22940 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.952580 23116 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.954169 23171 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.955320 23133 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:18.955880 23133 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:18.956267 23125 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.004s
I20260811 16:07:18.956811 23133 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.957257 22919 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.959270 23179 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:18.959679 23179 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.959811 22314 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.960534 23179 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:18.961779 23128 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.002s
I20260811 16:07:18.962247 23128 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.966740 23179 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.967248 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.968792 23122 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.971788 23128 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.973713 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.978057 22921 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:18.978231 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3075) took 2372 ms. Trace:
W20260811 16:07:18.984758 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:19.004408 13871 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.942390 23007 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.986953 13901 rpcz_store.cc:276] 0811 16:07:16.606303 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.606495 (+   192us) service_pool.cc:227] Handling call
0811 16:07:16.606899 (+   404us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:16.638871 (+ 31972us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.638904 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:17.903326 (+1264422us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:17.905334 (+  2008us) log.cc:842] Serialized 52 byte log entry
0811 16:07:18.215112 (+309778us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:18.234890 (+ 19778us) log.cc:842] Serialized 14 byte log entry
0811 16:07:18.250112 (+ 15222us) log.cc:842] Serialized 14 byte log entry
0811 16:07:18.904739 (+654627us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b180026eba0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:18.977620 (+ 72881us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b180026eba0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:07:18.977837 (+   217us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.977949 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.977996 (+    47us) raft_consensus.cc:1671] finished
0811 16:07:18.978009 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.978169 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32509,"prepare.queue_time_us":674342,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":90569,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":22955,"spinlock_wait_cycles":65521152,"thread_start_us":346951,"threads_started":2,"wal-append.queue_time_us":438802}
W20260811 16:07:19.007598 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:19.112537 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104881us
W20260811 16:07:19.113907 13871 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.114825 22621 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.117453 22812 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.100476 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 292170us
W20260811 16:07:19.048699 22941 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.651s	user 0.014s	sys 0.002s
W20260811 16:07:19.046545 23064 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.006s	sys 0.006s
W20260811 16:07:19.130307 23064 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.006s	sys 0.006s
I20260811 16:07:19.131974 22881 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.139868 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.142057 23180 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:19.141657 23143 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.147786 23143 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:19.168860 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53889.7us
W20260811 16:07:19.173105 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:19.180902 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 666532us
I20260811 16:07:19.182739 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1626) took 5189 ms. Trace:
I20260811 16:07:19.188175 13902 rpcz_store.cc:276] 0811 16:07:13.993398 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.034313 (+ 40915us) service_pool.cc:227] Handling call
0811 16:07:14.034562 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:18.291599 (+4257037us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:19.182000 (+890401us) spinlock_profiling.cc:243] Waited 4.26 s on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:19.182469 (+   469us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9788237696}
I20260811 16:07:19.198071 14575 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:19.201078 22881 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:19.179024 23098 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.669s	user 0.015s	sys 0.002s
I20260811 16:07:19.168336 22621 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.204854 22621 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.179435 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:19.210094 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:19.210457 13822 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260811 16:07:19.211272 22925 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:07:19.227909 23119 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.329s	user 0.002s	sys 0.003s
I20260811 16:07:19.228782 14574 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260811 16:07:19.230516 23126 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.231658 23126 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.202894 22881 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
W20260811 16:07:19.233124 23108 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.162s	user 0.002s	sys 0.000s
I20260811 16:07:19.233287 22881 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:19.235064 23127 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.235311 22668 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.236115 23127 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.236243 22668 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.242328 22881 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.244853 13817 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:07:19.245947 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.218364 22869 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:07:19.247306 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.265731 22881 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:19.267797 23007 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.268678 23007 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.269852 14578 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260811 16:07:19.269718 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.271875 23007 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.288909 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3508) took 2216 ms. Trace:
I20260811 16:07:19.289701 14575 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:07:19.290170 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.291059 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.293303 23054 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:19.293946 23054 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:19.294458 23054 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.291160 14579 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:19.296002 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.298532 14575 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:19.298359 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.298874 23127 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.292322 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.300230 14577 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18. Re-sending same reply.
I20260811 16:07:19.300685 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260811 16:07:19.302779 22621 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.308355 14574 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:19.313697 22314 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.314553 22314 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.317736 22314 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.311225 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.291953 13825 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
W20260811 16:07:19.333494 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.721s (SENT)
I20260811 16:07:19.336293 23110 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.335023 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.289508 13903 rpcz_store.cc:276] 0811 16:07:17.072046 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:17.110503 (+ 38457us) service_pool.cc:227] Handling call
0811 16:07:17.110826 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:17.119944 (+  9118us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:17.119981 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:17.147972 (+ 27991us) log.cc:842] Serialized 26 byte log entry
0811 16:07:17.491255 (+343283us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:17.491790 (+   535us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.492116 (+   326us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:19.226539 (+1734423us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:19.288254 (+ 61715us) raft_consensus.cc:1671] finished
0811 16:07:19.288281 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:19.288672 (+   391us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":20399,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8156,"spinlock_wait_cycles":4697856,"thread_start_us":236999,"threads_started":1,"wal-append.queue_time_us":633021}
I20260811 16:07:19.344559 23143 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.349897 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.352423 23166 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:19.352898 23166 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.353286 23166 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:19.354429 13823 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260811 16:07:19.357388 23180 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:19.369773 22621 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:19.389801 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49373us
I20260811 16:07:19.404515 23063 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:19.418885 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69375.8us
I20260811 16:07:19.423364 22314 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:19.419318 22981 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.778s	user 0.013s	sys 0.019s
I20260811 16:07:19.420743 22668 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.435619 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:19.437235 23082 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.012s	sys 0.023s
W20260811 16:07:19.440218 23117 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.429s	user 0.003s	sys 0.000s
W20260811 16:07:19.442708 23130 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.392s	user 0.002s	sys 0.002s
W20260811 16:07:19.444141 23082 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.013s	sys 0.023s
I20260811 16:07:19.447508 22314 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.453624 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:19.454282 23161 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.076s	user 0.002s	sys 0.000s
W20260811 16:07:19.444098 22981 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.874s	user 0.013s	sys 0.020s
I20260811 16:07:19.455942 23020 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:19.461997 23020 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.462942 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.468171 23124 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:19.468717 14573 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:19.472285 14580 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:19.473892 23054 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.475502 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.504670 23020 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:19.504891 22422 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:19.507506 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.517551 14583 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:07:19.519910 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.166s (SENT)
I20260811 16:07:19.524914 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.526065 22621 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:19.527130 22621 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:19.528532 14541 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.512s (SENT)
I20260811 16:07:19.529074 14541 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.528087 22621 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.536485 23054 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.540889 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 87726.8us
W20260811 16:07:19.544483 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109629us
I20260811 16:07:19.557013 22968 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:07:19.543804 22847 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:19.560667 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:19.560968 22314 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.561803 22968 raft_consensus.cc:2741] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260811 16:07:19.561934 14541 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.556s (SENT)
I20260811 16:07:19.562569 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.564373 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.566771 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.567608 23206 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:19.567438 22936 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260811 16:07:19.576313 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.578685 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.559753 22621 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.581257 23125 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.581602 22936 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:19.567549 22903 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:19.583520 22903 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.583963 22903 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:19.554040 23020 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260811 16:07:19.572827 23206 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:19.595527 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.607555 23020 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:19.609225 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.609896 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1568) took 1079 ms. Trace:
I20260811 16:07:19.610492 13823 rpcz_store.cc:276] 0811 16:07:18.530479 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:19.110714 (+580235us) service_pool.cc:227] Handling call
0811 16:07:19.252305 (+141591us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:19.354974 (+102669us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:19.609576 (+254602us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5400355050. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:19.609804 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":76263168}
I20260811 16:07:19.611613 22968 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:19.612427 22936 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:19.604396 22621 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:19.614042 22621 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:19.614506 22621 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.615566 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3514) took 1373 ms. Trace:
I20260811 16:07:19.615893 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.616122 13908 rpcz_store.cc:276] 0811 16:07:18.241704 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:18.242064 (+   360us) service_pool.cc:227] Handling call
0811 16:07:18.279893 (+ 37829us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:18.406142 (+126249us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:19.614838 (+1208696us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54001b1554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:19.615262 (+   424us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":162867072}
I20260811 16:07:19.619624 22936 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:19.629478 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.634351 14577 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:19.554735 23166 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.571520 22881 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:19.643949 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80053.4us
I20260811 16:07:19.646271 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:19.649739 13826 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260811 16:07:19.650456 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.651628 13823 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260811 16:07:19.651702 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.653685 23015 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.653908 13902 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
W20260811 16:07:19.659976 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.686s (SENT)
I20260811 16:07:19.649856 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:19.634451 23206 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.663179 23015 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.671208 23105 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:19.671721 23105 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.672111 23105 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:19.673044 23201 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260811 16:07:19.669474 22968 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260811 16:07:19.680169 13826 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:19.686403 22954 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:19.687213 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50848.2us
I20260811 16:07:19.695978 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.689317 22954 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:19.690080 23101 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:19.690353 23058 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.704020 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.690661 22936 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.706280 23166 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.662789 23207 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.706423 22936 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.707108 22907 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.709100 22936 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.706051 23082 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:19.691197 23020 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.711692 23020 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.707247 23207 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.714030 23020 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.714908 23125 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:19.715088 23207 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.735462 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.707999 22907 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.774021 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.779861 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:19.780543 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53459.7us
W20260811 16:07:19.781205 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48904.8us
I20260811 16:07:19.783579 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.784191 23082 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:19.784348 23101 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:19.786512 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:19.787472 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 130258us
I20260811 16:07:19.788118 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.789016 13820 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:19.789616 13818 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:19.790045 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.736753 22621 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.733070 23058 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:19.788307 14541 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.687s (SENT)
I20260811 16:07:19.791133 13818 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260811 16:07:19.795172 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 56361us
I20260811 16:07:19.797379 13826 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:19.800673 14575 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:07:19.801478 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.783579 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.792987 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.795455 23138 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:19.791999 23211 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260811 16:07:19.778424 23105 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.820988 13824 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:19.795922 22621 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.802655 22907 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.800902 23058 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.818948 22954 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:19.798014 22903 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.833143 13817 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:19.843262 23207 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:19.827512 22812 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260811 16:07:19.847587 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.834645 23138 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.837953 22907 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
W20260811 16:07:19.854991 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80721us
I20260811 16:07:19.839455 23058 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260811 16:07:19.840973 23005 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260811 16:07:19.853030 22954 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:19.848423 23063 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260811 16:07:19.866734 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78506.2us
I20260811 16:07:19.868985 22903 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.869663 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.861822 23207 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:19.860963 22954 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:19.876332 22954 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.876982 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:19.877673 22954 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.877712 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.879626 23133 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:19.879992 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.880259 14574 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:19.880299 23133 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:19.881889 23143 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:19.882121 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:19.883445 23131 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:19.883181 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:19.879547 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.887310 14583 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:19.889951 23050 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:19.890391 23050 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.890723 23050 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.893266 22903 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:19.893841 22903 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.894294 22903 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:19.882441 23133 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.900065 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.875372 23005 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:19.904615 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.688s (SENT)
I20260811 16:07:19.860308 23125 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260811 16:07:19.886793 22812 raft_consensus.cc:2741] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260811 16:07:19.908839 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.909931 23131 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:19.919065 23131 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:19.919474 23131 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:19.919910 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.721s (SENT)
I20260811 16:07:19.910403 23138 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.911751 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.920475 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.905239 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.906749 23105 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.922456 23131 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.935626 23131 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.941591 23105 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:19.942401 23126 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.943547 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47659.7us
I20260811 16:07:19.926484 22812 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:19.945488 23082 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:19.947546 23082 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:19.947477 22812 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.948884 23082 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.950374 23082 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.946323 23207 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:19.952032 22951 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:19.952482 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.953474 14581 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260811 16:07:19.950722 22812 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.964397 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.964941 23015 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.969769 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.970552 14578 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:19.975092 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:19.975869 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86475.2us
W20260811 16:07:19.974042 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:19.974717 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:19.977746 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.959479 23138 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.017s
I20260811 16:07:19.981436 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.969833 23063 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.985921 23058 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:19.986040 23144 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:19.986392 22947 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260811 16:07:19.968322 23005 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.992408 23166 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:19.994618 23053 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.995460 22422 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:19.996318 23128 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:19.973470 23050 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.996827 23063 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:19.998190 23213 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260811 16:07:19.999063 23143 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:20.001463 22947 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:20.015115 23015 raft_consensus.cc:1050] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:20.015247 23143 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:20.015861 23015 raft_consensus.cc:1054] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Illegal state: Leader has not yet committed an operation in its own term
I20260811 16:07:20.016453 23143 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.017849 23143 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.018419 22812 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:07:20.024047 23144 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:20.024595 22621 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:20.025835 22968 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Stepping down as leader of term 25
I20260811 16:07:20.026355 22968 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:20.027787 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58621.8us
I20260811 16:07:20.027441 22968 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.032783 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 112898us
I20260811 16:07:20.037987 23206 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:20.038654 23206 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:20.040011 23206 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.041427 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.740s (SENT)
I20260811 16:07:20.001282 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.009142 23166 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.010231 23128 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.052542 23128 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.052800 22968 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:20.052992 23166 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.054788 23166 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.009517 22422 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.012543 23050 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.019594 23101 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:20.020219 22951 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:07:20.043639 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.043708 23126 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.044732 23015 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.042537 23005 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.046048 14581 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260811 16:07:20.046761 23215 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260811 16:07:20.004947 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.998988 22903 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.071421 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 92043.3us
I20260811 16:07:20.074296 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.075237 14579 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.041457 23206 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:20.072515 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67645.7us
I20260811 16:07:20.076798 14583 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260811 16:07:20.075258 13787 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.077890 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.074395 23015 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.085217 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 84122.1us
I20260811 16:07:20.073923 23138 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:20.086016 14541 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.969s (SENT)
I20260811 16:07:20.089272 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:20.063864 22422 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.087364 22314 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:20.092855 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.095191 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:20.086386 13787 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.075462 23126 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.085969 22812 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:20.100766 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.095093 23138 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:20.101471 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.084376 23144 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260811 16:07:20.106380 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.103602 23143 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:20.106180 13817 raft_consensus.cc:2362] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20. Re-sending same reply.
I20260811 16:07:20.117683 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.096035 23005 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260811 16:07:20.108757 23138 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.122777 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.126245 13822 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:20.121155 22954 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:20.126660 23124 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:20.121385 23143 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.133627 23143 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.129730 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.125115 22947 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:20.141266 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.128285 23138 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.145045 13823 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:20.145305 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.147524 13822 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260811 16:07:20.130225 22954 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:20.119504 22314 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.126994 22907 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:20.152671 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73862.3us
I20260811 16:07:20.149240 13908 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:20.121963 22812 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.154798 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.161199 13901 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:20.170873 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 91499.2us
I20260811 16:07:20.160043 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.175743 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.176156 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.176466 13903 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:20.170881 13787 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.154021 23015 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:20.160054 22903 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:20.181576 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 87716.3us
I20260811 16:07:20.183948 13902 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:20.179358 14541 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 2.085s (SENT)
I20260811 16:07:20.188923 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.189953 13817 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 24 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260811 16:07:20.190526 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.190873 23126 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.191095 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.189038 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.193873 13818 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:20.195472 23220 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260811 16:07:20.196168 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:20.195598 13709 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.549s (SENT)
W20260811 16:07:20.199231 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 2.092s (SENT)
W20260811 16:07:20.200024 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 2.140s (SENT)
I20260811 16:07:20.202632 13900 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:20.204880 22314 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.207600 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.208557 14578 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:20.210778 22812 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.213367 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.214404 23105 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:20.214789 23105 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.214980 23131 raft_consensus.cc:1050] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:20.215168 23105 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.217516 23131 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.219385 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57754.6us
W20260811 16:07:20.220577 13787 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.221145 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.189250 23063 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.227375 22812 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:20.231981 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49329.9us
I20260811 16:07:20.198586 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:20.236933 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.238095 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.238626 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.239945 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.242403 14575 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:20.243556 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.244194 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.247910 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.238754 14580 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:20.237603 14581 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.255450 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.179471 22907 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.257866 13908 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 28 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260811 16:07:20.257885 14579 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.258828 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.262327 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.263691 13902 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.233703 22422 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.291694 23128 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.197724 22954 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.267411 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:20.267686 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72129.8us
I20260811 16:07:20.294358 22954 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:20.296254 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.296696 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.297310 14580 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.268944 22907 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:20.271281 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.300411 13905 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.272848 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.276750 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3597) took 1747 ms (client timeout 1549 ms). Trace:
I20260811 16:07:20.277890 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.302027 13827 rpcz_store.cc:269] 0811 16:07:18.529225 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:18.539495 (+ 10270us) service_pool.cc:227] Handling call
0811 16:07:20.276511 (+1737016us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540021aa54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:20.276660 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3561105664}
I20260811 16:07:20.302631 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.302799 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.303319 13900 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
W20260811 16:07:20.262470 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.304479 13900 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
W20260811 16:07:20.304632 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.305429 14541 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.305684 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48080.3us
I20260811 16:07:20.283964 13901 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:20.285118 22947 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:20.288731 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.270779 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.295660 23128 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.291277 23131 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:20.265925 14575 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:07:20.281807 23105 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.305841 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.310731 13907 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
W20260811 16:07:20.310431 13787 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.308784 13901 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260811 16:07:20.314634 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.313288 14581 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:07:20.314231 13903 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.309237 13904 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.314495 13907 pending_rounds.cc:76] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 14
I20260811 16:07:20.315260 13901 pending_rounds.cc:76] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:07:20.317852 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.317155 13907 pending_rounds.cc:97] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260811 16:07:20.317520 13901 pending_rounds.cc:97] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260811 16:07:20.325095 13903 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:07:20.308367 23166 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.323836 13905 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.326998 13907 raft_consensus.cc:2866] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:20.307281 23126 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.330662 14580 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.331250 23126 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.331954 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.688s (SENT)
I20260811 16:07:20.332011 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.332577 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.333135 23144 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:20.326996 13901 raft_consensus.cc:2866] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:20.323583 22968 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:20.319048 23128 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:20.337314 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.340551 13827 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:20.335801 22951 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:07:20.342149 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.342650 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.337049 23144 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.346307 14582 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:20.346683 23144 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.344211 13905 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:20.344907 22812 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:20.345432 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.316727 23131 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260811 16:07:20.301532 13622 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 14 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:20.309473 23138 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.355353 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:20.359381 13787 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.360034 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.364430 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.341575 23126 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:20.368134 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.334048 23166 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.334214 23143 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.352646 23128 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.373821 13901 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:20.377314 13818 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260811 16:07:20.379503 13823 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:20.374953 23015 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.380229 22947 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:20.381587 23015 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.382371 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.382711 22812 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:07:20.383873 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.383571 13902 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:20.386175 13905 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
W20260811 16:07:20.391491 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48750.7us
I20260811 16:07:20.392925 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.393543 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88187.4us
I20260811 16:07:20.389655 13827 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:20.396301 23105 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:20.397066 13787 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.397614 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.397863 23138 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.398474 22314 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:20.400185 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.400902 13824 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:20.402163 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.403496 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.403752 13826 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260811 16:07:20.402938 13903 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.404568 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.405742 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.404093 13824 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.407570 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.408927 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.412163 23166 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.403627 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.404451 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.413914 13904 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.404091 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.420092 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.421267 13901 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.421308 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.421670 13824 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.422183 14580 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.423583 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.423902 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.424500 23105 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:20.425055 23105 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.425482 23105 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:20.425618 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:20.398950 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.434794 22947 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:20.439767 13903 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:20.440562 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47722.5us
I20260811 16:07:20.441968 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.443354 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.444780 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.446951 13903 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260811 16:07:20.447732 13827 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:20.454483 13827 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:20.449503 13904 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.450980 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.438107 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.453325 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.456758 14577 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:20.457172 14541 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.451735 23138 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:20.460760 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61839.8us
W20260811 16:07:20.461786 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.462502 13787 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.463056 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.468216 13903 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:20.469256 13900 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:20.468607 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.473417 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.475399 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.471603 13825 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:07:20.483340 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.484633 23144 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260811 16:07:20.485073 13709 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.631s (SENT)
W20260811 16:07:20.487659 13620 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 331) took 31376 ms (client timeout 15000 ms). Trace:
I20260811 16:07:20.476511 13822 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.500432 13902 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 27. Current term is 28. Ops: []
I20260811 16:07:20.512614 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.512835 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74157.7us
I20260811 16:07:20.506438 13827 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.515367 13827 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:20.492985 22812 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:20.520255 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.529556 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.532763 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.525333 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.540917 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:20.528173 23218 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260811 16:07:20.540521 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.564760 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.528700 23143 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:20.471832 23128 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.571044 23231 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260811 16:07:20.573601 13907 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:07:20.574640 23126 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.564420 22951 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:20.575664 22951 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.575314 23126 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.576193 22951 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.597496 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.598373 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.598675 14580 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.599663 13909 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:20.600419 23229 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260811 16:07:20.601903 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109735us
W20260811 16:07:20.604024 23228 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260811 16:07:20.606633 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.632113 23053 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:20.566717 23131 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:20.670065 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 144755us
I20260811 16:07:20.673975 14577 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:20.672369 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65871.7us
W20260811 16:07:20.676312 13787 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.676832 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 146280us
I20260811 16:07:20.676942 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.606885 23015 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.678862 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.678776 23206 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:20.488153 13620 rpcz_store.cc:269] 0811 16:06:49.115443 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:49.166312 (+ 50869us) service_pool.cc:227] Handling call
0811 16:07:20.487361 (+31321049us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:11.824684 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:11.825346 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:11.825406 (+    60us) write_op.cc:435] Acquired schema lock
0811 16:07:11.825425 (+    19us) tablet.cc:660] Decoding operations
0811 16:07:11.826957 (+  1532us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:11.827079 (+   122us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:11.827161 (+    82us) tablet.cc:683] Acquiring locks for 12 operations
0811 16:07:11.875906 (+ 48745us) tablet.cc:699] Row locks acquired
0811 16:07:11.875952 (+    46us) write_op.cc:260] PREPARE: finished
0811 16:07:11.876145 (+   193us) write_op.cc:270] Start()
0811 16:07:11.876325 (+   180us) write_op.cc:276] Timestamp: P: 1786464431876075 usec, L: 0
0811 16:07:11.876367 (+    42us) op_driver.cc:331] REPLICATION: starting
0811 16:07:11.885856 (+  9489us) log.cc:842] Serialized 4751 byte log entry
0811 16:07:12.120891 (+235035us) op_driver.cc:444] REPLICATION: finished
0811 16:07:12.375612 (+254721us) write_op.cc:301] APPLY: starting
0811 16:07:12.375736 (+   124us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:13.905505 (+1529769us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:13.905670 (+   165us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:15.280982 (+1375312us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:15.398893 (+117911us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0811 16:07:15.398944 (+    51us) write_op.cc:312] APPLY: finished
0811 16:07:15.399384 (+   440us) log.cc:842] Serialized 113 byte log entry
0811 16:07:15.800319 (+400935us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:15.800512 (+   193us) write_op.cc:454] Released schema lock
0811 16:07:15.800576 (+    64us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:15.801000 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:15.801032 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":211937,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":254329,"apply.run_cpu_time_us":158582,"apply.run_wall_time_us":3425979,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54191,"num_ops":12,"prepare.queue_time_us":378131,"prepare.run_cpu_time_us":35030,"prepare.run_wall_time_us":216683,"raft.queue_time_us":99249,"raft.run_cpu_time_us":82181,"raft.run_wall_time_us":227060,"replication_time_us":244411,"thread_start_us":1058395,"threads_started":5,"wal-append.queue_time_us":713776,"wal-append.run_cpu_time_us":17657,"wal-append.run_wall_time_us":2270981}]]}
I20260811 16:07:20.683369 23126 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.684620 23005 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:20.675143 23144 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:20.685406 23005 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.685590 23144 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.686108 23144 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:20.686578 23005 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.695971 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:20.699484 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.704773 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.723657 14577 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:07:20.725134 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 203939us
I20260811 16:07:20.725292 13827 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:07:20.730468 13706 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:20.731344 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55068.5us
I20260811 16:07:20.732496 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.733397 13787 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.733951 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.735409 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.743755 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.744836 13905 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:20.742926 13909 raft_consensus.cc:2354] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19.
I20260811 16:07:20.745708 13906 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260811 16:07:20.751807 23082 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260811 16:07:20.756194 22812 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:20.756994 22812 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.759618 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.760074 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.762238 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.763445 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.764128 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.764745 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.765631 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.766089 22812 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:20.768522 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.770001 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.768814 13901 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
W20260811 16:07:20.812636 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 79266.2us
I20260811 16:07:20.727988 23207 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.016s
I20260811 16:07:20.822889 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.819274 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:20.742782 23131 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:07:20.824079 13901 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:20.825489 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.830587 14583 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:20.832950 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.834115 23131 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:20.833904 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71099.7us
W20260811 16:07:20.834630 13871 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.837381 13787 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.842819 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.848423 13787 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.848610 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.849082 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.849519 13909 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:07:20.850593 13787 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.851424 23207 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:20.852275 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.857823 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.853085 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.854866 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.864564 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 175855us
I20260811 16:07:20.866878 13907 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260811 16:07:20.856390 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.858119 13823 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:20.852424 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.879213 13821 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:20.835429 23166 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:20.832345 23015 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:20.833956 22812 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:20.847364 23131 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:20.834793 23082 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:20.856048 23053 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:20.885560 13822 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.902240 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.905761 13907 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:20.915114 23063 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:20.915443 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60694.3us
I20260811 16:07:20.878198 23206 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:20.914263 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.884845 23166 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.927345 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.887537 23138 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.858974 22422 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260811 16:07:20.927445 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.948550 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.919963 22954 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.934372 23166 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.919730 23053 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:20.961026 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.965209 22907 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:20.963299 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130363us
I20260811 16:07:20.969566 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.971311 13821 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.974658 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.976446 13823 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:20.978188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 127630us
W20260811 16:07:20.979403 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 213169us
W20260811 16:07:20.979442 13787 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.983505 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.985128 13787 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.985577 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.986712 13787 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.991616 23058 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.992551 23058 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.996124 23058 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:20.913196 23082 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.966822 22947 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.009562 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 97990.8us
W20260811 16:07:20.971331 23246 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260811 16:07:21.010993 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:21.010268 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50014.7us
I20260811 16:07:20.927642 22812 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.966809 23207 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:07:21.029064 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:21.016544 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:21.017446 12383 thread.cc:536] Waited for 1000ms trying to join with heartbeat (tid 13772)
W20260811 16:07:21.019198 23245 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260811 16:07:20.947912 23138 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.002975 23124 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 LEADER]: Stepping down as leader of term 27
I20260811 16:07:21.042765 23124 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:21.043201 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.044166 13825 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:21.043934 23144 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.043856 23124 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.046217 23144 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.025009 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.020191 23249 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260811 16:07:21.036567 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:21.037844 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.037955 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:21.038169 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.038975 23268 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:21.040290 23138 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:21.041682 23105 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.616s	user 0.017s	sys 0.003s
I20260811 16:07:21.020782 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.032351 23058 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.118010 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:21.028554 23005 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260811 16:07:21.022428 23082 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.048662 14577 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260811 16:07:21.035988 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:21.054744 13787 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:21.137487 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101572us
I20260811 16:07:21.137602 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.138621 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86968.7us
I20260811 16:07:21.140689 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:21.056845 13907 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:21.056488 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.968182 22954 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.131031 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 361091us
I20260811 16:07:21.046654 14574 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:21.035776 23015 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:21.150830 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.153702 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:21.154683 14583 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:21.144840 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.161013 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.156930 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.162057 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 151081us
I20260811 16:07:21.157141 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:21.163079 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.124449 23124 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:21.034657 22947 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.187716 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.139953 22621 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.153705 23015 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:21.200510 23015 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:21.202893 23263 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:21.188980 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.153635 23267 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:21.184790 23144 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260811 16:07:21.196341 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 158277us
I20260811 16:07:21.136786 23058 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.203482 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:21.203743 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 255471us
I20260811 16:07:21.203764 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:21.171480 22422 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:07:21.208941 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.138728 23206 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:21.190187 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.205798 22314 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:21.156476 23271 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:21.220310 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.224120 14574 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 19
W20260811 16:07:21.226195 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 173254us
W20260811 16:07:21.229847 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.204788 23251 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.278373 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48600us
I20260811 16:07:21.235733 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.125018 23105 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.263548 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:21.238711 22314 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:21.284999 23281 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:21.285449 23058 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:21.282367 13787 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 164 similar messages]
I20260811 16:07:21.274536 23128 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260811 16:07:21.271123 23005 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.298525 23278 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:21.299058 23278 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:21.299436 23278 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:21.299993 22947 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:21.300720 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.303333 14574 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:21.285086 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 94932.4us
W20260811 16:07:21.310096 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:21.263891 23082 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.274495 13818 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:07:21.120039 23053 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.313431 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89382.4us
W20260811 16:07:21.273303 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129283us
I20260811 16:07:21.321089 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.314831 14583 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:21.325598 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.275300 22907 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.294514 23251 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.323477 13821 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:21.329232 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:21.331667 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111449us
I20260811 16:07:21.304893 22621 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.345640 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.305972 22314 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:21.359637 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.363952 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:21.364675 13821 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:21.358610 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.357240 13823 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:21.367115 13818 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:07:21.390443 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44972.3us
I20260811 16:07:21.391438 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.399578 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.330343 23250 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.404067 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:21.365449 22951 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.783s	user 0.016s	sys 0.010s
I20260811 16:07:21.409344 14574 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:21.404572 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.387931 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58885.5us
I20260811 16:07:21.363629 22812 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.275013 23280 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.129s
I20260811 16:07:21.328493 23128 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260811 16:07:21.403268 22422 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.405369 22907 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:21.443427 13821 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
W20260811 16:07:21.464350 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59875us
I20260811 16:07:21.465600 23271 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:21.412886 23281 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:21.465027 14577 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:21.466902 13818 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260811 16:07:21.520211 13822 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.002s
I20260811 16:07:21.427248 23126 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:21.471812 23275 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260811 16:07:21.418103 22951 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.523927 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:21.467502 23258 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260811 16:07:21.501873 23138 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.520757 13822 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
W20260811 16:07:21.527635 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94922.7us
I20260811 16:07:21.537659 14581 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:21.471516 23255 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260811 16:07:21.529438 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47164.8us
I20260811 16:07:21.474428 23105 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:21.551585 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 230620us
I20260811 16:07:21.450464 23270 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260811 16:07:21.522634 22621 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.522617 23281 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:21.628538 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.477775 23166 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.458053 22422 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.536356 23245 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260811 16:07:21.637252 13822 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:21.629998 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:21.555402 23254 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260811 16:07:21.534112 23271 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:21.669070 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:21.672107 14578 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.014s	sys 0.012s
W20260811 16:07:21.672960 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 281620us
W20260811 16:07:21.674335 14578 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.014s	sys 0.012s
I20260811 16:07:21.603170 22954 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.642287 23283 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.660356 23267 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:21.549345 23126 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260811 16:07:21.681671 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.705760 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 102588us
I20260811 16:07:21.684916 23271 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.706532 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.706745 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.688479 22422 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.643584 22621 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.693389 23015 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.694468 23063 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.779s	user 0.014s	sys 0.000s
I20260811 16:07:21.695572 23105 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:21.698125 23131 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.003s
I20260811 16:07:21.698863 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.700944 13824 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:21.702126 23295 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.708048 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:21.740156 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.708629 22907 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:21.709278 23286 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.709352 23166 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.711279 23261 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:21.711776 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.752790 14577 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:21.712304 23290 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260811 16:07:21.712675 23274 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:21.713721 23278 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.702562 22314 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.773005 22314 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.775777 23270 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.777033 23278 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.777169 22954 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:21.777693 22954 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:21.778813 22621 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:21.751693 23063 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.779851 23295 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.782478 23295 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.707906 14581 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:21.709589 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.754230 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:21.718091 22947 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.770399 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71614.4us
I20260811 16:07:21.756596 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.788321 23286 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:21.788815 23285 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260811 16:07:21.796516 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:21.798606 23288 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:21.800954 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.801676 23294 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260811 16:07:21.805670 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:21.807400 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53262.1us
I20260811 16:07:21.827365 13824 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:21.827836 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:21.807981 23295 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:21.808807 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.808446 23281 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.703814 23283 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:21.818434 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111977us
I20260811 16:07:21.823788 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:21.751801 22422 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.847482 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.009s
I20260811 16:07:21.768862 23138 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:21.825910 13823 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:21.743180 22907 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:21.753206 23292 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election won for term 24
W20260811 16:07:21.829653 14541 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.784209 23128 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:21.835459 23307 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260811 16:07:21.809538 23289 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260811 16:07:21.846534 14542 leader_election.cc:398] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19.
I20260811 16:07:21.853749 14542 leader_election.cc:401] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:07:21.847995 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.010s
I20260811 16:07:21.778630 22954 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.856526 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.830021 23295 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:21.841899 23278 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:21.752360 23131 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.841574 23288 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:21.829782 23063 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.829886 23286 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:21.855973 22422 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.850450 23138 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:21.855789 22907 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:21.867363 23295 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:21.865437 23292 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:21.859025 23274 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260811 16:07:21.728031 23267 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.869467 23298 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
W20260811 16:07:21.896374 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 347704us
I20260811 16:07:21.855893 22951 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.825771 22947 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.889974 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57473.2us
W20260811 16:07:21.887629 23124 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
I20260811 16:07:21.877671 22968 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19.
I20260811 16:07:21.898959 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.864858 23300 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:21.883569 23278 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:21.885131 23250 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:21.935585 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 28.
I20260811 16:07:21.892307 23138 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:21.954799 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 116823us
I20260811 16:07:21.898023 23268 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.901506 22954 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:21.967583 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:22.007910 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 70436.3us
W20260811 16:07:22.031494 12383 thread.cc:536] Waited for 2000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:21.931787 23269 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.090603 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.105101 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.901039 23303 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:22.121572 13826 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.125187 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.133229 13787 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:22.133671 13787 leader_election.cc:401] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:07:22.135279 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 236397us
I20260811 16:07:21.890044 23063 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:22.148624 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 43683.9us
I20260811 16:07:22.151293 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.103609 23144 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.163906 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3216) took 1114 ms. Trace:
I20260811 16:07:22.164501 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:22.165828 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:22.157914 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 225700us
W20260811 16:07:22.158383 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 202797us
I20260811 16:07:22.159228 22947 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.160111 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.164304 13825 rpcz_store.cc:276] 0811 16:07:21.049985 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:21.056001 (+  6016us) service_pool.cc:227] Handling call
0811 16:07:22.163727 (+1107726us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54000d5554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:22.163847 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1821516032}
I20260811 16:07:22.104035 23206 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.176445 13823 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 26.
W20260811 16:07:22.169134 13871 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:22.142675 23166 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260811 16:07:22.141817 23263 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.152773 23282 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:22.163244 22951 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:22.179039 23128 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.034724 23250 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:22.209858 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44088.3us
I20260811 16:07:22.089186 23268 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.247033 22422 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.247927 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:22.248332 23308 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260811 16:07:22.248814 23268 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.249301 23063 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.249554 23250 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.227063 23131 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.227721 23283 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:22.228924 23312 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260811 16:07:22.252539 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3203) took 1397 ms. Trace:
I20260811 16:07:22.200259 23263 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:22.253621 23105 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.000s
I20260811 16:07:22.252915 13820 rpcz_store.cc:276] 0811 16:07:20.855177 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:20.855324 (+   147us) service_pool.cc:227] Handling call
0811 16:07:20.855691 (+   367us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:21.159510 (+303819us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:21.159629 (+   119us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:21.258246 (+ 98617us) log.cc:842] Serialized 52 byte log entry
0811 16:07:21.855621 (+597375us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:21.855661 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:21.855749 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:22.252298 (+396549us) raft_consensus.cc:1671] finished
0811 16:07:22.252318 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:22.252462 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14406,"raft.queue_time_us":50182,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":13648,"thread_start_us":825574,"threads_started":2,"wal-append.queue_time_us":615046}
I20260811 16:07:22.254846 14582 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260811 16:07:22.229816 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 93664.2us
I20260811 16:07:22.255189 23263 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:22.255491 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48960.7us
W20260811 16:07:22.231895 23306 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260811 16:07:22.178185 23144 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.257578 23286 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.258145 23144 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.213438 23015 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.177331 23269 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.261583 23269 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.193925 23206 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.263811 23206 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.264765 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.215572 23128 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.181421 23292 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.243844 22903 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.267671 22903 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.269992 22903 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.245131 23278 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.271790 23128 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.232282 23313 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:22.227519 23310 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260811 16:07:22.276571 23310 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:22.276981 23310 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:22.277915 23310 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.280460 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.288514 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.289153 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1815) took 1093 ms. Trace:
I20260811 16:07:22.282743 13826 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:22.290794 14580 rpcz_store.cc:276] 0811 16:07:21.189696 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:21.189836 (+   140us) service_pool.cc:227] Handling call
0811 16:07:21.207654 (+ 17818us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:21.213908 (+  6254us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:21.213947 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:21.214610 (+   663us) log.cc:842] Serialized 26 byte log entry
0811 16:07:21.319412 (+104802us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:21.352105 (+ 32693us) log.cc:842] Serialized 14 byte log entry
0811 16:07:21.352432 (+   327us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:21.352550 (+   118us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:22.276743 (+924193us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18004c3900. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:22.279723 (+  2980us) raft_consensus.cc:1671] finished
0811 16:07:22.283028 (+  3305us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:22.283217 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29066,"prepare.queue_time_us":33111,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":64,"raft.queue_time_us":1764,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":16085,"spinlock_wait_cycles":11378944,"thread_start_us":60107,"threads_started":1,"wal-append.queue_time_us":192577}
I20260811 16:07:22.288533 23313 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.306286 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.290423 22903 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.254061 23105 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:22.213099 23298 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:22.236253 23315 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260811 16:07:22.255736 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:22.275513 23166 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:22.273511 22951 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.292900 23143 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.294725 23310 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:22.300084 23289 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.325093 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.326086 13904 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
W20260811 16:07:22.333515 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 454941us
W20260811 16:07:22.339417 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83786.3us
I20260811 16:07:22.331202 22951 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.345474 22951 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.332371 23289 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.351279 23279 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:22.351913 13904 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260811 16:07:22.352116 23311 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:22.352530 23311 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.352880 23311 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:22.296856 23313 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.338187 23143 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.324169 23250 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:22.364547 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.365850 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.382670 13826 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:22.369509 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:22.375320 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206710us
I20260811 16:07:22.383549 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
W20260811 16:07:22.365017 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:22.390899 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.391925 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.392746 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:22.336866 23166 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:22.407801 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.338965 23294 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:22.414732 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.354772 23138 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.351926 23289 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.387957 22951 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.333451 22903 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.428721 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:22.410710 23250 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:22.432606 23250 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.426815 22951 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.416625 23294 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:22.438588 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.443087 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.443730 13820 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:07:22.444005 14582 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260811 16:07:22.438596 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.437135 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.444888 13818 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
W20260811 16:07:22.443097 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 283538us
W20260811 16:07:22.446457 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57543.7us
I20260811 16:07:22.449201 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:22.452220 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.458794 23313 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.453330 23144 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:22.468636 23144 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.469058 23144 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:22.461134 22951 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.463653 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.475481 23015 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:22.477149 23166 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.478232 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.478995 23144 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.475946 13905 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:22.467772 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:22.481371 23206 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:22.481822 23206 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.482244 23206 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:22.482808 23144 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.390441 23279 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260811 16:07:22.445297 13907 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:22.484711 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.485327 14577 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:22.485767 23138 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:22.486979 23295 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.005s
I20260811 16:07:22.487329 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.487495 23295 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.489704 23295 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.491199 22903 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.499754 23124 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260811 16:07:22.500160 23303 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:22.500013 14578 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:22.501194 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.501614 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.463737 23143 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:22.503171 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70065us
I20260811 16:07:22.452360 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.502722 22903 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:22.514484 22903 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:22.518334 22903 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.505478 23274 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260811 16:07:22.506345 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57275.5us
I20260811 16:07:22.506337 23105 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:22.448148 23294 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:22.442407 23292 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.508344 22422 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260811 16:07:22.509033 22907 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
I20260811 16:07:22.511162 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.511066 23303 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:22.534536 14580 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:22.536338 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 155684us
I20260811 16:07:22.539180 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.541448 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:22.502836 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:22.542877 23274 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:22.543383 23274 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.543785 23274 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.544358 23295 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:22.544013 23292 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.544855 23295 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.545305 23295 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:22.536870 22422 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.546003 22422 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:22.548686 23292 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.550868 23267 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.511966 23144 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:22.504101 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:07:22.555198 23304 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:22.551749 22907 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.555888 23304 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.557376 13904 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260811 16:07:22.559091 23251 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.564270 23311 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.570852 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:22.585405 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44017.2us
I20260811 16:07:22.498792 14577 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
W20260811 16:07:22.594063 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55212.3us
I20260811 16:07:22.596601 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:22.598379 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 95675.4us
I20260811 16:07:22.594023 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.599321 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:22.599977 14582 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:22.599408 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.603391 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:22.604221 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.609513 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.609754 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.610334 14579 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:22.614974 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.618827 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.620258 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2606) took 1193 ms. Trace:
I20260811 16:07:22.620256 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.558166 23304 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.619992 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.625340 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.625635 14575 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 27: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:22.593293 23251 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.557384 22907 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.592927 23300 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:22.599134 23334 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:22.637540 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.637913 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.638224 13820 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:22.620934 14583 rpcz_store.cc:276] 0811 16:07:21.429778 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:21.430091 (+   313us) service_pool.cc:227] Handling call
0811 16:07:21.430582 (+   491us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:21.785181 (+354599us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:21.785229 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:21.785786 (+   557us) log.cc:842] Serialized 52 byte log entry
0811 16:07:21.984969 (+199183us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:22.593949 (+608980us) log.cc:842] Serialized 14 byte log entry
0811 16:07:22.619917 (+ 25968us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:22.619998 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:22.620043 (+    45us) raft_consensus.cc:1671] finished
0811 16:07:22.620054 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:22.620195 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31990,"prepare.queue_time_us":167939,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":13041,"raft.queue_time_us":76834,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":10072,"thread_start_us":884800,"threads_started":3,"wal-append.queue_time_us":378027}
I20260811 16:07:22.634112 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.609318 23267 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:22.613860 23269 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:22.646637 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.614032 23015 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:07:22.623859 23124 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:22.658367 13706 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:22.645262 23058 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.013s
I20260811 16:07:22.643009 22968 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:22.665238 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.665881 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.627461 23322 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.644212 22954 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:22.629635 23263 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:22.668573 23058 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.012s	sys 0.014s
I20260811 16:07:22.648056 23267 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.679589 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.674891 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.676805 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.655526 23269 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.658228 23124 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.671957 23166 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:22.661397 23334 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.635960 23280 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.676964 13827 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:22.686064 23278 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:22.648758 23251 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.682785 22954 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.689006 23263 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.689471 22422 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.706781 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.665963 23015 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:22.674408 23138 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.660990 23303 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:22.737025 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60360.5us
I20260811 16:07:22.779474 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.741529 23344 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:22.741232 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56394.2us
I20260811 16:07:22.749226 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.787798 13909 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.753995 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.756482 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.761675 13907 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:22.792291 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.793623 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.693547 22314 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.765436 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.732152 23267 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.768936 13823 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:22.771895 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:22.791184 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.799443 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.772910 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.733882 23282 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.674918 22968 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.771315 22954 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:22.741572 23124 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:22.745194 23275 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260811 16:07:22.693255 23144 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260811 16:07:22.804514 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.810868 13825 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:22.800369 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:22.738158 23269 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:22.813082 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 180845us
I20260811 16:07:22.823415 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.771818 23311 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.817966 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.863600 13902 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:22.877318 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.878126 13900 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:22.878355 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97465.1us
W20260811 16:07:22.896914 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 96065.7us
I20260811 16:07:22.899663 13827 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:22.900291 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.684227 23322 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.909857 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.821460 22968 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:22.862447 23283 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.923301 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.759912 23280 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.791595 23303 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.924116 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.797425 23138 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.815877 22314 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.939915 23329 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.940456 23342 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260811 16:07:22.940943 23342 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.941365 23342 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Advancing to term 29
W20260811 16:07:22.931473 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 126309us
I20260811 16:07:22.877450 23206 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.949889 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.953112 23338 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:22.958570 23138 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.960412 23303 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.962401 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:23.047452 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:23.048255 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.053714 13900 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:23.065428 13821 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:23.066570 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:23.067348 14581 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 22
I20260811 16:07:22.947702 14578 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:23.075471 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.960466 23280 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.954843 23338 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.102s
I20260811 16:07:22.988530 22812 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.934777 23283 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.998308 23350 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.986467 22422 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.920370 23015 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.107836 12383 thread.cc:536] Waited for 3000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:22.773782 23334 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.814273 23282 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.794906 23300 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:23.136324 23105 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260811 16:07:22.940742 23329 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.949462 23274 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.169551 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 246386us
I20260811 16:07:23.102769 23280 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:23.110792 23251 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.187402 14575 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260811 16:07:23.202121 13820 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.003s
I20260811 16:07:23.203528 13820 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 27.
W20260811 16:07:23.192234 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 302710us
I20260811 16:07:23.164636 23372 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:23.216447 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:23.179877 23263 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.233901 23331 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:23.129745 22812 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.189705 23166 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.231568 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.244616 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:23.235072 23318 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:07:23.219834 22903 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:23.235962 23368 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.314631 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 195099us
W20260811 16:07:23.316840 23364 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260811 16:07:23.317055 23274 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.162948 23350 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.318215 23366 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260811 16:07:23.308490 23319 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260811 16:07:23.259660 23331 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.320470 23206 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:23.278546 23294 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.002s
W20260811 16:07:23.318953 23365 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260811 16:07:23.345297 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:23.347131 22812 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.349360 23283 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.217775 23280 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.335676 23263 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:23.291085 23322 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:23.364434 14575 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:23.364871 23294 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.366325 23342 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.367009 23341 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.368113 23355 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260811 16:07:23.269850 23166 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.323287 22314 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.355358 23303 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
W20260811 16:07:23.383679 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50010.8us
I20260811 16:07:23.358126 23274 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.397317 23269 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.009s
W20260811 16:07:23.314879 13909 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.000s
I20260811 16:07:23.381007 23261 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.336369 23332 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.139s
I20260811 16:07:23.424408 13909 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
W20260811 16:07:23.454015 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.017s
W20260811 16:07:23.454413 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.013s	sys 0.017s
W20260811 16:07:23.422746 23374 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.213s	user 0.004s	sys 0.000s
W20260811 16:07:23.470837 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.022s	sys 0.013s
W20260811 16:07:23.472450 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.022s	sys 0.014s
I20260811 16:07:23.423121 23251 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:23.472820 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 572571us
I20260811 16:07:23.424829 23375 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:23.436395 23283 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.437335 23310 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:23.425891 22812 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:23.425702 23206 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:23.456645 23295 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.003s
W20260811 16:07:23.483340 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.023s
W20260811 16:07:23.491379 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.009s	sys 0.023s
I20260811 16:07:23.498021 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.403743 23263 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.405768 23341 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.329005 23368 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.531695 14577 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260811 16:07:23.439755 23269 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.495384 22954 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.001s
I20260811 16:07:23.544140 23206 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:23.586365 23301 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.708s	user 0.000s	sys 0.010s
I20260811 16:07:23.586674 23206 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.553351 23362 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:23.588325 23376 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260811 16:07:23.587787 23362 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.563469 23320 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260811 16:07:23.592053 23362 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.598021 23131 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:23.496052 23282 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:23.550558 23388 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260811 16:07:23.457675 23274 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.610006 23274 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.530685 23250 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.612393 23350 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.612558 23269 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.446738 23261 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.533223 23015 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.610085 23280 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.622319 23294 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.492189 23283 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.485628 23251 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.574647 23329 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:23.496971 23310 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.496651 23295 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.623106 23368 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.495167 22812 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.613639 23334 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.627561 23294 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.638890 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 451388us
I20260811 16:07:23.625103 23362 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:23.611032 23250 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.661562 13825 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260811 16:07:23.489950 23375 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.616217 22954 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.675521 23368 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.659574 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:23.653169 23288 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.009s	sys 0.040s
W20260811 16:07:23.698603 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:23.703377 23274 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.661141 23267 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.003s
I20260811 16:07:23.713184 13826 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:23.714443 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:23.625232 23015 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.717782 13873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.013s
W20260811 16:07:23.713841 23288 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.747s	user 0.009s	sys 0.041s
W20260811 16:07:23.725591 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.001s	sys 0.013s
I20260811 16:07:23.692360 23342 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:23.738651 14575 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:23.686239 23294 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.760221 23356 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.638s	user 0.000s	sys 0.008s
I20260811 16:07:23.737237 23166 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.748683 23288 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:23.689180 23362 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.783952 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 331357us
I20260811 16:07:23.725275 23368 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.727035 23267 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.799757 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:23.808465 23263 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.728101 23274 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.724705 23303 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:23.816426 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:23.823760 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 159694us
I20260811 16:07:23.822956 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3564) took 1052 ms. Trace:
I20260811 16:07:23.827921 13902 rpcz_store.cc:276] 0811 16:07:22.770671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.907283 (+136612us) service_pool.cc:227] Handling call
0811 16:07:22.907694 (+   411us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.908044 (+   350us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.908071 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:22.919748 (+ 11677us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.459830 (+540082us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:23.491343 (+ 31513us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.822645 (+331302us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.822719 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:23.822761 (+    42us) raft_consensus.cc:1671] finished
0811 16:07:23.822773 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:23.822900 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":344234,"prepare.queue_time_us":31274,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":52,"raft.queue_time_us":483599,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":27513,"thread_start_us":509501,"threads_started":1,"wal-append.queue_time_us":715930}
W20260811 16:07:23.827055 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 347112us
W20260811 16:07:23.811672 23347 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.050s	user 0.000s	sys 0.009s
I20260811 16:07:23.850787 23283 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.853600 22954 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.856158 23015 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.861572 23274 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.861865 23368 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:23.823822 23268 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.019s	sys 0.023s
W20260811 16:07:23.862933 23268 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.019s	sys 0.024s
W20260811 16:07:23.865579 22968 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.000s
I20260811 16:07:23.866251 22968 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.821424 23405 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:23.888413 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 197386us
I20260811 16:07:23.834292 23251 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.891080 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.891110 14583 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260811 16:07:23.893528 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:23.872102 23342 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.848999 23292 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.899312 14583 pending_rounds.cc:76] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 16
I20260811 16:07:23.895588 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.909369 14583 pending_rounds.cc:97] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260811 16:07:23.901276 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.909744 14583 raft_consensus.cc:2866] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:23.911607 14542 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.632s (SENT)
I20260811 16:07:23.843129 23341 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.904302 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.910166 14578 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:23.920460 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.917260 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:23.888763 23295 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.873687 23300 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260811 16:07:23.904177 23251 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:23.939612 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:23.987977 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160942us
I20260811 16:07:23.971427 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.940482 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:23.900825 23283 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.914245 23405 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.986340 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 287780us
I20260811 16:07:23.923316 23310 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.931105 14577 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:23.995538 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.908914 23342 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.999475 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:23.931748 22812 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.014216 14583 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:24.000275 13825 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:24.019448 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:23.996460 23124 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.106s	user 0.009s	sys 0.007s
I20260811 16:07:23.918795 23292 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.025674 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.027133 13825 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260811 16:07:24.027840 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:24.003566 23375 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.087610 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.112509 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:24.081905 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53551.7us
I20260811 16:07:24.026443 14582 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260811 16:07:24.096069 23423 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:07:24.096503 23412 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.099666 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2623) took 1482 ms. Trace:
I20260811 16:07:24.028577 23294 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.019732 22947 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:24.027681 23124 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:24.189342 23408 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.327s	user 0.002s	sys 0.001s
W20260811 16:07:24.190703 23378 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260811 16:07:24.191072 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.191891 13824 raft_consensus.cc:2354] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:07:23.999603 23303 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.018671 23405 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.103340 22968 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.104159 23401 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader election won for term 27
I20260811 16:07:23.876789 23288 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.109478 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.997319 23417 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:24.027667 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 100284us
I20260811 16:07:24.112972 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.117344 14579 rpcz_store.cc:276] 0811 16:07:22.617218 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.618370 (+  1152us) service_pool.cc:227] Handling call
0811 16:07:22.631640 (+ 13270us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.642574 (+ 10934us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.642623 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:23.594428 (+951805us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:23.594924 (+   496us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.833690 (+238766us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:23.833728 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.833801 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:24.099274 (+265473us) raft_consensus.cc:1671] finished
0811 16:07:24.099298 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.099573 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1211,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12436,"spinlock_wait_cycles":7962240,"thread_start_us":215679,"threads_started":1,"wal-append.queue_time_us":500565}
W20260811 16:07:24.165490 12383 thread.cc:536] Waited for 4000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:24.020994 23283 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.183907 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.185593 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.119160 23341 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260811 16:07:24.185711 23268 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.183656 23375 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.189077 23294 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:24.191221 23124 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.196091 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.101300 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3652) took 1448 ms. Trace:
I20260811 16:07:24.194949 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3563) took 1424 ms. Trace:
W20260811 16:07:24.200423 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87986.6us
I20260811 16:07:24.201148 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:24.188205 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.185557 23058 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.208032 13827 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260811 16:07:24.237978 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:24.238392 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50267us
I20260811 16:07:24.230599 13821 rpcz_store.cc:276] 0811 16:07:22.653130 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.656794 (+  3664us) service_pool.cc:227] Handling call
0811 16:07:22.670446 (+ 13652us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.080862 (+410416us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:24.101012 (+1020150us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400240754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:24.101232 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":893777280}
I20260811 16:07:24.228924 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:24.217322 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.243322 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.243906 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:24.245488 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:24.215046 23397 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.375s	user 0.000s	sys 0.009s
W20260811 16:07:24.247008 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51041.8us
I20260811 16:07:24.251708 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.252393 23323 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.252892 23323 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.254680 23416 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:24.255127 13902 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260811 16:07:24.255318 23416 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.246145 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:24.256966 14583 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:24.256896 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44230.8us
I20260811 16:07:24.248620 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.255851 23416 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:24.263521 13909 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:24.265604 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.258733 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.256366 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.259531 13817 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:24.213142 22812 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:24.250285 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.237248 13908 rpcz_store.cc:276] 0811 16:07:22.770323 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.884766 (+114443us) service_pool.cc:227] Handling call
0811 16:07:22.885054 (+   288us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.896126 (+ 11072us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.896176 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:22.916895 (+ 20719us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.207582 (+290687us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:23.243854 (+ 36272us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.599556 (+355702us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b48000603d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:07:23.778855 (+179299us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b18004710a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:07:23.779100 (+   245us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.779210 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:23.899066 (+119856us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18004710a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:24.194750 (+295684us) raft_consensus.cc:1671] finished
0811 16:07:24.194774 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.194894 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":298861,"prepare.queue_time_us":42479,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":6590,"raft.queue_time_us":661450,"raft.run_cpu_time_us":1761,"raft.run_wall_time_us":612598,"spinlock_wait_cycles":165320704,"thread_start_us":265314,"threads_started":1,"wal-append.queue_time_us":372595}
I20260811 16:07:24.268117 13902 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21. Re-sending same reply.
I20260811 16:07:24.269449 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:24.261062 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.267123 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.271025 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.255899 23418 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:24.229182 22968 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:24.285742 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85685.2us
I20260811 16:07:24.245956 23124 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.268694 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.270040 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.197405 23412 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.286276 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.198912 22947 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.287384 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.287801 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.233155 23401 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:24.293052 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.285575 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.260560 23300 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:24.230748 23251 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
W20260811 16:07:24.294664 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48473.6us
I20260811 16:07:24.246380 23058 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.292835 23274 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.295670 13903 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:24.295066 23286 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:24.285998 23362 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.232985 23268 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.388465 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.288702 23105 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.212589 23425 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.077s
I20260811 16:07:24.260118 23138 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:24.357283 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:24.353942 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59539.7us
I20260811 16:07:24.289567 23322 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.212167 23417 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:24.365804 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 142260us
I20260811 16:07:24.365918 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:24.363919 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.295835 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.366802 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.368631 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.288916 23323 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.295158 23415 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.349578 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.350876 23428 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:24.295480 23427 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:24.413414 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.235493 23375 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.319744 23294 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:24.290073 22812 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.394841 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.394842 13907 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260811 16:07:24.410983 13909 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:24.370579 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 75127.5us
I20260811 16:07:24.294855 22968 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.351069 23368 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260811 16:07:24.295166 23124 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.405262 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.386258 23342 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.429149 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.431185 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:24.439945 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76050.1us
W20260811 16:07:24.441017 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.441519 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.414853 23428 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.422361 23294 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.452226 13821 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:24.420097 23292 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.459875 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3565) took 1688 ms. Trace:
W20260811 16:07:24.456607 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.465744 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.469808 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.403366 23138 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.483974 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.453645 23428 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:24.468863 23441 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.463675 13900 rpcz_store.cc:276] 0811 16:07:22.771587 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.077077 (+305490us) service_pool.cc:227] Handling call
0811 16:07:23.089680 (+ 12603us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:23.093437 (+  3757us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:23.093477 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:23.169121 (+ 75644us) log.cc:842] Serialized 52 byte log entry
0811 16:07:23.442206 (+273085us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:23.473315 (+ 31109us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.822073 (+348758us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.822272 (+   199us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.822352 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:24.103377 (+281025us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b18004b5440. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c567b3088 00007f5c567aa6b1 00007f5c567aa657 00007f5c5689e978 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8
0811 16:07:24.459538 (+356161us) raft_consensus.cc:1671] finished
0811 16:07:24.459572 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.459792 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":993907,"prepare.queue_time_us":31869,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5571,"raft.queue_time_us":494332,"raft.run_cpu_time_us":1814,"raft.run_wall_time_us":308155,"spinlock_wait_cycles":20387456,"thread_start_us":208752,"threads_started":1,"wal-append.queue_time_us":543262}
W20260811 16:07:24.479406 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 66138.2us
W20260811 16:07:24.468289 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.492583 13904 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:24.458767 23294 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:24.612001 23397 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260811 16:07:24.688568 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 220304us
I20260811 16:07:24.720394 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.461252 23251 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:24.555876 22947 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.570437 23448 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.401836 23286 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.479696 23283 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:24.624377 23434 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260811 16:07:24.616473 23439 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260811 16:07:24.419273 23415 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.548272 13902 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:24.461585 23420 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:24.571422 23444 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:07:24.623466 23436 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260811 16:07:24.543191 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:24.617784 23438 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
I20260811 16:07:24.576655 23124 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.625062 23331 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.578498 23138 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.583479 23311 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:24.479389 23405 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.580149 23268 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.553807 23441 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.555123 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.550690 13909 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:24.770150 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.735070 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.726338 13821 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 29.
I20260811 16:07:24.614279 23450 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.458959 23401 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.668520 23427 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260811 16:07:24.750415 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.787776 14577 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:24.789538 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.750896 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.790674 14583 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:24.751523 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.791275 23268 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:24.753230 13908 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:24.791718 23268 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.792176 23268 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:24.793777 23392 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.477s	user 0.001s	sys 0.003s
I20260811 16:07:24.754051 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.795635 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:24.795823 23353 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.028s	user 0.002s	sys 0.006s
I20260811 16:07:24.796603 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.797320 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3123) took 2194 ms. Trace:
I20260811 16:07:24.797742 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.798580 13904 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:24.757893 23286 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.742988 23444 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:24.797780 13901 rpcz_store.cc:276] 0811 16:07:22.603223 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.603365 (+   142us) service_pool.cc:227] Handling call
0811 16:07:22.623781 (+ 20416us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.662654 (+ 38873us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.662701 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:22.663096 (+   395us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.173677 (+510581us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:23.173733 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.173830 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:24.793451 (+1619621us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:07:24.797017 (+  3566us) raft_consensus.cc:1671] finished
0811 16:07:24.797041 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.797258 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":91783,"raft.queue_time_us":57946,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"spinlock_wait_cycles":44173568,"thread_start_us":441803,"threads_started":1,"wal-append.queue_time_us":574460}
I20260811 16:07:24.800411 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.737950 23337 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.760114 23283 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.763938 23058 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.744274 23447 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.801612 23337 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.801865 23283 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.802553 23447 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.803460 23417 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.801599 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.804677 22968 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:24.780323 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45380.2us
I20260811 16:07:24.805694 23337 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.781201 23450 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.807648 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.807943 23447 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.808621 23450 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.809111 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.763968 23322 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:24.787669 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.810170 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:24.809986 23322 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.810528 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.811048 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.811275 13901 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:24.812438 13909 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260811 16:07:24.812769 13901 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260811 16:07:24.813040 23274 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:24.789923 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:24.814658 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3554) took 2051 ms (client timeout 2641 ms). Trace:
I20260811 16:07:24.799566 23444 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:24.739269 23368 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.745316 23448 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.814733 13901 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:24.750604 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:24.776854 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 348393us
I20260811 16:07:24.857654 14582 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:24.832980 13908 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:24.823011 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.860354 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.732648 23278 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.090s
I20260811 16:07:24.863427 23448 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.863639 23283 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:24.815040 13905 rpcz_store.cc:269] 0811 16:07:22.762894 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.822764 (+ 59870us) service_pool.cc:227] Handling call
0811 16:07:24.789808 (+1967044us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:07:24.814579 (+ 24771us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5522176}
I20260811 16:07:24.823910 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.864145 23261 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.866854 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.877305 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.872714 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:24.885152 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.889992 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:24.865688 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.003s	sys 0.012s
W20260811 16:07:24.895944 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.012s
I20260811 16:07:24.779973 22812 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.911672 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:24.908043 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 656695us
I20260811 16:07:24.820364 23415 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:24.916893 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.013s	sys 0.014s
W20260811 16:07:24.917402 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 492240us
I20260811 16:07:24.869299 23450 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:24.888634 23448 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.892774 23268 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.910602 23058 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:24.884558 23283 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:24.950917 23283 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.951443 23283 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:24.955907 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:24.948163 13871 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.959957 23452 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.960834 23452 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.949021 23281 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:24.965968 23281 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:24.968019 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3229) took 2306 ms (client timeout 2245 ms). Trace:
I20260811 16:07:24.903059 23368 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:24.973539 13818 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
W20260811 16:07:24.968497 13824 rpcz_store.cc:269] 0811 16:07:22.661371 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.662323 (+   952us) service_pool.cc:227] Handling call
0811 16:07:24.967748 (+2305425us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540025f154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:24.967913 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3444720000}
I20260811 16:07:24.957506 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.981511 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.968420 23281 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.933513 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.934818 23429 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.935375 23450 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.994222 23450 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:24.933038 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.013s	sys 0.014s
I20260811 16:07:24.937148 23448 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.998517 23448 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.936647 23441 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.940461 23268 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.000753 23429 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.942526 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:25.003979 14573 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:07:25.007705 14582 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:07:24.937908 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.009778 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.942260 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.012668 14581 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:25.013827 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.011047 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.019518 23429 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:25.020879 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.013859 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.022717 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.024022 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.028318 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.032269 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:24.932363 23303 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.008s	sys 0.012s
I20260811 16:07:25.043540 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:25.044958 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63591.8us
I20260811 16:07:25.045665 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.043478 13905 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 29: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:25.045744 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.032677 14573 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:24.958766 23058 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:25.048602 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:25.049031 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 92166us
W20260811 16:07:25.049403 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 115965us
I20260811 16:07:24.976085 23368 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:25.051761 23294 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:25.053299 13790 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.009s	sys 0.007s
W20260811 16:07:25.064797 13790 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.009s	sys 0.007s
W20260811 16:07:25.044972 23303 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.009s	sys 0.012s
I20260811 16:07:25.054262 23271 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:25.056859 23415 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:25.078779 23415 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.081051 23415 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:25.058233 13825 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.011s	sys 0.026s
I20260811 16:07:25.060101 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.061499 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.086301 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.048806 23281 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:25.076205 23368 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.087491 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:25.063002 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.046598 23441 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.033149 23268 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.073982 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.066221 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.079234 23294 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.054001 23322 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:25.088619 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.088907 13825 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.011s	sys 0.026s
I20260811 16:07:25.070079 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.091329 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.949352 23420 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.109694 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:25.116178 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53293.2us
W20260811 16:07:25.117390 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.117849 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.112483 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46368.2us
I20260811 16:07:25.083317 22812 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.108031 23126 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:25.114202 23406 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.114895 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.060094 23295 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:25.116326 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3237) took 1084 ms. Trace:
W20260811 16:07:25.118999 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.141089 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.088260 23448 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:25.088163 23368 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:25.134924 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65243.2us
I20260811 16:07:25.146047 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:25.139741 23124 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:25.147102 23406 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:25.151563 23448 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.151458 23450 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.153538 13824 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.154157 23448 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.155296 23452 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.155383 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1832) took 1662 ms. Trace:
I20260811 16:07:25.108448 22968 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260811 16:07:25.156553 23450 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:25.156862 23416 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.003s
I20260811 16:07:25.157337 23416 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.158488 23375 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:25.159291 23428 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.004s
I20260811 16:07:25.087512 23281 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.159762 23428 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.160599 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.160944 14583 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:25.161563 23281 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.130874 23322 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:25.165473 23472 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:25.119187 23268 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.166906 23472 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:25.167461 23472 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:25.129653 22422 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:25.168694 23268 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.168591 23472 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.171396 23267 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.171758 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:25.174527 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.174718 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.175124 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3243) took 1033 ms. Trace:
I20260811 16:07:25.175549 13818 rpcz_store.cc:276] 0811 16:07:24.141930 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.417415 (+275485us) service_pool.cc:227] Handling call
0811 16:07:24.968689 (+551274us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.029632 (+ 60943us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.174933 (+145301us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540025f150. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:25.175069 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1264030464}
I20260811 16:07:25.176617 23467 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:25.176761 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.177932 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.178082 23454 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:25.178750 23454 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:25.178642 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.179483 23454 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:25.180081 23442 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:25.180505 23314 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:25.181027 23385 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:25.182485 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.185668 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.170794 23472 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:25.162763 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.196736 14583 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260811 16:07:25.179134 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.155970 14574 rpcz_store.cc:276] 0811 16:07:23.492962 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.493111 (+   149us) service_pool.cc:227] Handling call
0811 16:07:23.537214 (+ 44103us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.663598 (+126384us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:23.663630 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:23.663676 (+    46us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:23.663730 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.155102 (+1491372us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.155196 (+    94us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.155328 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":290105728}
I20260811 16:07:25.182380 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.130771 23261 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:25.198772 23463 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.198741 23058 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.201357 23267 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:25.201928 23267 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.139772 23338 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:25.207285 12383 thread.cc:536] Waited for 5000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:25.180713 23442 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:25.209463 23442 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.212247 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1831) took 1719 ms. Trace:
I20260811 16:07:25.212838 14575 rpcz_store.cc:276] 0811 16:07:23.492605 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.493469 (+   864us) service_pool.cc:227] Handling call
0811 16:07:23.536613 (+ 43144us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.764922 (+228309us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.211886 (+1446964us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.212155 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":435818240}
I20260811 16:07:25.214380 23283 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.215831 13820 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 25: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.216897 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.218258 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.193913 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.220324 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3661) took 1231 ms. Trace:
I20260811 16:07:25.220547 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.220911 13826 rpcz_store.cc:276] 0811 16:07:23.989089 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.992552 (+  3463us) service_pool.cc:227] Handling call
0811 16:07:23.992867 (+   315us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.390672 (+397805us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.390717 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:24.390768 (+    51us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:24.390810 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.219975 (+829165us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400174154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.220047 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.220236 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":914308992}
I20260811 16:07:25.221868 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.223785 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.140859 23300 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260811 16:07:25.131768 23294 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.134430 22812 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.226202 14574 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 20. Ops: []
I20260811 16:07:25.222767 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.228029 22812 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.228863 23416 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.204073 23267 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.231353 23428 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.232118 23406 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:07:25.232723 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:25.233074 23406 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:25.233471 13818 raft_consensus.cc:2354] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:07:25.234050 23464 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:25.234953 23268 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:25.235368 23268 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:25.236253 23268 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.236940 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.238129 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.238799 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.239486 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.239921 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.240731 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.241145 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:25.239909 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:25.242800 13826 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.243359 14581 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:25.243602 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.214710 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.245787 23283 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.132612 23420 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.246764 23322 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader election won for term 29
I20260811 16:07:25.247390 23322 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:25.248311 23322 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.251103 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.251942 13874 leader_election.cc:398] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:07:25.254055 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.244278 13826 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:07:25.258491 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76202.2us
I20260811 16:07:25.259516 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.249260 23420 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.278425 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:25.278527 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:25.280526 14542 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.313616 14575 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:25.314473 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.268388 23314 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.233500 23406 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:25.324208 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.324944 13818 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:07:25.325021 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85775.2us
I20260811 16:07:25.325824 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.326574 13818 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 29: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:25.327507 23396 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:07:25.333334 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.334486 13826 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.342025 23428 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:25.348066 23298 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:25.348768 23298 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:25.349211 23298 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:25.351693 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97758.6us
I20260811 16:07:25.354382 23281 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.342303 14575 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:25.361575 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47230.5us
I20260811 16:07:25.362375 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.362680 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.370386 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.373399 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:25.261250 23268 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:25.374413 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.393124 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.394778 13826 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:25.399230 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:25.396515 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.400995 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.374184 23362 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.018s
I20260811 16:07:25.374432 23314 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:25.385973 23401 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:25.387118 23311 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:25.410389 13787 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.407899 23278 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:25.413391 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3567) took 1141 ms. Trace:
I20260811 16:07:25.427601 13907 rpcz_store.cc:276] 0811 16:07:24.271563 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.287899 (+ 16336us) service_pool.cc:227] Handling call
0811 16:07:24.288181 (+   282us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.422835 (+134654us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.413043 (+990208us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.413307 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":244364672}
I20260811 16:07:25.429355 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:25.433272 13907 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 23. Ops: []
I20260811 16:07:25.398119 23271 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:25.437350 23271 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:25.437851 23271 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:07:25.443866 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.444410 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.446187 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.447359 23311 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:25.448097 23311 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260811 16:07:25.449227 23311 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:25.449602 23311 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:25.450821 23311 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.452630 23311 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:25.423899 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:25.425453 13826 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:07:25.459542 14575 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:25.409940 23362 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.019s
W20260811 16:07:25.435369 23444 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.006s
I20260811 16:07:25.427194 23278 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.437000 23454 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.494469 23464 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260811 16:07:25.466804 13787 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.415934 13909 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.015s
W20260811 16:07:25.498920 13909 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.015s
I20260811 16:07:25.498807 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.500276 13787 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.500734 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.501896 13901 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.028s
W20260811 16:07:25.502533 13901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.029s
W20260811 16:07:25.416348 13903 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.009s	sys 0.019s
W20260811 16:07:25.504124 13903 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.009s	sys 0.019s
I20260811 16:07:25.497517 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3126) took 1100 ms. Trace:
I20260811 16:07:25.505898 13904 rpcz_store.cc:276] 0811 16:07:24.397630 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.834424 (+436794us) service_pool.cc:227] Handling call
0811 16:07:25.247492 (+413068us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.247690 (+   198us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:25.247714 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.247767 (+    53us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:25.247800 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.247852 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.497269 (+249417us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000c7e50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:25.497439 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":949142272}
W20260811 16:07:25.517612 13787 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.518293 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.519893 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.520394 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.521781 13787 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.522323 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.536397 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.537070 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.538487 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.539063 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.528324 23367 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:25.528051 22812 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.498402 23278 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:25.528084 23280 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.550235 23375 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260811 16:07:25.552927 23478 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260811 16:07:25.558425 13787 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.508378 23267 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:25.557253 23105 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.019s	sys 0.016s
I20260811 16:07:25.530352 23464 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.495549 23444 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.597730 23271 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.515741 23369 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260811 16:07:25.594200 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.595400 23454 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.598469 23444 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.559684 23441 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:25.601647 13787 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.602272 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.019s
W20260811 16:07:25.613058 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.019s
W20260811 16:07:25.613785 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 526342us
I20260811 16:07:25.605370 14575 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:25.607400 13821 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260811 16:07:25.609140 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.607842 23425 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.019s
I20260811 16:07:25.637161 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.639218 14575 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
W20260811 16:07:25.599900 23105 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.016s
W20260811 16:07:25.655790 13787 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.698390 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.691097 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.010s
I20260811 16:07:25.693603 14573 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260811 16:07:25.660976 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.608672 23464 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:25.712427 13818 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 20. Ops: []
W20260811 16:07:25.708895 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.015s	sys 0.010s
I20260811 16:07:25.709964 14573 pending_rounds.cc:76] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 16
W20260811 16:07:25.640702 23425 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.006s	sys 0.019s
I20260811 16:07:25.643494 23441 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:25.720944 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60100.5us
I20260811 16:07:25.661235 23420 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.696938 23362 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:25.745482 14541 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.014s	sys 0.062s
W20260811 16:07:25.756824 14541 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.014s	sys 0.063s
W20260811 16:07:25.701411 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59416.2us
W20260811 16:07:25.757383 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 598935us
W20260811 16:07:25.716202 23058 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.020s	sys 0.010s
W20260811 16:07:25.759698 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.706738 23271 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:25.746462 14580 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.019s
I20260811 16:07:25.702725 23405 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.706378 23476 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:25.661651 23384 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260811 16:07:25.769040 14580 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.004s	sys 0.019s
I20260811 16:07:25.812772 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:25.814455 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:25.876551 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87785.7us
I20260811 16:07:25.715808 14573 pending_rounds.cc:97] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 25.17
W20260811 16:07:25.877663 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63263.8us
I20260811 16:07:25.878418 14573 raft_consensus.cc:2866] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:25.714879 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 595865us
W20260811 16:07:25.879326 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.880602 13871 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.881078 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.757263 23105 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:25.760679 23058 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.020s	sys 0.010s
I20260811 16:07:25.816176 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:25.900137 13787 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.900501 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:25.901212 13787 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.765412 23143 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:25.912995 13787 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.882241 23483 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260811 16:07:25.758131 23396 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.148s
I20260811 16:07:25.923633 23143 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.935536 23412 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.877745 23279 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:25.905112 23298 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.007s
I20260811 16:07:25.902514 23126 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:07:25.914585 23479 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260811 16:07:25.928869 22903 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:25.783324 23476 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.913676 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.930672 23384 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260811 16:07:25.932669 23477 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260811 16:07:25.755849 23278 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.876900 23464 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:25.888823 13903 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:25.979861 23015 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:25.760828 23401 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.145s
I20260811 16:07:25.965276 23250 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.906124 23271 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:25.968240 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 152151us
I20260811 16:07:25.901980 23467 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:25.939052 23472 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.004s
I20260811 16:07:25.763124 23362 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.919598 23105 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:25.993227 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1618) took 3079 ms. Trace:
W20260811 16:07:26.001437 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88486us
I20260811 16:07:25.965894 23298 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.923455 23442 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:26.006821 23441 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:26.016709 23435 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.783s	user 0.000s	sys 0.008s
I20260811 16:07:25.893587 23405 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:25.980638 23126 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:26.007496 22907 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.038611 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:26.167109 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 128794us
I20260811 16:07:26.168013 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.041889 23464 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:26.140956 23286 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:26.020642 23402 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:26.041509 13822 rpcz_store.cc:276] 0811 16:07:22.900758 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.002644 (+101886us) service_pool.cc:227] Handling call
0811 16:07:23.064477 (+ 61833us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.292969 (+228492us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:23.293019 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:23.293085 (+    66us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:23.293138 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.979982 (+2686844us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400355554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.980063 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.980284 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":524881792}
I20260811 16:07:25.975636 23279 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.042691 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.186434 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 143771us
I20260811 16:07:26.056401 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1634) took 1139 ms. Trace:
I20260811 16:07:26.187948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:26.118083 23498 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260811 16:07:26.045212 23267 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:26.191425 13787 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.192401 13787 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.042811 23271 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.070283 23491 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.169239 23405 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:07:26.156459 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 275866us
W20260811 16:07:26.205267 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.187659 13817 rpcz_store.cc:276] 0811 16:07:24.917057 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.926533 (+  9476us) service_pool.cc:227] Handling call
0811 16:07:24.927774 (+  1241us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.941450 (+ 13676us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.941488 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:24.941951 (+   463us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.407218 (+465267us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.407277 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.407373 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.054699 (+647326us) raft_consensus.cc:1671] finished
0811 16:07:26.056128 (+  1429us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.056326 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":464374,"threads_started":1,"wal-append.queue_time_us":754533}
W20260811 16:07:26.206287 13871 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.207404 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.207864 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.208086 12383 thread.cc:536] Waited for 6000ms trying to join with heartbeat (tid 13772)
W20260811 16:07:26.209038 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.209517 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.210629 13871 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.192919 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.182680 23402 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.186627 23489 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.188896 13822 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:26.182956 23472 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.176857 23485 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:26.212026 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.168769 23281 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:26.213258 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:26.255659 13817 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:26.214241 22903 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:26.214627 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.215485 23464 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.206614 23491 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.189952 23278 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.180737 23425 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
W20260811 16:07:26.257401 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.219655 23502 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260811 16:07:26.267567 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.225004 23490 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260811 16:07:26.259444 23472 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.253067 23489 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:26.275665 23501 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260811 16:07:26.277735 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1635) took 1345 ms. Trace:
I20260811 16:07:26.281201 14573 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:26.283247 23405 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.211557 23390 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.309188 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.297503 13822 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:26.305209 13820 rpcz_store.cc:276] 0811 16:07:24.932780 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.009693 (+ 76913us) service_pool.cc:227] Handling call
0811 16:07:26.277463 (+1267770us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:26.277654 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":441774848}
I20260811 16:07:26.303257 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1731) took 1552 ms. Trace:
I20260811 16:07:26.310873 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.315054 14579 rpcz_store.cc:276] 0811 16:07:24.751192 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.751337 (+   145us) service_pool.cc:227] Handling call
0811 16:07:24.764520 (+ 13183us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.772279 (+  7759us) raft_consensus.cc:1520] Early marking committed up to index 17
0811 16:07:24.783444 (+ 11165us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.082638 (+299194us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.082692 (+    54us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.082738 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.302891 (+1220153us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:26.302972 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.303168 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18522,"prepare.queue_time_us":11502,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":18918,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":17059072,"thread_start_us":280129,"threads_started":1,"wal-append.queue_time_us":622754}
I20260811 16:07:26.310818 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.319666 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.322239 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2652) took 1445 ms. Trace:
I20260811 16:07:26.323695 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3568) took 2034 ms. Trace:
I20260811 16:07:26.328652 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:26.322715 14577 rpcz_store.cc:276] 0811 16:07:24.877118 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.879373 (+  2255us) service_pool.cc:227] Handling call
0811 16:07:24.879729 (+   356us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.897522 (+ 17793us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.897551 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:24.898017 (+   466us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.225390 (+327373us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b18002fb240. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:07:25.641115 (+415725us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:25.641162 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.641240 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.290494 (+649254us) raft_consensus.cc:1671] finished
0811 16:07:26.290513 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.322167 (+ 31654us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17362,"raft.queue_time_us":22359,"spinlock_wait_cycles":50992896,"thread_start_us":415532,"threads_started":1,"wal-append.queue_time_us":1068245}
I20260811 16:07:26.324366 13903 rpcz_store.cc:276] 0811 16:07:24.289203 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.811632 (+522429us) service_pool.cc:227] Handling call
0811 16:07:24.812131 (+   499us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.812544 (+   413us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:07:25.508402 (+695858us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.778718 (+270316us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.888541 (+109823us) log.cc:842] Serialized 564 byte log entry
0811 16:07:25.888701 (+   160us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.138785 (+250084us) log.cc:842] Serialized 14 byte log entry
0811 16:07:26.139229 (+   444us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.143822 (+  4593us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.323483 (+179661us) raft_consensus.cc:1671] finished
0811 16:07:26.323507 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.323637 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8456,"prepare.queue_time_us":781245,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1272,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":50029,"thread_start_us":961538,"threads_started":2,"wal-append.queue_time_us":758430}
I20260811 16:07:26.200518 23267 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.316788 23497 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260811 16:07:26.341801 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.347909 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.289110 23485 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:26.301321 23486 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.198381 23105 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.353523 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.308629 23349 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:26.315979 23412 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.315533 23446 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:26.155406 23442 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.307324 23476 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.360249 13820 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:26.375052 13817 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:26.319283 23298 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.328047 23380 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260811 16:07:26.327564 22903 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.371245 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2664) took 1207 ms. Trace:
I20260811 16:07:26.393028 14574 rpcz_store.cc:276] 0811 16:07:25.163967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.226946 (+ 62979us) service_pool.cc:227] Handling call
0811 16:07:25.249728 (+ 22782us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:25.249993 (+   265us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:25.250031 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.256375 (+  6344us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.696326 (+439951us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:25.696375 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.696452 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.370997 (+674545us) raft_consensus.cc:1671] finished
0811 16:07:26.371019 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.371186 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":365532,"threads_started":1,"wal-append.queue_time_us":791956}
I20260811 16:07:26.340487 23410 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.373486 14579 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:26.341764 23441 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.361068 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3677) took 1184 ms. Trace:
I20260811 16:07:26.396189 13822 rpcz_store.cc:276] 0811 16:07:25.176515 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.334365 (+1157850us) service_pool.cc:227] Handling call
0811 16:07:26.360246 (+ 25881us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.360615 (+   369us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.360650 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.360708 (+    58us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:26.360751 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.360837 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.360991 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.224555 23402 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.356989 23517 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.358573 23491 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.358093 23058 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:26.204003 23126 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.374832 23494 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
W20260811 16:07:26.378559 23311 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.923s	user 0.014s	sys 0.001s
I20260811 16:07:26.344879 23390 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260811 16:07:26.399334 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1640) took 1200 ms. Trace:
I20260811 16:07:26.379614 23412 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:26.381520 23329 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:26.360013 23486 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:26.411713 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 236879us
W20260811 16:07:26.401116 23268 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.007s	user 0.013s	sys 0.002s
I20260811 16:07:26.371613 23349 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.425192 13820 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:26.437376 13817 rpcz_store.cc:276] 0811 16:07:25.253383 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.395255 (+1141872us) service_pool.cc:227] Handling call
0811 16:07:26.398787 (+  3532us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.399006 (+   219us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.399029 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.399064 (+    35us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.399089 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.399186 (+    97us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.399278 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.438473 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2642) took 2417 ms. Trace:
I20260811 16:07:26.395540 23518 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260811 16:07:26.447762 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.436791 23505 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260811 16:07:26.418759 23362 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.450877 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.451983 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.403345 23407 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:07:26.426802 23441 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:26.459846 14583 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:26.493952 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1836) took 1348 ms. Trace:
I20260811 16:07:26.494302 14583 rpcz_store.cc:276] 0811 16:07:25.145681 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.223418 (+ 77737us) service_pool.cc:227] Handling call
0811 16:07:26.459319 (+1235901us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.459599 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.493711 (+ 34112us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.493895 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54211840}
I20260811 16:07:26.457448 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3558) took 3693 ms. Trace:
I20260811 16:07:26.489789 13817 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:26.489727 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.491370 13902 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:26.496318 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.463749 23515 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260811 16:07:26.495349 13906 rpcz_store.cc:276] 0811 16:07:22.764040 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.876801 (+112761us) service_pool.cc:227] Handling call
0811 16:07:22.877193 (+   392us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:22.885587 (+  8394us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.885622 (+    35us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:22.925050 (+ 39428us) log.cc:842] Serialized 52 byte log entry
0811 16:07:25.216748 (+2291698us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b1800173b00. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:07:25.713009 (+496261us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.764688 (+ 51679us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.765244 (+   556us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.767559 (+  2315us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.457052 (+689493us) raft_consensus.cc:1671] finished
0811 16:07:26.457197 (+   145us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.457376 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28701,"prepare.queue_time_us":53754,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":63052,"raft.queue_time_us":85538,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":67951,"spinlock_wait_cycles":3533696,"thread_start_us":496027,"threads_started":1,"wal-append.queue_time_us":3061492}
I20260811 16:07:26.441423 23485 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.19, Last appended by leader: 19, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.400123 23410 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.502735 23513 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260811 16:07:26.504974 23410 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.505968 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3577) took 2140 ms. Trace:
I20260811 16:07:26.506448 13909 rpcz_store.cc:276] 0811 16:07:24.366657 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.813250 (+446593us) service_pool.cc:227] Handling call
0811 16:07:24.813545 (+   295us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.866577 (+ 53032us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:07:25.499409 (+632832us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.991047 (+491638us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.991917 (+   870us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.992103 (+   186us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.001323 (+  9220us) log.cc:842] Serialized 14 byte log entry
0811 16:07:26.002799 (+  1476us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.003164 (+   365us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.505683 (+502519us) raft_consensus.cc:1671] finished
0811 16:07:26.505712 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.505878 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5636,"prepare.queue_time_us":773141,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":139,"raft.queue_time_us":51834,"raft.run_cpu_time_us":606,"raft.run_wall_time_us":48710,"thread_start_us":983684,"threads_started":2,"wal-append.queue_time_us":627475}
I20260811 16:07:26.444759 23271 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.512770 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3668) took 2397 ms. Trace:
I20260811 16:07:26.513767 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3264) took 1263 ms. Trace:
I20260811 16:07:26.513199 13827 rpcz_store.cc:276] 0811 16:07:24.115267 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.391856 (+276589us) service_pool.cc:227] Handling call
0811 16:07:24.420939 (+ 29083us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.777618 (+356679us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:24.875041 (+ 97423us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.224415 (+349374us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18002ef1e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:07:25.747813 (+523398us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.818217 (+ 70404us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.818414 (+   197us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.818460 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.818554 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.512471 (+693917us) raft_consensus.cc:1671] finished
0811 16:07:26.512572 (+   101us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.512709 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33180,"prepare.queue_time_us":90667,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":4403,"raft.queue_time_us":225590,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":7391,"spinlock_wait_cycles":40396160,"thread_start_us":846864,"threads_started":2,"wal-append.queue_time_us":1005344}
I20260811 16:07:26.514760 23410 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.458792 23349 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:26.515403 23410 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.140899 13825 rpcz_store.cc:276] 0811 16:07:24.031599 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.031962 (+   363us) service_pool.cc:227] Handling call
0811 16:07:24.080756 (+ 48794us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.086617 (+  5861us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:24.115752 (+ 29135us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.115943 (+1000191us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.116000 (+    57us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.116057 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.116121 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.116258 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33599,"prepare.queue_time_us":30562,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1616,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10786,"thread_start_us":999803,"threads_started":1}
I20260811 16:07:26.516952 23267 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.517573 23410 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.517661 23472 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.518014 13825 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260811 16:07:26.518792 23489 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.399917 22903 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.518994 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3265) took 1173 ms. Trace:
I20260811 16:07:26.520841 22903 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.523774 23442 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.484720 23486 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.525568 23441 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.527799 23441 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.453151 14578 rpcz_store.cc:276] 0811 16:07:24.014498 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.015580 (+  1082us) service_pool.cc:227] Handling call
0811 16:07:24.089333 (+ 73753us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.186484 (+ 97151us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:24.621228 (+434744us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b180040c780. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:07:25.063387 (+442159us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.568210 (+504823us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.568820 (+   610us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.568979 (+   159us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.569024 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.569121 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.421137 (+852016us) raft_consensus.cc:1671] finished
0811 16:07:26.431319 (+ 10182us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.431516 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":90583,"prepare.queue_time_us":274383,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":98148,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":19879,"spinlock_wait_cycles":13180672,"thread_start_us":893850,"threads_started":2,"wal-append.queue_time_us":927980}
I20260811 16:07:26.530900 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1642) took 1271 ms. Trace:
I20260811 16:07:26.536747 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.467003 23510 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.450s	user 0.001s	sys 0.000s
W20260811 16:07:26.465837 23473 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.034s	user 0.000s	sys 0.002s
I20260811 16:07:26.537019 13827 rpcz_store.cc:276] 0811 16:07:25.259406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.514969 (+1255563us) service_pool.cc:227] Handling call
0811 16:07:26.530448 (+ 15479us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.530619 (+   171us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.530644 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.530681 (+    37us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.530707 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.530753 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.530846 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.547667 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.548864 13904 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:26.519680 13825 rpcz_store.cc:276] 0811 16:07:25.345967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.517046 (+1171079us) service_pool.cc:227] Handling call
0811 16:07:26.517700 (+   654us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:26.518547 (+   847us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.518922 (+   375us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.558399 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.558286 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3683) took 1205 ms. Trace:
I20260811 16:07:26.514396 13817 rpcz_store.cc:276] 0811 16:07:25.250877 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.489280 (+1238403us) service_pool.cc:227] Handling call
0811 16:07:26.489638 (+   358us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.513528 (+ 23890us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.513716 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.559698 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.563669 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.561034 13825 rpcz_store.cc:276] 0811 16:07:25.353240 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.551015 (+1197775us) service_pool.cc:227] Handling call
0811 16:07:26.551484 (+   469us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.557903 (+  6419us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.557943 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.557994 (+    51us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.558051 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.558117 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.558220 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.538152 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.563843 13902 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:26.568248 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.569171 13905 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:07:26.572317 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.576145 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 256575us
I20260811 16:07:26.551990 23401 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.576323 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.576967 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.574239 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:26.626051 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49164us
I20260811 16:07:26.601742 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.599534 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.589970 13817 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:26.628955 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.601287 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.606383 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.634876 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61088.2us
W20260811 16:07:26.637339 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 254288us
I20260811 16:07:26.638432 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3684) took 1284 ms. Trace:
I20260811 16:07:26.639204 13817 rpcz_store.cc:276] 0811 16:07:25.353662 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.562248 (+1208586us) service_pool.cc:227] Handling call
0811 16:07:26.589775 (+ 27527us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.632328 (+ 42553us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.638289 (+  5961us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.640997 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.641234 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:26.578926 23418 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:26.644930 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68793.8us
I20260811 16:07:26.578891 23350 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:26.633436 23263 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:26.633805 22954 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:26.649567 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3267) took 1206 ms. Trace:
I20260811 16:07:26.651898 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.649621 23281 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:26.654940 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1707) took 1269 ms. Trace:
I20260811 16:07:26.656461 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.637586 23425 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.654455 13817 rpcz_store.cc:276] 0811 16:07:25.436953 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.640485 (+1203532us) service_pool.cc:227] Handling call
0811 16:07:26.642863 (+  2378us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.643059 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.643091 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.643133 (+    42us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:26.643192 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.643250 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.643360 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.640324 23489 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:26.657585 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.639397 23362 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:26.648391 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.663465 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.666327 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.660434 13908 rpcz_store.cc:276] 0811 16:07:25.385752 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.385909 (+   157us) service_pool.cc:227] Handling call
0811 16:07:25.386401 (+   492us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:25.394429 (+  8028us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:25.394478 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:25.402646 (+  8168us) log.cc:842] Serialized 52 byte log entry
0811 16:07:25.906585 (+503939us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.928086 (+ 21501us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.928348 (+   262us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.928439 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.654703 (+726264us) raft_consensus.cc:1671] finished
0811 16:07:26.654724 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.654883 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10470,"prepare.queue_time_us":21822,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":10536,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7106,"thread_start_us":483476,"threads_started":1,"wal-append.queue_time_us":759415}
I20260811 16:07:26.666831 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.669349 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.670434 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.672367 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.675800 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.653920 23508 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.530s	user 0.004s	sys 0.001s
I20260811 16:07:26.636435 23518 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260811 16:07:26.580248 23410 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.075s
I20260811 16:07:26.677192 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.755378 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.678802 14578 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:26.756162 13908 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:26.650296 23429 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.651284 23442 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.650034 23344 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:26.662331 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.775698 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.776930 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.761094 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 113156us
I20260811 16:07:26.761482 23105 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:26.762622 14573 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:26.763321 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.763535 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.763780 23304 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.764504 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.765426 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.587626 23401 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.649930 23350 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:26.689996 13902 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:26.651575 22907 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.124s
I20260811 16:07:26.804354 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.771670 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 123303us
I20260811 16:07:26.774179 14583 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:26.778959 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.769366 13822 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260811 16:07:26.676105 23362 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:26.786938 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.652074 23329 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.124s
I20260811 16:07:26.809705 13908 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:26.680094 22954 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:26.649673 23267 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.801553 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.806272 13787 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.772899 23405 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:26.777781 23485 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.812023 13817 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:26.805703 23350 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:26.794559 23344 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:26.815793 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.668466 23425 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.817318 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.819948 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.825484 13787 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.815785 13902 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:26.826092 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.827245 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.828388 13817 raft_consensus.cc:2396] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260811 16:07:26.823737 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 166248us
I20260811 16:07:26.830753 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.809895 23418 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.814992 23362 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:26.833922 13787 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.849740 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.821012 23482 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.060s	user 0.000s	sys 0.003s
I20260811 16:07:26.848662 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:26.862800 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64434.6us
I20260811 16:07:26.782167 23442 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.799465 23304 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.807842 23486 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260811 16:07:26.824575 23263 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:26.841934 23520 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260811 16:07:26.846313 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.842485 23268 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:26.842335 23441 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:26.842549 23329 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:26.913614 13817 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260811 16:07:26.849221 23372 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:26.914242 23372 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.915231 23372 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.844349 23485 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.916360 23372 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:26.892777 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44230.3us
I20260811 16:07:26.918437 23485 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.919485 23401 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.920065 23401 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:26.825138 23528 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:26.849058 23405 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:26.849167 23310 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:26.924873 23310 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.891222 23105 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:26.870438 23286 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260811 16:07:26.928248 23105 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.930122 23286 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:26.923280 22954 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.932051 23527 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260811 16:07:26.933619 23534 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260811 16:07:26.849956 23418 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.937799 23418 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.940734 23304 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.941349 23540 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:26.901093 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.943687 23310 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.904284 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2653) took 2026 ms. Trace:
I20260811 16:07:26.944252 14580 rpcz_store.cc:276] 0811 16:07:24.877424 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.877974 (+   550us) service_pool.cc:227] Handling call
0811 16:07:24.878256 (+   282us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.907942 (+ 29686us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:07:24.934372 (+ 26430us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.227393 (+293021us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b180033b560. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:25.228116 (+   723us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180033b560. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:07:25.785737 (+557621us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.877360 (+ 91623us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.888621 (+ 11261us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:25.888672 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.888769 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.544486 (+655717us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:26.904058 (+359572us) raft_consensus.cc:1671] finished
0811 16:07:26.904094 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.904224 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18729,"prepare.queue_time_us":10100,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":73052,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":68353,"spinlock_wait_cycles":59394432,"thread_start_us":557300,"threads_started":1,"wal-append.queue_time_us":1188970}
I20260811 16:07:26.946827 23441 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260811 16:07:26.947345 23531 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260811 16:07:26.947000 23350 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.859711 23344 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.868712 23464 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:26.911777 23268 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.960737 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.961422 13817 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:26.930673 23286 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.909192 23263 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.948882 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3248) took 1875 ms. Trace:
I20260811 16:07:26.949671 23425 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.952562 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3685) took 1598 ms. Trace:
I20260811 16:07:26.971302 13825 rpcz_store.cc:276] 0811 16:07:25.353986 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.564673 (+1210687us) service_pool.cc:227] Handling call
0811 16:07:26.951858 (+387185us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.952049 (+   191us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.952255 (+   206us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.952282 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.952324 (+    42us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.952355 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.952408 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.952505 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":61482240}
I20260811 16:07:26.972680 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.867878 13787 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.953790 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2666) took 1750 ms. Trace:
I20260811 16:07:26.923650 23528 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.824332 23267 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.956878 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3582) took 2551 ms. Trace:
I20260811 16:07:26.958161 23489 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260811 16:07:26.983361 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:26.845731 14541 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 122 similar messages]
I20260811 16:07:26.962327 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.962990 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.963852 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3266) took 1617 ms. Trace:
I20260811 16:07:26.962078 23268 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:26.967440 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98920.5us
I20260811 16:07:26.973486 13825 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260811 16:07:26.955402 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:26.974985 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.969144 13823 rpcz_store.cc:276] 0811 16:07:25.073185 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.074738 (+  1553us) service_pool.cc:227] Handling call
0811 16:07:25.083908 (+  9170us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.227330 (+143422us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:07:25.227646 (+   316us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.689452 (+461806us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.689519 (+    67us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:25.689568 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.948575 (+1259007us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540029fc54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:26.948649 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.948823 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4737,"prepare.queue_time_us":851,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":68,"raft.queue_time_us":1569,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4550,"spinlock_wait_cycles":329229056,"thread_start_us":461368,"threads_started":1,"wal-append.queue_time_us":672146}
I20260811 16:07:26.989832 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.990307 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.973749 14582 rpcz_store.cc:276] 0811 16:07:25.203768 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.232477 (+ 28709us) service_pool.cc:227] Handling call
0811 16:07:26.953116 (+1720639us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.953314 (+   198us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.953496 (+   182us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.953524 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.953563 (+    39us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.953594 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.953644 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.953737 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":42250496}
I20260811 16:07:26.991132 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3268) took 1528 ms. Trace:
I20260811 16:07:26.992151 13823 rpcz_store.cc:276] 0811 16:07:25.462988 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.990337 (+1527349us) service_pool.cc:227] Handling call
0811 16:07:26.990643 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.990823 (+   180us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.990848 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.990886 (+    38us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.990915 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.990966 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.991065 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.992661 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3687) took 1526 ms. Trace:
W20260811 16:07:26.992940 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.993440 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.993783 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1643) took 1441 ms. Trace:
I20260811 16:07:26.977929 13901 rpcz_store.cc:276] 0811 16:07:24.405899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.861595 (+455696us) service_pool.cc:227] Handling call
0811 16:07:24.861991 (+   396us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.907042 (+ 45051us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.907179 (+   137us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:24.912694 (+  5515us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.503447 (+590753us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.883758 (+380311us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.901962 (+ 18204us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.902073 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.601585 (+699512us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:26.956600 (+355015us) raft_consensus.cc:1671] finished
0811 16:07:26.956708 (+   108us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.956821 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56033,"prepare.queue_time_us":207203,"prepare.run_cpu_time_us":9109,"prepare.run_wall_time_us":21436,"raft.queue_time_us":75482,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":14055,"spinlock_wait_cycles":17995520,"thread_start_us":892167,"threads_started":2,"wal-append.queue_time_us":765212}
I20260811 16:07:26.994316 23288 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:26.994812 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.984802 13827 rpcz_store.cc:276] 0811 16:07:25.346335 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.547107 (+1200772us) service_pool.cc:227] Handling call
0811 16:07:26.950661 (+403554us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.950891 (+   230us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.951090 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.951118 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.963522 (+ 12404us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:07:26.963574 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.963654 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.963788 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":65134976}
I20260811 16:07:26.994148 13823 rpcz_store.cc:276] 0811 16:07:25.552055 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.993072 (+1441017us) service_pool.cc:227] Handling call
0811 16:07:26.993355 (+   283us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.993516 (+   161us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.993540 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.993587 (+    47us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:26.993612 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.993656 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.993737 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.984083 14580 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
W20260811 16:07:26.984586 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 138904us
I20260811 16:07:26.996203 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3269) took 1443 ms. Trace:
I20260811 16:07:26.996531 13827 rpcz_store.cc:276] 0811 16:07:25.553033 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.995480 (+1442447us) service_pool.cc:227] Handling call
0811 16:07:26.995772 (+   292us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.995927 (+   155us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.995948 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.995982 (+    34us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.996009 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.996070 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.996157 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:26.997385 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.990674 23407 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:26.997754 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.998713 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.999289 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.999521 23407 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.999714 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3688) took 1362 ms. Trace:
I20260811 16:07:27.000087 13823 rpcz_store.cc:276] 0811 16:07:25.637121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.998943 (+1361822us) service_pool.cc:227] Handling call
0811 16:07:26.999245 (+   302us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.999407 (+   162us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.999436 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.999471 (+    35us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:26.999497 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.999547 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.999666 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:27.000841 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.001261 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:27.002430 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.003260 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.003654 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.005055 23407 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.987025 23528 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.008383 23263 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.008613 23528 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:27.011547 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56232.3us
I20260811 16:07:27.012413 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.997795 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.998577 13907 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:27.015511 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.993247 13825 rpcz_store.cc:276] 0811 16:07:25.466530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.991692 (+1525162us) service_pool.cc:227] Handling call
0811 16:07:26.992054 (+   362us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.992271 (+   217us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.992312 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.992372 (+    60us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.992417 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.992483 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.992597 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:27.017444 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:27.019685 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 180464us
W20260811 16:07:27.019728 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:27.023412 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 155564us
I20260811 16:07:27.023684 13817 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:27.025098 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:27.026598 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.026957 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:27.017686 14541 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.018591 22907 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.029935 23298 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:27.030469 23298 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:27.030856 23298 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:27.024204 22954 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:27.032150 23362 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.027382 23441 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:27.037722 23532 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260811 16:07:27.039340 23533 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260811 16:07:27.040403 23298 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.043520 23442 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.046558 23267 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.046923 23298 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.047220 22947 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.051483 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.055670 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.057778 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45456.1us
I20260811 16:07:27.021157 23268 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election won for term 26
W20260811 16:07:27.062481 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.066277 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.066524 13902 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260811 16:07:27.066886 13902 pending_rounds.cc:76] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 16
I20260811 16:07:27.067211 13902 pending_rounds.cc:97] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260811 16:07:27.067520 13902 raft_consensus.cc:2866] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:27.023674 23281 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:27.070204 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:27.077371 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.078372 13909 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:27.081036 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.082583 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.084602 13901 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:27.085570 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.057703 23362 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.087455 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.080415 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.091301 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:27.092337 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.092734 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.064504 23418 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:27.083029 23298 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:27.098649 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:07:27.099647 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.100199 12383 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:27.100301 13909 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:27.101356 12383 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:27.103510 23058 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:27.103969 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.104423 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.104964 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3270) took 1489 ms. Trace:
I20260811 16:07:27.106369 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:27.107832 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033357
I20260811 16:07:27.108337 23350 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.105136 23058 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:27.109210 23537 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260811 16:07:27.109315 23281 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.024071 23286 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.084139 23268 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:27.088536 23407 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:27.117369 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.105541 13827 rpcz_store.cc:276] 0811 16:07:25.615106 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.997365 (+1382259us) service_pool.cc:227] Handling call
0811 16:07:26.997675 (+   310us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:27.012080 (+ 14405us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:27.012118 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:27.020883 (+  8765us) log.cc:842] Serialized 26 byte log entry
0811 16:07:27.102152 (+ 81269us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:27.102209 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.102304 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:27.104616 (+  2312us) raft_consensus.cc:1671] finished
0811 16:07:27.104642 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:27.104879 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14035,"raft.queue_time_us":25050,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":17508,"threads_started":1,"wal-append.queue_time_us":45054}
I20260811 16:07:27.111297 23267 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260811 16:07:27.115012 23286 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:27.115888 23268 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.121869 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:27.132259 23143 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:27.139959 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:27.122361 13909 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:27.141239 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.142403 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:27.142699 13827 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 24: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:27.143606 23447 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:27.095901 23288 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.144196 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:27.106745 23298 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.145787 23298 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.113313 23441 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260811 16:07:27.148401 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57618.2us
I20260811 16:07:27.150691 12383 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:27.151862 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1636) took 2218 ms. Trace:
I20260811 16:07:27.152231 13824 rpcz_store.cc:276] 0811 16:07:24.933167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.045494 (+112327us) service_pool.cc:227] Handling call
0811 16:07:27.151627 (+2106133us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002dd2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.151801 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":244100352}
I20260811 16:07:27.155378 23544 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.156108 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 768) took 2290 ms. Trace:
I20260811 16:07:27.155880 23544 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.156474 13900 rpcz_store.cc:276] 0811 16:07:24.866128 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.905359 (+ 39231us) service_pool.cc:227] Handling call
0811 16:07:27.155534 (+2250175us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400142b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.156012 (+   478us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2744029568}
I20260811 16:07:27.157994 23544 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.149670 23441 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.158813 23441 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.159425 13826 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:27.160148 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.160795 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3260) took 2072 ms. Trace:
I20260811 16:07:27.161144 13826 rpcz_store.cc:276] 0811 16:07:25.088246 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.531688 (+443442us) service_pool.cc:227] Handling call
0811 16:07:27.159237 (+1627549us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:27.159843 (+   606us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.160629 (+   786us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002dd2d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.160743 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3674265344}
I20260811 16:07:27.161532 23401 raft_consensus.cc:2684] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Received pre-election callback for term 21 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 16:07:27.162686 23267 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:27.163291 23267 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.167100 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.168033 14574 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260811 16:07:27.169387 23283 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:27.169930 23283 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.166033 23267 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.171550 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.172142 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.176051 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.178707 13817 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260811 16:07:27.180362 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.144117 23447 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:27.186131 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 162010us
I20260811 16:07:27.167037 23126 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:07:27.204617 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.206043 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 139630us
W20260811 16:07:27.205397 13787 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.218907 23310 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:27.144027 23350 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.224284 14582 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:07:27.225055 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.226133 23442 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.230338 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.182580 23349 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260811 16:07:27.252668 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99857.2us
I20260811 16:07:27.233016 23283 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.233848 23447 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.234202 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.235340 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.237182 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.248654 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:27.253638 14573 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 25: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:27.253747 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.181828 23429 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.261910 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.263017 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.272732 13824 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
W20260811 16:07:27.278291 23556 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260811 16:07:27.255402 23442 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.257009 23401 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.284237 23401 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.273972 23283 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
W20260811 16:07:27.286832 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3253) took 2201 ms (client timeout 1513 ms). Trace:
W20260811 16:07:27.290413 13821 rpcz_store.cc:269] 0811 16:07:25.085388 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.160334 (+ 74946us) service_pool.cc:227] Handling call
0811 16:07:27.286633 (+2126299us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400354b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.286768 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1008393984}
I20260811 16:07:27.291778 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.288477 23279 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.264133 23263 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:27.301928 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.307453 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.273689 23525 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.252460 23350 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:27.313766 13871 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:27.269333 23528 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260811 16:07:27.293781 23554 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:27.302655 23543 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.305961 23472 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:27.310032 23522 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.309185 23442 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.314855 23384 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.337563 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.339996 14575 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:27.348393 23402 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:27.321147 23554 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.317363 23489 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260811 16:07:27.360751 23350 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.351131 23385 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:27.352334 23401 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.351051 23522 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.338404 23472 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.355105 23441 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.332245 23543 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.378180 23138 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:27.378481 12383 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:27.380071 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.399401 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.401228 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.410784 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.414316 13907 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260811 16:07:27.414875 13907 pending_rounds.cc:76] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 14
I20260811 16:07:27.415414 13907 pending_rounds.cc:97] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260811 16:07:27.415773 13907 raft_consensus.cc:2866] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:27.418706 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 146401us
I20260811 16:07:27.420461 13826 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:27.387615 23554 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:27.396705 23138 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:27.444810 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.446580 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.454198 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.423659 23331 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.468042 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:27.472326 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48663us
W20260811 16:07:27.472306 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 133145us
W20260811 16:07:27.465548 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 203163us
I20260811 16:07:27.474550 12383 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:27.481838 14583 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:27.483448 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.484058 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.483588 23406 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.484459 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.485077 23406 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:27.485275 23543 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.488709 23464 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:27.490595 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3263) took 2263 ms. Trace:
I20260811 16:07:27.490954 13822 rpcz_store.cc:276] 0811 16:07:25.226972 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.397215 (+1170243us) service_pool.cc:227] Handling call
0811 16:07:26.399712 (+  2497us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:26.807489 (+407777us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.490374 (+682885us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.490539 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":823049472}
I20260811 16:07:27.492388 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:27.493283 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 2667) took 2254 ms (client timeout 2018 ms). Trace:
W20260811 16:07:27.493647 14581 rpcz_store.cc:269] 0811 16:07:25.238798 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.244193 (+  5395us) service_pool.cc:227] Handling call
0811 16:07:27.492226 (+2248033us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:07:27.493182 (+   956us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15012736}
I20260811 16:07:27.496002 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3583) took 1050 ms. Trace:
I20260811 16:07:27.496759 23485 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:27.497303 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3250) took 2423 ms. Trace:
I20260811 16:07:27.497773 23485 consensus_queue.cc:1225] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 26.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260811 16:07:27.497725 13818 rpcz_store.cc:276] 0811 16:07:25.073944 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.329062 (+255118us) service_pool.cc:227] Handling call
0811 16:07:25.329355 (+   293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.716871 (+387516us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.497048 (+1780177us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54002ab7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.497241 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":880497920}
I20260811 16:07:27.496405 13903 rpcz_store.cc:276] 0811 16:07:26.445532 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.446566 (+  1034us) service_pool.cc:227] Handling call
0811 16:07:26.446882 (+   316us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.520101 (+ 73219us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.520137 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.520176 (+    39us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:26.520204 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.495779 (+975575us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.495826 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:27.495946 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":167951104}
I20260811 16:07:27.477605 22621 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.477020 23267 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:27.507030 23362 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:27.507613 23362 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.451923 23279 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260811 16:07:27.507952 23543 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:27.509807 23362 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.509860 23401 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:27.510419 23401 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:27.454384 23525 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:27.511300 23401 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.513268 23401 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.513772 22621 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.514343 22621 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.516091 23441 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.516453 22621 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:27.519300 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:27.524134 13787 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.525449 13787 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.525977 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.526973 23405 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260811 16:07:27.529503 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.530387 13825 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:07:27.528800 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.531780 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 472735us
W20260811 16:07:27.532892 14541 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.535394 14541 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.536495 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.536945 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.538285 23271 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.542327 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1646) took 1317 ms. Trace:
I20260811 16:07:27.542932 13820 rpcz_store.cc:276] 0811 16:07:26.224789 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.311041 (+ 86252us) service_pool.cc:227] Handling call
0811 16:07:27.542080 (+1231039us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54000983d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.542242 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":70453504}
I20260811 16:07:27.545811 23472 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.546649 23138 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.544569 13826 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260811 16:07:27.548431 13826 pending_rounds.cc:76] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 11
I20260811 16:07:27.548696 13826 pending_rounds.cc:97] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260811 16:07:27.548960 13826 raft_consensus.cc:2866] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:27.551014 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:27.552104 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:27.553630 22954 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:27.554090 22954 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.554476 22954 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:27.557734 23385 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Stepping down as leader of term 25
I20260811 16:07:27.558362 23385 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:27.548049 23138 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:27.545549 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.560577 13820 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:27.560930 23390 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:27.561445 23390 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:27.567303 13820 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260811 16:07:27.568578 23271 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:27.568915 13908 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:27.569372 23271 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:27.547464 13823 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:27.532572 13787 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.584616 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 295459us
W20260811 16:07:27.585384 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52842.5us
I20260811 16:07:27.586067 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:27.587020 13787 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.587700 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.591781 13820 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260811 16:07:27.592046 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.592941 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.597908 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.598706 13818 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:07:27.597949 13908 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:27.604370 23420 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:27.609226 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:27.595911 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.612411 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 192626us
I20260811 16:07:27.614125 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.616740 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.589321 23540 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:27.623821 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.624615 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.562474 23390 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.632122 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.593511 23442 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.641325 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.644430 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.648036 22621 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:27.650883 13787 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.587277 23298 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.648753 22621 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260811 16:07:27.694226 23522 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.650079 23267 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:27.649950 23369 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260811 16:07:27.646184 23446 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:27.645649 23271 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.600140 23407 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260811 16:07:27.599920 23385 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.645910 23441 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.158s
I20260811 16:07:27.781193 13905 raft_consensus.cc:2396] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
W20260811 16:07:27.803731 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 190705us
W20260811 16:07:27.810660 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 164900us
I20260811 16:07:27.817222 14575 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:27.817703 13907 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260811 16:07:27.743328 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.820173 13906 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260811 16:07:27.727754 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 86578.5us
I20260811 16:07:27.632057 23544 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:27.822124 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:27.818708 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.810077 23126 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.003s
I20260811 16:07:27.638525 23565 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:27.777733 23525 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:27.768992 23543 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:27.781720 23267 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.776329 23331 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:27.843410 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.864573 13902 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.845045 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.846279 13907 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260811 16:07:27.686057 23396 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.146s
I20260811 16:07:27.859500 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.861119 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:27.827339 23522 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.819257 23410 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.639731 23540 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.876578 13906 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
W20260811 16:07:27.858673 22947 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.044s	sys 0.047s
I20260811 16:07:27.843565 23385 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:07:27.880393 22947 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.044s	sys 0.048s
I20260811 16:07:27.888782 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3161) took 1133 ms. Trace:
I20260811 16:07:27.889429 13908 rpcz_store.cc:276] 0811 16:07:26.755579 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.814751 (+ 59172us) service_pool.cc:227] Handling call
0811 16:07:26.815107 (+   356us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:27.604331 (+789224us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.888435 (+284104us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54002ad5d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.888698 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1733344512}
I20260811 16:07:27.901816 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3273) took 1702 ms. Trace:
I20260811 16:07:27.902447 13823 rpcz_store.cc:276] 0811 16:07:26.199727 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.003218 (+803491us) service_pool.cc:227] Handling call
0811 16:07:27.547204 (+543986us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:27.588985 (+ 41781us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.901565 (+312580us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000983d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.901722 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1250310912}
I20260811 16:07:27.911661 23344 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:27.912143 23344 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:27.912931 23344 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.921578 13902 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:27.792346 22954 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.853986 23567 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.777572 23554 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:27.942613 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 325016us
I20260811 16:07:27.839246 23446 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260811 16:07:27.950872 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66775.9us
I20260811 16:07:27.939612 23567 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.968516 14582 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260811 16:07:27.943979 23401 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.964088 23429 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:27.971936 23429 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.974115 23429 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:27.984033 23278 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.984848 23278 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.988157 23368 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.988813 23368 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.992189 23543 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:07:27.929456 23267 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260811 16:07:27.880486 23410 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:28.005868 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50220.1us
I20260811 16:07:27.880439 23522 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.960711 23441 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260811 16:07:28.025434 22954 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:28.025650 23571 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:07:27.984061 23344 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:28.047291 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45084.4us
I20260811 16:07:28.012723 23329 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.050500 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.053869 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:28.003469 23401 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.032119 23298 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.084667 13706 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.095162 12383 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:28.043800 23278 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.101619 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.105634 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:28.116426 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.024s	sys 0.039s
W20260811 16:07:28.117165 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.025s	sys 0.039s
I20260811 16:07:28.091845 23414 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260811 16:07:28.123018 14582 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:28.094581 23267 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:28.128780 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.130079 14573 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:28.048333 23368 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.078074 23441 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:07:28.123592 14583 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 19. Ops: [17.16-17.16]
I20260811 16:07:28.111636 23420 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:28.142212 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.144411 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 27.
I20260811 16:07:28.122395 23540 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:28.142338 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.028s
W20260811 16:07:28.152992 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.009s	sys 0.029s
I20260811 16:07:28.071211 23329 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.161424 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:28.163451 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.139192 23267 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:28.166944 23522 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.149478 23554 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.168434 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.125991 23128 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260811 16:07:28.148348 23331 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.194948 14583 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:07:28.204119 23572 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260811 16:07:28.204834 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 595706us
I20260811 16:07:28.154659 23401 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.236214 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:28.237293 13818 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:28.223608 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.224220 13817 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260811 16:07:28.187594 23576 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260811 16:07:28.253819 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:28.254832 13901 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:28.207410 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:28.235301 13822 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:28.238466 13824 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:28.257720 13823 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:28.259626 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.277176 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.278350 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:28.227898 23271 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.001s	sys 0.040s
I20260811 16:07:28.215369 23567 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.284371 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:28.285276 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.288568 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:28.289402 13909 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:28.300854 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.302641 23271 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.001s	sys 0.040s
I20260811 16:07:28.304365 14581 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260811 16:07:28.246083 23522 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.312357 14582 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:28.295619 23298 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260811 16:07:28.236917 23331 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.317476 23522 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.317880 23267 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.343408 23583 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.048s
I20260811 16:07:28.370440 23425 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:28.375000 23574 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260811 16:07:28.310184 23464 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.377054 23464 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.377110 13909 raft_consensus.cc:2396] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260811 16:07:28.328550 14583 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
W20260811 16:07:28.383438 23573 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
W20260811 16:07:28.348068 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:28.343993 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:28.346382 13617 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.644s	user 0.012s	sys 0.043s
I20260811 16:07:28.343673 13901 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:28.351107 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.391782 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47920.2us
I20260811 16:07:28.392585 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.390214 13823 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:28.393846 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:28.394040 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:28.394917 23536 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:28.395470 23536 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:28.354990 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.400136 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.394246 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:28.407052 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 426004us
I20260811 16:07:28.407364 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.415000 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.415001 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 285918us
I20260811 16:07:28.353638 23522 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.350255 23331 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.405797 23536 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:28.344163 23441 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.076s
I20260811 16:07:28.348929 23565 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.166s
I20260811 16:07:28.405622 23281 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:28.416975 22954 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:28.666621 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.666968 13818 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:28.411243 23583 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:28.419431 23567 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:28.417475 23274 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:28.667940 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:28.668730 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 248342us
W20260811 16:07:28.802449 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:28.802650 23274 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:28.802933 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:28.410094 23015 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:28.803699 23015 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:28.803982 23015 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:28.335506 23298 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:28.672780 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.001s	sys 0.013s
W20260811 16:07:28.807479 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.001s	sys 0.013s
W20260811 16:07:28.807941 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 648622us
W20260811 16:07:28.802449 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 353807us
I20260811 16:07:28.810261 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:28.672711 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 252038us
I20260811 16:07:28.811602 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:28.811941 23058 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.813071 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.743216 23565 consensus_queue.cc:1225] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260811 16:07:28.752146 23329 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.685771 23579 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.817137 23015 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.756772 23485 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.818265 23579 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.818958 23329 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.818675 23485 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.819808 23015 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.671890 23368 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.822561 23368 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.807435 23298 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:28.819547 23329 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.820895 23579 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:28.717638 23464 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.752557 12383 tablet_replica.cc:330] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:28.821010 23281 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:28.821023 23485 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.687750 23267 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.834249 23414 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:28.787984 23286 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.838773 23410 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.839249 22954 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:28.857640 23138 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:28.839883 23593 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:28.841526 23592 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260811 16:07:28.841575 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3299) took 1026 ms. Trace:
I20260811 16:07:28.867530 13820 rpcz_store.cc:276] 0811 16:07:27.814708 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.814914 (+   206us) service_pool.cc:227] Handling call
0811 16:07:27.834276 (+ 19362us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:28.030132 (+195856us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:28.030183 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:28.034847 (+  4664us) log.cc:842] Serialized 26 byte log entry
0811 16:07:28.417856 (+383009us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:28.417893 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:28.417966 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:28.841320 (+423354us) raft_consensus.cc:1671] finished
0811 16:07:28.841348 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:28.841512 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3459,"raft.queue_time_us":5836,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11008,"thread_start_us":564799,"threads_started":2,"wal-append.queue_time_us":791487}
I20260811 16:07:28.812454 23058 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.877934 23058 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.861660 23138 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.883337 23138 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.861946 22954 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.850688 23441 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:28.861927 23589 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260811 16:07:28.899678 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.919589 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:28.872365 23281 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:28.923943 13905 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260811 16:07:28.924337 13905 pending_rounds.cc:76] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 16
I20260811 16:07:28.924535 13905 pending_rounds.cc:97] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260811 16:07:28.924748 13905 raft_consensus.cc:2866] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:28.936101 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:28.945181 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.874598 23579 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:28.953017 13824 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:28.960031 23368 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.866016 23286 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.932888 23058 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.921867 23138 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:28.967345 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.919220 23271 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.989758 23271 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.968614 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.991801 23271 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:28.992518 23286 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.992862 22621 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260811 16:07:28.969338 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:28.860761 23267 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.996414 23267 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.997643 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3712) took 1118 ms. Trace:
I20260811 16:07:28.998024 13825 rpcz_store.cc:276] 0811 16:07:27.878977 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.879205 (+   228us) service_pool.cc:227] Handling call
0811 16:07:27.879638 (+   433us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:27.942863 (+ 63225us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:27.942896 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:27.943383 (+   487us) log.cc:842] Serialized 26 byte log entry
0811 16:07:28.295742 (+352359us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:28.295796 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:28.295890 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:28.997440 (+701550us) raft_consensus.cc:1671] finished
0811 16:07:28.997463 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:28.997589 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62714,"raft.queue_time_us":63882,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":8513,"thread_start_us":328978,"threads_started":1,"wal-append.queue_time_us":769356}
I20260811 16:07:28.903551 23441 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.001597 23441 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.971493 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.004241 13818 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:28.973125 23604 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260811 16:07:28.979887 23446 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:28.987709 23058 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.989199 23554 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
W20260811 16:07:29.005947 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 203530us
I20260811 16:07:28.980746 23329 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.026989 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:29.014428 23446 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:29.014912 23138 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.028781 23446 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.030365 23446 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:29.023878 23554 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:29.032941 23554 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.20, Last appended by leader: 20, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.033960 23058 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.034196 23554 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:29.030999 23138 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:28.939622 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 1.824s	user 0.053s	sys 0.044s Metrics: {"bytes_written":5254,"delete_count":0,"lbm_write_time_us":884,"lbm_writes_lt_1ms":5,"reinsert_count":0,"thread_start_us":405326,"threads_started":1,"update_count":193,"wal-append.queue_time_us":582735}
W20260811 16:07:29.019311 23385 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.090s	user 0.021s	sys 0.000s
I20260811 16:07:29.043027 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.312731
I20260811 16:07:29.046928 23298 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.048413 14574 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 27. Current term is 28. Ops: []
I20260811 16:07:29.043076 12383 raft_consensus.cc:2229] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:29.021797 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.054114 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:29.022576 23583 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:29.054979 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:29.052147 23298 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.060220 23406 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.058375 23615 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:29.065475 23402 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:29.046286 23536 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:29.078212 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 265195us
W20260811 16:07:29.083714 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 155181us
W20260811 16:07:29.086323 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.097867 23523 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.099066 23523 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.104220 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.108548 23583 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.077683 23406 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.084470 23402 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:29.124487 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65161.1us
I20260811 16:07:29.145380 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:29.128988 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:29.077920 23344 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.151682 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.152607 14577 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26.
I20260811 16:07:29.136932 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.139221 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:29.148638 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 331524us
I20260811 16:07:29.154557 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:29.141212 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.154428 13826 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:29.156785 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.156921 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.134665 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.159576 13818 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.161374 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.162389 13825 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:29.153868 23524 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.151765 23402 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:29.166929 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.179491 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.179491 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:29.185411 13908 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 26
I20260811 16:07:29.186357 13826 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 28.
I20260811 16:07:29.123780 23523 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.164373 14541 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.192694 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.129104 23329 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.204021 13906 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260811 16:07:29.065626 23281 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.209824 13820 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260811 16:07:29.205523 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:29.167644 23420 raft_consensus.cc:659] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260811 16:07:29.206738 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.216640 14582 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.20-23.20]
I20260811 16:07:29.154107 23543 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.225775 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:29.202724 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61312.9us
I20260811 16:07:29.167790 23126 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.223835 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:29.217249 13901 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:29.230226 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:29.235283 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 277436us
I20260811 16:07:29.237452 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:29.238338 13906 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:29.202623 23579 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.247635 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.166698 23344 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.165011 23524 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.279075 13902 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.20-23.20]
I20260811 16:07:29.252439 13908 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:29.254501 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:29.230198 23536 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.291702 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 139265us
I20260811 16:07:29.242802 23441 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:29.317966 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.320226 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:29.285611 23625 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.212987 23329 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.327041 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:29.240221 23543 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.240480 23126 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.340066 23350 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:29.340426 23524 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.340662 23350 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.340816 23126 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.341198 23350 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:29.343384 23638 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Leader election won for term 28
I20260811 16:07:29.344462 23638 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:29.345116 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1762) took 1383 ms. Trace:
I20260811 16:07:29.315956 23441 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.345655 14575 rpcz_store.cc:276] 0811 16:07:27.961623 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.961769 (+   146us) service_pool.cc:227] Handling call
0811 16:07:27.975416 (+ 13647us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:27.998121 (+ 22705us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:27.998161 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:28.841632 (+843471us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:28.842096 (+   464us) log.cc:842] Serialized 26 byte log entry
0811 16:07:29.054193 (+212097us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:29.054231 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:29.055979 (+  1748us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:29.344686 (+288707us) raft_consensus.cc:1671] finished
0811 16:07:29.344739 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:29.345025 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22284,"raft.queue_time_us":25630,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6928,"spinlock_wait_cycles":6837120,"thread_start_us":211645,"threads_started":1,"wal-append.queue_time_us":388385}
I20260811 16:07:29.286501 23579 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.322243 23286 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.375651 23406 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.326376 22954 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.383177 23390 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:29.375001 23344 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.330191 23625 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.384805 22954 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.353984 22947 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.358172 23441 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:29.388916 23543 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.392346 23579 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.355310 23638 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.395545 23329 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.378206 23286 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:29.401638 23568 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.283s	user 0.011s	sys 0.001s
I20260811 16:07:29.402866 23625 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.440377 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3726) took 1025 ms. Trace:
I20260811 16:07:29.441555 13817 rpcz_store.cc:276] 0811 16:07:28.414847 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:28.415031 (+   184us) service_pool.cc:227] Handling call
0811 16:07:28.415479 (+   448us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:28.415916 (+   437us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:28.415956 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:28.416565 (+   609us) log.cc:842] Serialized 26 byte log entry
0811 16:07:29.207420 (+790855us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:29.207477 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:29.207571 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:29.439109 (+231538us) raft_consensus.cc:1671] finished
0811 16:07:29.439265 (+   156us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:29.439951 (+   686us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":889,"raft.run_cpu_time_us":8019,"raft.run_wall_time_us":264382,"thread_start_us":483901,"threads_started":1,"wal-append.queue_time_us":897917}
W20260811 16:07:29.444649 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190137us
I20260811 16:07:29.453086 13903 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: [16.13-17.14]
I20260811 16:07:29.460675 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:29.461879 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.466110 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:29.470239 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.488067 23329 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.488830 22954 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.492063 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.493978 23344 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:29.495067 23344 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.389194 22947 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.498533 23344 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.501571 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 174436us
I20260811 16:07:29.508016 13907 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260811 16:07:29.511775 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.513475 23329 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.516569 23329 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.521142 23402 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.522998 13903 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:29.503859 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 157007us
I20260811 16:07:29.498977 23286 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.541030 23105 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:29.541287 23126 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260811 16:07:29.544687 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97536us
I20260811 16:07:29.547343 22947 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.552835 23271 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.560434 23350 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.570578 23350 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.572559 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:29.579317 13825 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:29.584817 13904 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:29.591459 23528 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.592216 23528 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.595368 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3616) took 1757 ms. Trace:
W20260811 16:07:29.604138 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57110.9us
I20260811 16:07:29.554147 23271 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.595979 13904 rpcz_store.cc:276] 0811 16:07:27.834124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.834258 (+   134us) service_pool.cc:227] Handling call
0811 16:07:27.834520 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:29.587912 (+1753392us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:29.590736 (+  2824us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:29.591042 (+   306us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4023635840}
I20260811 16:07:29.617161 23368 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.618074 23368 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.621587 23396 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:29.622782 23396 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 LEADER]: Stepping down as leader of term 27
I20260811 16:07:29.623322 23396 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:29.624303 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 121502us
I20260811 16:07:29.624732 23396 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.626545 23396 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:29.630103 23401 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:29.641739 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:29.656430 23402 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.667119 23607 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.668085 23607 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.671324 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:29.675300 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58469.2us
I20260811 16:07:29.676317 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.678232 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.679080 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.687558 14580 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:29.688042 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.689119 12383 raft_consensus.cc:2258] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:29.664669 23271 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:29.701942 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60482us
I20260811 16:07:29.705652 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.690165 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.711230 23615 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:29.713815 23615 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.730356 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.724251 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.724876 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.718961 13903 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260811 16:07:29.725550 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.721459 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.714984 23536 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:29.730417 23528 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.716487 23615 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.733073 23390 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.760344 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.733230 23414 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.723472 22621 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.723824 23577 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.759820 23647 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.762424 13901 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:29.797087 23647 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.796963 22621 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.763413 13908 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.764413 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.801931 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.802698 13824 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.753161 23329 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.804842 23329 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.771425 23536 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:29.771471 23390 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.819727 12383 tablet_replica.cc:330] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:29.821444 23390 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.776613 23441 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.823493 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.824597 13826 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 23: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:29.825551 23441 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.777981 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.779518 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.827045 22621 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.782019 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.788800 23607 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:29.791467 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 331248us
I20260811 16:07:29.830952 23414 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:29.793460 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63466.2us
I20260811 16:07:29.797004 23577 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.801780 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.772472 13818 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260811 16:07:29.765105 23368 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.808056 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.811628 23447 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.815466 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.817200 23536 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.822566 13906 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
W20260811 16:07:29.775496 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:29.841281 13818 pending_rounds.cc:76] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 13
I20260811 16:07:29.839855 12383 raft_consensus.cc:2229] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:29.846326 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173050us
I20260811 16:07:29.846398 13818 pending_rounds.cc:97] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260811 16:07:29.852203 23414 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.853596 23577 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.855336 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.858531 13818 raft_consensus.cc:2866] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:29.867065 23329 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.867944 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:29.869392 23606 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:29.869875 23606 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:29.870190 23606 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:29.874616 14541 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:29.876099 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.880788 12383 raft_consensus.cc:2258] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:29.883512 23583 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:29.871018 13817 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.847661 23447 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:29.901165 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68407.8us
W20260811 16:07:29.903982 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.904541 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:29.911471 23425 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.912257 23425 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.914631 23425 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.919222 23607 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:29.894743 23447 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:29.932142 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73144.8us
I20260811 16:07:29.933166 23414 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260811 16:07:29.931555 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:29.935354 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.937690 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.939471 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.881278 23606 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.120070 23606 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.945070 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:29.946283 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44183.4us
I20260811 16:07:29.942929 12383 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:29.931512 23647 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.947961 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.949270 13627 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 14, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 14 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:29.952315 23390 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260811 16:07:29.964673 13622 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 330) took 64462 ms (client timeout 15000 ms). Trace:
I20260811 16:07:29.975559 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.976368 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.977582 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.978328 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:29.974977 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.123600 12383 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:30.240021 23609 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.296276 22947 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:30.296787 22947 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:30.296420 23609 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.297740 22947 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.299098 22947 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:30.300343 23651 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:30.301453 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 323194us
I20260811 16:07:30.303115 23651 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:30.274461 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 302173us
I20260811 16:07:30.314075 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:30.299585 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 178250us
I20260811 16:07:30.323637 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.324877 23429 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:30.325924 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.326856 13820 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:07:30.334494 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 399191us
I20260811 16:07:30.337281 12383 pending_rounds.cc:62] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 3 pending ops.
I20260811 16:07:30.337559 23441 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:30.338004 12383 pending_rounds.cc:68] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 23 index: 20 } timestamp: 7317358372869898240 op_type: NO_OP noop_request { }
I20260811 16:07:30.338603 12383 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:30.339033 12383 pending_rounds.cc:68] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 21 index: 19 } timestamp: 7317358309818638336 op_type: NO_OP noop_request { }
I20260811 16:07:30.339478 23274 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.339490 12383 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:30.340263 12383 pending_rounds.cc:68] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 20 index: 18 } timestamp: 7317358282840498176 op_type: NO_OP noop_request { }
I20260811 16:07:30.340747 12383 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:30.341161 12383 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:30.326625 23429 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:30.343308 23429 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.347259 13871 leader_election.cc:398] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26.
I20260811 16:07:30.340287 23274 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.347863 13871 leader_election.cc:401] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:30.349886 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.350731 23274 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.352998 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.351058 23368 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:30.366556 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 411500us
I20260811 16:07:30.367642 23613 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:30.367903 23402 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26.
I20260811 16:07:30.374097 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:30.380872 14575 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:30.387004 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.389297 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.386322 23528 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.387754 13821 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:30.374977 23609 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:30.306746 13622 rpcz_store.cc:269] 0811 16:06:25.502616 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.507939 (+  5323us) service_pool.cc:227] Handling call
0811 16:07:29.964331 (+64456392us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:20.615327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:20.616503 (+  1176us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:20.616590 (+    87us) write_op.cc:435] Acquired schema lock
0811 16:07:20.616631 (+    41us) tablet.cc:660] Decoding operations
0811 16:07:20.617185 (+   554us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:20.617303 (+   118us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:20.617361 (+    58us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:07:20.617702 (+   341us) tablet.cc:699] Row locks acquired
0811 16:07:20.617743 (+    41us) write_op.cc:260] PREPARE: finished
0811 16:07:20.618005 (+   262us) write_op.cc:270] Start()
0811 16:07:20.618201 (+   196us) write_op.cc:276] Timestamp: P: 1786464440617906 usec, L: 0
0811 16:07:20.618247 (+    46us) op_driver.cc:331] REPLICATION: starting
0811 16:07:20.675346 (+ 57099us) log.cc:842] Serialized 536 byte log entry
0811 16:07:21.319658 (+644312us) op_driver.cc:444] REPLICATION: finished
0811 16:07:21.952906 (+633248us) write_op.cc:301] APPLY: starting
0811 16:07:22.089708 (+136802us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:22.250883 (+161175us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:22.251011 (+   128us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:22.251870 (+   859us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:22.252188 (+   318us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0811 16:07:22.252269 (+    81us) write_op.cc:312] APPLY: finished
0811 16:07:22.252532 (+   263us) log.cc:842] Serialized 25 byte log entry
0811 16:07:22.418299 (+165767us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:22.422847 (+  4548us) write_op.cc:454] Released schema lock
0811 16:07:22.431532 (+  8685us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:22.431927 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:22.431957 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":933646,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":525025,"apply.run_cpu_time_us":46356,"apply.run_wall_time_us":530642,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8299,"num_ops":1,"prepare.queue_time_us":112656,"prepare.run_cpu_time_us":82520,"prepare.run_wall_time_us":315766,"raft.queue_time_us":248235,"raft.run_cpu_time_us":11996,"raft.run_wall_time_us":456641,"replication_time_us":691204,"thread_start_us":657220,"threads_started":5,"wal-append.queue_time_us":460913,"wal-append.run_cpu_time_us":53879,"wal-append.run_wall_time_us":2174660}]]}
I20260811 16:07:30.400000 23651 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260811 16:07:30.401357 13622 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 329) took 18560 ms (client timeout 15000 ms). Trace:
I20260811 16:07:30.401736 23651 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:30.402346 23651 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:30.402187 13622 rpcz_store.cc:269] 0811 16:07:11.841000 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:30.400923 (+18559923us) service_pool.cc:214] Skipping call since client already timed out
0811 16:07:30.401221 (+   298us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260811 16:07:30.406805 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.408517 23528 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.410952 23609 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:30.430372 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.432878 23329 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:30.433100 23402 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:30.433368 23528 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:30.433648 23329 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:30.447557 23662 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
W20260811 16:07:30.449584 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84712.8us
I20260811 16:07:30.430048 23606 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:30.420018 23651 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.441865 23441 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:30.457805 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99329.6us
I20260811 16:07:30.433987 23402 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.446898 23329 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.444726 23609 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.463567 23651 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:30.477653 13825 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260811 16:07:30.453655 23606 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.470016 23368 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.479619 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 30 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.479430 13822 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260811 16:07:30.462608 23429 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.481484 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:30.476033 23441 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.486485 13817 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.500008 23368 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.504091 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.502559 12383 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:30.491648 23441 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.509778 23647 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:30.512176 13821 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260811 16:07:30.519025 23329 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.502353 23607 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.012s
I20260811 16:07:30.531586 23536 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
W20260811 16:07:30.533671 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62784us
I20260811 16:07:30.528620 23429 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.537083 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.536922 23414 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:30.538489 23128 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:30.538542 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.539981 12383 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:30.540783 12383 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:30.544684 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 214698us
I20260811 16:07:30.551887 23402 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.553859 23606 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.563800 23368 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.566637 23609 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.569324 12383 tablet_replica.cc:330] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:30.526028 23441 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.577286 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.576150 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.576735 12383 raft_consensus.cc:2229] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:07:30.575022 23128 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:30.588277 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49828.2us
I20260811 16:07:30.588261 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.592628 13817 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:30.575438 23647 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260811 16:07:30.599782 23128 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:30.607285 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.594483 13627 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:30.625557 23647 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:30.632002 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.635011 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:30.637285 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48119us
I20260811 16:07:30.644004 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.646028 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.646713 12383 raft_consensus.cc:2258] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:30.648458 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.650651 12383 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:30.652011 12383 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:07:30.655218 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:30.663830 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 162141us
W20260811 16:07:30.664889 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 106888us
W20260811 16:07:30.666555 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:30.673305 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 298063us
I20260811 16:07:30.673424 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.667095 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.675293 23565 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:30.682060 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.685559 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.687438 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.689086 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:30.690521 13821 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.690172 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:30.654253 23666 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:30.690168 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.696084 13825 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:30.699570 13824 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:07:30.696997 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:30.694787 23609 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:30.704047 23667 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.712234 13907 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260811 16:07:30.713585 23274 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.714259 23274 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.708112 23606 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:30.717058 23274 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.719933 12383 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:30.722506 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.723088 13905 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:07:30.726351 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.699097 23666 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.726861 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.727739 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.728935 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.729661 13902 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:30.723500 23667 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.728767 23671 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.008s
I20260811 16:07:30.719357 23606 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:30.735846 14575 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260811 16:07:30.729142 23666 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.745118 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.749199 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:30.749466 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.749949 13900 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.742997 23651 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:30.751606 13909 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260811 16:07:30.752684 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:30.753140 13909 pending_rounds.cc:76] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 15
I20260811 16:07:30.753479 13909 pending_rounds.cc:97] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260811 16:07:30.753506 13907 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.753837 13909 raft_consensus.cc:2866] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:30.755407 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.754274 13906 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:30.756927 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.758989 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.757565 13905 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:30.740375 23402 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.763721 23402 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:30.774188 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.774739 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.775666 23651 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:07:30.776268 14542 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:30.777341 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:07:30.779052 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52750.2us
W20260811 16:07:30.779815 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.780165 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.781068 13821 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
W20260811 16:07:30.781934 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78807.6us
I20260811 16:07:30.784255 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.790525 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.787850 23414 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260811 16:07:30.788185 23666 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:30.794629 23668 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:30.794903 23429 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:30.795254 23668 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.797189 23668 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:30.798516 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.791302 13905 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:30.801935 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:30.801270 23429 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:30.804652 23429 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:30.808343 23606 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.803279 23671 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:30.810468 23671 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:30.817816 13900 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:30.820609 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:30.826121 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46347.4us
I20260811 16:07:30.811035 23671 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:30.826941 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.827391 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:30.831012 13787 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.831650 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.836987 13906 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260811 16:07:30.835306 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:30.846487 23329 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.847352 23329 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.848728 13906 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260811 16:07:30.849560 23672 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.850019 23329 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:30.850382 13871 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.850138 23672 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.851393 23667 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:30.851706 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 30 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.852622 23672 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.860987 13907 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:30.864732 23329 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.865612 23329 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.833530 23609 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:30.880235 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.872190 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:30.892800 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.874358 23583 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:30.879432 23402 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:30.901899 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:30.902005 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:30.905933 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55581.8us
I20260811 16:07:30.908013 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.917788 14581 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:07:30.906826 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:30.939687 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.948138 23329 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.950788 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:30.952466 23402 raft_consensus.cc:2741] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260811 16:07:30.959298 23671 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:30.971618 23681 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:07:30.972249 23396 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.972841 23396 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.918834 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
W20260811 16:07:30.979585 13787 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.980160 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:30.993384 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:30.995899 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 89162.5us
W20260811 16:07:30.993511 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 215059us
W20260811 16:07:31.005829 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:30.993497 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 159078us
I20260811 16:07:30.977264 23672 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:07:31.000828 13787 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.993008 23441 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:31.013381 23396 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.028515 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Raft consensus shutting down.
W20260811 16:07:31.047286 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:31.054057 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:31.051752 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:31.059995 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.060902 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:31.062038 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.022646 23429 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.071874 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:07:31.057346 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:31.080470 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.082974 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:31.061058 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.089064 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.090181 23688 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:31.090747 23688 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.091171 23688 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:31.091373 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.092119 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:31.094946 23429 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.095481 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.085901 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:31.084070 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.107520 23420 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:31.108718 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.109666 23682 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:31.110101 23682 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:31.110562 23682 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:31.100925 23647 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:31.112991 23647 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:31.113391 23647 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:31.110744 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.144280 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.052780 23672 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.169298 23368 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:31.077297 23668 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.178135 14575 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:07:31.116899 23447 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
W20260811 16:07:31.142400 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:31.185662 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67805.6us
I20260811 16:07:31.110049 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:31.214794 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70610.2us
W20260811 16:07:31.226343 13617 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260811 16:07:31.236001 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.256247 23414 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260811 16:07:31.299464 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.311968 13905 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:31.222911 23668 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.224949 23368 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
W20260811 16:07:31.333170 23694 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260811 16:07:31.310706 23565 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:31.341463 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 238767us
W20260811 16:07:31.346935 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 105992us
I20260811 16:07:31.231343 23420 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260811 16:07:31.345911 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.352234 23672 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.354909 23672 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:31.358441 23688 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.361649 12383 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:31.402498 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.408373 23274 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.412528 23274 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:31.416972 12383 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:31.417845 12383 pending_rounds.cc:62] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 2 pending ops.
I20260811 16:07:31.418128 12383 pending_rounds.cc:68] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 15 index: 12 } timestamp: 7317358359953182720 op_type: NO_OP noop_request { }
W20260811 16:07:31.418278 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85401.2us
I20260811 16:07:31.418531 12383 raft_consensus.cc:2866] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:31.419180 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.420121 23329 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:31.421684 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:31.418859 12383 pending_rounds.cc:68] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 13 index: 11 } timestamp: 7317358323633618944 op_type: NO_OP noop_request { }
I20260811 16:07:31.422657 23528 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:31.423516 23528 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.423905 23528 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:31.426937 23688 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.353107 23565 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.428937 12383 raft_consensus.cc:2866] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:31.433128 12383 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:31.435650 23565 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.447325 23710 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.448028 23710 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.449743 23274 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.445673 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.461133 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.471845 13900 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260811 16:07:31.473251 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.464640 23329 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:31.476543 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.477272 13907 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:31.479583 23447 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:31.480324 23447 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.465842 23710 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.470964 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.482889 23414 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:31.483407 23414 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:31.483632 23565 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.484870 23447 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.484546 23565 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:31.485616 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:31.486048 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:31.487077 23606 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:31.484542 23414 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.491070 23565 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:31.494181 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:31.495700 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54600.2us
I20260811 16:07:31.496587 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.497612 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.497674 22947 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:31.498715 22947 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:31.501751 23682 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.503115 13907 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:31.503499 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.511552 23606 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:31.512212 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.450837 23647 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:31.513783 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.511615 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:31.515307 23647 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.514932 23651 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:31.516582 23651 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:31.518410 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51313.6us
I20260811 16:07:31.517930 23651 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.523268 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.504830 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.526345 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.527349 22947 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:31.528002 22947 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:31.528512 22947 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:31.529707 22947 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.531704 23414 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:31.531543 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.539976 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.501753 23528 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:31.548254 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 325513us
W20260811 16:07:31.559533 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:31.560532 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:31.560941 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:31.571619 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.562964 14542 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:31.573628 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.579722 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.580088 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.589131 13822 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 22
W20260811 16:07:31.572816 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:31.596345 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:31.600747 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 201985us
I20260811 16:07:31.601866 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.548642 23682 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.629940 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.572309 23606 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:31.637477 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.595712 23607 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:31.651176 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.658349 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.661835 14575 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:31.644568 12383 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
W20260811 16:07:31.687132 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113370us
I20260811 16:07:31.697118 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.649202 23703 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:31.688113 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:31.703735 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45545.9us
I20260811 16:07:31.704586 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.712985 13902 raft_consensus.cc:2354] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:31.714022 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:31.715624 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 120140us
I20260811 16:07:31.716785 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.728595 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:31.724104 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.737552 13900 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260811 16:07:31.718133 23420 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:31.765798 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.742765 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:31.799623 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82893.2us
W20260811 16:07:31.817401 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 180490us
W20260811 16:07:31.801182 23723 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260811 16:07:31.798748 23565 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:31.836015 23528 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.840219 23718 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.839752 23709 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260811 16:07:31.799798 23128 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.859253 23128 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.859594 23718 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:31.862116 23718 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.845309 12383 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:31.845551 23679 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.079s	user 0.000s	sys 0.007s
I20260811 16:07:31.870762 12383 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:31.876750 23565 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:31.861954 23128 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.884021 12383 tablet_replica.cc:330] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:31.886658 12383 raft_consensus.cc:2229] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:07:31.887796 23565 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:31.921530 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 254568us
I20260811 16:07:31.930552 12383 raft_consensus.cc:2258] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:31.898072 14541 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 146 similar messages]
W20260811 16:07:31.938710 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.939006 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.828665 23720 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.097s
I20260811 16:07:31.943267 14573 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
W20260811 16:07:31.943104 23719 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.266s	user 0.000s	sys 0.005s
I20260811 16:07:31.949759 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:31.955192 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78929.7us
W20260811 16:07:31.959133 23727 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.202s	user 0.000s	sys 0.002s
I20260811 16:07:31.958945 23441 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:31.971849 13822 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:31.951401 23420 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:31.985348 23420 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:31.986297 23729 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260811 16:07:31.987766 23420 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.982812 23703 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:31.990012 23441 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.990589 23441 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Advancing to term 27
W20260811 16:07:31.998952 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48412.4us
W20260811 16:07:32.060451 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84995.2us
W20260811 16:07:32.081606 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 125271us
W20260811 16:07:32.107849 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.099457 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 110970us
I20260811 16:07:31.971128 23682 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:32.096897 23741 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
W20260811 16:07:32.112264 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 371820us
I20260811 16:07:32.112787 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.118620 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.125561 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.130992 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.133347 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.136014 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.123616 12383 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.141397 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:32.141764 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.142264 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.142894 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.167538 13909 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:32.177122 13826 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260811 16:07:32.177273 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.177884 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.154136 23720 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:32.183949 23740 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.116415 23274 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260811 16:07:32.160437 23672 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.189425 23718 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:32.190565 23718 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:32.160905 23607 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:32.192492 23274 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:32.192945 23274 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:32.193956 23274 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.198729 23746 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:32.199680 12383 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:07:32.201128 12383 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.190902 23718 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:32.218657 13822 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260811 16:07:32.121708 23682 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.227525 13824 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260811 16:07:32.233223 23682 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.190982 23441 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:32.237187 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59957.3us
I20260811 16:07:32.228206 23528 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:32.241158 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.241499 13909 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260811 16:07:32.241677 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.241868 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 103542us
I20260811 16:07:32.240135 23738 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:32.244557 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.248723 13824 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260811 16:07:32.250622 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:32.243422 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:32.274448 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.266178 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.282059 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.283435 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.263281 22947 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:32.267879 23746 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.275130 23441 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.252012 23682 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
W20260811 16:07:32.304097 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55931us
I20260811 16:07:32.254166 23738 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.295089 23703 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.280329 23720 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260811 16:07:32.310683 12383 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.277297 23739 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260811 16:07:32.317167 23738 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.317783 13823 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:32.304821 23746 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.319595 13906 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:32.323361 23685 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260811 16:07:32.324241 23716 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.330000 23732 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:32.312098 23708 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:32.295395 23707 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260811 16:07:32.308032 23420 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.370780 23420 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.373180 23420 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.374146 23746 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:32.375401 23274 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:32.375986 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:32.376447 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 100178us
W20260811 16:07:32.377101 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:32.377663 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.378331 12383 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:32.378765 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.378981 12383 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.380115 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.382618 12383 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.382994 23703 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:32.366675 23732 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:32.386051 23732 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.387318 23732 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:32.391501 23709 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.392119 23709 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.393232 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.394207 23739 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.394479 23709 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:32.395881 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.396409 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.398388 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.398926 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:32.400759 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129346us
I20260811 16:07:32.416031 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.297362 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 3.244s	user 0.150s	sys 0.093s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":27564,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":437833,"dirs.run_cpu_time_us":910,"dirs.run_wall_time_us":42702,"lbm_read_time_us":42698,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":23,"lbm_write_time_us":5763,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":10,"reinsert_count":0,"thread_start_us":320580,"threads_started":2,"update_count":241}
I20260811 16:07:32.395242 23718 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.428023 23718 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:32.428844 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:32.429505 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
W20260811 16:07:32.414824 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:32.431701 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.432116 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.433451 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.433956 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.438472 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.443292 13820 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 26. Current term is 27. Ops: []
I20260811 16:07:32.445240 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260811 16:07:32.446938 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.447644 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.448655 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150300us
W20260811 16:07:32.432126 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.456741 12383 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:32.453018 23536 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260811 16:07:32.459771 23536 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 LEADER]: Stepping down as leader of term 26
I20260811 16:07:32.459793 23744 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.460263 23536 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:32.421005 23734 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:32.458578 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.468518 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.468999 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.470969 23744 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:32.456801 23739 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:32.477155 12383 pending_rounds.cc:62] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:32.477445 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.478408 23739 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:32.479089 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.480135 23671 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.480615 23609 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.480671 23671 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.482268 13789 leader_election.cc:398] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:32.482615 13789 leader_election.cc:401] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:32.477550 12383 pending_rounds.cc:68] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 23 index: 17 } timestamp: 7317358331455651840 op_type: NO_OP noop_request { }
I20260811 16:07:32.484050 12383 raft_consensus.cc:2866] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:32.484452 12383 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.449256 23703 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:32.488306 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.453702 23714 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:32.490542 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58440.4us
I20260811 16:07:32.496891 14581 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260811 16:07:32.489112 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:32.504490 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.512642 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:32.517768 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.518033 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:32.520509 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.525465 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.527384 23565 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260811 16:07:32.535557 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.515025 23671 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:32.507659 23734 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.539606 23734 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.512512 23703 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.541977 23734 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.536602 14575 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:32.543915 13908 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:32.545665 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:32.546007 14575 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:32.461280 23536 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:32.549845 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.550357 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.550482 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.554591 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.555064 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.556224 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.556629 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.559679 13821 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260811 16:07:32.561349 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.561733 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.562310 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.553463 23651 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:32.564539 23402 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.549438 23734 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260811 16:07:32.587535 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.588660 23651 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.594549 23651 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:32.572150 23420 consensus_queue.cc:1159] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" responder_term: 26 status { last_received { term: 26 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 26 index: 15 } }
I20260811 16:07:32.604436 23738 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.605104 23738 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.572683 23714 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.613933 23705 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:32.616256 23685 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:32.616825 23685 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.627391 23536 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:32.577948 23732 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:32.632871 23732 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.633352 23732 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:32.578397 23739 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:32.646610 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57973.4us
W20260811 16:07:32.662952 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.671275 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 115065us
W20260811 16:07:32.671943 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.672302 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.665133 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:32.673362 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.678056 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.679065 23714 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:32.680058 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:32.655905 23703 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.670485 23609 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:32.664244 23447 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:07:32.688485 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.708171 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:32.706488 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 142789us
I20260811 16:07:32.697161 12383 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.711814 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.705338 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.709177 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:32.682034 23528 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:32.712677 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:32.727280 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:32.730494 23731 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:32.731029 23731 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:32.731426 23731 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:32.732610 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.693560 23738 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.691286 23703 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.740526 23703 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.741593 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.743441 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.744191 14581 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:32.746803 23731 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.700766 23447 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:32.754971 13627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 312) took 53969 ms (client timeout 15000 ms). Trace:
W20260811 16:07:32.755596 13627 rpcz_store.cc:269] 0811 16:06:38.797493 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:38.886808 (+ 89315us) service_pool.cc:227] Handling call
0811 16:07:32.754894 (+53868086us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:30.665738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:30.666566 (+   828us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:30.666633 (+    67us) write_op.cc:435] Acquired schema lock
0811 16:07:30.666659 (+    26us) tablet.cc:660] Decoding operations
0811 16:07:30.691873 (+ 25214us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:30.702179 (+ 10306us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:30.709942 (+  7763us) tablet.cc:683] Acquiring locks for 2 operations
0811 16:07:30.763816 (+ 53874us) tablet.cc:699] Row locks acquired
0811 16:07:30.763854 (+    38us) write_op.cc:260] PREPARE: finished
0811 16:07:30.764141 (+   287us) write_op.cc:270] Start()
0811 16:07:30.764296 (+   155us) write_op.cc:276] Timestamp: P: 1786464450764028 usec, L: 0
0811 16:07:30.764341 (+    45us) op_driver.cc:331] REPLICATION: starting
0811 16:07:30.765171 (+   830us) log.cc:842] Serialized 987 byte log entry
0811 16:07:31.341099 (+575928us) op_driver.cc:444] REPLICATION: finished
0811 16:07:31.715640 (+374541us) write_op.cc:301] APPLY: starting
0811 16:07:31.727017 (+ 11377us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:31.945855 (+218838us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:31.979180 (+ 33325us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:32.363459 (+384279us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b1800362140. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c516d70dc 00007f5c516fba5a 00007f5c516fb347 00007f5c516fb2e0 00007f5c516da7b8 00007f5c5533bf9b 00007f5c55380774 00007f5c5523408a 00007f5c552369db
0811 16:07:32.364378 (+   919us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:32.364713 (+   335us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0811 16:07:32.364778 (+    65us) write_op.cc:312] APPLY: finished
0811 16:07:32.365104 (+   326us) log.cc:842] Serialized 33 byte log entry
0811 16:07:32.559039 (+193935us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:32.570505 (+ 11466us) write_op.cc:454] Released schema lock
0811 16:07:32.584062 (+ 13557us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:32.590000 (+  5938us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:32.590030 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8166,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":260854,"apply.run_cpu_time_us":47730,"apply.run_wall_time_us":895050,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"cfile_init":1,"lbm_read_time_us":46099,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"num_ops":2,"prepare.queue_time_us":16129,"prepare.run_cpu_time_us":97775,"prepare.run_wall_time_us":391705,"raft.queue_time_us":205029,"raft.run_cpu_time_us":15025,"raft.run_wall_time_us":293126,"replication_time_us":572067,"spinlock_wait_cycles":10052864,"thread_start_us":730199,"threads_started":5,"wal-append.queue_time_us":512459,"wal-append.run_cpu_time_us":83635,"wal-append.run_wall_time_us":1145642}]]}
I20260811 16:07:32.724951 23746 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260811 16:07:32.764705 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76250.7us
W20260811 16:07:32.766269 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.729086 12383 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:32.771811 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.777503 13903 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:32.781510 12383 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.787433 23447 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.774192 23685 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.796449 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.796798 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.767725 23672 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:32.801957 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.803550 23607 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:32.764212 23746 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.806057 23746 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:32.805449 23732 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.807194 12383 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.808212 12383 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Raft consensus shutting down.
W20260811 16:07:32.809048 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.811235 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.812335 23722 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:32.810631 23732 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.813054 23651 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.815780 23651 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.819494 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:32.820355 13823 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:32.827592 12383 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.886103 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:32.886997 14573 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 24: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:32.889029 23731 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:32.899541 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.900220 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.912233 23775 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260811 16:07:32.915282 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52899.7us
W20260811 16:07:32.918776 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:32.926198 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.926815 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.926729 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.927330 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.934803 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.931857 23441 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.936354 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:32.937008 14573 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:32.924422 23720 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.910642 23746 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.944578 23709 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:32.937718 23736 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.967643 23709 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:32.971282 13626 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 18, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 18 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:32.982081 23711 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.965716 23743 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:33.005209 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.992122 23709 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.013273 13626 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.006964 12383 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.027518 12383 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.028209 12383 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.993852 23736 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:33.050971 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.064241 12383 tablet_replica.cc:330] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.065464 12383 raft_consensus.cc:2229] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.066223 12383 raft_consensus.cc:2258] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.073856 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122858us
I20260811 16:07:33.088125 14573 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:33.017565 23743 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:33.098600 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 151502us
I20260811 16:07:33.101783 13626 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 18, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.113713 13626 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.123266 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.133513 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.135514 23746 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.126814 23749 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:33.147085 23749 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:33.151504 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:33.156728 13905 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:33.152660 23743 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.153084 23736 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.148126 23749 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.167936 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.168218 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.168735 13904 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:33.182711 13905 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:33.190264 23709 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.131243 13626 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:33.194514 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.195395 13626 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 20 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.198443 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:33.199251 13825 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.199798 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:33.200601 14573 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.199103 23709 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.202889 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.206377 13626 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.208724 12383 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.209888 12383 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.210004 14573 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:33.210825 12383 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.215941 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:33.216759 13905 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.217108 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:33.218472 23736 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:33.219094 23736 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:33.220045 23736 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:33.210049 13626 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:33.226564 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.230376 12383 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.226138 13626 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 16, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 16 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.212472 13825 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:33.241572 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:33.245432 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.244311 13626 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.247285 14573 raft_consensus.cc:2354] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
W20260811 16:07:33.245047 13709 raft_consensus.cc:2670] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 16:07:33.249228 13905 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:33.250250 12383 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:33.250960 13787 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:33.252038 13787 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.252480 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.253227 23743 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:33.255406 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:33.264984 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:33.255527 13626 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 20, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.271193 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:33.272739 13626 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 24, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 24 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.274631 13626 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.276086 13626 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.277561 13626 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 17, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.279346 13626 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 9, term changed from 13 to 14, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194), NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 14 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:33.281737 13626 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:33.282943 12383 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.285009 13787 leader_election.cc:398] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:33.285378 13787 leader_election.cc:401] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:33.286463 23749 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:33.287652 13626 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.289407 13626 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.290146 12383 tablet_replica.cc:330] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.290985 13626 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.301831 12383 raft_consensus.cc:2229] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.303174 12383 raft_consensus.cc:2258] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.306555 12383 tablet_replica.cc:330] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.340216 12383 raft_consensus.cc:2229] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.344417 12383 raft_consensus.cc:2258] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.360180 23706 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.361053 23706 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.364203 12383 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
W20260811 16:07:33.368278 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:33.371007 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.373490 23706 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.373706 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.375003 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:33.375944 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:33.377008 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.378135 12383 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.379618 12383 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.379846 23706 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:33.383056 12383 tablet_replica.cc:330] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.384274 12383 raft_consensus.cc:2229] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.385174 12383 raft_consensus.cc:2258] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.388527 12383 tablet_replica.cc:330] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.389927 12383 raft_consensus.cc:2229] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.391337 12383 raft_consensus.cc:2258] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.394629 12383 tablet_replica.cc:330] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.395267 23706 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.395578 12383 raft_consensus.cc:2229] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.395889 23706 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.396412 12383 raft_consensus.cc:2258] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.400069 12383 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.401114 12383 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.401698 12383 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.403272 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.404804 12383 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.406108 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.407959 13904 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:33.409152 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.409327 12383 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.410046 23779 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:33.410526 23779 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:33.410887 23779 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:33.410178 23706 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.421710 12383 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.422753 23779 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:33.430635 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.431951 23779 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.432934 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:33.433645 13906 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 24
I20260811 16:07:33.433774 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.435525 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.438443 12383 pending_rounds.cc:62] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.438918 12383 pending_rounds.cc:68] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 23 index: 12 } timestamp: 7317358372857696256 op_type: NO_OP noop_request { }
I20260811 16:07:33.439939 12383 raft_consensus.cc:2866] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.440877 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.449208 13906 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:33.455051 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.459967 23779 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:33.467739 23779 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:33.467883 12383 tablet_replica.cc:330] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.469192 12383 raft_consensus.cc:2229] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.468837 23779 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.473444 12383 pending_rounds.cc:62] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.476248 12383 pending_rounds.cc:68] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 20 index: 12 } timestamp: 7317358329102389248 op_type: NO_OP noop_request { }
I20260811 16:07:33.477357 12383 raft_consensus.cc:2866] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.477754 12383 raft_consensus.cc:2258] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.485572 23739 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.488729 23739 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.493208 23739 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.494397 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.495187 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:33.495267 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:33.507920 12383 tablet_replica.cc:330] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.509197 12383 raft_consensus.cc:2229] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.511937 12383 pending_rounds.cc:62] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
W20260811 16:07:33.512748 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:33.512625 12383 pending_rounds.cc:68] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 22 index: 11 } timestamp: 7317358300924674048 op_type: NO_OP noop_request { }
I20260811 16:07:33.516088 12383 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.516417 12383 raft_consensus.cc:2258] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.522094 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.522683 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.523636 23722 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:33.579397 12383 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.581334 12383 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.582074 12383 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.605083 23368 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.605685 23368 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.607990 23368 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.609350 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.610273 13906 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 24: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:33.611528 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.613569 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:33.615398 23368 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:33.629102 12383 tablet_replica.cc:330] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.642714 12383 raft_consensus.cc:2229] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.647708 13906 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260811 16:07:33.657851 12383 pending_rounds.cc:62] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.658349 12383 pending_rounds.cc:68] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 17 index: 11 } timestamp: 7317358291718115328 op_type: NO_OP noop_request { }
I20260811 16:07:33.659032 12383 raft_consensus.cc:2866] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.659498 12383 raft_consensus.cc:2258] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.658303 23709 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.657982 23746 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.662837 23447 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.669152 23709 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:33.670733 23447 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.670974 23746 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.676810 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.659510 23736 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.010s
I20260811 16:07:33.678499 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:33.679229 23368 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:33.682204 14541 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.683641 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:33.674925 23709 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:33.685312 13626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 313) took 24601 ms (client timeout 15000 ms). Trace:
I20260811 16:07:33.680397 23447 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.698671 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.699486 13906 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:33.698930 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:33.703370 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.706105 23781 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:33.686653 13626 rpcz_store.cc:269] 0811 16:07:09.077019 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.077639 (+   620us) service_pool.cc:227] Handling call
0811 16:07:33.678035 (+24600396us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:33.365942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:33.366582 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:33.366632 (+    50us) write_op.cc:435] Acquired schema lock
0811 16:07:33.366654 (+    22us) tablet.cc:660] Decoding operations
0811 16:07:33.387238 (+ 20584us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:33.387333 (+    95us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:33.387360 (+    27us) tablet.cc:683] Acquiring locks for 22 operations
0811 16:07:33.410979 (+ 23619us) tablet.cc:699] Row locks acquired
0811 16:07:33.411001 (+    22us) write_op.cc:260] PREPARE: finished
0811 16:07:33.411191 (+   190us) write_op.cc:270] Start()
0811 16:07:33.411324 (+   133us) write_op.cc:276] Timestamp: P: 1786464453411103 usec, L: 0
0811 16:07:33.411342 (+    18us) op_driver.cc:331] REPLICATION: starting
0811 16:07:33.412077 (+   735us) log.cc:842] Serialized 8752 byte log entry
0811 16:07:33.441081 (+ 29004us) op_driver.cc:444] REPLICATION: finished
0811 16:07:33.456932 (+ 15851us) write_op.cc:301] APPLY: starting
0811 16:07:33.457025 (+    93us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:33.526131 (+ 69106us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:33.528011 (+  1880us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:33.577538 (+ 49527us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:33.577934 (+   396us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0811 16:07:33.577989 (+    55us) write_op.cc:312] APPLY: finished
0811 16:07:33.578415 (+   426us) log.cc:842] Serialized 196 byte log entry
0811 16:07:33.583325 (+  4910us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:33.583575 (+   250us) write_op.cc:454] Released schema lock
0811 16:07:33.583648 (+    73us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:33.639789 (+ 56141us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:33.641528 (+  1739us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19642,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":15541,"apply.run_cpu_time_us":27334,"apply.run_wall_time_us":196643,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95911,"num_ops":22,"prepare.queue_time_us":59092,"prepare.run_cpu_time_us":6380,"prepare.run_wall_time_us":48196,"replication_time_us":29623,"spinlock_wait_cycles":74752,"thread_start_us":66361,"threads_started":2}]]}
I20260811 16:07:33.692135 23709 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:33.748376 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.749776 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.758100 23746 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.750905 12383 pending_rounds.cc:62] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.760187 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.780772 13906 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:33.763367 12383 pending_rounds.cc:68] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 25 index: 14 } timestamp: 7317358321825345536 op_type: NO_OP noop_request { }
I20260811 16:07:33.782517 12383 raft_consensus.cc:2866] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.783206 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.776903 13621 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.799098 13621 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:33.825420 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:33.833096 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.817379 13621 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:33.848892 23706 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.849650 23706 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.852017 23706 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:33.863040 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:33.845384 13621 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 10 to 25. New cstate: current_term: 25 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:07:33.865162 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:33.866287 13621 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.869242 23781 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:07:33.877965 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43799.9us
W20260811 16:07:33.883378 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73312.5us
W20260811 16:07:33.883616 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:33.886870 12383 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.926074 13621 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 17 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:33.927901 12383 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.938535 12383 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.913743 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:33.965195 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 167646us
I20260811 16:07:33.953095 23794 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.955772 23781 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.973999 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:33.979343 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:33.966452 23743 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.990868 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.991683 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:33.997298 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:33.978641 23794 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.009830 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:34.012125 13906 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260811 16:07:34.014382 14575 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260811 16:07:33.989087 23743 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.987350 23781 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.018833 23705 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260811 16:07:34.024797 23743 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.025679 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.020161 23368 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.027808 23368 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.033655 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.013500 23793 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.034896 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.036543 13825 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 27.
I20260811 16:07:34.039176 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.041285 23739 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:34.052570 23794 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.055315 23781 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.056041 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.042929 12383 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.059942 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.065699 12383 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.066956 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.046687 23739 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.070168 23746 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:34.070380 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.070699 23746 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.071228 23746 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.071542 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.072403 13824 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 27: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.073066 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.073875 14583 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:34.074636 23736 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:34.076573 13621 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 19 to 21, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.078598 13905 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:34.082245 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.084296 23798 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:34.035846 23793 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.085144 23739 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.085179 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:34.086144 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:34.086997 23739 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.087743 23793 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.088982 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.089462 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.089696 14573 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:07:34.090178 14575 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.075256 13820 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:34.078444 13621 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.094414 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.096525 13820 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 27: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.096339 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:34.095103 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.100123 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:34.109097 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.110456 12383 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.102208 23794 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.112848 23794 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.113252 23794 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.113842 13621 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.104195 23368 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.109882 14575 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:34.102782 23709 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260811 16:07:34.120453 23709 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.120859 23709 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.132536 23781 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Advancing to term 27
W20260811 16:07:34.140797 13871 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.141368 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.142028 23781 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:34.142287 23792 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:34.148662 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:34.149569 23743 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.150599 12383 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.150188 23743 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.151553 12383 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.152191 12383 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.152690 23743 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:34.153347 14541 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.155040 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.156399 23796 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.156919 23796 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.157274 23796 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.159602 23731 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.160219 23731 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.166780 23731 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.171641 23746 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.175547 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.176404 14583 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.177332 23746 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.180392 23709 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.184624 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.185369 13820 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.188143 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.188761 13906 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.189996 23739 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:34.190917 23792 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:34.195591 13820 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 28.
I20260811 16:07:34.187855 23794 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.197574 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.198483 13908 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.198640 13906 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.200421 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:34.201426 23731 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.201951 23731 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.202564 23731 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.201948 23794 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.198566 23796 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.208817 23796 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.216995 23792 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:34.218789 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.222436 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.224229 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.195494 12383 tablet_replica.cc:330] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.227697 13825 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.228799 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:34.221707 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:34.232074 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:34.231993 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.232879 14583 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.233331 13908 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.236034 12383 raft_consensus.cc:2229] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.237270 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.238155 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.242909 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:34.250284 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.250885 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.251606 14574 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.258070 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.244261 23796 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.259776 12383 raft_consensus.cc:2258] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.260746 14581 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:34.265844 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:34.264518 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.264144 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 28.
I20260811 16:07:34.251959 23709 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.219563 23792 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.303942 23746 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:34.307463 23731 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.310461 23731 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.316082 12383 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.318177 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.321884 13906 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.324908 23368 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.325523 23368 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.329685 23792 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.330077 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.330821 23368 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.332393 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:34.334177 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.335490 12383 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.337978 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:34.262954 23796 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.339386 23796 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:34.339802 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.338303 12383 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.340718 23709 raft_consensus.cc:2684] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Received pre-election callback for term 19 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 16:07:34.340209 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:34.343993 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:34.344866 23746 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:34.345784 23746 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.346638 23746 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.354257 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.356356 13908 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:34.356644 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.360376 14583 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.374064 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.374233 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 28.
I20260811 16:07:34.376245 13706 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:34.376906 13706 raft_consensus.cc:2670] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 16:07:34.377615 12383 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.378619 12383 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:34.389665 23796 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.391718 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 125955us
I20260811 16:07:34.394344 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.394423 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:34.395030 13821 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:34.397001 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.399201 23705 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:34.399797 23705 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:34.400667 23705 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.408531 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.413913 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.416690 23736 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:34.417083 23812 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:34.419775 23812 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.420166 23812 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:34.422268 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.423918 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.425796 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.430869 12383 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.425192 23736 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.449334 23736 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.443637 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.507932 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:34.513089 23815 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260811 16:07:34.519443 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.529707 23812 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.532455 23812 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:34.537017 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.538395 23796 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.539965 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.544466 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.545377 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.549252 12383 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.544442 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.551491 13817 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.550870 12383 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:07:34.555423 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.556144 14574 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.558018 12383 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.561352 12383 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.562206 12383 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:34.563366 12383 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.566649 12383 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.570583 12383 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.571439 12383 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.578464 23706 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.579164 23706 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.580806 14574 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:34.593523 23706 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:34.614670 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:34.617122 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:34.618577 23792 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.619275 23792 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.622015 23792 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.622938 23706 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.623571 23706 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.625680 23706 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.628499 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.598609 13817 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:34.599489 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:34.636154 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.638165 23736 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:34.638830 23736 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.639922 23736 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.600205 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:34.603101 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.644659 13821 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:34.646242 23779 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.646939 23779 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.651243 23779 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.654884 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.659790 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.669315 23706 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.669898 23706 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.670248 23706 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.672245 23736 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.672909 23736 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.669380 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:07:34.675565 23736 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.675217 23792 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.676971 23792 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.679527 23792 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.679419 23706 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.696877 23706 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:34.700286 13621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 217) took 25149 ms (client timeout 15000 ms). Trace:
I20260811 16:07:34.691273 23818 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.729429 23818 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.732077 23818 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.673484 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:34.694769 14541 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.688072 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50516.1us
I20260811 16:07:34.702394 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:34.708055 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.721434 13620 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 16 to 17, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:34.736968 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:34.737715 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.738052 13817 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.738657 23706 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:34.738886 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44164us
W20260811 16:07:34.741354 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.733178 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59793.5us
I20260811 16:07:34.742170 23793 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.742727 23793 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.743643 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.744299 13904 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:34.745838 23793 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.746656 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.747447 23812 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.747848 23812 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.748013 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.747470 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.749634 13820 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:34.748265 23812 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.750216 23779 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.750658 23779 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.751065 23779 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:34.729305 13621 rpcz_store.cc:269] 0811 16:07:09.550982 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:10.047305 (+496323us) service_pool.cc:227] Handling call
0811 16:07:34.700195 (+24652890us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:34.343979 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:34.344509 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:34.344543 (+    34us) write_op.cc:435] Acquired schema lock
0811 16:07:34.344559 (+    16us) tablet.cc:660] Decoding operations
0811 16:07:34.345506 (+   947us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:34.345596 (+    90us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:34.345634 (+    38us) tablet.cc:683] Acquiring locks for 9 operations
0811 16:07:34.346361 (+   727us) tablet.cc:699] Row locks acquired
0811 16:07:34.346381 (+    20us) write_op.cc:260] PREPARE: finished
0811 16:07:34.346524 (+   143us) write_op.cc:270] Start()
0811 16:07:34.346658 (+   134us) write_op.cc:276] Timestamp: P: 1786464454346476 usec, L: 0
0811 16:07:34.346679 (+    21us) op_driver.cc:331] REPLICATION: starting
0811 16:07:34.371232 (+ 24553us) log.cc:842] Serialized 3664 byte log entry
0811 16:07:34.420043 (+ 48811us) op_driver.cc:444] REPLICATION: finished
0811 16:07:34.445918 (+ 25875us) write_op.cc:301] APPLY: starting
0811 16:07:34.446014 (+    96us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:34.559383 (+113369us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:34.559521 (+   138us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:34.585029 (+ 25508us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:34.595381 (+ 10352us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0811 16:07:34.595450 (+    69us) write_op.cc:312] APPLY: finished
0811 16:07:34.595793 (+   343us) log.cc:842] Serialized 89 byte log entry
0811 16:07:34.599219 (+  3426us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.599405 (+   186us) write_op.cc:454] Released schema lock
0811 16:07:34.599453 (+    48us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:34.622781 (+ 23328us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.622824 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":776,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":25558,"apply.run_cpu_time_us":15078,"apply.run_wall_time_us":177339,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41675,"num_ops":9,"prepare.queue_time_us":148310,"prepare.run_cpu_time_us":3867,"prepare.run_wall_time_us":27636,"replication_time_us":73247,"thread_start_us":144237,"threads_started":2}]]}
W20260811 16:07:34.754482 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.733779 23792 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:34.758033 13620 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 21, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.758831 23792 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:34.760457 13817 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 25.
I20260811 16:07:34.760021 23792 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.760216 13620 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 18 to 22, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.761560 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.764120 23794 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:34.764708 23794 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:34.765679 23794 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.770392 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.771126 14575 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:34.771045 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.771837 13906 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
W20260811 16:07:34.774397 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.778630 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:34.778926 13620 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.783699 23818 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:34.785454 23812 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.786929 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.801559 23818 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.802184 23818 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:34.802667 23736 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:34.802876 23812 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.803122 23736 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.803649 23736 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:34.810014 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:34.813508 23736 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.782634 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:34.795816 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.802246 13620 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:34.817781 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.818109 13620 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.819723 23812 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:34.820206 23812 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.820613 23812 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:34.819917 13620 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.821820 13620 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:34.826151 23821 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.826779 23821 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.827303 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.828955 23821 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.829173 23796 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.829710 23796 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.831509 23736 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.831841 23796 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.789696 23779 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.834220 23779 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:34.836236 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.841187 13620 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.845862 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.848132 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.850255 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:34.854763 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.856534 13906 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 25: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:34.856913 13904 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:34.857872 13620 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:34.860719 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.861631 14575 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 25: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:34.865283 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.865965 14575 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
W20260811 16:07:34.866492 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.869340 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.869783 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.883597 23821 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:34.887253 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.887953 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.888202 23792 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.888675 23792 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.889003 23731 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:34.889108 23792 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.889528 23731 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.889979 23731 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:34.887454 13908 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260811 16:07:34.896210 23796 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:07:34.897083 23818 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.898324 13905 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 23: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:34.901571 23731 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.904412 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.908772 23796 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:34.879442 23812 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.909374 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.909870 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.910601 23821 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:34.910738 23812 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:34.910980 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.915944 23731 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.925823 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.926518 13908 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:34.930184 23792 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.937198 23818 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.940717 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.946779 13817 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.949972 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:34.950975 13904 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:34.961687 23812 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:34.964757 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.966230 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:34.965174 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.967687 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:34.967587 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.968770 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.972527 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.973167 14575 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:34.975469 23731 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:34.987221 23705 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:34.988672 23736 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:34.996069 23792 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.996196 23731 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.997524 23731 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.968235 23812 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.005116 23812 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.975215 23818 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:35.006814 13820 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:35.007869 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:35.008522 13821 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:35.009688 23706 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:35.012701 13904 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:35.014536 23706 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:35.028563 13620 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 332) took 23324 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.029124 13620 rpcz_store.cc:269] 0811 16:07:11.704239 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:20.684758 (+8980519us) service_pool.cc:227] Handling call
0811 16:07:22.287590 (+1602832us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54000311d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c57866d6c 00007f5c57960c3e 00007f5c55c72fb4 00007f5c55c72f42 00007f5c55c72e71 00007f5c55c72dec 00007f5c55c720a2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:35.016689 (+12729099us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:34.870851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:34.871405 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:34.871456 (+    51us) write_op.cc:435] Acquired schema lock
0811 16:07:34.871474 (+    18us) tablet.cc:660] Decoding operations
0811 16:07:34.872462 (+   988us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:34.872522 (+    60us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:34.872558 (+    36us) tablet.cc:683] Acquiring locks for 10 operations
0811 16:07:34.873401 (+   843us) tablet.cc:699] Row locks acquired
0811 16:07:34.873416 (+    15us) write_op.cc:260] PREPARE: finished
0811 16:07:34.873573 (+   157us) write_op.cc:270] Start()
0811 16:07:34.873690 (+   117us) write_op.cc:276] Timestamp: P: 1786464454873522 usec, L: 0
0811 16:07:34.873709 (+    19us) op_driver.cc:331] REPLICATION: starting
0811 16:07:34.874406 (+   697us) log.cc:842] Serialized 4004 byte log entry
0811 16:07:34.878364 (+  3958us) op_driver.cc:444] REPLICATION: finished
0811 16:07:34.881173 (+  2809us) write_op.cc:301] APPLY: starting
0811 16:07:34.881280 (+   107us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:34.886585 (+  5305us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:34.886710 (+   125us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:34.910296 (+ 23586us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:34.916466 (+  6170us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0811 16:07:34.916529 (+    63us) write_op.cc:312] APPLY: finished
0811 16:07:34.916862 (+   333us) log.cc:842] Serialized 97 byte log entry
0811 16:07:34.919624 (+  2762us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.934438 (+ 14814us) write_op.cc:454] Released schema lock
0811 16:07:34.934528 (+    90us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:34.934886 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.934917 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2913764,"reported_tablets":47,"spinlock_wait_cycles":1024058240,"child_traces":[["op",{"apply.queue_time_us":2509,"apply.run_cpu_time_us":13790,"apply.run_wall_time_us":55400,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41720,"num_ops":10,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":3930,"prepare.run_wall_time_us":18484,"replication_time_us":4528}]]}
I20260811 16:07:35.037155 14574 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:35.040693 23736 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260811 16:07:35.054443 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:35.063979 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:35.035311 14575 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:35.079895 14575 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:35.103653 23731 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 16:07:35.140928 14541 connection.cc:698] client connection to 127.12.23.193:40411 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:07:35.116430 13871 connection.cc:698] client connection to 127.12.23.193:40411 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:07:35.143328 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:07:35.144646 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: sendmsg error: Broken pipe (error 32)
I20260811 16:07:35.148342 13821 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:35.152081 23792 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260811 16:07:35.186970 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:35.227414 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:35.228123 14574 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:35.233170 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:35.233989 14575 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
W20260811 16:07:35.250581 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:35.267637 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:35.268544 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:35.272745 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.276917 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.278258 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.278273 23821 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:35.279559 23821 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:35.280568 23821 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.282536 23818 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:35.283008 23818 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:35.283372 23818 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:35.285339 14574 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:07:35.291384 13823 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260811 16:07:35.293493 23794 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:35.311049 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.302794 23818 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.314719 23818 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.316336 23812 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:35.317116 23812 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:35.318171 23792 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.318058 23812 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.318794 23792 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.321053 23792 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.323177 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:35.324100 13823 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:35.333796 13624 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 328) took 121135 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.334383 13624 rpcz_store.cc:269] 0811 16:05:34.198954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.199335 (+   381us) service_pool.cc:227] Handling call
0811 16:07:35.333670 (+121134335us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11101,"reported_tablets":47}
I20260811 16:07:35.338332 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:35.337364 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:35.344472 14574 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:35.347185 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.348116 13823 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:35.355408 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:35.390391 14574 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:35.394184 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:35.394975 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:35.403478 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.403955 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.415393 23812 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:35.416397 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:35.424240 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:35.428050 13908 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:35.429855 23731 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:35.427758 23812 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:35.431716 23812 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:35.432780 23812 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:35.449298 13625 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 310) took 103070 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.451076 13625 rpcz_store.cc:269] 0811 16:05:52.378799 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:52.449622 (+ 70823us) service_pool.cc:227] Handling call
0811 16:07:35.448511 (+102998889us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":778958,"reported_tablets":47}
W20260811 16:07:35.518862 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:35.569229 13628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 215) took 83718 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.580166 13628 rpcz_store.cc:269] 0811 16:06:11.850829 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.851184 (+   355us) service_pool.cc:227] Handling call
0811 16:07:35.568994 (+83717810us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":40}
I20260811 16:07:35.625312 23706 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.625964 23706 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.630671 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:35.636356 23706 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:35.638796 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.639570 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.641974 23794 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:35.703435 13630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 214) took 108195 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.712811 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:35.704104 13630 rpcz_store.cc:269] 0811 16:05:47.508145 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.508366 (+   221us) service_pool.cc:227] Handling call
0811 16:07:35.703216 (+108194850us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55270,"reported_tablets":40}
I20260811 16:07:35.720391 23736 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:35.721161 23736 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.717080 13622 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 14 to 18, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.732784 13622 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 17, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.735165 13622 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 22 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:07:35.738935 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:35.740551 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.743175 23736 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.740077 13622 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 21, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.745374 13622 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.746675 13622 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.747434 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:35.748160 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 28.
I20260811 16:07:35.743021 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:35.750643 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 28.
I20260811 16:07:35.760733 13622 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:35.768679 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.762678 13622 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.762478 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.770674 13622 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 23, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 23 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.772339 23796 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260811 16:07:35.772851 23796 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:35.773208 23796 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:35.772378 13622 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.775904 13622 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 23, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 23 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.780717 23706 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.781384 23706 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.782191 13622 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.783857 13622 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.787101 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:35.787866 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:35.785405 13622 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:07:35.788499 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.790364 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.789714 13622 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.791896 23794 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:35.792317 23794 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.791656 13622 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.792687 23794 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:35.793571 13622 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.795482 13622 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.797991 13622 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.798696 23706 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:35.799710 13622 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 25, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 25 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.806314 23794 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.807781 13622 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 20, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.794327 23796 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.812261 13622 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.816169 13622 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:35.818320 13622 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.819752 13622 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.822703 13622 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:35.830758 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:35.836637 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.839321 23794 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:35.840436 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:35.840567 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:35.841138 13908 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:35.841233 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:35.843402 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:35.844048 14574 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:35.845496 23796 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.849575 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 29.
I20260811 16:07:35.855744 13622 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.863497 13622 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 9 to 12, term changed from 14 to 16, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.854976 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 29.
I20260811 16:07:35.866393 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.854976 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:35.867849 13823 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:35.866468 13622 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 23, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 23 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.867835 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.869716 13622 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.871318 13622 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.872026 23812 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:35.867835 23796 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader election won for term 29
I20260811 16:07:35.873601 23796 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:35.873386 13622 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.875391 13622 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 17, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.876792 23794 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:35.874619 23796 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.877473 23794 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:35.877419 13622 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.884939 13622 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.880174 23794 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.886691 13622 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.891754 14574 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:07:35.893442 23818 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:35.938385 14583 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260811 16:07:35.941493 23812 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260811 16:07:35.947955 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:36.008455 23829 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.009101 23829 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.012660 23829 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:36.014266 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:36.022508 14541 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.023087 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.025408 23829 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:36.068600 23812 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.069232 23812 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.075050 23812 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.078173 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:36.078984 14574 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:07:36.089906 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.094707 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.108013 23818 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.110833 14574 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:36.115013 23856 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:36.109015 23818 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.109282 23812 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:36.124426 23812 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.124890 23812 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:36.134611 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:36.148514 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:36.149359 14583 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:07:36.137440 23818 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:36.157212 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:36.159596 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:36.161551 23855 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:36.162003 23855 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.162411 23855 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:36.176903 12383 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:36.203100 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.210574 23855 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.212836 23855 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:36.213583 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:36.220628 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:36.214406 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.232607 23812 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.244925 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:36.245682 14574 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:36.250627 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.258147 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:36.261646 14574 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
W20260811 16:07:36.244940 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.257571 23812 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.275501 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:36.276196 14583 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:36.278129 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.286931 14583 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:36.288825 23856 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:36.289522 23856 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:36.300773 23856 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.342712 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60982.6us
W20260811 16:07:36.343556 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.348927 14583 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260811 16:07:36.352156 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.356355 23736 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260811 16:07:36.360376 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.366829 23868 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:36.403326 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:36.394953 23868 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:36.405401 23868 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.416744 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.435793 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:36.484275 13904 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260811 16:07:36.486768 23860 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:36.528405 13905 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260811 16:07:36.533254 13622 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 314) took 6473 ms. Trace:
I20260811 16:07:36.533715 13622 rpcz_store.cc:276] 0811 16:07:30.060232 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:30.414345 (+354113us) service_pool.cc:227] Handling call
0811 16:07:36.533158 (+6118813us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:35.964850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:35.965393 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:35.965424 (+    31us) write_op.cc:435] Acquired schema lock
0811 16:07:35.965440 (+    16us) tablet.cc:660] Decoding operations
0811 16:07:35.967789 (+  2349us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:35.967894 (+   105us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:35.967929 (+    35us) tablet.cc:683] Acquiring locks for 36 operations
0811 16:07:35.974833 (+  6904us) tablet.cc:699] Row locks acquired
0811 16:07:35.974853 (+    20us) write_op.cc:260] PREPARE: finished
0811 16:07:35.975008 (+   155us) write_op.cc:270] Start()
0811 16:07:35.975115 (+   107us) write_op.cc:276] Timestamp: P: 1786464455974957 usec, L: 0
0811 16:07:35.975158 (+    43us) op_driver.cc:331] REPLICATION: starting
0811 16:07:35.999597 (+ 24439us) log.cc:842] Serialized 14275 byte log entry
0811 16:07:36.080294 (+ 80697us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b1800318880. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c518a1a30 00007f5c5189b44d 00007f5c5189a78b 00007f5c518a5220
0811 16:07:36.113020 (+ 32726us) op_driver.cc:444] REPLICATION: finished
0811 16:07:36.204591 (+ 91571us) write_op.cc:301] APPLY: starting
0811 16:07:36.204676 (+    85us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:36.296133 (+ 91457us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:36.296176 (+    43us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:36.465887 (+169711us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:36.466400 (+   513us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=72,key_file_lookups=72,delta_file_lookups=0,mrs_lookups=0
0811 16:07:36.466456 (+    56us) write_op.cc:312] APPLY: finished
0811 16:07:36.467072 (+   616us) log.cc:842] Serialized 308 byte log entry
0811 16:07:36.467981 (+   909us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.468333 (+   352us) write_op.cc:454] Released schema lock
0811 16:07:36.468420 (+    87us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:36.480456 (+ 12036us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.480490 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22483,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":91261,"apply.run_cpu_time_us":49294,"apply.run_wall_time_us":276580,"cfile_cache_hit":146,"cfile_cache_hit_bytes":154319,"num_ops":36,"prepare.queue_time_us":9341,"prepare.run_cpu_time_us":8148,"prepare.run_wall_time_us":82308,"raft.queue_time_us":68836,"raft.run_cpu_time_us":39353,"raft.run_wall_time_us":65261,"replication_time_us":137755,"spinlock_wait_cycles":3315456,"thread_start_us":127703,"threads_started":4,"wal-append.queue_time_us":7357}]]}
I20260811 16:07:36.536398 23736 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:36.562891 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.576704 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:36.605031 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:36.639568 13626 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.645963 13626 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 20, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 20 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.648234 13626 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 18 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.651099 13626 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.652741 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 24, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.662925 13626 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 21 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.665135 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 21, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.666893 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 21 to 24, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.669198 13626 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:36.673019 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.670936 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 19 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.682268 13626 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:36.683605 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.696698 13623 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 216) took 60174 ms (client timeout 15000 ms). Trace:
W20260811 16:07:36.697178 13623 rpcz_store.cc:269] 0811 16:06:36.530392 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:36.538861 (+  8469us) service_pool.cc:227] Handling call
0811 16:07:36.696477 (+60157616us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":213289,"reported_tablets":40}
W20260811 16:07:36.698197 13686 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.698593 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.711652 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.739542 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:36.745867 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.747516 23871 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:36.748214 23871 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.750697 23871 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.773084 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:36.773871 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:07:36.777618 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:36.778790 23872 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:36.779366 23872 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:36.779803 23872 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:36.790130 23872 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.791667 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.794486 23878 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:36.795295 23878 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:36.796993 23872 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.798465 23878 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:36.816720 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.823593 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:36.824366 14574 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:36.832906 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:07:36.835563 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:36.835837 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:36.836306 13905 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
W20260811 16:07:36.836840 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:36.837425 23871 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:36.838066 23871 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:36.840799 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.842334 23878 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:36.842758 23878 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:36.843122 23878 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:36.839092 23871 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.858372 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.868834 13627 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 15 to 19, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.880820 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 333) took 6107 ms. Trace:
I20260811 16:07:36.893172 14574 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260811 16:07:36.912333 13626 rpcz_store.cc:276] 0811 16:07:30.773212 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:33.716670 (+2943458us) service_pool.cc:227] Handling call
0811 16:07:36.880708 (+3164038us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:36.717579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:36.727286 (+  9707us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:36.736837 (+  9551us) write_op.cc:435] Acquired schema lock
0811 16:07:36.736856 (+    19us) tablet.cc:660] Decoding operations
0811 16:07:36.737947 (+  1091us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:36.738016 (+    69us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:36.738041 (+    25us) tablet.cc:683] Acquiring locks for 11 operations
0811 16:07:36.751002 (+ 12961us) tablet.cc:699] Row locks acquired
0811 16:07:36.751027 (+    25us) write_op.cc:260] PREPARE: finished
0811 16:07:36.751252 (+   225us) write_op.cc:270] Start()
0811 16:07:36.751381 (+   129us) write_op.cc:276] Timestamp: P: 1786464456751205 usec, L: 0
0811 16:07:36.751403 (+    22us) op_driver.cc:331] REPLICATION: starting
0811 16:07:36.752169 (+   766us) log.cc:842] Serialized 4367 byte log entry
0811 16:07:36.798181 (+ 46012us) op_driver.cc:444] REPLICATION: finished
0811 16:07:36.798525 (+   344us) write_op.cc:301] APPLY: starting
0811 16:07:36.798613 (+    88us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:36.803964 (+  5351us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:36.804089 (+   125us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:36.810717 (+  6628us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:36.810987 (+   270us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0811 16:07:36.811049 (+    62us) write_op.cc:312] APPLY: finished
0811 16:07:36.819364 (+  8315us) log.cc:842] Serialized 105 byte log entry
0811 16:07:36.819583 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.819750 (+   167us) write_op.cc:454] Released schema lock
0811 16:07:36.819810 (+    60us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:36.848177 (+ 28367us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.848220 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9663,"reported_tablets":47,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":14148,"apply.run_wall_time_us":50099,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45892,"num_ops":11,"prepare.queue_time_us":10834,"prepare.run_cpu_time_us":4359,"prepare.run_wall_time_us":48431,"replication_time_us":46671,"thread_start_us":7926,"threads_started":1}]]}
W20260811 16:07:36.898715 13871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 400 similar messages]
I20260811 16:07:36.882037 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 15 to 18, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 18 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.894724 23878 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:36.920949 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.926949 13627 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 24 to 28, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 28 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.947099 13627 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 20 to 24, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 24 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.935379 23878 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:36.943727 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.932301 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:36.954280 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:36.958171 23872 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:36.963491 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:36.964249 13904 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:36.976708 13904 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:37.008000 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:37.010659 23878 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:37.011634 23878 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:37.012686 23878 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:37.031354 13623 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 22 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.033735 14575 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260811 16:07:37.034332 13623 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 22 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.042025 23871 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:37.051024 13623 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.053355 13623 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.062296 13623 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.064414 13623 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 26, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.066141 13623 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 23 to 25, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 25 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.075791 13623 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 29, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 29 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.078226 13627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 218) took 6652 ms. Trace:
I20260811 16:07:37.078588 13627 rpcz_store.cc:276] 0811 16:07:30.426005 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:32.776230 (+2350225us) service_pool.cc:227] Handling call
0811 16:07:37.006682 (+4230452us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:37.006710 (+    28us) write_op.cc:454] Released schema lock
0811 16:07:37.078171 (+ 71461us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:36.967456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:36.967931 (+   475us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:36.967960 (+    29us) write_op.cc:435] Acquired schema lock
0811 16:07:36.967971 (+    11us) tablet.cc:660] Decoding operations
0811 16:07:36.968523 (+   552us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:36.968615 (+    92us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:36.968647 (+    32us) tablet.cc:683] Acquiring locks for 4 operations
0811 16:07:36.969053 (+   406us) tablet.cc:699] Row locks acquired
0811 16:07:36.969067 (+    14us) write_op.cc:260] PREPARE: finished
0811 16:07:36.969213 (+   146us) write_op.cc:270] Start()
0811 16:07:36.969314 (+   101us) write_op.cc:276] Timestamp: P: 1786464456969161 usec, L: 0
0811 16:07:36.969333 (+    19us) op_driver.cc:331] REPLICATION: starting
0811 16:07:36.970029 (+   696us) log.cc:842] Serialized 1682 byte log entry
0811 16:07:36.972463 (+  2434us) op_driver.cc:444] REPLICATION: finished
0811 16:07:36.972938 (+   475us) write_op.cc:301] APPLY: starting
0811 16:07:36.973021 (+    83us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:36.975481 (+  2460us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:36.975607 (+   126us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:36.978089 (+  2482us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:36.978292 (+   203us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0811 16:07:36.978347 (+    55us) write_op.cc:312] APPLY: finished
0811 16:07:36.978606 (+   259us) log.cc:842] Serialized 49 byte log entry
0811 16:07:36.979572 (+   966us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.979701 (+   129us) write_op.cc:454] Released schema lock
0811 16:07:36.979747 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6614,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":6293,"apply.run_wall_time_us":7128,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16688,"num_ops":4,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":2848,"prepare.run_wall_time_us":2849,"replication_time_us":3017}]]}
I20260811 16:07:37.084266 13623 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.086079 13623 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.087785 13623 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.089475 13623 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.091253 13623 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 23 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.093627 13623 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:37.095108 13623 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 23, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:37.109972 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.177631 12383 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:37.185840 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.216473 13626 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 24 to 25, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 25 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:37.227625 13626 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:37.228523 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.230230 13626 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 23 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:37.235584 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 24 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.237186 13626 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.240199 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 24 to 26, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:37.242519 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 24 to 25, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 25 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:07:37.266603 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:37.267307 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:37.267748 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:37.269838 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.283885 13623 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:37.307255 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.453305 14575 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260811 16:07:37.455780 23868 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:37.458985 13904 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260811 16:07:37.460897 23796 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:07:37.520205 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.555013 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.555773 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.641175 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:37.666826 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:37.799374 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.847985 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.855852 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.966893 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.971434 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:37.987767 13904 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.011432 13825 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260811 16:07:38.013415 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 962f3dc40b494dc48647abd894784e8d. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.013906 23868 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:07:38.015743 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.026306 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:38.031544 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.075817 23871 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Committing config change with OpId 26.15: config changed from index -1 to 15, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.080001 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.087762 13817 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Committing config change with OpId 26.15: config changed from index -1 to 15, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.112210 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:38.129361 13904 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.146236 13626 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 15, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:38.150094 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20f7937a4cf04cef96095a62cb4ef661. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.154515 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.166505 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260811 16:07:38.168220 23866 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:38.178134 12383 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:38.222640 23868 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.224696 13825 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.262897 13825 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.306412 13627 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:38.346493 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.353773 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2c264c500bb4a599103d9117a31012d. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.356592 13904 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260811 16:07:38.359115 23890 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:38.386494 23890 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index -1 to 18, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.398447 13904 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index -1 to 18, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.429278 13825 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.439617 13627 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 18, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:38.466985 13903 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260811 16:07:38.465262 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e92ba91a1eb84cef82a03bb6ed271a72. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.468761 23890 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:38.469911 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.501344 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.565335 23891 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.598857 13904 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.634498 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.680428 23908 ts_tablet_manager.cc:927] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:38.725607 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.757709 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.768726 13627 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.775758 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.778855 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:38.779697 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71852us
I20260811 16:07:38.775455 23908 tablet_copy_client.cc:316] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
W20260811 16:07:38.798920 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:38.807183 23914 ts_tablet_manager.cc:927] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:38.807415 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 962f3dc40b494dc48647abd894784e8d from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:07:38.808197 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 962f3dc40b494dc48647abd894784e8d from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-962f3dc40b494dc48647abd894784e8d
I20260811 16:07:38.863508 23914 tablet_copy_client.cc:316] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:07:38.865752 13922 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 20f7937a4cf04cef96095a62cb4ef661 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:07:38.866365 13922 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 20f7937a4cf04cef96095a62cb4ef661 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-20f7937a4cf04cef96095a62cb4ef661
W20260811 16:07:38.871532 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:38.872128 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.873363 13923 tablet_copy_source_session.cc:205] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
W20260811 16:07:38.879073 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.889441 23908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962f3dc40b494dc48647abd894784e8d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:07:38.895466 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.911252 13922 tablet_copy_source_session.cc:205] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:07:38.919107 23914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f7937a4cf04cef96095a62cb4ef661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:07:38.936122 23922 ts_tablet_manager.cc:927] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:38.940183 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.945281 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.945930 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:38.953338 23922 tablet_copy_client.cc:316] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:07:38.955916 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet b2c264c500bb4a599103d9117a31012d from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:07:38.956477 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet b2c264c500bb4a599103d9117a31012d from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-b2c264c500bb4a599103d9117a31012d
I20260811 16:07:38.970046 13839 tablet_copy_source_session.cc:205] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:07:38.977512 23922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c264c500bb4a599103d9117a31012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:07:38.980582 23924 ts_tablet_manager.cc:927] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:38.987979 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.001250 23924 tablet_copy_client.cc:316] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:07:38.976682 23908 tablet_copy_client.cc:791] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.003101 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet e92ba91a1eb84cef82a03bb6ed271a72 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:07:39.003647 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet e92ba91a1eb84cef82a03bb6ed271a72 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-e92ba91a1eb84cef82a03bb6ed271a72
I20260811 16:07:39.003130 23908 tablet_copy_client.cc:655] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:07:39.005265 23914 tablet_copy_client.cc:791] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.005959 23914 tablet_copy_client.cc:655] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:07:39.019266 23914 tablet_copy_client.cc:531] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260811 16:07:39.020833 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.022784 23908 tablet_copy_client.cc:531] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:07:39.018963 13839 tablet_copy_source_session.cc:205] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:07:39.030736 23924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92ba91a1eb84cef82a03bb6ed271a72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:07:39.033239 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:39.060472 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:39.064275 23914 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:07:39.091403 23924 tablet_copy_client.cc:791] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.093055 23924 tablet_copy_client.cc:655] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
W20260811 16:07:39.098986 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.100080 23924 tablet_copy_client.cc:531] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:07:39.119537 23924 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
W20260811 16:07:39.148137 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:39.151590 23908 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
W20260811 16:07:39.178658 12383 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:39.186710 23922 tablet_copy_client.cc:791] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.199556 23922 tablet_copy_client.cc:655] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:07:39.203593 23922 tablet_copy_client.cc:531] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260811 16:07:39.213420 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:39.232041 23922 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
W20260811 16:07:39.522950 23924 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.071s	user 0.003s	sys 0.014s
I20260811 16:07:39.524057 23924 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.526571 23924 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.527628 23924 ts_tablet_manager.cc:1397] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.408s	user 0.043s	sys 0.044s
W20260811 16:07:39.537801 23914 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:07:39.538977 23914 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.540158 23914 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.541107 23914 ts_tablet_manager.cc:1397] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.480s	user 0.039s	sys 0.032s
I20260811 16:07:39.580747 23914 raft_consensus.cc:348] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:07:39.563479 23908 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.070s	user 0.006s	sys 0.002s
I20260811 16:07:39.591931 23914 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.616472 23914 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.619958 23914 ts_tablet_manager.cc:1428] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.001s
I20260811 16:07:39.620820 23908 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.622694 23908 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.623677 23908 ts_tablet_manager.cc:1397] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.472s	user 0.063s	sys 0.017s
I20260811 16:07:39.624817 13922 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20f7937a4cf04cef96095a62cb4ef661 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:07:39.625327 13922 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20f7937a4cf04cef96095a62cb4ef661 on tablet 20f7937a4cf04cef96095a62cb4ef661 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:39.624867 23924 raft_consensus.cc:348] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.629202 23924 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.630050 23924 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.638212 23924 ts_tablet_manager.cc:1428] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.000s
I20260811 16:07:39.640177 23908 raft_consensus.cc:348] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.641249 23908 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.642081 23908 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.644945 23908 ts_tablet_manager.cc:1428] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260811 16:07:39.646936 23922 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.697204 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-e92ba91a1eb84cef82a03bb6ed271a72 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:07:39.698453 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-e92ba91a1eb84cef82a03bb6ed271a72 on tablet e92ba91a1eb84cef82a03bb6ed271a72 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:39.770524 23922 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.773216 23922 ts_tablet_manager.cc:1397] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.541s	user 0.050s	sys 0.017s
W20260811 16:07:39.791903 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49612.5us
W20260811 16:07:39.825022 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65353.9us
W20260811 16:07:39.843520 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.848351 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.864614 14575 raft_consensus.cc:1203] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Deduplicated request from leader. Original: 26.14->[26.15-26.15]   Dedup: 26.15->[]
I20260811 16:07:39.873972 23922 raft_consensus.cc:348] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.876117 23922 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.901217 13922 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-962f3dc40b494dc48647abd894784e8d received from {username='slave'} at 127.0.0.1:56292
I20260811 16:07:39.901896 13922 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-962f3dc40b494dc48647abd894784e8d on tablet 962f3dc40b494dc48647abd894784e8d with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:39.877183 23922 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:07:39.906343 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.907334 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:39.910387 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:39.938423 23922 ts_tablet_manager.cc:1428] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.007s
W20260811 16:07:39.939308 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.940985 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.970268 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.996908 14575 raft_consensus.cc:1203] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Deduplicated request from leader. Original: 24.12->[24.13-24.13]   Dedup: 24.13->[]
I20260811 16:07:40.017802 14574 raft_consensus.cc:1203] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Deduplicated request from leader. Original: 26.17->[26.18-26.18]   Dedup: 26.18->[]
W20260811 16:07:40.071684 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.086845 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-b2c264c500bb4a599103d9117a31012d received from {username='slave'} at 127.0.0.1:50506
I20260811 16:07:40.087765 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-b2c264c500bb4a599103d9117a31012d on tablet b2c264c500bb4a599103d9117a31012d with peer 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:40.089165 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:40.089991 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:40.179471 12383 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:40.239579 14574 raft_consensus.cc:1203] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
W20260811 16:07:40.323936 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.341889 23942 raft_consensus.cc:1050] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:40.345768 23942 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 13, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:40.362511 23913 raft_consensus.cc:1050] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
W20260811 16:07:40.396803 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:40.402810 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:40.408481 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50142.2us
I20260811 16:07:40.415690 13817 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260811 16:07:40.415903 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:40.420591 14581 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260811 16:07:40.422128 23913 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 11, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:40.427780 23945 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:40.432590 23868 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:40.432549 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:40.448640 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:40.458034 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.463356 14581 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:40.467244 23913 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:40.496019 13905 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260811 16:07:40.508150 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.513439 23948 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:40.575662 23937 raft_consensus.cc:1050] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:40.578949 23937 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 16, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:40.602732 23950 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:40.610857 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.611795 14575 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260811 16:07:40.610946 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:40.613336 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.613741 23937 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260811 16:07:40.623416 23948 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.626821 14581 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.632529 13908 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260811 16:07:40.634518 13908 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:40.645905 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:40.674440 23939 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260811 16:07:40.683290 14581 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.694026 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:40.697866 13627 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:40.706670 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:40.717500 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:40.719762 13817 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.740136 23945 raft_consensus.cc:1050] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:40.743796 23945 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:40.761998 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.777024 14575 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:40.779806 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:40.781747 23959 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:40.773401 23948 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.782778 13903 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.828732 14575 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.796815 23959 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260811 16:07:40.837087 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.932273 14581 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.928930 23963 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.041539 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:41.046386 13623 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.058955 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:41.059753 13823 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.109198 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:41.115193 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:41.122336 13626 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:41.180595 13908 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:41.198438 14581 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:41.201906 23963 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:41.204473 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:41.213354 23963 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:41.224516 23960 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.245298 12383 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:41.242868 14581 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.252656 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:41.268292 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:41.288594 13626 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:41.293532 13817 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.308876 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:41.309893 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 20f7937a4cf04cef96095a62cb4ef661 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260811 16:07:41.315626 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:41.406435 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.464524 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:41.472929 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.490064 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:41.491044 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:41.546805 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:41.578445 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.585743 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.653218 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.694406 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:41.758846 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.759527 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:41.778884 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:41.903015 13787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260811 16:07:41.903391 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.074748 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.211934 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 103600us
W20260811 16:07:42.230445 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.245898 12383 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:42.296551 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:42.313520 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.439556 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:42.441448 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:42.477284 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.549798 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:42.569664 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.686663 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.701368 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.728611 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:42.750598 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47563us
W20260811 16:07:42.759246 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:42.799845 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:42.874533 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:42.901602 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:42.931787 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.982674 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:42.992069 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:43.031617 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:43.034368 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.078531 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:43.134357 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.187522 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.246520 12383 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:43.375412 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.376579 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:43.502877 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:43.581384 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.629397 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:43.676301 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:43.755370 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57373.2us
W20260811 16:07:43.799109 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:43.828428 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:43.869083 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:43.880807 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.915107 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:43.926311 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.943673 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:43.974444 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:44.008186 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:44.059281 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:44.083981 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.087229 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:44.137233 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:44.229781 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.247766 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.247766 12383 thread.cc:536] Waited for 9000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:44.256589 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.322696 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.449925 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.529135 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.835063 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:44.940889 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.001082 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.041466 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.108028 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:45.129288 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.141309 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:45.217397 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.249075 12383 thread.cc:536] Waited for 10000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:45.255385 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.260195 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.325836 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.414760 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:45.446991 13825 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:45.500083 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44214us
W20260811 16:07:45.501142 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.511314 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 147022us
W20260811 16:07:45.520905 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.540031 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:45.572935 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:45.573577 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:45.578943 14583 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260811 16:07:45.656855 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.672456 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 95030us
W20260811 16:07:45.673466 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:45.678498 23948 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:45.682381 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:45.693668 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.725210 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:45.754834 24010 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:45.756949 14583 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:45.760021 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260811 16:07:45.785285 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260811 16:07:45.796428 13626 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 14, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:07:45.891640 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.967875 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:46.035797 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 84251.5us
W20260811 16:07:46.038934 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:46.054059 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f6a000330b3415da4f525eae84f33fb with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:60510
W20260811 16:07:46.101670 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:46.102489 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.113902 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.119328 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260811 16:07:46.116197 24020 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:07:46.128515 24020 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:46.131028 24020 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:46.164461 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:46.174428 24020 ts_tablet_manager.cc:1905] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:07:46.186349 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:46.230379 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.250047 12383 thread.cc:536] Waited for 11000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:46.289613 24020 ts_tablet_manager.cc:1918] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260811 16:07:46.292790 24020 log.cc:1196] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/7f6a000330b3415da4f525eae84f33fb
I20260811 16:07:46.301749 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 7f6a000330b3415da4f525eae84f33fb (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
W20260811 16:07:46.345305 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:46.363235 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:46.398579 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.490020 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:46.610940 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.656837 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.731611 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.741168 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:46.758131 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.766112 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.834872 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.850019 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.939421 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260811 16:07:47.071002 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.172217 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.250607 12383 thread.cc:536] Waited for 12000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:47.455849 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.510921 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:47.586663 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.600136 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.721458 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53495.7us
W20260811 16:07:47.724922 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.769672 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44794.5us
W20260811 16:07:47.794498 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83396.7us
W20260811 16:07:47.833823 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:47.866808 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:47.920181 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.961189 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.983654 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:47.987458 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:47.972216 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:47.999744 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:48.077756 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46807.2us
W20260811 16:07:48.173650 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52745.8us
W20260811 16:07:48.201197 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:48.209494 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:48.251255 12383 thread.cc:536] Waited for 13000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:48.274821 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:48.290705 14583 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:48.341660 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:48.374032 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:48.374972 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:48.375578 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:48.409569 13908 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260811 16:07:48.416177 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:48.415959 24034 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260811 16:07:48.418341 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:48.418481 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:48.461654 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:48.469442 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:48.506313 24031 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 6 to 14, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:48.508215 13905 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 6 to 14, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:48.516804 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:48.530752 13623 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 6 to 14, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:48.539551 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:48.555832 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:48.560242 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260811 16:07:48.585595 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:48.699539 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet a48002159c1643c489d152b863d3d839 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:52448
I20260811 16:07:48.762454 24043 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:07:48.791086 24043 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:48.794780 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:48.818317 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:48.829860 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260811 16:07:48.854530 24043 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:48.871857 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260811 16:07:48.892221 24043 ts_tablet_manager.cc:1905] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:07:48.895676 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260811 16:07:48.959059 24043 ts_tablet_manager.cc:1918] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260811 16:07:48.959641 24043 log.cc:1196] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/a48002159c1643c489d152b863d3d839
I20260811 16:07:48.963901 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet a48002159c1643c489d152b863d3d839 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
W20260811 16:07:49.007802 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.213807 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.251839 12383 thread.cc:536] Waited for 14000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:49.288599 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.327914 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.339895 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.353801 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.436563 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:49.454150 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.466827 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.498075 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.685560 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:49.799427 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.861639 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.008205 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.034271 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:50.063014 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.092756 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.111404 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:50.133481 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.135200 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:50.238211 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.238381 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43833us
W20260811 16:07:50.251166 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:50.252942 12383 thread.cc:536] Waited for 15000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:50.309820 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:50.300431 13823 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:50.318893 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:50.347066 13903 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260811 16:07:50.350131 24048 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:50.373299 14581 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260811 16:07:50.380434 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.382877 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260811 16:07:50.382699 24047 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260811 16:07:50.383458 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:50.406513 23992 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 LEADER]: Committing config change with OpId 29.17: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:50.413466 13906 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:50.442809 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c390fd23cec5435d81b38a50b2988a60 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260811 16:07:50.462807 13626 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 29 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:50.498557 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260811 16:07:50.516826 14583 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:50.585867 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:50.597399 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.607440 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.663621 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.725229 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:50.743656 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:50.889101 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:50.907763 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:51.027381 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.059832 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:51.099548 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 69903.6us
W20260811 16:07:51.127130 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46577.1us
W20260811 16:07:51.139987 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:51.176687 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.192817 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.202033 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:51.253552 12383 thread.cc:536] Waited for 16000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:51.302948 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:51.350270 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:51.370069 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:51.424310 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:51.445560 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:51.487793 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:51.693811 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.773547 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:51.814227 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:51.850006 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.946601 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 448 similar messages]
W20260811 16:07:52.013252 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50410us
W20260811 16:07:52.041061 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:52.044113 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.093840 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.156278 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.172041 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:52.183281 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.237948 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:52.254122 12383 thread.cc:536] Waited for 17000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:52.359877 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.379495 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.404456 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:52.619664 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:52.624348 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:52.753602 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.761235 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:52.763196 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.768067 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.801285 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:52.814553 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.851274 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.904855 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:53.037912 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.073712 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:53.122809 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:53.126941 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:53.146379 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:53.184300 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:53.185178 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.194736 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:53.206487 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:53.254719 12383 thread.cc:536] Waited for 18000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:53.440243 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72993.3us
W20260811 16:07:53.443602 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:53.444728 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58721.2us
W20260811 16:07:53.467839 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:53.527083 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.605706 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:53.606536 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.614243 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:54.032311 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:54.035362 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:54.055281 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 215597us
W20260811 16:07:54.075277 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.075937 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:54.079303 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:54.176798 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:54.186290 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.226950 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:54.255224 12383 thread.cc:536] Waited for 19000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:54.281448 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:54.350435 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.399418 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.551694 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.579314 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.587111 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.621234 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.691767 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.782801 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.785709 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.891850 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:54.953056 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.993727 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.104035 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:55.255812 12383 thread.cc:536] Waited for 20000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:55.316992 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:55.321803 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.330878 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:55.378350 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.392419 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.443527 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.461671 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:55.515794 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.541496 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.557905 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.622619 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.628249 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:55.657182 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.660123 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:55.785909 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:55.834252 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:55.839398 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.841493 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:55.843492 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.872061 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:56.002264 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:56.144318 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:56.256510 12383 thread.cc:536] Waited for 21000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:56.282438 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:56.288628 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:56.388540 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:56.453604 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:56.457568 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:56.530926 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:56.538822 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:07:56.609252 13903 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:56.655903 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:56.712134 14581 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:56.758499 24094 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:56.786044 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:56.813050 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:56.824347 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260811 16:07:56.862684 24093 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 4 to 16, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:56.871521 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:07:56.875260 14581 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 4 to 16, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:56.903010 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:56.914070 13623 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 4 to 16, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:56.955528 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:56.982414 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260811 16:07:56.986909 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54401.7us
I20260811 16:07:57.042488 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
W20260811 16:07:57.054947 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:07:57.073524 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 801054abfed346a09c04b7cd13d7c62f with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:52448
I20260811 16:07:57.080444 24107 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:07:57.081866 24107 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:57.085958 24107 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:57.089922 24107 ts_tablet_manager.cc:1905] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:07:57.099584 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:07:57.183813 24107 ts_tablet_manager.cc:1918] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.15
I20260811 16:07:57.184438 24107 log.cc:1196] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/801054abfed346a09c04b7cd13d7c62f
I20260811 16:07:57.187335 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 801054abfed346a09c04b7cd13d7c62f (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
W20260811 16:07:57.197870 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.257074 12383 thread.cc:536] Waited for 22000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:57.293495 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.339154 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.343292 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.372786 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:57.380892 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:57.589358 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:57.609084 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:57.619549 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.741524 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.760550 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.877415 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:57.887939 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:57.903164 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:57.934589 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:57.944104 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:57.945667 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.083123 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:58.116292 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.122349 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.123782 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.226907 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66487.1us
W20260811 16:07:58.236174 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.244833 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:58.257650 12383 thread.cc:536] Waited for 23000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:58.266601 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.263563 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:58.349468 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.352680 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:58.373441 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:58.467801 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:58.508741 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:58.595332 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.636962 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:07:58.770342 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:58.896544 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:59.007526 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.080479 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:07:59.145826 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:07:59.231336 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.258210 12383 thread.cc:536] Waited for 24000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:59.274001 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:59.311569 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:59.348011 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:59.362950 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.406858 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:59.433612 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.514138 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:59.545814 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.565557 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.593189 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.743355 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.833478 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.853299 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:00.005384 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.259006 12383 thread.cc:536] Waited for 25000ms trying to join with diag-logger (tid 13768)
W20260811 16:08:00.357420 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:00.480262 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.482842 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.493359 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.496129 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:00.498823 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.582792 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:00.617775 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:00.709365 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.814466 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:08:00.819746 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.855934 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.878732 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:00.911813 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:01.031963 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.058220 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:08:01.078826 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:01.080617 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.141481 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800237040 after lost signal to thread 12388
W20260811 16:08:01.143193 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800374fc0 after lost signal to thread 13668
W20260811 16:08:01.145401 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3a60 after lost signal to thread 13856
W20260811 16:08:01.146929 13853 debug-util.cc:398] Leaking SignalData structure 0x7b080042a0c0 after lost signal to thread 13941
W20260811 16:08:01.148547 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08003c46a0 after lost signal to thread 14610
W20260811 16:08:01.172439 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.260068 12383 thread.cc:536] Waited for 26000ms trying to join with diag-logger (tid 13768)
W20260811 16:08:01.345613 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:08:01.353051 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.357689 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.358678 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:01.438767 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:01.504587 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:08:01.542961 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:01.583889 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.593231 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.607053 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:01.639400 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:08:01.696583 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.775121 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:01.880160 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.898253 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:01.908201 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.966185 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.978878 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:01.985414 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260811 16:08:02.020520 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68578.6us
W20260811 16:08:02.159391 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:02.204536 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:02.255788 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:02.295588 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.327303 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.421640 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:02.483085 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
W20260811 16:08:02.525390 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.537503 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:02.597172 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:02.651000 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.876947 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.988682 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:03.091972 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:03.125705 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.181797 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.210654 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:03.241166 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:08:03.260406 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:03.282166 13874 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.291554 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.292189 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.304330 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.306202 13874 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.308429 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.313617 13874 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.349412 13874 consensus_peers.cc:487] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.351100 13874 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.351910 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.360878 14544 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.361858 14544 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.363593 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:03.374272 13874 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.383116 13874 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.386874 13874 consensus_peers.cc:487] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.398520 14544 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.405330 13874 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.412369 14544 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.417098 14544 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.426551 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:03.449359 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:03.454552 14544 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.459688 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.464205 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:03.519227 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:03.524051 13874 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.532155 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:03.555913 14544 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.572327 13874 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.576915 14544 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.579955 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.581996 14544 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.586589 14544 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.587083 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:03.597491 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:03.623072 13874 consensus_peers.cc:487] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.623409 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:03.627662 12383 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.630511 12383 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.631736 12383 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.633934 14544 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.635316 12383 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.636346 12383 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.637832 12383 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.639554 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:03.642136 12383 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.643250 12383 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.643967 12383 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.647059 12383 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.648001 12383 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.648979 12383 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.651993 12383 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.652866 12383 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.654261 12383 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.657416 12383 tablet_replica.cc:330] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.658452 12383 raft_consensus.cc:2229] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.659384 12383 raft_consensus.cc:2258] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.662878 12383 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.663901 12383 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.664779 12383 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.665690 14544 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.667714 12383 tablet_replica.cc:330] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.668962 12383 raft_consensus.cc:2229] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.670573 12383 raft_consensus.cc:2258] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.673897 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.674932 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.676280 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.676491 14544 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.679340 12383 tablet_replica.cc:330] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.680397 12383 raft_consensus.cc:2229] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.681478 12383 raft_consensus.cc:2258] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.686964 12383 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.687948 12383 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.689252 12383 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.692698 12383 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.693794 12383 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.694437 12383 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.697341 12383 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.698414 12383 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.699270 12383 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.702800 12383 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.703869 12383 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.705448 12383 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.710443 13874 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.712911 12383 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
W20260811 16:08:03.713459 14544 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.717100 12383 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.718772 12383 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.723956 12383 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.724978 12383 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.725973 12383 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.729666 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.730641 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.737165 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.741879 12383 tablet_replica.cc:330] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.742990 12383 raft_consensus.cc:2229] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.744283 12383 raft_consensus.cc:2258] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.748265 12383 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: stopping tablet replica
W20260811 16:08:03.749118 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:08:03.749173 12383 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.750931 12383 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.753969 12383 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.754966 12383 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:03.754506 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:03.764591 12383 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.788738 12383 tablet_replica.cc:330] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.823036 12383 raft_consensus.cc:2229] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.854763 12383 raft_consensus.cc:2258] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.858086 12383 tablet_replica.cc:330] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.859081 12383 raft_consensus.cc:2229] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.860219 12383 raft_consensus.cc:2258] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.862841 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:03.879923 12383 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
W20260811 16:08:03.893451 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260811 16:08:03.898366 12383 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.899549 12383 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.900545 13874 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.903697 12383 tablet_replica.cc:330] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.931129 12383 raft_consensus.cc:2229] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.932392 12383 raft_consensus.cc:2258] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.937364 12383 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.938215 12383 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.939671 12383 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.953639 12383 tablet_replica.cc:330] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.954564 12383 raft_consensus.cc:2229] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.956044 12383 raft_consensus.cc:2258] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.969317 12383 tablet_replica.cc:330] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.970285 12383 raft_consensus.cc:2229] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.971179 12383 raft_consensus.cc:2258] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.974207 12383 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.974972 12383 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.975747 12383 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.978437 12383 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.999346 12383 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.000052 12383 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.041719 12383 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.042526 12383 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.043095 12383 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.067205 12383 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.086025 12383 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.086679 12383 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.100287 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.101101 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.107715 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.110653 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.111527 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.112604 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:04.116153 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:04.121374 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:04.127401 12383 tablet_replica.cc:330] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.128521 12383 raft_consensus.cc:2229] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.129422 12383 raft_consensus.cc:2258] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.155879 12383 tablet_replica.cc:330] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.156800 12383 raft_consensus.cc:2229] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.157599 12383 raft_consensus.cc:2258] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.160859 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.161736 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:04.180644 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.190161 12383 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.190994 12383 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.204102 12383 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.207055 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.207862 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.209220 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.236159 24120 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:04.237237 12383 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.236886 24120 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.238250 12383 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.239384 12383 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.240753 24120 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:04.242676 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:04.244762 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:04.248054 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:04.249039 24120 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:04.249722 12383 tablet_replica.cc:330] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.250532 12383 raft_consensus.cc:2229] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.251184 12383 raft_consensus.cc:2258] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.267880 12383 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.268751 12383 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.269445 12383 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.272378 12383 tablet_replica.cc:330] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.273070 12383 raft_consensus.cc:2229] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.273881 12383 raft_consensus.cc:2258] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.276522 12383 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.277285 12383 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Raft consensus shutting down.
I20260811 16:08:04.278642 12383 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.288627 12383 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.289415 12383 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:04.291481 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:08:04.298722 12383 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:04.303874 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:08:04.318714 12383 tablet_replica.cc:330] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.325276 12383 raft_consensus.cc:2229] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:04.326787 12383 raft_consensus.cc:2258] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:04.340929 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:04.351928 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:04.453079 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:08:04.601315 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:04.682248 24111 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.682847 24111 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.685227 24111 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:04.693831 24111 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.694746 24111 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:04.735879 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.748711 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.754962 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.756732 24132 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:04.770808 24111 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:04.775307 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.777803 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.778291 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.782024 24111 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:08:04.787779 24143 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.788661 24143 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.793097 24143 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:04.794523 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:04.799763 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.802904 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.807377 24137 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:04.807880 13874 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:04.808305 24111 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.808869 24111 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.811820 24111 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:04.815868 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:04.819563 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:04.820078 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.820907 24111 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:04.821920 24143 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.822578 24143 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.824990 24143 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:04.827739 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:04.830780 24111 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.831455 24111 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.833719 24111 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:04.840118 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:08:04.842063 14544 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.840389 13874 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:04.848340 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:04.849565 24143 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:08:04.851387 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:04.852789 24111 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:08:04.879606 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:04.911405 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:04.925249 24135 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.925989 24135 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:04.926884 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:04.929435 24135 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:04.938652 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.941948 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.948782 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.949790 24135 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:08:04.977406 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.040092 24137 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.040191 24143 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.040756 24137 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.040834 24143 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:05.046921 13874 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.047536 13874 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.050535 24143 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.051357 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:05.051716 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:05.052068 14575 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:08:05.053821 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:05.054602 24143 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260811 16:08:05.055352 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.056180 24143 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:08:05.056644 24143 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.049672 24137 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.057072 24143 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:08:05.066882 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.077322 24111 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.077894 24111 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.080000 24111 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.083021 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.084357 13905 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:08:05.077854 24143 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.085518 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:08:05.086359 24111 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:08:05.086701 24111 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.086993 24111 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:08:05.090163 14544 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.090883 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:08:05.091588 14575 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:08:05.095253 13874 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.098719 24143 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.100273 14575 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:08:05.100443 24111 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.103214 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.103961 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:08:05.104096 24143 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:08:05.104718 13905 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:08:05.105367 24135 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.105211 24143 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:08:05.107558 24143 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.106916 24135 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.111097 24111 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.111997 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.113547 24135 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:05.113155 14544 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.116261 14544 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.114022 13902 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 26.
I20260811 16:08:05.119459 24132 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.120105 24132 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.122517 24132 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.125377 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.126135 13903 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 29.
I20260811 16:08:05.127130 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:08:05.128263 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.129065 24132 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260811 16:08:05.129516 24132 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.130070 24132 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Advancing to term 30
W20260811 16:08:05.135980 14541 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.139945 14541 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.139294 13627 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 25 to 26, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:05.141028 24111 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:08:05.145121 13905 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:08:05.148250 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.149269 24111 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:08:05.149720 24111 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:08:05.150489 24111 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.155916 24143 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:08:05.177196 14544 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.169325 24143 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.187103 24143 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:05.188702 24141 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.189350 24141 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:08:05.195447 13874 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.196759 24141 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.209951 13874 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.220614 24132 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.223312 24111 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:08:05.223696 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.230360 24111 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:05.232434 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:05.232838 24111 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:05.233215 24132 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.230873 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.234233 24137 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:05.234935 14544 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.234467 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.236575 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.235967 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:08:05.237664 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Advancing to term 30
I20260811 16:08:05.239531 24141 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:05.245018 24141 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.245600 24141 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:08:05.247895 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.248368 24141 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:05.248528 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 30.
W20260811 16:08:05.248941 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.249823 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.254119 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.255208 24111 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 FOLLOWER]: Leader election won for term 30
I20260811 16:08:05.255717 24111 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:08:05.256664 24111 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.261328 24132 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:05.262732 13623 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 20 to 21, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:08:05.263808 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.269250 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
W20260811 16:08:05.276494 13874 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.277345 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.284951 24141 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:05.302611 24141 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.303251 24141 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.305935 24141 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.307343 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:05.310981 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.311573 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.315218 24141 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:05.317932 13874 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.406912 13623 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 29 to 30, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 30 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:08:05.450624 24139 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.451221 24139 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.453406 24139 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.459357 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:05.477247 13874 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.478410 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.479269 24139 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:05.497505 24139 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.498111 24139 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.500464 24139 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.504675 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:05.508883 13874 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.521831 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.522338 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.523175 24139 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:05.531664 24111 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.532286 24111 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.534824 24111 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.541834 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.558561 13905 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
W20260811 16:08:05.548329 14541 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:05.560122 14544 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.561244 14544 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.567363 24111 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:05.571960 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.572247 13905 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260811 16:08:05.572808 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.573683 24111 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.574134 24132 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:08:05.574213 24111 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.581511 24111 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.585772 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:05.586541 14544 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.588274 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:05.600405 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.600987 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.602336 24111 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:08:05.615967 14574 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260811 16:08:05.618234 24141 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260811 16:08:05.632687 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:05.661341 13874 consensus_peers.cc:487] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.677150 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:05.685039 13874 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:05.687238 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
W20260811 16:08:05.698097 14542 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:05.713812 24141 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.714664 24141 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.718077 24141 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.730574 13874 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.735356 13874 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.736447 14544 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.744352 13613 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44665us
W20260811 16:08:05.754855 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:05.758450 14544 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.763289 13874 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.770968 14542 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.773809 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.774508 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.775485 24139 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:05.781144 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:05.781518 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:05.793148 14542 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.809692 14542 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.816356 14542 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.832808 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:05.836735 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:05.839385 14544 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.893400 14544 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.897657 14542 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.898490 14542 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:06.326030 13874 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.326783 13874 consensus_peers.cc:487] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.327324 13874 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.428586 13874 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.827329 13874 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.827309 24164 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.828109 24164 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.830479 24164 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:06.834266 24166 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:06.835323 24166 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.836829 13874 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:06.839250 24166 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:06.841624 24164 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.842460 24164 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.844967 24164 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.847604 13874 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.864776 24167 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:06.865397 24167 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.867609 24167 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:06.881342 24174 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:06.883317 24174 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.886026 24174 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:06.888048 24164 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:06.888075 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:06.888918 24164 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.889523 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:06.889976 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:06.891052 24164 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:06.892300 24164 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.892798 24164 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.893195 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:06.897972 24164 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.930886 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
I20260811 16:08:06.963734 24178 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.964649 24164 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.966887 24164 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.969735 24164 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:06.965438 24178 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.971797 24139 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.972543 24139 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.976929 13874 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.980619 24139 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.981204 13874 leader_election.cc:334] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:06.982028 13874 consensus_peers.cc:487] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.982540 13874 consensus_peers.cc:487] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.982904 24169 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:06.983771 24169 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.982990 13874 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:06.985621 13871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 523 similar messages]
I20260811 16:08:06.986291 24169 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:06.987164 24178 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.992043 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:06.996943 13871 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:06.997507 13871 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:06.998430 13871 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.001871 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260811 16:08:07.002020 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.002494 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:07.008945 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.009250 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.011476 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.011708 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.012836 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.013540 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.017033 14542 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.017757 14542 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.018350 14542 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.018885 14542 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.019491 14542 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.028245 13874 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.030831 13874 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.031580 24169 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.032161 24169 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.034319 24169 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.034564 24178 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.035251 24178 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:07.037436 24178 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:07.040536 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:07.040899 24183 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.041589 24183 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:07.048244 13874 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.048125 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.053812 24178 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.053331 14542 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.054445 24178 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.055397 24177 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.055925 14542 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.055891 24177 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:07.056531 14542 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:08:07.056929 24178 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.056983 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.057848 24169 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.058044 24177 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.057863 24181 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.058918 24181 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:07.059907 24183 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.060832 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.061085 24181 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.061656 24181 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:08:07.062124 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:07.063043 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:07.064081 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.062858 24181 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:08:07.063181 14542 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.063313 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.067533 24178 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:07.065557 14542 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.070713 14542 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.071388 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:08:07.074360 13874 leader_election.cc:334] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.076958 13874 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.079309 24182 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.074699 24181 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.080520 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:07.080119 24182 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.081697 12383 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.081784 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.082654 24177 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.082906 12383 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.083112 24182 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.083894 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.084766 24182 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:08:07.085115 12383 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.085872 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:08:07.085071 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.086640 24182 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.086601 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.087692 24183 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:08:07.089856 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.090142 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.090616 24182 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.091313 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.091173 24182 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.094303 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.095501 24182 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.093454 24177 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.095615 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.095616 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.096297 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.096498 14581 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:08:07.096330 24177 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.097164 24178 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:08:07.098831 24177 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.099367 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.100792 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.100905 24182 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.102901 24183 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.104239 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.102186 12383 tablet_replica.cc:330] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.105278 14544 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.105542 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.105918 14544 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.106870 12383 raft_consensus.cc:2229] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:07.106627 14544 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.107692 12383 raft_consensus.cc:2258] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.107582 24182 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.107867 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.108295 24182 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.108603 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.109548 24183 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.110386 24182 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:07.110661 14544 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.106012 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.111541 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.112241 24182 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:07.112458 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.112692 14544 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.112910 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:07.114283 14544 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.113258 13874 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.115294 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.115437 24177 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.114352 24182 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.115762 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.110716 12383 tablet_replica.cc:330] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.116024 24177 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:07.117060 12383 raft_consensus.cc:2229] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.118113 24182 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:08:07.118373 24177 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:07.120250 13874 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.115204 14544 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.121515 12383 raft_consensus.cc:2258] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.121515 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.122419 14544 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.123281 24177 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:07.123852 24177 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.124246 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:08:07.125036 13874 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.126212 24177 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.126688 12383 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.123046 14544 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.127460 24182 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:08:07.127529 14544 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.128180 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.128669 12383 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.128670 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:07.130076 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.129479 12383 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.135823 24177 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:07.137435 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.137730 24177 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.138449 24178 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.129770 24182 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:08:07.141032 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.141392 12383 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.142760 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.143263 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.143477 24183 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.144024 24182 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.143606 12383 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.144177 24183 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.145351 12383 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.145725 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.148344 12383 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.150987 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.151615 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.152467 24182 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:08:07.152916 14541 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.153193 13874 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.153685 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.153914 24183 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:07.141995 24177 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.154613 24178 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.155324 24177 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:07.155850 24177 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.156426 12383 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:07.157099 14542 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:08:07.157480 14542 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.158049 24177 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.158226 24183 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.159665 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.160296 12383 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.163481 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.163379 13874 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.163978 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.164261 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 30 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.165165 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 30 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.165237 24177 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:08:07.129407 14544 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.166334 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.166783 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.167606 24183 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.167845 12383 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.168645 12383 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.169436 12383 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.170995 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.171586 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.172114 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.172979 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.173775 24183 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:08:07.174021 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.174882 14544 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.176939 12383 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.177878 12383 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.178462 12383 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.181128 12383 tablet_replica.cc:330] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.181911 12383 raft_consensus.cc:2229] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.183082 12383 raft_consensus.cc:2258] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.185953 12383 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.186724 12383 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.187750 12383 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.189632 12383 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.190214 12383 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.190713 12383 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.192689 12383 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.193250 12383 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.193825 12383 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.195794 12383 tablet_replica.cc:330] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.196383 12383 raft_consensus.cc:2229] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.197006 12383 raft_consensus.cc:2258] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.199503 12383 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.200100 12383 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.201151 12383 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.203399 12383 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.203992 12383 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.205222 12383 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.207500 12383 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.208143 12383 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.209105 12383 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.211089 12383 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.211751 12383 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.212239 12383 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.214479 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.215118 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.216566 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.218104 24183 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.219051 12383 tablet_replica.cc:330] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.218744 24183 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.220180 12383 raft_consensus.cc:2229] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.220821 12383 raft_consensus.cc:2258] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.222595 24183 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.223855 12383 tablet_replica.cc:330] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.224747 12383 raft_consensus.cc:2229] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.225458 12383 raft_consensus.cc:2258] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.228783 12383 tablet_replica.cc:330] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.228835 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.229693 12383 raft_consensus.cc:2229] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
W20260811 16:08:07.230551 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.230808 12383 raft_consensus.cc:2258] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.231005 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.231923 24183 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:08:07.233902 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.234648 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.236011 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.238147 12383 tablet_replica.cc:330] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.238881 12383 raft_consensus.cc:2229] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.239840 12383 raft_consensus.cc:2258] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.241887 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.242529 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.243323 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.245347 12383 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.245949 12383 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.246455 12383 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.248525 12383 tablet_replica.cc:330] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.249138 12383 raft_consensus.cc:2229] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.250293 12383 raft_consensus.cc:2258] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.252460 12383 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.253018 12383 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.254025 12383 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.256522 12383 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.257280 12383 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.257879 12383 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.260975 12383 tablet_replica.cc:330] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.261739 12383 raft_consensus.cc:2229] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.262956 12383 raft_consensus.cc:2258] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.266199 12383 tablet_replica.cc:330] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.266942 12383 raft_consensus.cc:2229] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.267570 12383 raft_consensus.cc:2258] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.270129 12383 tablet_replica.cc:330] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.270887 12383 raft_consensus.cc:2229] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.272087 12383 raft_consensus.cc:2258] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.274672 12383 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.275450 12383 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.276054 12383 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.278168 12383 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.278913 12383 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.280242 12383 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.282907 12383 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.283685 12383 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.284207 12383 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.286206 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.286938 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.288034 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.291294 12383 tablet_replica.cc:330] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.292166 12383 raft_consensus.cc:2229] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.293442 12383 raft_consensus.cc:2258] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.295928 12383 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.296761 12383 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.297492 12383 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.299614 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:07.300036 12383 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.300669 12383 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.301196 12383 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.303068 12383 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.303674 12383 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.304621 12383 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.307090 12383 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.307881 12383 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.309038 12383 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.311126 12383 tablet_replica.cc:330] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.311707 12383 raft_consensus.cc:2229] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.312282 12383 raft_consensus.cc:2258] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.314383 12383 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.314962 12383 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.315560 12383 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.317607 12383 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.318118 12383 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.319469 12383 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.321807 12383 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.322371 12383 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.323408 12383 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.373775 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:07.506490 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104803us
W20260811 16:08:07.538676 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:07.539960 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:08:07.547442 14542 connection.cc:698] client connection to 127.12.23.195:42003 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:08:07.588814 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:07.730979 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.878340 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1560 after lost signal to thread 12388
W20260811 16:08:07.879575 14607 debug-util.cc:398] Leaking SignalData structure 0x7b0800327740 after lost signal to thread 13668
W20260811 16:08:07.880295 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe1c0 after lost signal to thread 13941
W20260811 16:08:07.881350 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0100 after lost signal to thread 14610
W20260811 16:08:07.895893 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080014b900 after lost signal to thread 12388
W20260811 16:08:07.897145 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001751c0 after lost signal to thread 13668
W20260811 16:08:07.897994 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800394ae0 after lost signal to thread 13941
W20260811 16:08:07.899361 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800367920 after lost signal to thread 14610
W20260811 16:08:07.899641 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003772c0 after lost signal to thread 14611
W20260811 16:08:07.935242 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
W20260811 16:08:07.958968 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:07.984774 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.033087 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.331408 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.339187 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:08.456653 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08001785a0 after lost signal to thread 12388
W20260811 16:08:08.458007 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08000311c0 after lost signal to thread 13668
W20260811 16:08:08.458690 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080003ea40 after lost signal to thread 13941
W20260811 16:08:08.460269 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080014f860 after lost signal to thread 14610
I20260811 16:08:08.497871 24187 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.498643 24187 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.501546 24190 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.502177 24190 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.503773 24173 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.504360 24173 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.516021 24195 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.516746 24195 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.517758 24190 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.518426 24190 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.519702 24195 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.524049 24198 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.501024 24187 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.525770 24187 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.526383 24187 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.528864 24187 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.529670 24173 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.524744 24198 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.529662 24195 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.518915 24190 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.534235 24195 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.535950 24198 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.536304 24190 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.541654 24195 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:08.546501 14544 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.547267 14544 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.562752 12383 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 13937)
W20260811 16:08:08.568259 14544 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.576079 14544 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.576875 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:08.578488 24187 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.579264 24187 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.582224 24187 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.588038 24197 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.589198 24197 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.595995 24197 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:08.592769 14542 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.605173 14542 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:08:08.601302 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.606634 14541 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.583585 24194 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.610031 24194 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.612411 24194 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.608678 24187 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.614048 14542 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
W20260811 16:08:08.620995 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:08.621734 24187 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.625929 24187 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.628855 24187 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.615315 24197 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:08:08.629581 14544 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.633437 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.639322 14541 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.644411 14541 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:08.647094 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.652364 14541 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.647353 24187 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:08.660069 14542 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.669479 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.673684 24187 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:08:08.675470 14542 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
W20260811 16:08:08.672750 14541 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.676891 14544 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:08.682804 14542 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.687211 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:08.690883 14542 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.691547 24187 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:08.689807 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.696269 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.697289 24187 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:08.698359 14542 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.698889 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.699846 24187 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:08:08.701102 14542 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.701838 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.702637 24187 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:08:08.752002 24187 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.752810 24187 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.755209 24187 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:08.760692 14541 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.766229 14542 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.770898 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.772132 24187 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.773540 14542 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.774111 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.775199 24187 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.777345 14542 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.778203 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.779162 24187 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:08:08.780400 14542 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.780915 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.782091 24187 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.795585 14542 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.796202 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.797091 24187 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:08:08.798132 14542 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:08.845244 24197 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:08.845865 24197 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:08.847082 14544 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:08.848572 24197 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.851567 24197 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:08.852123 24197 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.854305 24197 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:08.855620 14544 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.857678 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.858366 14541 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.858896 14541 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:08.859568 14542 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.860041 24197 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:08.863442 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.863997 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.864871 24197 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:08.872898 14542 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:08.873991 24197 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:08.874591 24197 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.878449 24197 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:08.885902 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.887631 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.888240 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.889245 24197 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:08:08.914294 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.922031 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.939049 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
W20260811 16:08:08.972787 14542 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:08.983530 14544 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.001703 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:09.063515 14544 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.070865 14542 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.133152 14544 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.135746 14544 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.142027 14542 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.176574 14542 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:09.202769 24197 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.203542 24197 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:09.205948 24197 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:09.210677 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:09.211426 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:09.211858 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.212664 24197 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:08:09.225075 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260811 16:08:09.241976 14542 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.267261 14542 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.278048 14542 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.292071 14542 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.294199 14544 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.312757 14542 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.342576 14544 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.358407 14542 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.373749 14544 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.374965 14542 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.407817 14544 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.427830 14544 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.437764 14544 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.478561 24198 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.479210 24198 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:09.481276 24198 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:09.486934 14544 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.487598 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:09.489040 14542 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.489611 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:09.490103 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.491020 24197 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:09.495980 14544 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.515878 24197 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.516567 24197 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:09.518985 24197 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:09.525003 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:09.526365 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:09.526916 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.527813 24197 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:08:09.544066 14542 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:09.579214 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:08:09.592106 24197 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.593228 24197 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:09.601473 14542 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
W20260811 16:08:09.606169 14541 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:09.606860 14541 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.606251 24197 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:09.608269 24197 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:09.625449 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:09.626389 14544 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:09.627838 14544 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.676877 12383 tablet_server.cc:178] TabletServer@127.12.23.196:0 shutting down...
W20260811 16:08:09.707120 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:09.723801 14542 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.742420 14544 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.754740 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:09.755877 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.756966 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.757799 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:09.758262 14542 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:09.760732 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.761433 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.761993 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.764729 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.765601 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.766276 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.768646 12383 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.769337 12383 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.770402 12383 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.772521 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.773196 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.774148 12383 pending_rounds.cc:62] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Trying to abort 1 pending ops.
I20260811 16:08:09.774456 12383 pending_rounds.cc:68] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Aborting op as it isn't in flight: id { term: 30 index: 18 } timestamp: 7317358531623370752 op_type: NO_OP noop_request { }
I20260811 16:08:09.774796 12383 raft_consensus.cc:2866] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:08:09.775188 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.778013 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.778754 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.779413 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.781689 12383 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.782260 12383 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.783025 12383 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.784955 12383 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.785480 12383 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.786149 12383 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.788445 12383 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.788985 12383 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.789458 12383 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.791829 12383 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.792412 12383 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.793305 12383 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.795849 12383 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.796558 12383 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.797578 12383 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.800328 12383 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.801199 12383 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.802295 12383 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:09.802760 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:09.804759 12383 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.805466 12383 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.806460 12383 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.808689 12383 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.809307 12383 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.809813 12383 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.811800 12383 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.812390 12383 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.813361 12383 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.816104 12383 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.816851 12383 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.817384 12383 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.819460 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.820034 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.820691 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.823036 12383 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.824033 12383 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.824867 12383 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.828610 12383 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.829612 12383 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Raft consensus shutting down.
W20260811 16:08:09.830475 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:09.830798 12383 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.833940 12383 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.834611 12383 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.835238 12383 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.837416 12383 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.838147 12383 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.838999 12383 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.841065 12383 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.841706 12383 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.842231 12383 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.844835 12383 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.845605 12383 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.847080 12383 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.849676 12383 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.850310 12383 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.850880 12383 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.853509 12383 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.854130 12383 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.854820 12383 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.856966 12383 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.857594 12383 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.858747 12383 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.861430 12383 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.862658 12383 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.863956 12383 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.866401 12383 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.867234 12383 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.868120 12383 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.870093 12383 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.870651 12383 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.871570 12383 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.874126 12383 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.874878 12383 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.875741 12383 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.877844 12383 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.878417 12383 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.879385 12383 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.881925 12383 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.882746 12383 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.883787 12383 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.885878 12383 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.886468 12383 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.887005 12383 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.889040 12383 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.889631 12383 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.890518 12383 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.892578 12383 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.893152 12383 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.894018 12383 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.895960 12383 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.896520 12383 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.896991 12383 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.898939 12383 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.899518 12383 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.900382 12383 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.902511 12383 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.903054 12383 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.903595 12383 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.905651 12383 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.906212 12383 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.907073 12383 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.909037 12383 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.909566 12383 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.910118 12383 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.912053 12383 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.912611 12383 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.913555 12383 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.915750 12383 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.916303 12383 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.917235 12383 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.919292 12383 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.919849 12383 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.920778 12383 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.922791 12383 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.923346 12383 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.923883 12383 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.926097 12383 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.926645 12383 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.927600 12383 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:09.942449 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
I20260811 16:08:10.372454 12383 tablet_server.cc:194] TabletServer@127.12.23.196:0 shutdown complete.
I20260811 16:08:10.491262 12383 master.cc:537] Master@127.12.23.254:34613 shutting down...
W20260811 16:08:14.940867 13612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 404 similar messages]
W20260811 16:08:14.944577 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:24.147418 13612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:24.151243 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:27.538811 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:27.540109 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:27.540680 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: stopping tablet replica
I20260811 16:08:27.760612 12383 master.cc:552] Master@127.12.23.254:34613 shutdown complete.
I20260811 16:08:27.821672 12383 test_util.cc:175] -----------------------------------------------
I20260811 16:08:27.821897 12383 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0

FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:589: Failure
Expected equality of these values:
  leader.second
    Which is: 4
  3
I20260811 16:09:49.839077 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
W20260811 16:09:49.876669 26667 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
W20260811 16:09:49.889232 26667 consensus_peers.cc:487] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:49.909632 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:49.910934 12383 tablet_replica.cc:330] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.912415 12383 raft_consensus.cc:2229] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.913467 12383 raft_consensus.cc:2258] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.926882 12383 tablet_replica.cc:330] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.927995 12383 raft_consensus.cc:2229] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.928643 12383 raft_consensus.cc:2258] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.931977 12383 tablet_replica.cc:330] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.933547 12383 raft_consensus.cc:2229] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:49.934830 12383 raft_consensus.cc:2258] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.938370 12383 tablet_replica.cc:330] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
W20260811 16:09:49.938216 26581 consensus_peers.cc:487] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:49.939460 12383 raft_consensus.cc:2229] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.940097 12383 raft_consensus.cc:2258] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.943024 12383 tablet_replica.cc:330] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.943866 12383 raft_consensus.cc:2229] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.944284 12383 raft_consensus.cc:2258] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.947547 12383 tablet_replica.cc:330] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.948280 12383 raft_consensus.cc:2229] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.948855 12383 raft_consensus.cc:2258] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.951752 12383 tablet_replica.cc:330] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.952514 12383 raft_consensus.cc:2229] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.953207 12383 raft_consensus.cc:2258] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.956255 12383 tablet_replica.cc:330] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.956930 12383 raft_consensus.cc:2229] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.957329 12383 raft_consensus.cc:2258] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.960400 12383 tablet_replica.cc:330] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.961037 12383 raft_consensus.cc:2229] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.961556 12383 raft_consensus.cc:2258] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.965566 12383 tablet_replica.cc:330] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.966358 12383 raft_consensus.cc:2229] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.966820 12383 raft_consensus.cc:2258] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.970430 12383 tablet_replica.cc:330] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.971094 12383 raft_consensus.cc:2229] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.971735 12383 raft_consensus.cc:2258] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.974472 12383 tablet_replica.cc:330] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.975095 12383 raft_consensus.cc:2229] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.975716 12383 raft_consensus.cc:2258] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.978219 12383 tablet_replica.cc:330] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.978821 12383 raft_consensus.cc:2229] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.979494 12383 raft_consensus.cc:2258] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.982550 12383 tablet_replica.cc:330] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.983125 12383 raft_consensus.cc:2229] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.983603 12383 raft_consensus.cc:2258] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.986228 12383 tablet_replica.cc:330] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.986893 12383 raft_consensus.cc:2229] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.987484 12383 raft_consensus.cc:2258] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.990410 12383 tablet_replica.cc:330] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.991017 12383 raft_consensus.cc:2229] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.991503 12383 raft_consensus.cc:2258] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.994180 12383 tablet_replica.cc:330] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.994729 12383 raft_consensus.cc:2229] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.995378 12383 raft_consensus.cc:2258] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.998035 12383 tablet_replica.cc:330] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.998554 12383 raft_consensus.cc:2229] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.999078 12383 raft_consensus.cc:2258] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:50.023644 26581 consensus_peers.cc:487] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.080924 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
W20260811 16:09:50.108160 26667 consensus_peers.cc:487] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.114245 26581 consensus_peers.cc:487] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.143298 26581 consensus_peers.cc:487] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.146252 26581 consensus_peers.cc:487] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.146714 26581 consensus_peers.cc:487] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.151587 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:09:50.162797 26667 consensus_peers.cc:487] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.167845 26664 consensus_peers.cc:487] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Couldn't send request to peer 7f4016f7a11141209b201c76a3c4ac20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.173609 26581 consensus_peers.cc:487] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.183117 26581 consensus_peers.cc:487] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.207974 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:50.208938 12383 tablet_replica.cc:330] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.210098 12383 raft_consensus.cc:2229] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.210718 12383 raft_consensus.cc:2258] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.213562 12383 tablet_replica.cc:330] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.214368 12383 raft_consensus.cc:2229] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.215015 12383 raft_consensus.cc:2258] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.217747 12383 tablet_replica.cc:330] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.218452 12383 raft_consensus.cc:2229] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.219700 12383 raft_consensus.cc:2258] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.223232 12383 tablet_replica.cc:330] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.224283 12383 raft_consensus.cc:2229] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.224907 12383 raft_consensus.cc:2258] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.228083 12383 tablet_replica.cc:330] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.228988 12383 raft_consensus.cc:2229] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.230268 12383 raft_consensus.cc:2258] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:50.231017 26664 consensus_peers.cc:487] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Couldn't send request to peer 7f4016f7a11141209b201c76a3c4ac20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.233198 12383 tablet_replica.cc:330] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.233995 12383 raft_consensus.cc:2229] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.234680 12383 raft_consensus.cc:2258] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.237625 12383 tablet_replica.cc:330] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.238320 12383 raft_consensus.cc:2229] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.239358 12383 raft_consensus.cc:2258] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.242004 12383 tablet_replica.cc:330] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.242686 12383 raft_consensus.cc:2229] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.243377 12383 raft_consensus.cc:2258] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.247064 12383 tablet_replica.cc:330] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.247800 12383 raft_consensus.cc:2229] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.248214 27123 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:50.249089 12383 raft_consensus.cc:2258] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.248862 27123 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:50.251286 27123 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:50.252627 12383 tablet_replica.cc:330] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.254485 12383 raft_consensus.cc:2229] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.255251 12383 raft_consensus.cc:2258] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:50.256062 26667 leader_election.cc:334] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111)
W20260811 16:09:50.257417 26664 leader_election.cc:334] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:09:50.257910 26664 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:50.258720 27123 raft_consensus.cc:2726] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:50.259073 12383 tablet_replica.cc:330] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.259884 12383 raft_consensus.cc:2229] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.260391 12383 raft_consensus.cc:2258] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.263505 12383 tablet_replica.cc:330] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.264384 12383 raft_consensus.cc:2229] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.265295 12383 raft_consensus.cc:2258] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.268235 12383 tablet_replica.cc:330] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.268882 12383 raft_consensus.cc:2229] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.269387 12383 raft_consensus.cc:2258] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.272110 12383 tablet_replica.cc:330] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.272680 12383 raft_consensus.cc:2229] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.273710 12383 raft_consensus.cc:2258] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.276331 12383 tablet_replica.cc:330] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.276921 12383 raft_consensus.cc:2229] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.277915 12383 raft_consensus.cc:2258] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.280428 12383 tablet_replica.cc:330] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.281086 12383 raft_consensus.cc:2229] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.282101 12383 raft_consensus.cc:2258] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.284610 12383 tablet_replica.cc:330] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.285372 12383 raft_consensus.cc:2229] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.285993 12383 raft_consensus.cc:2258] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.288853 12383 tablet_replica.cc:330] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.289443 12383 raft_consensus.cc:2229] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.289940 12383 raft_consensus.cc:2258] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.305316 27123 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:50.306059 27123 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:50.308651 27123 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
W20260811 16:09:50.313145 26664 leader_election.cc:334] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:09:50.313812 26667 leader_election.cc:334] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111)
I20260811 16:09:50.314318 26667 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:50.315086 27123 raft_consensus.cc:2726] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:09:50.344524 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
W20260811 16:09:50.385687 26664 consensus_peers.cc:487] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Couldn't send request to peer 7f4016f7a11141209b201c76a3c4ac20. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:36691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.386384 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
I20260811 16:09:50.425103 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:50.426069 12383 tablet_replica.cc:330] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.426853 12383 raft_consensus.cc:2229] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.427968 12383 raft_consensus.cc:2258] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.430580 12383 tablet_replica.cc:330] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.431339 12383 raft_consensus.cc:2229] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.431895 12383 raft_consensus.cc:2258] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.434289 12383 tablet_replica.cc:330] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.434973 12383 raft_consensus.cc:2229] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.435640 12383 raft_consensus.cc:2258] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.437952 12383 tablet_replica.cc:330] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.438632 12383 raft_consensus.cc:2229] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.439226 12383 raft_consensus.cc:2258] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.441457 12383 tablet_replica.cc:330] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.442119 12383 raft_consensus.cc:2229] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.442651 12383 raft_consensus.cc:2258] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.445142 12383 tablet_replica.cc:330] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.445765 12383 raft_consensus.cc:2229] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.446297 12383 raft_consensus.cc:2258] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.448678 12383 tablet_replica.cc:330] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.449267 12383 raft_consensus.cc:2229] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.449719 12383 raft_consensus.cc:2258] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.452030 12383 tablet_replica.cc:330] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.452672 12383 raft_consensus.cc:2229] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.453624 12383 raft_consensus.cc:2258] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.455904 12383 tablet_replica.cc:330] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.456566 12383 raft_consensus.cc:2229] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.457213 12383 raft_consensus.cc:2258] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.459507 12383 tablet_replica.cc:330] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.460122 12383 raft_consensus.cc:2229] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.460626 12383 raft_consensus.cc:2258] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.462922 12383 tablet_replica.cc:330] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.463706 12383 raft_consensus.cc:2229] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.464210 12383 raft_consensus.cc:2258] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.467064 12383 tablet_replica.cc:330] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.467751 12383 raft_consensus.cc:2229] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.468290 12383 raft_consensus.cc:2258] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.470634 12383 tablet_replica.cc:330] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.471190 12383 raft_consensus.cc:2229] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.471662 12383 raft_consensus.cc:2258] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.474016 12383 tablet_replica.cc:330] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.474581 12383 raft_consensus.cc:2229] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.475111 12383 raft_consensus.cc:2258] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.477432 12383 tablet_replica.cc:330] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.477981 12383 raft_consensus.cc:2229] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.478849 12383 raft_consensus.cc:2258] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.481149 12383 tablet_replica.cc:330] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.481658 12383 raft_consensus.cc:2229] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.482185 12383 raft_consensus.cc:2258] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.485373 12383 tablet_replica.cc:330] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.486047 12383 raft_consensus.cc:2229] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.486544 12383 raft_consensus.cc:2258] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.488878 12383 tablet_replica.cc:330] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.489364 12383 raft_consensus.cc:2229] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.489799 12383 raft_consensus.cc:2258] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.559639 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:09:50.602365 12383 master.cc:537] Master@127.12.23.254:42807 shutting down...
I20260811 16:09:50.632756 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.633466 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.633876 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: stopping tablet replica
I20260811 16:09:50.656797 12383 master.cc:552] Master@127.12.23.254:42807 shutdown complete.
I20260811 16:09:50.697476 12383 test_util.cc:175] -----------------------------------------------
I20260811 16:09:50.697796 12383 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0

[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260811 16:02:05.361492 12383 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.23.254:35557
I20260811 16:02:05.365854 12383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:02:05.367830 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:05.407220 12391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:05.407330 12392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:05.407354 12394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:05.409328 12383 server_base.cc:1034] running on GCE node
I20260811 16:02:06.742939 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:06.743342 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:06.743531 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464126743503 us; error 0 us; skew 500 ppm
I20260811 16:02:06.744796 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:06.752126 12383 webserver.cc:460] Webserver started at http://127.12.23.254:38253/ using document root <none> and password file <none>
I20260811 16:02:06.753549 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:06.753791 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:06.754420 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:06.762876 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/master-0-root/instance:
uuid: "dfcd381655ee4182965c3796f55d0909"
format_stamp: "Formatted at 2026-08-11 16:02:06 on dist-test-slave-chsk"
I20260811 16:02:06.775329 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.011s	user 0.005s	sys 0.006s
I20260811 16:02:06.783483 12400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:06.785380 12383 fs_manager.cc:725] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.003s
I20260811 16:02:06.785869 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/master-0-root
uuid: "dfcd381655ee4182965c3796f55d0909"
format_stamp: "Formatted at 2026-08-11 16:02:06 on dist-test-slave-chsk"
I20260811 16:02:06.786300 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:06.829779 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:06.832742 12383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:02:06.833454 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:07.075500 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.254:35557
I20260811 16:02:07.075706 12457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.254:35557 every 8 connection(s)
I20260811 16:02:07.093741 12458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:07.144380 12458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909: Bootstrap starting.
I20260811 16:02:07.158412 12458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:07.163220 12458 log.cc:824] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909: Log is configured to *not* fsync() on all Append() calls
I20260811 16:02:07.173496 12458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909: No bootstrap required, opened a new log
I20260811 16:02:07.217504 12458 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfcd381655ee4182965c3796f55d0909" member_type: VOTER }
I20260811 16:02:07.218525 12458 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:07.218986 12458 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfcd381655ee4182965c3796f55d0909, State: Initialized, Role: FOLLOWER
I20260811 16:02:07.220712 12458 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfcd381655ee4182965c3796f55d0909" member_type: VOTER }
I20260811 16:02:07.221683 12458 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:02:07.222203 12458 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:02:07.222723 12458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:07.229619 12458 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfcd381655ee4182965c3796f55d0909" member_type: VOTER }
I20260811 16:02:07.230865 12458 leader_election.cc:302] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfcd381655ee4182965c3796f55d0909; no voters: 
I20260811 16:02:07.233379 12458 leader_election.cc:288] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 16:02:07.233842 12461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:07.237980 12461 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 1 LEADER]: Becoming Leader. State: Replica: dfcd381655ee4182965c3796f55d0909, State: Running, Role: LEADER
I20260811 16:02:07.239295 12461 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfcd381655ee4182965c3796f55d0909" member_type: VOTER }
I20260811 16:02:07.240334 12458 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:02:07.257412 12463 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfcd381655ee4182965c3796f55d0909" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfcd381655ee4182965c3796f55d0909" member_type: VOTER } }
I20260811 16:02:07.258059 12463 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [sys.catalog]: This master's current role is: LEADER
I20260811 16:02:07.260609 12464 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfcd381655ee4182965c3796f55d0909. Latest consensus state: current_term: 1 leader_uuid: "dfcd381655ee4182965c3796f55d0909" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfcd381655ee4182965c3796f55d0909" member_type: VOTER } }
I20260811 16:02:07.261273 12464 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [sys.catalog]: This master's current role is: LEADER
I20260811 16:02:07.262179 12472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:02:07.282483 12472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:02:07.287907 12383 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:02:07.307255 12472 catalog_manager.cc:1347] Generated new cluster ID: 2fdcb36e42b5403eb4f04aaf29d48f07
I20260811 16:02:07.307658 12472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:02:07.332680 12472 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:02:07.334903 12472 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:02:07.349725 12472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909: Generated new TSK 0
I20260811 16:02:07.351359 12472 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:02:07.420835 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:07.434939 12485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:07.436995 12486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:07.440977 12383 server_base.cc:1034] running on GCE node
W20260811 16:02:07.441112 12489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:07.442133 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:07.442366 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:07.442587 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464127442549 us; error 0 us; skew 500 ppm
I20260811 16:02:07.443281 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:07.450866 12383 webserver.cc:460] Webserver started at http://127.12.23.193:43119/ using document root <none> and password file <none>
I20260811 16:02:07.451563 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:07.451805 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:07.452159 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:07.453492 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-0-root/instance:
uuid: "a27c491fc4f94a36a21d041084c2fca0"
format_stamp: "Formatted at 2026-08-11 16:02:07 on dist-test-slave-chsk"
I20260811 16:02:07.461553 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260811 16:02:07.468324 12496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:07.469333 12383 fs_manager.cc:725] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
I20260811 16:02:07.469699 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "a27c491fc4f94a36a21d041084c2fca0"
format_stamp: "Formatted at 2026-08-11 16:02:07 on dist-test-slave-chsk"
I20260811 16:02:07.470028 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:07.489781 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:07.491591 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:07.495369 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:02:07.501348 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:02:07.501731 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260811 16:02:07.502089 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:02:07.502264 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:07.675670 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:38169
I20260811 16:02:07.676087 12569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:38169 every 8 connection(s)
I20260811 16:02:07.688482 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:07.711560 12575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:07.721596 12576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:07.739341 12383 server_base.cc:1034] running on GCE node
W20260811 16:02:07.744288 12578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:07.745530 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:07.745781 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:07.745977 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464127745959 us; error 0 us; skew 500 ppm
I20260811 16:02:07.749243 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:07.751493 12570 heartbeater.cc:347] Connected to a master server at 127.12.23.254:35557
I20260811 16:02:07.752051 12570 heartbeater.cc:464] Registering TS with master...
I20260811 16:02:07.753235 12383 webserver.cc:460] Webserver started at http://127.12.23.194:46387/ using document root <none> and password file <none>
I20260811 16:02:07.753432 12570 heartbeater.cc:511] Master 127.12.23.254:35557 requested a full tablet report, sending...
I20260811 16:02:07.754002 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:07.754338 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:07.754803 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:07.756361 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-1-root/instance:
uuid: "f8a19dfafc734cc3880b953c04b907ed"
format_stamp: "Formatted at 2026-08-11 16:02:07 on dist-test-slave-chsk"
I20260811 16:02:07.758527 12419 ts_manager.cc:194] Registered new tserver with Master: a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169)
I20260811 16:02:07.762840 12419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57068
I20260811 16:02:07.764796 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260811 16:02:07.768963 12583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:07.769948 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:02:07.770248 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-1-root
uuid: "f8a19dfafc734cc3880b953c04b907ed"
format_stamp: "Formatted at 2026-08-11 16:02:07 on dist-test-slave-chsk"
I20260811 16:02:07.770527 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:07.828063 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:07.829540 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:07.831382 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:02:07.834785 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:02:07.835017 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:07.835414 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:02:07.835566 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:07.999194 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.194:37615
I20260811 16:02:07.999361 12653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.194:37615 every 8 connection(s)
I20260811 16:02:08.007700 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:08.019377 12657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:08.024919 12658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:08.031491 12654 heartbeater.cc:347] Connected to a master server at 127.12.23.254:35557
I20260811 16:02:08.032171 12654 heartbeater.cc:464] Registering TS with master...
I20260811 16:02:08.033581 12654 heartbeater.cc:511] Master 127.12.23.254:35557 requested a full tablet report, sending...
I20260811 16:02:08.038816 12419 ts_manager.cc:194] Registered new tserver with Master: f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:08.042351 12419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57076
I20260811 16:02:08.044302 12383 server_base.cc:1034] running on GCE node
W20260811 16:02:08.047093 12661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:08.048259 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:08.048769 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:08.049017 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464128048977 us; error 0 us; skew 500 ppm
I20260811 16:02:08.049585 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:08.052841 12383 webserver.cc:460] Webserver started at http://127.12.23.195:32845/ using document root <none> and password file <none>
I20260811 16:02:08.053406 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:08.053647 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:08.053954 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:08.055222 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-2-root/instance:
uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
format_stamp: "Formatted at 2026-08-11 16:02:08 on dist-test-slave-chsk"
I20260811 16:02:08.060439 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260811 16:02:08.064960 12666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:08.065986 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260811 16:02:08.066567 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-2-root
uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
format_stamp: "Formatted at 2026-08-11 16:02:08 on dist-test-slave-chsk"
I20260811 16:02:08.066936 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786464125124352-12383-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:08.090385 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:08.092178 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:08.095763 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:02:08.100893 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:02:08.101130 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:08.101629 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:02:08.101790 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:08.264681 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.195:39257
I20260811 16:02:08.265074 12742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.195:39257 every 8 connection(s)
I20260811 16:02:08.288568 12743 heartbeater.cc:347] Connected to a master server at 127.12.23.254:35557
I20260811 16:02:08.289127 12743 heartbeater.cc:464] Registering TS with master...
I20260811 16:02:08.290233 12743 heartbeater.cc:511] Master 127.12.23.254:35557 requested a full tablet report, sending...
I20260811 16:02:08.292923 12419 ts_manager.cc:194] Registered new tserver with Master: 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:08.293445 12383 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022727491s
I20260811 16:02:08.294656 12419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57084
I20260811 16:02:08.298074 12383 test_util.cc:268] Using random seed: -1748669385
I20260811 16:02:08.371282 12419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57096:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:02:08.376515 12419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:02:08.554489 12524 tablet_service.cc:1467] Processing CreateTablet for tablet a77a384dd03d4be1ac6b8123dea40cb3 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:02:08.556471 12524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77a384dd03d4be1ac6b8123dea40cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.573944 12523 tablet_service.cc:1467] Processing CreateTablet for tablet 21405d7971b14ab4a35d1fc36fb19476 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:02:08.577309 12523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21405d7971b14ab4a35d1fc36fb19476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.580957 12527 tablet_service.cc:1467] Processing CreateTablet for tablet e6fa8a013c76488b8bb9237b91d6db50 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:02:08.573796 12522 tablet_service.cc:1467] Processing CreateTablet for tablet c5e352ef474247afba334577ed77bf34 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:02:08.579421 12521 tablet_service.cc:1467] Processing CreateTablet for tablet 72e6525795fa4c1f8f38e33e352b45d4 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:02:08.571317 12520 tablet_service.cc:1467] Processing CreateTablet for tablet 964e53cff01b4fe584f7842346b4dabb (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:02:08.579499 12525 tablet_service.cc:1467] Processing CreateTablet for tablet 7771b13c97514a6cab9f73d5528b1810 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:02:08.588248 12696 tablet_service.cc:1467] Processing CreateTablet for tablet 72e6525795fa4c1f8f38e33e352b45d4 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:02:08.588588 12702 tablet_service.cc:1467] Processing CreateTablet for tablet e6fa8a013c76488b8bb9237b91d6db50 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:02:08.593732 12522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5e352ef474247afba334577ed77bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.586910 12528 tablet_service.cc:1467] Processing CreateTablet for tablet c735c53211dd4eb88d3ae2f494456997 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:02:08.593466 12694 tablet_service.cc:1467] Processing CreateTablet for tablet 964e53cff01b4fe584f7842346b4dabb (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:02:08.584075 12703 tablet_service.cc:1467] Processing CreateTablet for tablet c735c53211dd4eb88d3ae2f494456997 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:02:08.584067 12697 tablet_service.cc:1467] Processing CreateTablet for tablet c5e352ef474247afba334577ed77bf34 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:02:08.580992 12701 tablet_service.cc:1467] Processing CreateTablet for tablet 0bcd8a6bb0c64059994880e1b5ec5ff4 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:02:08.584134 12700 tablet_service.cc:1467] Processing CreateTablet for tablet 7771b13c97514a6cab9f73d5528b1810 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:02:08.586839 12699 tablet_service.cc:1467] Processing CreateTablet for tablet a77a384dd03d4be1ac6b8123dea40cb3 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:02:08.591643 12526 tablet_service.cc:1467] Processing CreateTablet for tablet 0bcd8a6bb0c64059994880e1b5ec5ff4 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:02:08.596375 12696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e6525795fa4c1f8f38e33e352b45d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.588188 12698 tablet_service.cc:1467] Processing CreateTablet for tablet 21405d7971b14ab4a35d1fc36fb19476 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:02:08.598553 12527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6fa8a013c76488b8bb9237b91d6db50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.602177 12698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21405d7971b14ab4a35d1fc36fb19476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.605846 12528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c735c53211dd4eb88d3ae2f494456997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.604990 12703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c735c53211dd4eb88d3ae2f494456997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.607647 12525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7771b13c97514a6cab9f73d5528b1810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.611599 12700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7771b13c97514a6cab9f73d5528b1810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.612730 12697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5e352ef474247afba334577ed77bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.614002 12521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e6525795fa4c1f8f38e33e352b45d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.615305 12702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6fa8a013c76488b8bb9237b91d6db50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.616384 12699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77a384dd03d4be1ac6b8123dea40cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.616447 12526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bcd8a6bb0c64059994880e1b5ec5ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.620012 12520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 964e53cff01b4fe584f7842346b4dabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.621021 12701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bcd8a6bb0c64059994880e1b5ec5ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.626658 12694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 964e53cff01b4fe584f7842346b4dabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.714290 12611 tablet_service.cc:1467] Processing CreateTablet for tablet 7771b13c97514a6cab9f73d5528b1810 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:02:08.721423 12611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7771b13c97514a6cab9f73d5528b1810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.721387 12613 tablet_service.cc:1467] Processing CreateTablet for tablet 0bcd8a6bb0c64059994880e1b5ec5ff4 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:02:08.721552 12615 tablet_service.cc:1467] Processing CreateTablet for tablet c735c53211dd4eb88d3ae2f494456997 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:02:08.732167 12609 tablet_service.cc:1467] Processing CreateTablet for tablet 21405d7971b14ab4a35d1fc36fb19476 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:02:08.728835 12610 tablet_service.cc:1467] Processing CreateTablet for tablet a77a384dd03d4be1ac6b8123dea40cb3 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:02:08.725957 12614 tablet_service.cc:1467] Processing CreateTablet for tablet e6fa8a013c76488b8bb9237b91d6db50 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:02:08.734757 12608 tablet_service.cc:1467] Processing CreateTablet for tablet c5e352ef474247afba334577ed77bf34 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:02:08.740309 12615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c735c53211dd4eb88d3ae2f494456997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.745877 12606 tablet_service.cc:1467] Processing CreateTablet for tablet 964e53cff01b4fe584f7842346b4dabb (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:02:08.744531 12607 tablet_service.cc:1467] Processing CreateTablet for tablet 72e6525795fa4c1f8f38e33e352b45d4 (DEFAULT_TABLE table=test-workload [id=a412c0109af24562ad79e01cedbd3db8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:02:08.755744 12613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bcd8a6bb0c64059994880e1b5ec5ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.768517 12570 heartbeater.cc:503] Master 127.12.23.254:35557 was elected leader, sending a full tablet report...
I20260811 16:02:08.774011 12610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a77a384dd03d4be1ac6b8123dea40cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.781922 12606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 964e53cff01b4fe584f7842346b4dabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.790258 12607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e6525795fa4c1f8f38e33e352b45d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.794555 12614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6fa8a013c76488b8bb9237b91d6db50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.797547 12608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5e352ef474247afba334577ed77bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.800388 12609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21405d7971b14ab4a35d1fc36fb19476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:08.816783 12763 tablet_bootstrap.cc:492] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:08.842201 12762 tablet_bootstrap.cc:492] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:08.888540 12763 tablet_bootstrap.cc:654] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:08.888557 12762 tablet_bootstrap.cc:654] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:08.908979 12763 tablet_bootstrap.cc:492] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:08.911516 12763 ts_tablet_manager.cc:1397] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.111s	user 0.003s	sys 0.016s
I20260811 16:02:08.915885 12764 tablet_bootstrap.cc:492] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:08.923542 12763 raft_consensus.cc:348] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.925735 12763 raft_consensus.cc:374] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:08.926059 12763 raft_consensus.cc:729] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:08.927007 12762 tablet_bootstrap.cc:492] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:08.927853 12762 ts_tablet_manager.cc:1397] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.012s
I20260811 16:02:08.931918 12762 raft_consensus.cc:348] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.932720 12762 raft_consensus.cc:374] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:08.933190 12762 raft_consensus.cc:729] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:08.933971 12762 consensus_queue.cc:260] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.928529 12763 consensus_queue.cc:260] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.941500 12762 ts_tablet_manager.cc:1428] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260811 16:02:08.943317 12762 tablet_bootstrap.cc:492] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:08.950672 12763 ts_tablet_manager.cc:1428] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.005s
I20260811 16:02:08.951203 12743 heartbeater.cc:503] Master 127.12.23.254:35557 was elected leader, sending a full tablet report...
I20260811 16:02:08.953272 12762 tablet_bootstrap.cc:654] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:08.951721 12763 tablet_bootstrap.cc:492] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:08.949086 12764 tablet_bootstrap.cc:654] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:08.963121 12763 tablet_bootstrap.cc:654] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:08.969161 12762 tablet_bootstrap.cc:492] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:08.969759 12762 ts_tablet_manager.cc:1397] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.014s
I20260811 16:02:08.973587 12762 raft_consensus.cc:348] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.974717 12762 raft_consensus.cc:374] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:08.975313 12762 raft_consensus.cc:729] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:08.976233 12762 consensus_queue.cc:260] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.976853 12763 tablet_bootstrap.cc:492] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:08.977742 12763 ts_tablet_manager.cc:1397] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260811 16:02:08.978839 12762 ts_tablet_manager.cc:1428] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260811 16:02:08.979985 12762 tablet_bootstrap.cc:492] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:08.981199 12763 raft_consensus.cc:348] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.981954 12763 raft_consensus.cc:374] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:08.982283 12763 raft_consensus.cc:729] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:08.983094 12763 consensus_queue.cc:260] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:08.985558 12763 ts_tablet_manager.cc:1428] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260811 16:02:08.986553 12763 tablet_bootstrap.cc:492] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:08.987782 12762 tablet_bootstrap.cc:654] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:08.994050 12763 tablet_bootstrap.cc:654] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.003299 12762 tablet_bootstrap.cc:492] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.006044 12762 ts_tablet_manager.cc:1397] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260811 16:02:09.008428 12763 tablet_bootstrap.cc:492] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.008936 12763 ts_tablet_manager.cc:1397] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.010s
I20260811 16:02:09.009682 12764 tablet_bootstrap.cc:492] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.010241 12764 ts_tablet_manager.cc:1397] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.009s
I20260811 16:02:09.010176 12762 raft_consensus.cc:348] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.011691 12762 raft_consensus.cc:374] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.012096 12762 raft_consensus.cc:729] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.012238 12763 raft_consensus.cc:348] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.013003 12763 raft_consensus.cc:374] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.013325 12763 raft_consensus.cc:729] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.013140 12762 consensus_queue.cc:260] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.014084 12763 consensus_queue.cc:260] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.016335 12762 ts_tablet_manager.cc:1428] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260811 16:02:09.016729 12763 ts_tablet_manager.cc:1428] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260811 16:02:09.017493 12762 tablet_bootstrap.cc:492] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:09.017750 12763 tablet_bootstrap.cc:492] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
W20260811 16:02:09.024804 12744 tablet.cc:2369] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:02:09.032646 12763 tablet_bootstrap.cc:654] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.037904 12762 tablet_bootstrap.cc:654] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.039280 12768 raft_consensus.cc:482] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.040132 12768 raft_consensus.cc:504] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.044283 12764 raft_consensus.cc:348] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.045965 12764 raft_consensus.cc:374] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.046754 12764 raft_consensus.cc:729] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.047117 12654 heartbeater.cc:503] Master 127.12.23.254:35557 was elected leader, sending a full tablet report...
I20260811 16:02:09.048926 12768 leader_election.cc:288] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.051726 12764 consensus_queue.cc:260] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.088070 12764 ts_tablet_manager.cc:1428] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.077s	user 0.012s	sys 0.006s
I20260811 16:02:09.089534 12764 tablet_bootstrap.cc:492] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.098225 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.101274 12763 tablet_bootstrap.cc:492] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.101792 12763 ts_tablet_manager.cc:1397] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.034s
I20260811 16:02:09.102869 12764 tablet_bootstrap.cc:654] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
W20260811 16:02:09.104753 12672 leader_election.cc:341] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.108191 12763 raft_consensus.cc:348] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.109254 12762 tablet_bootstrap.cc:492] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.109334 12763 raft_consensus.cc:374] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.113538 12763 raft_consensus.cc:729] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.113636 12775 raft_consensus.cc:482] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.109818 12762 ts_tablet_manager.cc:1397] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.034s
I20260811 16:02:09.114425 12775 raft_consensus.cc:504] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.114836 12763 consensus_queue.cc:260] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.119292 12775 leader_election.cc:288] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.136240 12763 ts_tablet_manager.cc:1428] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.005s
I20260811 16:02:09.140209 12763 tablet_bootstrap.cc:492] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:09.142627 12762 raft_consensus.cc:348] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.143662 12762 raft_consensus.cc:374] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.148773 12762 raft_consensus.cc:729] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.152535 12762 consensus_queue.cc:260] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.153978 12764 tablet_bootstrap.cc:492] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.154595 12764 ts_tablet_manager.cc:1397] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.016s
I20260811 16:02:09.168546 12762 ts_tablet_manager.cc:1428] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.000s
I20260811 16:02:09.168922 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.170500 12762 tablet_bootstrap.cc:492] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
W20260811 16:02:09.172447 12672 leader_election.cc:341] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.171182 12764 raft_consensus.cc:348] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.173106 12672 leader_election.cc:302] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f; no voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.173442 12764 raft_consensus.cc:374] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.173854 12764 raft_consensus.cc:729] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.174360 12768 raft_consensus.cc:2726] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.174865 12764 consensus_queue.cc:260] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.177589 12767 raft_consensus.cc:482] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.178480 12767 raft_consensus.cc:504] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.181945 12763 tablet_bootstrap.cc:654] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.184713 12767 leader_election.cc:288] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.192011 12764 ts_tablet_manager.cc:1428] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.004s
I20260811 16:02:09.204541 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.205749 12538 raft_consensus.cc:2454] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 0.
I20260811 16:02:09.216377 12764 tablet_bootstrap.cc:492] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.216284 12588 leader_election.cc:302] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:09.225881 12775 raft_consensus.cc:2781] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.229938 12764 tablet_bootstrap.cc:654] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.226358 12775 raft_consensus.cc:482] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.232555 12775 raft_consensus.cc:3037] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.236713 12768 raft_consensus.cc:482] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.237634 12768 raft_consensus.cc:504] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.242353 12768 leader_election.cc:288] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.243959 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.244144 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.245076 12538 raft_consensus.cc:2454] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 0.
W20260811 16:02:09.245688 12672 leader_election.cc:341] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.246465 12672 leader_election.cc:302] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.249377 12768 raft_consensus.cc:2781] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.250542 12768 raft_consensus.cc:482] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.252432 12768 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.254449 12762 tablet_bootstrap.cc:654] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.257718 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
W20260811 16:02:09.263942 12585 leader_election.cc:341] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.266762 12763 tablet_bootstrap.cc:492] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.268530 12763 ts_tablet_manager.cc:1397] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.021s
I20260811 16:02:09.270131 12775 raft_consensus.cc:504] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
W20260811 16:02:09.274859 12475 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:02:09.281375 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
W20260811 16:02:09.291496 12501 leader_election.cc:341] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.294405 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:09.295329 12538 raft_consensus.cc:3037] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.297171 12763 raft_consensus.cc:348] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.298260 12763 raft_consensus.cc:374] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.298578 12763 raft_consensus.cc:729] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.299394 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:09.299319 12763 consensus_queue.cc:260] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.298069 12775 leader_election.cc:288] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
W20260811 16:02:09.301906 12585 leader_election.cc:341] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.296149 12768 raft_consensus.cc:504] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.304694 12764 tablet_bootstrap.cc:492] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.305580 12764 ts_tablet_manager.cc:1397] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.014s
I20260811 16:02:09.312572 12762 tablet_bootstrap.cc:492] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.312263 12764 raft_consensus.cc:348] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.314917 12768 leader_election.cc:288] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.314117 12762 ts_tablet_manager.cc:1397] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.010s
I20260811 16:02:09.315518 12768 raft_consensus.cc:482] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.316222 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:09.316026 12768 raft_consensus.cc:504] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.315960 12537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:09.317660 12537 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.318277 12768 leader_election.cc:288] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.314286 12764 raft_consensus.cc:374] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.319121 12764 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.319322 12762 raft_consensus.cc:348] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.320184 12762 raft_consensus.cc:374] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.320523 12762 raft_consensus.cc:729] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.320065 12764 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.321376 12762 consensus_queue.cc:260] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.323127 12764 ts_tablet_manager.cc:1428] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260811 16:02:09.323823 12762 ts_tablet_manager.cc:1428] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:02:09.323724 12536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.324186 12764 tablet_bootstrap.cc:492] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.324826 12762 tablet_bootstrap.cc:492] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:09.326503 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
W20260811 16:02:09.328315 12672 leader_election.cc:341] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:02:09.332084 12672 leader_election.cc:341] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.335752 12764 tablet_bootstrap.cc:654] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.335943 12537 raft_consensus.cc:2454] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 1.
W20260811 16:02:09.339044 12672 leader_election.cc:341] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.339581 12672 leader_election.cc:302] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f; no voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.340799 12672 leader_election.cc:302] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.342769 12768 raft_consensus.cc:2781] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.343464 12762 tablet_bootstrap.cc:654] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.341528 12792 raft_consensus.cc:2726] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.343484 12768 raft_consensus.cc:686] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:09.348277 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.352491 12768 consensus_queue.cc:237] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.353242 12498 leader_election.cc:302] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.354631 12767 raft_consensus.cc:2726] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.359943 12538 raft_consensus.cc:2454] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 1.
I20260811 16:02:09.364187 12588 leader_election.cc:302] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 3e9f006c4fb5462f8bcb4e933014f39f
I20260811 16:02:09.366015 12775 raft_consensus.cc:2781] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.365316 12763 ts_tablet_manager.cc:1428] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.096s	user 0.019s	sys 0.015s
I20260811 16:02:09.371656 12763 tablet_bootstrap.cc:492] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:09.382426 12762 tablet_bootstrap.cc:492] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.383646 12762 ts_tablet_manager.cc:1397] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.006s
I20260811 16:02:09.385702 12775 raft_consensus.cc:686] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:09.389195 12775 consensus_queue.cc:237] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.391191 12764 tablet_bootstrap.cc:492] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.394685 12764 ts_tablet_manager.cc:1397] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.008s
I20260811 16:02:09.401391 12419 catalog_manager.cc:5495] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 1 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:09.411320 12763 tablet_bootstrap.cc:654] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.413348 12764 raft_consensus.cc:348] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.414211 12764 raft_consensus.cc:374] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.414559 12764 raft_consensus.cc:729] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.413666 12762 raft_consensus.cc:348] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.415092 12762 raft_consensus.cc:374] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.415364 12764 consensus_queue.cc:260] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.415652 12762 raft_consensus.cc:729] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.417876 12764 ts_tablet_manager.cc:1428] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260811 16:02:09.419111 12764 tablet_bootstrap.cc:492] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.418752 12762 consensus_queue.cc:260] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.421249 12762 ts_tablet_manager.cc:1428] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260811 16:02:09.422627 12762 tablet_bootstrap.cc:492] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:09.437045 12762 tablet_bootstrap.cc:654] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.436592 12417 catalog_manager.cc:5495] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 1 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:09.444600 12764 tablet_bootstrap.cc:654] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.453869 12763 tablet_bootstrap.cc:492] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.455013 12767 raft_consensus.cc:482] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.455798 12767 raft_consensus.cc:504] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.458159 12767 leader_election.cc:288] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.459561 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.460480 12715 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:09.460608 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.461340 12626 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:09.455057 12763 ts_tablet_manager.cc:1397] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.018s
I20260811 16:02:09.461833 12498 leader_election.cc:302] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:09.463315 12764 tablet_bootstrap.cc:492] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.464059 12764 ts_tablet_manager.cc:1397] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.012s
I20260811 16:02:09.465842 12767 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.466542 12767 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.467871 12764 raft_consensus.cc:348] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.469249 12764 raft_consensus.cc:374] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.470456 12764 raft_consensus.cc:729] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.472941 12768 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.473341 12767 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.473421 12806 raft_consensus.cc:2781] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.473896 12806 raft_consensus.cc:482] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.473613 12768 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.474329 12806 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.474471 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
W20260811 16:02:09.476967 12501 leader_election.cc:341] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.477093 12763 raft_consensus.cc:348] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.477873 12768 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.478214 12763 raft_consensus.cc:374] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.479111 12763 raft_consensus.cc:729] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.479928 12764 consensus_queue.cc:260] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.480176 12763 consensus_queue.cc:260] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.482983 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.483623 12763 ts_tablet_manager.cc:1428] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.004s
I20260811 16:02:09.483775 12715 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:09.484203 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.485108 12538 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 0.
I20260811 16:02:09.487897 12672 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:09.488108 12763 tablet_bootstrap.cc:492] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:09.488770 12768 raft_consensus.cc:2781] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.489199 12768 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.488925 12498 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.489593 12768 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.490217 12767 raft_consensus.cc:2781] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.490649 12767 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.490993 12767 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.495518 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
W20260811 16:02:09.497097 12672 leader_election.cc:341] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.497334 12768 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.499732 12764 ts_tablet_manager.cc:1428] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.004s
I20260811 16:02:09.500391 12767 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.500931 12764 tablet_bootstrap.cc:492] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.500667 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:09.502424 12767 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.502990 12767 raft_consensus.cc:482] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:02:09.504189 12672 leader_election.cc:341] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.506024 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:09.506883 12762 tablet_bootstrap.cc:492] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.507313 12538 raft_consensus.cc:2379] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e9f006c4fb5462f8bcb4e933014f39f in current term 1: Already voted for candidate a27c491fc4f94a36a21d041084c2fca0 in this term.
I20260811 16:02:09.507434 12762 ts_tablet_manager.cc:1397] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.012s
I20260811 16:02:09.508145 12763 tablet_bootstrap.cc:654] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.505270 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:09.499488 12768 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
W20260811 16:02:09.511176 12501 leader_election.cc:341] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.509078 12672 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f; no voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.512048 12762 raft_consensus.cc:348] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.512898 12762 raft_consensus.cc:374] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.513227 12762 raft_consensus.cc:729] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.513971 12762 consensus_queue.cc:260] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.515098 12768 raft_consensus.cc:2726] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.510771 12767 raft_consensus.cc:504] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.517153 12762 ts_tablet_manager.cc:1428] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260811 16:02:09.517969 12767 leader_election.cc:288] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.518198 12762 tablet_bootstrap.cc:492] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:09.519274 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
W20260811 16:02:09.520977 12501 leader_election.cc:341] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.519935 12764 tablet_bootstrap.cc:654] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.530119 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:09.531034 12715 raft_consensus.cc:2379] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a27c491fc4f94a36a21d041084c2fca0 in current term 1: Already voted for candidate 3e9f006c4fb5462f8bcb4e933014f39f in this term.
I20260811 16:02:09.533236 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.533993 12715 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:09.535867 12498 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.539160 12806 raft_consensus.cc:504] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.537216 12498 leader_election.cc:302] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.547382 12767 raft_consensus.cc:2726] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.548663 12762 tablet_bootstrap.cc:654] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.548374 12767 raft_consensus.cc:2781] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.553345 12767 raft_consensus.cc:482] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.554013 12767 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.554121 12775 raft_consensus.cc:482] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.554657 12775 raft_consensus.cc:504] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.557067 12775 leader_election.cc:288] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.558308 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.559221 12538 raft_consensus.cc:2379] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a19dfafc734cc3880b953c04b907ed in current term 1: Already voted for candidate 3e9f006c4fb5462f8bcb4e933014f39f in this term.
I20260811 16:02:09.560947 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.564424 12585 leader_election.cc:302] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a19dfafc734cc3880b953c04b907ed; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:09.567384 12775 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.569698 12798 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.571089 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:09.570318 12798 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.572738 12626 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.577466 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.578053 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.576800 12798 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
W20260811 16:02:09.578827 12588 leader_election.cc:341] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:02:09.580338 12585 leader_election.cc:341] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.581207 12585 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a19dfafc734cc3880b953c04b907ed; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:09.582406 12798 raft_consensus.cc:2726] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.585832 12775 raft_consensus.cc:2726] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.587116 12768 raft_consensus.cc:482] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.585134 12798 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.587951 12768 raft_consensus.cc:504] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.588474 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:09.588222 12798 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.589095 12715 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.584043 12806 leader_election.cc:288] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.592279 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964e53cff01b4fe584f7842346b4dabb" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.592269 12768 leader_election.cc:288] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.596268 12538 raft_consensus.cc:2454] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 0.
I20260811 16:02:09.583685 12767 raft_consensus.cc:504] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.598031 12763 tablet_bootstrap.cc:492] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.598449 12672 leader_election.cc:302] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:09.603240 12763 ts_tablet_manager.cc:1397] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.022s
I20260811 16:02:09.603716 12768 raft_consensus.cc:2781] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.601361 12715 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:09.601959 12764 tablet_bootstrap.cc:492] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.605445 12764 ts_tablet_manager.cc:1397] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.005s
I20260811 16:02:09.606055 12767 leader_election.cc:288] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.602408 12714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.602300 12798 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.599261 12626 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:09.604302 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.604411 12768 raft_consensus.cc:482] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.608847 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
W20260811 16:02:09.612040 12585 leader_election.cc:341] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.612355 12712 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.613351 12498 leader_election.cc:302] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:09.614846 12767 raft_consensus.cc:2781] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.612083 12768 raft_consensus.cc:3037] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.615769 12767 raft_consensus.cc:686] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:09.617821 12767 consensus_queue.cc:237] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.607925 12763 raft_consensus.cc:348] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.622769 12763 raft_consensus.cc:374] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.624974 12763 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.625273 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964e53cff01b4fe584f7842346b4dabb" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.626688 12763 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.628176 12764 raft_consensus.cc:348] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.629199 12764 raft_consensus.cc:374] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.632678 12763 ts_tablet_manager.cc:1428] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.001s
I20260811 16:02:09.633862 12762 tablet_bootstrap.cc:492] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.634521 12762 ts_tablet_manager.cc:1397] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.014s
I20260811 16:02:09.634413 12763 tablet_bootstrap.cc:492] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:09.629667 12764 raft_consensus.cc:729] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.636370 12764 consensus_queue.cc:260] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.647954 12762 raft_consensus.cc:348] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.649060 12762 raft_consensus.cc:374] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.649480 12762 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.650012 12768 raft_consensus.cc:504] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.650236 12762 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.653429 12762 ts_tablet_manager.cc:1428] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.009s
W20260811 16:02:09.642627 12588 leader_election.cc:341] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.653957 12588 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a19dfafc734cc3880b953c04b907ed; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:09.654636 12762 tablet_bootstrap.cc:492] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: Bootstrap starting.
I20260811 16:02:09.655644 12417 catalog_manager.cc:5495] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:09.661159 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964e53cff01b4fe584f7842346b4dabb" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:09.662070 12538 raft_consensus.cc:3037] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.659317 12798 raft_consensus.cc:2726] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.667725 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:09.669108 12624 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.660110 12768 leader_election.cc:288] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
W20260811 16:02:09.672974 12672 leader_election.cc:341] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.674579 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "964e53cff01b4fe584f7842346b4dabb" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
W20260811 16:02:09.677640 12672 leader_election.cc:341] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.682961 12763 tablet_bootstrap.cc:654] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.684599 12712 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:09.685612 12764 ts_tablet_manager.cc:1428] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.080s	user 0.012s	sys 0.001s
I20260811 16:02:09.686656 12498 leader_election.cc:302] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:09.687623 12767 raft_consensus.cc:2781] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.688156 12767 raft_consensus.cc:686] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:09.687634 12764 tablet_bootstrap.cc:492] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.689131 12767 consensus_queue.cc:237] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.695696 12538 raft_consensus.cc:2454] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 1.
I20260811 16:02:09.697645 12672 leader_election.cc:302] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.699195 12768 raft_consensus.cc:2781] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.704273 12768 raft_consensus.cc:686] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:09.706315 12768 consensus_queue.cc:237] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.707662 12762 tablet_bootstrap.cc:654] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.723320 12763 tablet_bootstrap.cc:492] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.724076 12763 ts_tablet_manager.cc:1397] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.020s
I20260811 16:02:09.726202 12624 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:09.729429 12763 raft_consensus.cc:348] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.731241 12763 raft_consensus.cc:374] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.731585 12763 raft_consensus.cc:729] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.731032 12764 tablet_bootstrap.cc:654] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.732730 12763 consensus_queue.cc:260] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.741422 12763 ts_tablet_manager.cc:1428] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.003s
I20260811 16:02:09.742566 12763 tablet_bootstrap.cc:492] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f: Bootstrap starting.
I20260811 16:02:09.747220 12762 tablet_bootstrap.cc:492] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: No bootstrap required, opened a new log
I20260811 16:02:09.747949 12762 ts_tablet_manager.cc:1397] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: Time spent bootstrapping tablet: real 0.094s	user 0.020s	sys 0.005s
I20260811 16:02:09.746156 12418 catalog_manager.cc:5495] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:09.756942 12762 raft_consensus.cc:348] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.757521 12762 raft_consensus.cc:374] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.757814 12762 raft_consensus.cc:729] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.757892 12416 catalog_manager.cc:5495] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 1 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:09.758605 12762 consensus_queue.cc:260] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.763849 12762 ts_tablet_manager.cc:1428] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260811 16:02:09.766502 12767 raft_consensus.cc:482] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.767390 12767 raft_consensus.cc:504] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.769176 12763 tablet_bootstrap.cc:654] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.776328 12767 leader_election.cc:288] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.776243 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.776247 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
W20260811 16:02:09.779654 12501 leader_election.cc:341] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.780306 12712 raft_consensus.cc:2454] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:09.782701 12763 tablet_bootstrap.cc:492] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f: No bootstrap required, opened a new log
I20260811 16:02:09.782557 12498 leader_election.cc:302] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.783257 12763 ts_tablet_manager.cc:1397] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.009s
I20260811 16:02:09.785912 12767 raft_consensus.cc:2781] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.786433 12767 raft_consensus.cc:482] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.786948 12767 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.787765 12763 raft_consensus.cc:348] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.788436 12763 raft_consensus.cc:374] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.788684 12763 raft_consensus.cc:729] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.789398 12763 consensus_queue.cc:260] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.791812 12763 ts_tablet_manager.cc:1428] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:02:09.805045 12767 raft_consensus.cc:504] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.805945 12764 tablet_bootstrap.cc:492] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.806565 12764 ts_tablet_manager.cc:1397] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.119s	user 0.001s	sys 0.023s
I20260811 16:02:09.808280 12767 leader_election.cc:288] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.809892 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
W20260811 16:02:09.812608 12501 leader_election.cc:341] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:09.815192 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:09.815900 12712 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.816157 12764 raft_consensus.cc:348] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.817003 12768 raft_consensus.cc:482] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.817358 12764 raft_consensus.cc:374] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.817881 12764 raft_consensus.cc:729] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.817858 12768 raft_consensus.cc:504] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.819326 12764 consensus_queue.cc:260] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.821163 12768 leader_election.cc:288] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.824427 12764 ts_tablet_manager.cc:1428] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.002s
I20260811 16:02:09.825567 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.826025 12764 tablet_bootstrap.cc:492] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.830856 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.832736 12538 raft_consensus.cc:2379] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e9f006c4fb5462f8bcb4e933014f39f in current term 1: Already voted for candidate f8a19dfafc734cc3880b953c04b907ed in this term.
I20260811 16:02:09.837327 12793 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.838649 12672 leader_election.cc:302] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f; no voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.838798 12793 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.840814 12768 raft_consensus.cc:3037] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.841148 12793 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.843631 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:09.844704 12626 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 0.
I20260811 16:02:09.847494 12764 tablet_bootstrap.cc:654] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.847575 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.847743 12672 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:09.848584 12538 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 0.
I20260811 16:02:09.849164 12793 raft_consensus.cc:2781] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:09.849555 12793 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:09.849959 12793 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.858336 12764 tablet_bootstrap.cc:492] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.857725 12793 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.859272 12764 ts_tablet_manager.cc:1397] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.020s
I20260811 16:02:09.861781 12793 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:09.865207 12764 raft_consensus.cc:348] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.864972 12793 consensus_queue.cc:1035] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:02:09.866483 12764 raft_consensus.cc:374] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.867094 12764 raft_consensus.cc:729] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.868294 12764 consensus_queue.cc:260] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.871411 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:09.872429 12768 raft_consensus.cc:2726] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:09.872601 12538 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.873543 12712 raft_consensus.cc:2454] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:09.875037 12498 leader_election.cc:302] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:09.876870 12767 raft_consensus.cc:2781] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.877539 12767 raft_consensus.cc:686] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:09.878841 12767 consensus_queue.cc:237] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.883823 12798 raft_consensus.cc:482] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.884209 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:09.885052 12764 ts_tablet_manager.cc:1428] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.005s
I20260811 16:02:09.884866 12624 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.884557 12798 raft_consensus.cc:504] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.893282 12537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:09.894011 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:09.894164 12813 consensus_queue.cc:1035] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:09.896100 12712 raft_consensus.cc:2379] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a19dfafc734cc3880b953c04b907ed in current term 1: Already voted for candidate a27c491fc4f94a36a21d041084c2fca0 in this term.
I20260811 16:02:09.893172 12798 leader_election.cc:288] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:09.897953 12764 tablet_bootstrap.cc:492] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed: Bootstrap starting.
I20260811 16:02:09.898556 12585 leader_election.cc:302] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a19dfafc734cc3880b953c04b907ed; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:09.903910 12813 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:09.908331 12764 tablet_bootstrap.cc:654] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:09.912226 12798 consensus_queue.cc:1035] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:09.929708 12538 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 1.
I20260811 16:02:09.935796 12672 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:09.937501 12768 raft_consensus.cc:2781] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:09.938248 12768 raft_consensus.cc:686] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:09.941180 12768 consensus_queue.cc:237] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.950752 12764 tablet_bootstrap.cc:492] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed: No bootstrap required, opened a new log
I20260811 16:02:09.951363 12764 ts_tablet_manager.cc:1397] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.006s
I20260811 16:02:09.960703 12764 raft_consensus.cc:348] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.965256 12764 raft_consensus.cc:374] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:09.965549 12764 raft_consensus.cc:729] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Initialized, Role: FOLLOWER
I20260811 16:02:09.957950 12806 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:09.966563 12764 consensus_queue.cc:260] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.968083 12806 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:09.957917 12624 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 1.
I20260811 16:02:09.998584 12813 raft_consensus.cc:2726] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:10.000135 12764 ts_tablet_manager.cc:1428] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260811 16:02:10.020185 12419 catalog_manager.cc:5495] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:10.011339 12624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:10.008908 12806 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:10.040544 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:10.033238 12624 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:10.034979 12768 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:10.046509 12501 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:10.069420 12806 raft_consensus.cc:2781] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:10.070765 12806 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:10.071842 12806 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:10.081054 12813 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:10.081148 12793 consensus_queue.cc:1035] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.081784 12813 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:10.088078 12813 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:10.102787 12714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
I20260811 16:02:10.112138 12537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:10.118296 12537 raft_consensus.cc:2379] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a19dfafc734cc3880b953c04b907ed in current term 1: Already voted for candidate a27c491fc4f94a36a21d041084c2fca0 in this term.
I20260811 16:02:10.089805 12768 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:10.140098 12715 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 0.
I20260811 16:02:10.140089 12714 raft_consensus.cc:2379] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a19dfafc734cc3880b953c04b907ed in current term 1: Already voted for candidate 3e9f006c4fb5462f8bcb4e933014f39f in this term.
I20260811 16:02:10.153959 12768 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:10.156409 12806 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:10.165524 12806 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
W20260811 16:02:10.280541 12475 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:02:10.288940 12623 raft_consensus.cc:3037] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:10.301380 12824 consensus_queue.cc:1035] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.341958 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:10.342738 12626 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 0.
I20260811 16:02:10.344205 12672 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:10.345495 12793 raft_consensus.cc:2781] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:10.346006 12793 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:10.346401 12793 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:10.347666 12418 catalog_manager.cc:5495] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 1 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:10.354714 12535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0" is_pre_election: true
I20260811 16:02:10.355659 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:10.356283 12535 raft_consensus.cc:2379] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e9f006c4fb5462f8bcb4e933014f39f in current term 1: Already voted for candidate a27c491fc4f94a36a21d041084c2fca0 in this term.
I20260811 16:02:10.356292 12626 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:10.361176 12793 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:10.364213 12793 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:10.368408 12767 consensus_queue.cc:1035] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.372511 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:10.373189 12626 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:10.373694 12715 raft_consensus.cc:2379] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a27c491fc4f94a36a21d041084c2fca0 in current term 1: Already voted for candidate 3e9f006c4fb5462f8bcb4e933014f39f in this term.
I20260811 16:02:10.374989 12501 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:10.376346 12767 raft_consensus.cc:2781] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:10.377063 12767 raft_consensus.cc:686] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:10.378429 12767 consensus_queue.cc:237] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:10.383824 12806 consensus_queue.cc:1035] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.405678 12767 consensus_queue.cc:1035] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.406967 12837 consensus_queue.cc:1035] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 16:02:10.409799 12837 consensus_queue.cc:1035] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.414615 12534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:10.456073 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:10.453243 12793 consensus_queue.cc:1035] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 16:02:10.457111 12626 raft_consensus.cc:2379] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e9f006c4fb5462f8bcb4e933014f39f in current term 1: Already voted for candidate a27c491fc4f94a36a21d041084c2fca0 in this term.
I20260811 16:02:10.480573 12585 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a19dfafc734cc3880b953c04b907ed; no voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:10.522970 12840 consensus_queue.cc:1035] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260811 16:02:10.637969 12813 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:10.663443 12824 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.676371 12672 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f; no voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:10.678648 12768 raft_consensus.cc:2726] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:02:10.706509 12768 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.712072 12418 catalog_manager.cc:5495] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
W20260811 16:02:10.756458 12585 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:39257, user_credentials={real_user=slave}} blocked reactor thread for 250982us
I20260811 16:02:10.769666 12813 raft_consensus.cc:2726] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:10.884068 12840 consensus_queue.cc:1035] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:10.913270 12840 consensus_queue.cc:1035] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:02:11.282334 12475 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:02:11.484548 12840 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:11.485095 12840 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:11.486750 12840 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
W20260811 16:02:11.487203 12650 debug-util.cc:398] Leaking SignalData structure 0x7b080012b060 after lost signal to thread 12388
I20260811 16:02:11.487748 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed" is_pre_election: true
I20260811 16:02:11.487927 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" is_pre_election: true
W20260811 16:02:11.488124 12650 debug-util.cc:398] Leaking SignalData structure 0x7b080012b740 after lost signal to thread 12457
I20260811 16:02:11.488437 12626 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
I20260811 16:02:11.488596 12712 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 1.
W20260811 16:02:11.489256 12650 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2ac0 after lost signal to thread 12569
I20260811 16:02:11.489663 12501 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
W20260811 16:02:11.490271 12650 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1d80 after lost signal to thread 12653
W20260811 16:02:11.491209 12650 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9960 after lost signal to thread 12742
I20260811 16:02:11.491292 12840 raft_consensus.cc:2781] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:02:11.491678 12840 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:11.492015 12840 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:11.496958 12840 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:11.498672 12840 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:11.499688 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:11.500257 12626 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:11.500052 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:11.500730 12712 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:11.506155 12626 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 2.
I20260811 16:02:11.507361 12501 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:11.508090 12840 raft_consensus.cc:2781] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:11.508415 12712 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 2.
I20260811 16:02:11.508589 12840 raft_consensus.cc:686] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:11.510073 12840 consensus_queue.cc:237] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:11.519760 12419 catalog_manager.cc:5495] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 0 to 2, leader changed from <none> to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:12.060501 12712 raft_consensus.cc:1261] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:02:12.062070 12840 consensus_queue.cc:1035] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:12.097343 12626 raft_consensus.cc:1261] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:02:12.105754 12767 consensus_queue.cc:1035] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:12.110052 12712 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
mode: GRACEFUL
new_leader_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:38254
I20260811 16:02:12.110878 12712 raft_consensus.cc:595] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Received request to transfer leadership to TS a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:12.136859 12538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:54412
I20260811 16:02:12.137586 12538 raft_consensus.cc:595] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:12.142741 12538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:54412
I20260811 16:02:12.143484 12538 raft_consensus.cc:595] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:12.148656 12712 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:38254
I20260811 16:02:12.149375 12712 raft_consensus.cc:595] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:12.176996 12872 raft_consensus.cc:979] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:12.177559 12793 raft_consensus.cc:1067] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:12.179503 12626 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34382
I20260811 16:02:12.180078 12626 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:12.180395 12626 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.185702 12626 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.187693 12626 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:12.188676 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:12.188689 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:12.189639 12712 raft_consensus.cc:3032] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:12.189625 12538 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.190186 12712 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:12.191025 12712 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.192534 12712 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.196767 12538 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:12.198071 12588 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:12.198923 12850 raft_consensus.cc:2781] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:12.199092 12712 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:12.203611 12850 raft_consensus.cc:686] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:12.204670 12850 consensus_queue.cc:237] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.212855 12419 catalog_manager.cc:5495] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 1 to 2, leader changed from 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 2 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:12.255525 12867 raft_consensus.cc:979] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:12.255990 12767 raft_consensus.cc:1067] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:12.257735 12626 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34394
I20260811 16:02:12.258271 12626 raft_consensus.cc:482] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:12.258599 12626 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.263679 12626 raft_consensus.cc:504] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.265326 12626 leader_election.cc:288] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:12.266492 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:12.266492 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:12.267324 12712 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.267478 12538 raft_consensus.cc:3032] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:12.267918 12538 raft_consensus.cc:729] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:12.268797 12538 consensus_queue.cc:260] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.270207 12538 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.272751 12712 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:12.273886 12585 leader_election.cc:302] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:12.274682 12850 raft_consensus.cc:2781] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:12.275133 12850 raft_consensus.cc:686] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:12.275920 12850 consensus_queue.cc:237] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.278107 12538 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:12.283313 12419 catalog_manager.cc:5495] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 1 to 2, leader changed from a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 2 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:12.301272 12872 raft_consensus.cc:979] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: : Instructing follower a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:12.301731 12793 raft_consensus.cc:1067] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Signalling peer a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:12.303593 12538 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:54398
I20260811 16:02:12.304282 12538 raft_consensus.cc:482] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:12.304718 12538 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.312376 12538 raft_consensus.cc:504] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.314671 12538 leader_election.cc:288] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:12.315728 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:12.315728 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:12.316429 12712 raft_consensus.cc:3032] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:12.316684 12626 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.316784 12712 raft_consensus.cc:729] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:12.317636 12712 consensus_queue.cc:260] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.318962 12712 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.324030 12626 raft_consensus.cc:2454] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 2.
I20260811 16:02:12.325300 12501 leader_election.cc:302] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:12.325924 12712 raft_consensus.cc:2454] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 2.
I20260811 16:02:12.326267 12767 raft_consensus.cc:2781] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:12.326870 12767 raft_consensus.cc:686] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:12.327795 12767 consensus_queue.cc:237] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.336328 12419 catalog_manager.cc:5495] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 1 to 2, leader changed from 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195) to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:12.346776 12867 raft_consensus.cc:979] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:12.347275 12767 raft_consensus.cc:1067] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:12.348941 12626 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34394
I20260811 16:02:12.349493 12626 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:12.349805 12626 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.355671 12626 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.357368 12626 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:12.358624 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:12.358597 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:12.359440 12538 raft_consensus.cc:3032] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:12.359500 12712 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.359910 12538 raft_consensus.cc:729] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:12.360657 12538 consensus_queue.cc:260] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.361687 12538 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:12.366551 12538 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:12.366542 12712 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:12.367787 12588 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:12.368583 12850 raft_consensus.cc:2781] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:12.369081 12850 raft_consensus.cc:686] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:12.369843 12850 consensus_queue.cc:237] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:12.388836 12419 catalog_manager.cc:5495] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 1 to 2, leader changed from a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 2 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:12.602236 12712 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.603876 12850 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:12.614743 12538 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.617923 12884 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:12.751210 12712 raft_consensus.cc:1261] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.752682 12885 consensus_queue.cc:1035] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:12.763620 12538 raft_consensus.cc:1261] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.766074 12873 consensus_queue.cc:1035] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:12.920807 12626 raft_consensus.cc:1261] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.922713 12889 consensus_queue.cc:1035] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:12.925827 12712 raft_consensus.cc:1261] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.927525 12873 consensus_queue.cc:1035] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:12.940142 12715 raft_consensus.cc:1261] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.944926 12538 raft_consensus.cc:1261] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:12.944868 12867 consensus_queue.cc:1035] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260811 16:02:12.947878 12885 consensus_queue.cc:1035] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:15.195189 12383 auto_leader_rebalancer-test.cc:269] The leader distribution is 
I20260811 16:02:15.196615 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:15.228582 12538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
mode: GRACEFUL
new_leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:54414
I20260811 16:02:15.229365 12538 raft_consensus.cc:595] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Received request to transfer leadership to TS 3e9f006c4fb5462f8bcb4e933014f39f
I20260811 16:02:15.250347 12623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
mode: GRACEFUL
new_leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:34408
I20260811 16:02:15.251340 12623 raft_consensus.cc:595] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Received request to transfer leadership to TS 3e9f006c4fb5462f8bcb4e933014f39f
I20260811 16:02:15.252712 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260811 16:02:15.253397 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:15.329752 12904 raft_consensus.cc:979] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: : Instructing follower 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:15.330466 12873 raft_consensus.cc:1067] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Signalling peer 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:15.332728 12712 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:38244
I20260811 16:02:15.333678 12712 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:15.334226 12712 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:15.345510 12712 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:15.349327 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:15.350270 12538 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:15.355837 12712 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 3 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:15.357796 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:15.358875 12623 raft_consensus.cc:3032] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:15.359545 12623 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:15.361070 12623 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:15.363557 12623 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:15.373471 12538 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 3.
I20260811 16:02:15.375620 12672 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:15.376942 12793 raft_consensus.cc:2781] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:15.376727 12623 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 3.
I20260811 16:02:15.381371 12793 raft_consensus.cc:686] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:15.383000 12793 consensus_queue.cc:237] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:15.434062 12419 catalog_manager.cc:5495] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 2 to 3, leader changed from f8a19dfafc734cc3880b953c04b907ed (127.12.23.194) to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 3 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:15.644613 12867 raft_consensus.cc:979] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: : Instructing follower 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:15.645255 12905 raft_consensus.cc:1067] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Signalling peer 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:15.647226 12712 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:38252
I20260811 16:02:15.647826 12712 raft_consensus.cc:482] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:15.648171 12712 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:15.653662 12712 raft_consensus.cc:504] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:15.655339 12712 leader_election.cc:288] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 2 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:15.657218 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:15.657037 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:15.657919 12623 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:15.657969 12538 raft_consensus.cc:3032] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:15.658501 12538 raft_consensus.cc:729] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:15.659493 12538 consensus_queue.cc:260] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:15.661036 12538 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:15.666100 12623 raft_consensus.cc:2454] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 2.
I20260811 16:02:15.667595 12672 leader_election.cc:302] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:15.668612 12793 raft_consensus.cc:2781] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:15.668888 12538 raft_consensus.cc:2454] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 2.
I20260811 16:02:15.669137 12793 raft_consensus.cc:686] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:15.670406 12793 consensus_queue.cc:237] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:15.679600 12419 catalog_manager.cc:5495] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 1 to 2, leader changed from a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193) to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 2 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:15.854099 12538 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:15.855496 12793 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:15.870463 12623 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:15.872233 12907 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:16.183174 12538 raft_consensus.cc:1261] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:16.184477 12907 consensus_queue.cc:1035] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:16.194653 12626 raft_consensus.cc:1261] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:16.197110 12921 consensus_queue.cc:1035] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:16.254519 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:16.259915 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:16.260392 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:17.261332 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:17.266264 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:17.266721 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:18.267684 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:18.272449 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:18.272929 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:19.273892 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:19.278725 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:19.279222 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:20.280129 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:20.286088 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:20.286557 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:21.357913 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:21.363380 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:21.363843 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:02:21.535413 12564 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9060 after lost signal to thread 12388
W20260811 16:02:21.536233 12564 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9740 after lost signal to thread 12457
W20260811 16:02:21.537216 12564 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1de0 after lost signal to thread 12569
W20260811 16:02:21.538045 12564 debug-util.cc:398] Leaking SignalData structure 0x7b080012bd60 after lost signal to thread 12653
W20260811 16:02:21.538766 12564 debug-util.cc:398] Leaking SignalData structure 0x7b0800198960 after lost signal to thread 12742
I20260811 16:02:22.364778 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:22.370343 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:22.370817 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:23.371865 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:23.377782 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:23.378283 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:24.379220 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:24.385490 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:24.385931 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:25.423038 12383 auto_leader_rebalancer-test.cc:288] The leader distribution is 
I20260811 16:02:25.429322 12538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:54412
I20260811 16:02:25.429977 12538 raft_consensus.cc:595] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:25.436093 12538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:54412
I20260811 16:02:25.436762 12538 raft_consensus.cc:595] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:25.442937 12538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:54412
I20260811 16:02:25.443571 12538 raft_consensus.cc:595] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:25.450438 12712 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:38254
I20260811 16:02:25.451248 12712 raft_consensus.cc:595] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:25.497622 12712 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
mode: GRACEFUL
new_leader_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:38254
I20260811 16:02:25.498611 12712 raft_consensus.cc:595] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Received request to transfer leadership to TS f8a19dfafc734cc3880b953c04b907ed
I20260811 16:02:25.545583 12928 raft_consensus.cc:979] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.546280 12932 raft_consensus.cc:1067] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.547937 12623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34382
I20260811 16:02:25.548509 12623 raft_consensus.cc:482] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:25.548830 12623 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.555836 12623 raft_consensus.cc:504] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.558178 12926 raft_consensus.cc:979] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.558923 12933 raft_consensus.cc:1067] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.559211 12623 leader_election.cc:288] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 3 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:25.560674 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:25.560937 12623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34394
I20260811 16:02:25.560591 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7771b13c97514a6cab9f73d5528b1810" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:25.561546 12712 raft_consensus.cc:3032] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:25.561663 12538 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.561731 12623 raft_consensus.cc:482] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:25.561908 12712 raft_consensus.cc:729] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:25.562247 12623 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.562826 12712 consensus_queue.cc:260] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.564374 12712 raft_consensus.cc:3037] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.567618 12538 raft_consensus.cc:2454] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 3.
I20260811 16:02:25.569008 12588 leader_election.cc:302] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:25.569361 12623 raft_consensus.cc:504] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.569936 12931 raft_consensus.cc:2781] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:25.570818 12931 raft_consensus.cc:686] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 3 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:25.571370 12712 raft_consensus.cc:2454] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 3.
I20260811 16:02:25.572554 12623 leader_election.cc:288] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 3 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:25.571996 12931 consensus_queue.cc:237] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.573063 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:25.573863 12538 raft_consensus.cc:3032] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:25.574220 12538 raft_consensus.cc:729] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:25.574259 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c735c53211dd4eb88d3ae2f494456997" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:25.575039 12712 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.575271 12538 consensus_queue.cc:260] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.576926 12538 raft_consensus.cc:3037] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.583741 12712 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 3.
I20260811 16:02:25.584990 12585 leader_election.cc:302] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:25.585888 12931 raft_consensus.cc:2781] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:25.586423 12538 raft_consensus.cc:2454] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 3.
I20260811 16:02:25.586437 12931 raft_consensus.cc:686] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 3 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:25.587824 12931 consensus_queue.cc:237] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.591130 12419 catalog_manager.cc:5495] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 2 to 3, leader changed from 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 3 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:25.610829 12419 catalog_manager.cc:5495] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 2 to 3, leader changed from a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 3 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:25.742935 12926 raft_consensus.cc:979] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.743716 12933 raft_consensus.cc:1067] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.745460 12623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34394
I20260811 16:02:25.745970 12623 raft_consensus.cc:482] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:25.746249 12623 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:25.751614 12623 raft_consensus.cc:504] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.753309 12623 leader_election.cc:288] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:25.754544 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:25.754415 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:25.755087 12712 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:25.755474 12538 raft_consensus.cc:3032] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:25.755769 12538 raft_consensus.cc:729] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:25.756533 12538 consensus_queue.cc:260] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.757800 12538 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:25.762177 12712 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:25.763844 12585 leader_election.cc:302] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:25.764727 12931 raft_consensus.cc:2781] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:25.764907 12538 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 2.
I20260811 16:02:25.765170 12931 raft_consensus.cc:686] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:25.766206 12931 consensus_queue.cc:237] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.773265 12419 catalog_manager.cc:5495] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 1 to 2, leader changed from a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 2 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:25.779385 12928 raft_consensus.cc:979] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.779910 12932 raft_consensus.cc:1067] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.782850 12623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34382
I20260811 16:02:25.783437 12623 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:25.783849 12623 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:02:25.789211 12623 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.791023 12623 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 4 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:25.792398 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:25.792440 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:25.793258 12712 raft_consensus.cc:3032] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:02:25.793247 12538 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:02:25.793672 12712 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:25.794425 12712 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.795609 12712 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:02:25.800028 12538 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 4.
I20260811 16:02:25.801242 12588 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:25.801754 12712 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 4.
I20260811 16:02:25.802111 12931 raft_consensus.cc:2781] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:02:25.802680 12931 raft_consensus.cc:686] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:25.803601 12931 consensus_queue.cc:237] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.811360 12926 raft_consensus.cc:979] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: : Instructing follower f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.811967 12933 raft_consensus.cc:1067] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Signalling peer f8a19dfafc734cc3880b953c04b907ed to start an election
I20260811 16:02:25.813423 12623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
 from {username='slave'} at 127.0.0.1:34394
I20260811 16:02:25.812994 12419 catalog_manager.cc:5495] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 3 to 4, leader changed from 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 4 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:25.813886 12623 raft_consensus.cc:482] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:25.814249 12623 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.819346 12623 raft_consensus.cc:504] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.821435 12623 leader_election.cc:288] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 3 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:25.821777 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:25.822001 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bcd8a6bb0c64059994880e1b5ec5ff4" candidate_uuid: "f8a19dfafc734cc3880b953c04b907ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:25.822317 12538 raft_consensus.cc:3032] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:25.822593 12712 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.822607 12538 raft_consensus.cc:729] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:25.823467 12538 consensus_queue.cc:260] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.824389 12538 raft_consensus.cc:3037] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:25.827257 12712 raft_consensus.cc:2454] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 3.
I20260811 16:02:25.828280 12585 leader_election.cc:302] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:25.828735 12538 raft_consensus.cc:2454] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a19dfafc734cc3880b953c04b907ed in term 3.
I20260811 16:02:25.829047 12931 raft_consensus.cc:2781] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:25.829542 12931 raft_consensus.cc:686] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 3 LEADER]: Becoming Leader. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:25.830327 12931 consensus_queue.cc:237] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:25.836905 12419 catalog_manager.cc:5495] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed reported cstate change: term changed from 2 to 3, leader changed from a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193) to f8a19dfafc734cc3880b953c04b907ed (127.12.23.194). New cstate: current_term: 3 leader_uuid: "f8a19dfafc734cc3880b953c04b907ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:25.960971 12538 raft_consensus.cc:1261] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:25.962337 12931 consensus_queue.cc:1035] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:25.973214 12712 raft_consensus.cc:1261] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:25.975122 12947 consensus_queue.cc:1035] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:25.985846 12538 raft_consensus.cc:1261] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:02:25.987040 12947 consensus_queue.cc:1035] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:25.999702 12712 raft_consensus.cc:1261] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:02:26.001389 12931 consensus_queue.cc:1035] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:26.209978 12538 raft_consensus.cc:1261] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:26.211432 12931 consensus_queue.cc:1035] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:26.224735 12712 raft_consensus.cc:1261] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:26.226805 12947 consensus_queue.cc:1035] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:26.235889 12715 raft_consensus.cc:1261] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:26.238678 12873 consensus_queue.cc:1035] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:26.252749 12538 raft_consensus.cc:1261] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:26.254302 12873 consensus_queue.cc:1035] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:26.296204 12538 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 4 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:02:26.297398 12873 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:02:26.310475 12712 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 4 FOLLOWER]: Refusing update from remote peer f8a19dfafc734cc3880b953c04b907ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:02:26.312984 12931 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:02:28.544312 12383 auto_leader_rebalancer-test.cc:303] The leader distribution is 
I20260811 16:02:28.545325 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:28.552559 12623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
mode: GRACEFUL
new_leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:34408
I20260811 16:02:28.553166 12623 raft_consensus.cc:595] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Received request to transfer leadership to TS 3e9f006c4fb5462f8bcb4e933014f39f
I20260811 16:02:28.555972 12623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
mode: GRACEFUL
new_leader_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:34408
I20260811 16:02:28.556618 12623 raft_consensus.cc:595] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 LEADER]: Received request to transfer leadership to TS a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:28.559824 12623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
mode: GRACEFUL
new_leader_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:34408
I20260811 16:02:28.560473 12623 raft_consensus.cc:595] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Received request to transfer leadership to TS a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:28.563822 12623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
mode: GRACEFUL
new_leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:34408
I20260811 16:02:28.564435 12623 raft_consensus.cc:595] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 LEADER]: Received request to transfer leadership to TS 3e9f006c4fb5462f8bcb4e933014f39f
I20260811 16:02:28.568096 12623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50"
dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
mode: GRACEFUL
new_leader_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:34408
I20260811 16:02:28.568763 12623 raft_consensus.cc:595] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Received request to transfer leadership to TS a27c491fc4f94a36a21d041084c2fca0
I20260811 16:02:28.570480 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:02:28.571101 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:28.659473 12962 raft_consensus.cc:979] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: : Instructing follower a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:28.660024 12963 raft_consensus.cc:1067] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Signalling peer a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:28.661932 12536 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:54402
I20260811 16:02:28.662582 12536 raft_consensus.cc:482] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:28.662918 12536 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:28.670651 12536 raft_consensus.cc:504] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.673527 12536 leader_election.cc:288] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 3 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:28.674487 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:28.674557 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a77a384dd03d4be1ac6b8123dea40cb3" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:28.675199 12623 raft_consensus.cc:3032] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:28.675253 12715 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:28.675607 12623 raft_consensus.cc:729] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:28.676304 12623 consensus_queue.cc:260] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.677155 12623 raft_consensus.cc:3037] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:28.681406 12623 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 3.
I20260811 16:02:28.681597 12715 raft_consensus.cc:2454] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 3.
I20260811 16:02:28.682834 12501 leader_election.cc:302] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a27c491fc4f94a36a21d041084c2fca0, f8a19dfafc734cc3880b953c04b907ed; no voters: 
I20260811 16:02:28.684207 12964 raft_consensus.cc:2781] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:28.685052 12964 raft_consensus.cc:686] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 3 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:28.685858 12964 consensus_queue.cc:237] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.693049 12419 catalog_manager.cc:5495] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 2 to 3, leader changed from f8a19dfafc734cc3880b953c04b907ed (127.12.23.194) to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:28.861367 12963 raft_consensus.cc:979] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: : Instructing follower 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:28.861841 12962 raft_consensus.cc:1067] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 LEADER]: Signalling peer 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:28.862739 12959 raft_consensus.cc:979] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: : Instructing follower 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:28.863220 12963 raft_consensus.cc:1067] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Signalling peer 3e9f006c4fb5462f8bcb4e933014f39f to start an election
I20260811 16:02:28.863466 12715 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c5e352ef474247afba334577ed77bf34"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:38244
I20260811 16:02:28.864028 12715 raft_consensus.cc:482] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:28.864392 12715 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:02:28.864967 12712 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476"
dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
 from {username='slave'} at 127.0.0.1:38244
I20260811 16:02:28.865487 12712 raft_consensus.cc:482] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:28.865805 12712 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:28.869997 12715 raft_consensus.cc:504] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.870477 12712 raft_consensus.cc:504] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.872316 12712 leader_election.cc:288] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 3 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:28.872457 12715 leader_election.cc:288] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 5 election: Requested vote from peers a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169), f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615)
I20260811 16:02:28.873773 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:28.873899 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21405d7971b14ab4a35d1fc36fb19476" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:28.874452 12538 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:28.874506 12623 raft_consensus.cc:3032] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:28.874509 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:28.875007 12623 raft_consensus.cc:729] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:28.875316 12626 raft_consensus.cc:3032] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:02:28.875629 12626 raft_consensus.cc:729] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:28.875840 12623 consensus_queue.cc:260] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.876464 12626 consensus_queue.cc:260] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.877272 12623 raft_consensus.cc:3037] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:28.877928 12626 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:02:28.878150 12536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5e352ef474247afba334577ed77bf34" candidate_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
I20260811 16:02:28.878742 12536 raft_consensus.cc:3037] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:02:28.881992 12538 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 3.
I20260811 16:02:28.883356 12672 leader_election.cc:302] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:28.884255 12928 raft_consensus.cc:2781] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:28.884364 12623 raft_consensus.cc:2454] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 3.
I20260811 16:02:28.885878 12536 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 5.
I20260811 16:02:28.886821 12626 raft_consensus.cc:2454] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e9f006c4fb5462f8bcb4e933014f39f in term 5.
I20260811 16:02:28.887467 12672 leader_election.cc:302] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:28.887656 12928 raft_consensus.cc:686] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:28.888330 12972 raft_consensus.cc:2781] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:02:28.888624 12928 consensus_queue.cc:237] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.889756 12972 raft_consensus.cc:686] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 5 LEADER]: Becoming Leader. State: Replica: 3e9f006c4fb5462f8bcb4e933014f39f, State: Running, Role: LEADER
I20260811 16:02:28.890653 12972 consensus_queue.cc:237] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.897701 12419 catalog_manager.cc:5495] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 2 to 3, leader changed from f8a19dfafc734cc3880b953c04b907ed (127.12.23.194) to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 3 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:28.909447 12419 catalog_manager.cc:5495] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f reported cstate change: term changed from 4 to 5, leader changed from f8a19dfafc734cc3880b953c04b907ed (127.12.23.194) to 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195). New cstate: current_term: 5 leader_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:28.912895 12959 raft_consensus.cc:979] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: : Instructing follower a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:28.913439 12963 raft_consensus.cc:1067] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 LEADER]: Signalling peer a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:28.915139 12536 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:54402
I20260811 16:02:28.915769 12536 raft_consensus.cc:482] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:28.916092 12536 raft_consensus.cc:3037] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:28.921730 12536 raft_consensus.cc:504] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.923591 12536 leader_election.cc:288] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:28.924449 12626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:28.924593 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e6525795fa4c1f8f38e33e352b45d4" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:28.925117 12626 raft_consensus.cc:3032] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:28.925450 12626 raft_consensus.cc:729] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:28.925215 12715 raft_consensus.cc:3037] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:28.926378 12626 consensus_queue.cc:260] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.927480 12626 raft_consensus.cc:3037] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:28.931015 12715 raft_consensus.cc:2454] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 2.
I20260811 16:02:28.932363 12498 leader_election.cc:302] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:28.933149 12964 raft_consensus.cc:2781] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:28.933558 12964 raft_consensus.cc:686] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:28.933684 12626 raft_consensus.cc:2454] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 2.
I20260811 16:02:28.934424 12964 consensus_queue.cc:237] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:28.941416 12419 catalog_manager.cc:5495] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 1 to 2, leader changed from f8a19dfafc734cc3880b953c04b907ed (127.12.23.194) to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:29.069703 12626 raft_consensus.cc:1261] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:29.071092 12964 consensus_queue.cc:1035] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:29.081875 12715 raft_consensus.cc:1261] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:29.084158 12965 consensus_queue.cc:1035] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:29.110144 12962 raft_consensus.cc:979] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: : Instructing follower a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:29.110862 12963 raft_consensus.cc:1067] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Signalling peer a27c491fc4f94a36a21d041084c2fca0 to start an election
I20260811 16:02:29.113004 12536 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50"
dest_uuid: "a27c491fc4f94a36a21d041084c2fca0"
 from {username='slave'} at 127.0.0.1:54402
I20260811 16:02:29.113704 12536 raft_consensus.cc:482] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:29.114228 12536 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:29.120883 12536 raft_consensus.cc:504] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:29.123432 12536 leader_election.cc:288] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 3 election: Requested vote from peers f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615), 3e9f006c4fb5462f8bcb4e933014f39f (127.12.23.195:39257)
I20260811 16:02:29.124155 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a19dfafc734cc3880b953c04b907ed"
I20260811 16:02:29.124748 12623 raft_consensus.cc:3032] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:29.125034 12623 raft_consensus.cc:729] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a19dfafc734cc3880b953c04b907ed, State: Running, Role: LEADER
I20260811 16:02:29.124984 12715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6fa8a013c76488b8bb9237b91d6db50" candidate_uuid: "a27c491fc4f94a36a21d041084c2fca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e9f006c4fb5462f8bcb4e933014f39f"
I20260811 16:02:29.125770 12715 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:29.126056 12623 consensus_queue.cc:260] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:29.126974 12623 raft_consensus.cc:3037] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:29.130612 12715 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 3.
I20260811 16:02:29.131912 12498 leader_election.cc:302] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e9f006c4fb5462f8bcb4e933014f39f, a27c491fc4f94a36a21d041084c2fca0; no voters: 
I20260811 16:02:29.132246 12623 raft_consensus.cc:2454] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a27c491fc4f94a36a21d041084c2fca0 in term 3.
I20260811 16:02:29.133731 12981 raft_consensus.cc:2781] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:29.134279 12981 raft_consensus.cc:686] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 3 LEADER]: Becoming Leader. State: Replica: a27c491fc4f94a36a21d041084c2fca0, State: Running, Role: LEADER
I20260811 16:02:29.135272 12981 consensus_queue.cc:237] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } }
I20260811 16:02:29.144577 12419 catalog_manager.cc:5495] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 reported cstate change: term changed from 2 to 3, leader changed from f8a19dfafc734cc3880b953c04b907ed (127.12.23.194) to a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "a27c491fc4f94a36a21d041084c2fca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:29.314661 12536 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 5 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:02:29.316329 12623 raft_consensus.cc:1261] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:29.316486 12972 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:02:29.317912 12928 consensus_queue.cc:1035] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:29.342156 12623 raft_consensus.cc:1261] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 5 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:02:29.344287 12973 consensus_queue.cc:1035] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:02:29.366816 12536 raft_consensus.cc:1261] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Refusing update from remote peer 3e9f006c4fb5462f8bcb4e933014f39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:29.369755 12988 consensus_queue.cc:1035] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a27c491fc4f94a36a21d041084c2fca0" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:02:29.360379 12623 raft_consensus.cc:1261] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:29.381214 12981 consensus_queue.cc:1035] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:29.401767 12715 raft_consensus.cc:1261] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:29.403533 12981 consensus_queue.cc:1035] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:29.561682 12623 raft_consensus.cc:1261] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:29.562891 12964 consensus_queue.cc:1035] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a19dfafc734cc3880b953c04b907ed" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:29.572017 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:29.572017 12715 raft_consensus.cc:1261] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Refusing update from remote peer a27c491fc4f94a36a21d041084c2fca0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:29.577930 12981 consensus_queue.cc:1035] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e9f006c4fb5462f8bcb4e933014f39f" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:29.581722 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:29.582466 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:30.583581 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:30.590884 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:30.591367 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:31.592327 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:31.597419 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:31.597899 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:32.716341 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:32.721385 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:32.721876 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:02:32.750506 12650 debug-util.cc:398] Leaking SignalData structure 0x7b08001f28a0 after lost signal to thread 12388
W20260811 16:02:32.751325 12650 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7780 after lost signal to thread 12457
W20260811 16:02:32.752095 12650 debug-util.cc:398] Leaking SignalData structure 0x7b080012b400 after lost signal to thread 12569
W20260811 16:02:32.752781 12650 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbe60 after lost signal to thread 12653
W20260811 16:02:32.753432 12650 debug-util.cc:398] Leaking SignalData structure 0x7b0800198420 after lost signal to thread 12742
I20260811 16:02:33.722833 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:33.728305 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:33.728977 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:34.730129 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:34.737962 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:34.738631 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:35.739758 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:35.745138 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:35.745584 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:36.746384 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:36.753091 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:36.753545 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:37.754393 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:37.759207 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:37.759672 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:38.789100 12383 auto_leader_rebalancer-test.cc:314] The leader distribution is 
I20260811 16:02:38.789875 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
I20260811 16:02:38.827421 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:02:38.828106 12383 tablet_replica.cc:330] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.828992 12383 raft_consensus.cc:2229] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:38.829810 12383 raft_consensus.cc:2258] T 21405d7971b14ab4a35d1fc36fb19476 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.832650 12383 tablet_replica.cc:330] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.833194 12383 raft_consensus.cc:2229] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:38.833724 12383 raft_consensus.cc:2258] T c5e352ef474247afba334577ed77bf34 P a27c491fc4f94a36a21d041084c2fca0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.835493 12383 tablet_replica.cc:330] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.836000 12383 raft_consensus.cc:2229] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:02:38.836901 12383 raft_consensus.cc:2258] T e6fa8a013c76488b8bb9237b91d6db50 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.838687 12383 tablet_replica.cc:330] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.839306 12383 raft_consensus.cc:2229] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:02:38.840147 12383 raft_consensus.cc:2258] T a77a384dd03d4be1ac6b8123dea40cb3 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.841886 12383 tablet_replica.cc:330] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.842424 12383 raft_consensus.cc:2229] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:38.842864 12383 raft_consensus.cc:2258] T c735c53211dd4eb88d3ae2f494456997 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.844750 12383 tablet_replica.cc:330] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.845268 12383 raft_consensus.cc:2229] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:02:38.846092 12383 raft_consensus.cc:2258] T 72e6525795fa4c1f8f38e33e352b45d4 P a27c491fc4f94a36a21d041084c2fca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.848363 12383 tablet_replica.cc:330] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.849007 12383 raft_consensus.cc:2229] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:38.849610 12383 raft_consensus.cc:2258] T 7771b13c97514a6cab9f73d5528b1810 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.851408 12383 tablet_replica.cc:330] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.851828 12383 raft_consensus.cc:2229] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:38.852170 12383 raft_consensus.cc:2258] T 964e53cff01b4fe584f7842346b4dabb P a27c491fc4f94a36a21d041084c2fca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:38.853821 12383 tablet_replica.cc:330] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0: stopping tablet replica
I20260811 16:02:38.854246 12383 raft_consensus.cc:2229] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:38.854599 12383 raft_consensus.cc:2258] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P a27c491fc4f94a36a21d041084c2fca0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260811 16:02:39.041985 12588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:38169: connect: Connection refused (error 111)
W20260811 16:02:39.047367 12672 consensus_peers.cc:487] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f -> Peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Couldn't send request to peer a27c491fc4f94a36a21d041084c2fca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:38169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:02:39.047962 12672 consensus_peers.cc:487] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f -> Peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Couldn't send request to peer a27c491fc4f94a36a21d041084c2fca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:38169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:02:39.048234 12588 consensus_peers.cc:487] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed -> Peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Couldn't send request to peer a27c491fc4f94a36a21d041084c2fca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:38169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:02:39.048399 12672 consensus_peers.cc:487] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f -> Peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Couldn't send request to peer a27c491fc4f94a36a21d041084c2fca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:38169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:02:39.062783 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
I20260811 16:02:39.082563 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
I20260811 16:02:39.119350 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:02:39.120159 12383 tablet_replica.cc:330] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.121179 12383 raft_consensus.cc:2229] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 3 LEADER]: Raft consensus shutting down.
W20260811 16:02:39.121618 12588 consensus_peers.cc:487] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed -> Peer a27c491fc4f94a36a21d041084c2fca0 (127.12.23.193:38169): Couldn't send request to peer a27c491fc4f94a36a21d041084c2fca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:38169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:02:39.122800 12383 raft_consensus.cc:2258] T 7771b13c97514a6cab9f73d5528b1810 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.124559 12383 tablet_replica.cc:330] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.125097 12383 raft_consensus.cc:2229] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.125511 12383 raft_consensus.cc:2258] T e6fa8a013c76488b8bb9237b91d6db50 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.127105 12383 tablet_replica.cc:330] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.127837 12383 raft_consensus.cc:2229] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.128249 12383 raft_consensus.cc:2258] T 21405d7971b14ab4a35d1fc36fb19476 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.129834 12383 tablet_replica.cc:330] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.130292 12383 raft_consensus.cc:2229] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.130676 12383 raft_consensus.cc:2258] T 964e53cff01b4fe584f7842346b4dabb P f8a19dfafc734cc3880b953c04b907ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.132380 12383 tablet_replica.cc:330] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.132854 12383 raft_consensus.cc:2229] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:02:39.133605 12383 raft_consensus.cc:2258] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.135478 12383 tablet_replica.cc:330] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.135962 12383 raft_consensus.cc:2229] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:02:39.136735 12383 raft_consensus.cc:2258] T c735c53211dd4eb88d3ae2f494456997 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.138610 12383 tablet_replica.cc:330] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.139217 12383 raft_consensus.cc:2229] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.139743 12383 raft_consensus.cc:2258] T 72e6525795fa4c1f8f38e33e352b45d4 P f8a19dfafc734cc3880b953c04b907ed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:02:39.141270 12672 consensus_peers.cc:487] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f -> Peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Couldn't send request to peer f8a19dfafc734cc3880b953c04b907ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:02:39.142017 12383 tablet_replica.cc:330] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.142719 12383 raft_consensus.cc:2229] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.143229 12383 raft_consensus.cc:2258] T a77a384dd03d4be1ac6b8123dea40cb3 P f8a19dfafc734cc3880b953c04b907ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.145041 12383 tablet_replica.cc:330] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed: stopping tablet replica
I20260811 16:02:39.145486 12383 raft_consensus.cc:2229] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 5 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.145848 12383 raft_consensus.cc:2258] T c5e352ef474247afba334577ed77bf34 P f8a19dfafc734cc3880b953c04b907ed [term 5 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.203789 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
I20260811 16:02:39.221884 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
I20260811 16:02:39.254218 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:02:39.254995 12383 tablet_replica.cc:330] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.256188 12383 raft_consensus.cc:2229] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:02:39.257463 12383 raft_consensus.cc:2258] T 21405d7971b14ab4a35d1fc36fb19476 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.259503 12383 tablet_replica.cc:330] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.260203 12383 raft_consensus.cc:2229] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.260751 12383 raft_consensus.cc:2258] T 7771b13c97514a6cab9f73d5528b1810 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.262951 12383 tablet_replica.cc:330] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
W20260811 16:02:39.263554 12672 consensus_peers.cc:487] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f -> Peer f8a19dfafc734cc3880b953c04b907ed (127.12.23.194:37615): Couldn't send request to peer f8a19dfafc734cc3880b953c04b907ed. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:37615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:02:39.263567 12383 raft_consensus.cc:2229] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 5 LEADER]: Raft consensus shutting down.
I20260811 16:02:39.264561 12383 raft_consensus.cc:2258] T c5e352ef474247afba334577ed77bf34 P 3e9f006c4fb5462f8bcb4e933014f39f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.266368 12383 tablet_replica.cc:330] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.266898 12383 raft_consensus.cc:2229] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.267414 12383 raft_consensus.cc:2258] T 72e6525795fa4c1f8f38e33e352b45d4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.269151 12383 tablet_replica.cc:330] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.269639 12383 raft_consensus.cc:2229] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.270037 12383 raft_consensus.cc:2258] T a77a384dd03d4be1ac6b8123dea40cb3 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.271870 12383 tablet_replica.cc:330] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.272364 12383 raft_consensus.cc:2229] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.272799 12383 raft_consensus.cc:2258] T c735c53211dd4eb88d3ae2f494456997 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.274469 12383 tablet_replica.cc:330] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.275018 12383 raft_consensus.cc:2229] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.275539 12383 raft_consensus.cc:2258] T 0bcd8a6bb0c64059994880e1b5ec5ff4 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.277316 12383 tablet_replica.cc:330] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.277791 12383 raft_consensus.cc:2229] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:02:39.278553 12383 raft_consensus.cc:2258] T 964e53cff01b4fe584f7842346b4dabb P 3e9f006c4fb5462f8bcb4e933014f39f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.280233 12383 tablet_replica.cc:330] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f: stopping tablet replica
I20260811 16:02:39.280694 12383 raft_consensus.cc:2229] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:02:39.281150 12383 raft_consensus.cc:2258] T e6fa8a013c76488b8bb9237b91d6db50 P 3e9f006c4fb5462f8bcb4e933014f39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.309557 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:02:39.327811 12383 master.cc:537] Master@127.12.23.254:35557 shutting down...
I20260811 16:02:39.562980 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:02:39.563673 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:02:39.564080 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P dfcd381655ee4182965c3796f55d0909: stopping tablet replica
I20260811 16:02:39.583097 12383 master.cc:552] Master@127.12.23.254:35557 shutdown complete.
3e9f006c4fb5462f8bcb4e933014f39f  1
a27c491fc4f94a36a21d041084c2fca0  4
f8a19dfafc734cc3880b953c04b907ed  4
3e9f006c4fb5462f8bcb4e933014f39f  3
a27c491fc4f94a36a21d041084c2fca0  3
f8a19dfafc734cc3880b953c04b907ed  3
3e9f006c4fb5462f8bcb4e933014f39f  1
a27c491fc4f94a36a21d041084c2fca0  0
f8a19dfafc734cc3880b953c04b907ed  8
3e9f006c4fb5462f8bcb4e933014f39f  3
a27c491fc4f94a36a21d041084c2fca0  3
f8a19dfafc734cc3880b953c04b907ed  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (34271 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260811 16:02:39.628289 12383 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.23.254:33065
I20260811 16:02:39.629411 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:39.635979 13015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:39.636075 13013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:39.636718 13017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:39.636919 12383 server_base.cc:1034] running on GCE node
I20260811 16:02:39.638283 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:39.638461 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:39.638576 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464159638560 us; error 0 us; skew 500 ppm
I20260811 16:02:39.639008 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:39.641458 12383 webserver.cc:460] Webserver started at http://127.12.23.254:43715/ using document root <none> and password file <none>
I20260811 16:02:39.641930 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:39.642098 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:39.642331 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:39.643867 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/master-0-root/instance:
uuid: "259ad82890b143a28279bcc9771401eb"
format_stamp: "Formatted at 2026-08-11 16:02:39 on dist-test-slave-chsk"
I20260811 16:02:39.648524 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260811 16:02:39.651858 13023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:39.652642 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260811 16:02:39.652940 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/master-0-root
uuid: "259ad82890b143a28279bcc9771401eb"
format_stamp: "Formatted at 2026-08-11 16:02:39 on dist-test-slave-chsk"
I20260811 16:02:39.653232 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:39.670539 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:39.671991 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:39.711441 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.254:33065
I20260811 16:02:39.711556 13078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.254:33065 every 8 connection(s)
I20260811 16:02:39.715466 13079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:39.725622 13079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb: Bootstrap starting.
I20260811 16:02:39.731690 13079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:39.736968 13079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb: No bootstrap required, opened a new log
I20260811 16:02:39.739063 13079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ad82890b143a28279bcc9771401eb" member_type: VOTER }
I20260811 16:02:39.739635 13079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:39.739838 13079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259ad82890b143a28279bcc9771401eb, State: Initialized, Role: FOLLOWER
I20260811 16:02:39.740406 13079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ad82890b143a28279bcc9771401eb" member_type: VOTER }
I20260811 16:02:39.740891 13079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:02:39.741089 13079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:02:39.741312 13079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:39.745774 13079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ad82890b143a28279bcc9771401eb" member_type: VOTER }
I20260811 16:02:39.746300 13079 leader_election.cc:302] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 259ad82890b143a28279bcc9771401eb; no voters: 
I20260811 16:02:39.747510 13079 leader_election.cc:288] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 16:02:39.747929 13082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:39.749352 13082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 1 LEADER]: Becoming Leader. State: Replica: 259ad82890b143a28279bcc9771401eb, State: Running, Role: LEADER
I20260811 16:02:39.749977 13082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ad82890b143a28279bcc9771401eb" member_type: VOTER }
I20260811 16:02:39.750589 13079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:02:39.755394 13084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "259ad82890b143a28279bcc9771401eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ad82890b143a28279bcc9771401eb" member_type: VOTER } }
I20260811 16:02:39.756188 13084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [sys.catalog]: This master's current role is: LEADER
I20260811 16:02:39.757743 13086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 259ad82890b143a28279bcc9771401eb. Latest consensus state: current_term: 1 leader_uuid: "259ad82890b143a28279bcc9771401eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ad82890b143a28279bcc9771401eb" member_type: VOTER } }
I20260811 16:02:39.758486 13086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [sys.catalog]: This master's current role is: LEADER
I20260811 16:02:39.760558 13092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:02:39.767532 13092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:02:39.769634 12383 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:02:39.776607 13092 catalog_manager.cc:1347] Generated new cluster ID: be00e367de6b46aea7d5fbde4a5ec85d
I20260811 16:02:39.776911 13092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:02:39.797236 13092 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:02:39.798862 13092 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:02:39.810559 13092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb: Generated new TSK 0
I20260811 16:02:39.811286 13092 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:02:39.836215 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:39.842662 13105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:39.843631 13107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:39.845568 13110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:39.846127 12383 server_base.cc:1034] running on GCE node
I20260811 16:02:39.847319 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:39.847517 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:39.847671 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464159847646 us; error 0 us; skew 500 ppm
I20260811 16:02:39.848199 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:39.854637 12383 webserver.cc:460] Webserver started at http://127.12.23.193:39857/ using document root <none> and password file <none>
I20260811 16:02:39.855249 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:39.855455 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:39.855715 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:39.856827 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-0-root/instance:
uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
format_stamp: "Formatted at 2026-08-11 16:02:39 on dist-test-slave-chsk"
I20260811 16:02:39.861673 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260811 16:02:39.865147 13115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:39.865926 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260811 16:02:39.866333 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
format_stamp: "Formatted at 2026-08-11 16:02:39 on dist-test-slave-chsk"
I20260811 16:02:39.866636 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:39.884430 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:39.885730 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:39.887238 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:02:39.889523 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:02:39.889746 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:39.889991 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:02:39.890166 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:39.934001 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:43793
I20260811 16:02:39.934201 13187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:43793 every 8 connection(s)
I20260811 16:02:39.939733 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:39.947228 13192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:39.951301 13193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:39.952642 13195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:39.953047 12383 server_base.cc:1034] running on GCE node
I20260811 16:02:39.955322 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:39.955513 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:39.955734 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464159955718 us; error 0 us; skew 500 ppm
I20260811 16:02:39.956264 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:39.959549 12383 webserver.cc:460] Webserver started at http://127.12.23.194:39889/ using document root <none> and password file <none>
I20260811 16:02:39.959775 13188 heartbeater.cc:347] Connected to a master server at 127.12.23.254:33065
I20260811 16:02:39.960187 13188 heartbeater.cc:464] Registering TS with master...
I20260811 16:02:39.960315 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:39.960582 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:39.960898 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:39.961037 13188 heartbeater.cc:511] Master 127.12.23.254:33065 requested a full tablet report, sending...
I20260811 16:02:39.962482 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-1-root/instance:
uuid: "c25f197541914fd183cfc830874850bc"
format_stamp: "Formatted at 2026-08-11 16:02:39 on dist-test-slave-chsk"
I20260811 16:02:39.963567 13042 ts_manager.cc:194] Registered new tserver with Master: d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793)
I20260811 16:02:39.965647 13042 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59124
I20260811 16:02:39.968050 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260811 16:02:39.971900 13200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:39.972680 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260811 16:02:39.972973 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-1-root
uuid: "c25f197541914fd183cfc830874850bc"
format_stamp: "Formatted at 2026-08-11 16:02:39 on dist-test-slave-chsk"
I20260811 16:02:39.973272 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:39.989332 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:39.990639 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:39.992185 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:02:39.994478 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:02:39.994704 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:39.994943 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:02:39.995108 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:40.042390 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.194:32775
I20260811 16:02:40.042510 13270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.194:32775 every 8 connection(s)
I20260811 16:02:40.047123 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:02:40.055094 13274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:02:40.058063 13275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:40.064204 12383 server_base.cc:1034] running on GCE node
W20260811 16:02:40.065383 13277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:02:40.065604 13271 heartbeater.cc:347] Connected to a master server at 127.12.23.254:33065
I20260811 16:02:40.066094 13271 heartbeater.cc:464] Registering TS with master...
I20260811 16:02:40.066408 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:02:40.066615 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:02:40.066846 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464160066831 us; error 0 us; skew 500 ppm
I20260811 16:02:40.066896 13271 heartbeater.cc:511] Master 127.12.23.254:33065 requested a full tablet report, sending...
I20260811 16:02:40.067452 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:02:40.069384 13042 ts_manager.cc:194] Registered new tserver with Master: c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:40.070350 12383 webserver.cc:460] Webserver started at http://127.12.23.195:39951/ using document root <none> and password file <none>
I20260811 16:02:40.070878 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:02:40.071089 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:02:40.071321 13042 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59128
I20260811 16:02:40.071435 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:02:40.073021 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-2-root/instance:
uuid: "7b555939358643899e1397258987535d"
format_stamp: "Formatted at 2026-08-11 16:02:40 on dist-test-slave-chsk"
I20260811 16:02:40.078390 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260811 16:02:40.082329 13282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:40.083442 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260811 16:02:40.083819 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-2-root
uuid: "7b555939358643899e1397258987535d"
format_stamp: "Formatted at 2026-08-11 16:02:40 on dist-test-slave-chsk"
I20260811 16:02:40.084115 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786464125124352-12383-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:02:40.095472 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:02:40.096724 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:02:40.098140 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:02:40.100406 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:02:40.100638 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:40.100896 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:02:40.101046 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:02:40.143819 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.195:44149
I20260811 16:02:40.143944 13356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.195:44149 every 8 connection(s)
I20260811 16:02:40.160575 13357 heartbeater.cc:347] Connected to a master server at 127.12.23.254:33065
I20260811 16:02:40.161073 13357 heartbeater.cc:464] Registering TS with master...
I20260811 16:02:40.161829 13357 heartbeater.cc:511] Master 127.12.23.254:33065 requested a full tablet report, sending...
I20260811 16:02:40.164197 13042 ts_manager.cc:194] Registered new tserver with Master: 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.164639 12383 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017566426s
I20260811 16:02:40.166483 13042 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59140
I20260811 16:02:40.167527 12383 test_util.cc:268] Using random seed: -1716799965
I20260811 16:02:40.194201 13042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59150:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:02:40.197448 13042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:02:40.279517 13147 tablet_service.cc:1467] Processing CreateTablet for tablet 36bdb501dd17430bbf0cf02be659eacf (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260811 16:02:40.280007 13141 tablet_service.cc:1467] Processing CreateTablet for tablet 075052c6d7344633b1f2f0fbf6396f0c (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260811 16:02:40.281164 13147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36bdb501dd17430bbf0cf02be659eacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.282393 13142 tablet_service.cc:1467] Processing CreateTablet for tablet 5c57dae40cd744caba94fa022161be37 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260811 16:02:40.283833 13142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c57dae40cd744caba94fa022161be37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.288197 13146 tablet_service.cc:1467] Processing CreateTablet for tablet dcc638510fcb467baf7e8a4d477a1406 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260811 16:02:40.289777 13146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcc638510fcb467baf7e8a4d477a1406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.292083 13143 tablet_service.cc:1467] Processing CreateTablet for tablet ba132088b4994a7dae3e355cfc29e350 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260811 16:02:40.293577 13143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba132088b4994a7dae3e355cfc29e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.296490 13144 tablet_service.cc:1467] Processing CreateTablet for tablet a19c81b4088e4261992248f3e719d391 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260811 16:02:40.297957 13144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c81b4088e4261992248f3e719d391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.300494 13375 tablet_bootstrap.cc:492] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.300503 13145 tablet_service.cc:1467] Processing CreateTablet for tablet c0238f8ae0914ec783617ab6546e5b03 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260811 16:02:40.302140 13141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 075052c6d7344633b1f2f0fbf6396f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.304538 13140 tablet_service.cc:1467] Processing CreateTablet for tablet b72ef29484ad478ba56453068ac55128 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260811 16:02:40.306041 13140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b72ef29484ad478ba56453068ac55128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.306620 13146 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff2448da3464456a9c340f87a086dfe (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260811 16:02:40.307006 13375 tablet_bootstrap.cc:654] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.307564 13145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0238f8ae0914ec783617ab6546e5b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.308266 13146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff2448da3464456a9c340f87a086dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.325304 13314 tablet_service.cc:1467] Processing CreateTablet for tablet 36bdb501dd17430bbf0cf02be659eacf (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260811 16:02:40.326701 13314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36bdb501dd17430bbf0cf02be659eacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.333307 13313 tablet_service.cc:1467] Processing CreateTablet for tablet dcc638510fcb467baf7e8a4d477a1406 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260811 16:02:40.333943 13310 tablet_service.cc:1467] Processing CreateTablet for tablet a19c81b4088e4261992248f3e719d391 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260811 16:02:40.334923 13313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcc638510fcb467baf7e8a4d477a1406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.336345 13308 tablet_service.cc:1467] Processing CreateTablet for tablet ba132088b4994a7dae3e355cfc29e350 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260811 16:02:40.337762 13308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba132088b4994a7dae3e355cfc29e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.340384 13307 tablet_service.cc:1467] Processing CreateTablet for tablet 5c57dae40cd744caba94fa022161be37 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260811 16:02:40.341128 13233 tablet_service.cc:1467] Processing CreateTablet for tablet 36bdb501dd17430bbf0cf02be659eacf (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260811 16:02:40.342597 13233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36bdb501dd17430bbf0cf02be659eacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.342648 13306 tablet_service.cc:1467] Processing CreateTablet for tablet 075052c6d7344633b1f2f0fbf6396f0c (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260811 16:02:40.345819 13375 tablet_bootstrap.cc:492] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.345495 13304 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff2448da3464456a9c340f87a086dfe (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260811 16:02:40.346325 13375 ts_tablet_manager.cc:1397] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.010s
I20260811 16:02:40.347433 13305 tablet_service.cc:1467] Processing CreateTablet for tablet b72ef29484ad478ba56453068ac55128 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260811 16:02:40.340384 13303 tablet_service.cc:1467] Processing CreateTablet for tablet 87e5f45e71374c2aa902b34b1670ba95 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260811 16:02:40.338976 13311 tablet_service.cc:1467] Processing CreateTablet for tablet c0238f8ae0914ec783617ab6546e5b03 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260811 16:02:40.350457 13310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c81b4088e4261992248f3e719d391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.351759 13231 tablet_service.cc:1467] Processing CreateTablet for tablet dcc638510fcb467baf7e8a4d477a1406 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260811 16:02:40.352197 13146 tablet_service.cc:1467] Processing CreateTablet for tablet 87e5f45e71374c2aa902b34b1670ba95 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260811 16:02:40.353173 13231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcc638510fcb467baf7e8a4d477a1406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.353466 13146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87e5f45e71374c2aa902b34b1670ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.354269 13303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87e5f45e71374c2aa902b34b1670ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.355875 13304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff2448da3464456a9c340f87a086dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.357406 13307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c57dae40cd744caba94fa022161be37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.358930 13306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 075052c6d7344633b1f2f0fbf6396f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.360198 13311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0238f8ae0914ec783617ab6546e5b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.362600 13305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b72ef29484ad478ba56453068ac55128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.362483 13230 tablet_service.cc:1467] Processing CreateTablet for tablet c0238f8ae0914ec783617ab6546e5b03 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260811 16:02:40.364220 13230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0238f8ae0914ec783617ab6546e5b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.349386 13375 raft_consensus.cc:348] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.365432 13375 raft_consensus.cc:374] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.365772 13375 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.366496 13375 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.376489 13228 tablet_service.cc:1467] Processing CreateTablet for tablet a19c81b4088e4261992248f3e719d391 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260811 16:02:40.377964 13228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c81b4088e4261992248f3e719d391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.387904 13227 tablet_service.cc:1467] Processing CreateTablet for tablet ba132088b4994a7dae3e355cfc29e350 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260811 16:02:40.390889 13227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba132088b4994a7dae3e355cfc29e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.400933 13225 tablet_service.cc:1467] Processing CreateTablet for tablet 075052c6d7344633b1f2f0fbf6396f0c (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260811 16:02:40.398279 13226 tablet_service.cc:1467] Processing CreateTablet for tablet 5c57dae40cd744caba94fa022161be37 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260811 16:02:40.403101 13378 tablet_bootstrap.cc:492] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.403517 13225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 075052c6d7344633b1f2f0fbf6396f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.406288 13224 tablet_service.cc:1467] Processing CreateTablet for tablet b72ef29484ad478ba56453068ac55128 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260811 16:02:40.417225 13224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b72ef29484ad478ba56453068ac55128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.419907 13226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c57dae40cd744caba94fa022161be37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.426330 13223 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff2448da3464456a9c340f87a086dfe (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260811 16:02:40.428414 13223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff2448da3464456a9c340f87a086dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.434044 13221 tablet_service.cc:1467] Processing CreateTablet for tablet 87e5f45e71374c2aa902b34b1670ba95 (DEFAULT_TABLE table=test-workload [id=0cdded87be7e4a46b1ee33d205f2e7d5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260811 16:02:40.436376 13221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87e5f45e71374c2aa902b34b1670ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:02:40.440411 13188 heartbeater.cc:503] Master 127.12.23.254:33065 was elected leader, sending a full tablet report...
I20260811 16:02:40.440711 13375 ts_tablet_manager.cc:1428] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.094s	user 0.019s	sys 0.041s
I20260811 16:02:40.441743 13375 tablet_bootstrap.cc:492] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.444856 13377 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.445461 13377 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.448167 13375 tablet_bootstrap.cc:654] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.449910 13378 tablet_bootstrap.cc:654] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.500052 13377 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b555939358643899e1397258987535d (127.12.23.195:44149), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:40.548620 13378 tablet_bootstrap.cc:492] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.553577 13387 tablet_bootstrap.cc:492] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.552842 13378 ts_tablet_manager.cc:1397] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.150s	user 0.018s	sys 0.025s
I20260811 16:02:40.556861 13378 raft_consensus.cc:348] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.557771 13378 raft_consensus.cc:374] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.558097 13378 raft_consensus.cc:729] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.559103 13378 consensus_queue.cc:260] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.560067 13387 tablet_bootstrap.cc:654] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.575652 13375 tablet_bootstrap.cc:492] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.576406 13375 ts_tablet_manager.cc:1397] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.135s	user 0.025s	sys 0.059s
I20260811 16:02:40.580968 13375 raft_consensus.cc:348] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.581813 13375 raft_consensus.cc:374] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.582062 13357 heartbeater.cc:503] Master 127.12.23.254:33065 was elected leader, sending a full tablet report...
I20260811 16:02:40.582176 13375 raft_consensus.cc:729] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.583007 13375 consensus_queue.cc:260] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.585357 13375 ts_tablet_manager.cc:1428] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260811 16:02:40.586380 13375 tablet_bootstrap.cc:492] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.587445 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
W20260811 16:02:40.591611 13116 leader_election.cc:341] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b555939358643899e1397258987535d (127.12.23.195:44149): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.593042 13375 tablet_bootstrap.cc:654] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.593724 13378 ts_tablet_manager.cc:1428] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.010s
I20260811 16:02:40.594923 13378 tablet_bootstrap.cc:492] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.601868 13387 tablet_bootstrap.cc:492] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.602447 13387 ts_tablet_manager.cc:1397] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.003s
I20260811 16:02:40.603806 13378 tablet_bootstrap.cc:654] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.604221 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:40.605396 13387 raft_consensus.cc:348] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.606254 13387 raft_consensus.cc:374] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 16:02:40.606168 13117 leader_election.cc:341] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.606762 13117 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d489d42b74ee4099bc1c0a9a4a21881d; no voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc
I20260811 16:02:40.607625 13377 raft_consensus.cc:2726] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:40.608812 13387 raft_consensus.cc:729] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.609669 13387 consensus_queue.cc:260] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.614600 13375 tablet_bootstrap.cc:492] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.615304 13375 ts_tablet_manager.cc:1397] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.014s
I20260811 16:02:40.618036 13378 tablet_bootstrap.cc:492] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.618675 13378 ts_tablet_manager.cc:1397] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260811 16:02:40.618271 13375 raft_consensus.cc:348] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.619109 13375 raft_consensus.cc:374] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.619496 13375 raft_consensus.cc:729] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.620427 13375 consensus_queue.cc:260] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.621462 13271 heartbeater.cc:503] Master 127.12.23.254:33065 was elected leader, sending a full tablet report...
I20260811 16:02:40.621989 13387 ts_tablet_manager.cc:1428] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.012s
I20260811 16:02:40.622990 13387 tablet_bootstrap.cc:492] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.626448 13375 ts_tablet_manager.cc:1428] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260811 16:02:40.627841 13375 tablet_bootstrap.cc:492] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.628958 13378 raft_consensus.cc:348] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.629951 13378 raft_consensus.cc:374] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.630331 13378 raft_consensus.cc:729] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.634855 13387 tablet_bootstrap.cc:654] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.635350 13378 consensus_queue.cc:260] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.638216 13375 tablet_bootstrap.cc:654] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.643994 13378 ts_tablet_manager.cc:1428] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260811 16:02:40.645582 13378 tablet_bootstrap.cc:492] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: Bootstrap starting.
W20260811 16:02:40.648138 13358 tablet.cc:2369] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:02:40.652442 13375 tablet_bootstrap.cc:492] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.652976 13375 ts_tablet_manager.cc:1397] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260811 16:02:40.655931 13375 raft_consensus.cc:348] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.656769 13375 raft_consensus.cc:374] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.657109 13375 raft_consensus.cc:729] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.657990 13375 consensus_queue.cc:260] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.660066 13387 tablet_bootstrap.cc:492] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.660638 13387 ts_tablet_manager.cc:1397] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.013s
I20260811 16:02:40.662616 13375 ts_tablet_manager.cc:1428] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260811 16:02:40.663789 13375 tablet_bootstrap.cc:492] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.663640 13387 raft_consensus.cc:348] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.664649 13387 raft_consensus.cc:374] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.665046 13387 raft_consensus.cc:729] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.665944 13387 consensus_queue.cc:260] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.660084 13378 tablet_bootstrap.cc:654] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.668195 13387 ts_tablet_manager.cc:1428] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260811 16:02:40.669302 13387 tablet_bootstrap.cc:492] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.673753 13375 tablet_bootstrap.cc:654] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.678504 13387 tablet_bootstrap.cc:654] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.679890 13377 raft_consensus.cc:482] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.680418 13377 raft_consensus.cc:504] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.682585 13377 leader_election.cc:288] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.683645 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:40.684247 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
I20260811 16:02:40.684896 13325 raft_consensus.cc:2454] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 0.
W20260811 16:02:40.685631 13117 leader_election.cc:341] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.685878 13375 tablet_bootstrap.cc:492] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.686496 13375 ts_tablet_manager.cc:1397] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260811 16:02:40.686372 13116 leader_election.cc:302] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: c25f197541914fd183cfc830874850bc
I20260811 16:02:40.687724 13377 raft_consensus.cc:2781] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:40.688107 13377 raft_consensus.cc:482] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:40.688439 13377 raft_consensus.cc:3037] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.690148 13378 tablet_bootstrap.cc:492] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.689673 13375 raft_consensus.cc:348] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.690670 13375 raft_consensus.cc:374] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.690828 13378 ts_tablet_manager.cc:1397] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.016s
I20260811 16:02:40.690999 13375 raft_consensus.cc:729] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.692231 13387 tablet_bootstrap.cc:492] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.691872 13375 consensus_queue.cc:260] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.692732 13387 ts_tablet_manager.cc:1397] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260811 16:02:40.694231 13375 ts_tablet_manager.cc:1428] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260811 16:02:40.695278 13375 tablet_bootstrap.cc:492] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.695571 13387 raft_consensus.cc:348] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.696326 13387 raft_consensus.cc:374] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.696601 13387 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.697531 13387 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.697582 13377 raft_consensus.cc:504] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.701155 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:40.701876 13375 tablet_bootstrap.cc:654] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.701339 13378 raft_consensus.cc:348] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.702376 13378 raft_consensus.cc:374] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 16:02:40.702620 13117 leader_election.cc:341] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.702762 13378 raft_consensus.cc:729] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.703583 13392 raft_consensus.cc:482] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.704078 13392 raft_consensus.cc:504] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.703881 13378 consensus_queue.cc:260] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.712435 13378 ts_tablet_manager.cc:1428] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260811 16:02:40.713637 13392 leader_election.cc:288] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.713896 13378 tablet_bootstrap.cc:492] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.726166 13387 ts_tablet_manager.cc:1428] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260811 16:02:40.719977 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:40.728276 13325 raft_consensus.cc:3037] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.734388 13387 tablet_bootstrap.cc:492] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.736853 13377 leader_election.cc:288] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.743533 13325 raft_consensus.cc:2454] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 1.
I20260811 16:02:40.745770 13387 tablet_bootstrap.cc:654] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.745522 13116 leader_election.cc:302] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: c25f197541914fd183cfc830874850bc
I20260811 16:02:40.747367 13377 raft_consensus.cc:2781] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:40.748050 13377 raft_consensus.cc:686] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:40.749246 13377 consensus_queue.cc:237] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.757400 13378 tablet_bootstrap.cc:654] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.761099 13040 catalog_manager.cc:5495] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 0 to 1, leader changed from <none> to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 1 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:40.762266 13375 tablet_bootstrap.cc:492] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.764008 13375 ts_tablet_manager.cc:1397] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.032s
I20260811 16:02:40.766476 13387 tablet_bootstrap.cc:492] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.766993 13387 ts_tablet_manager.cc:1397] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.013s
W20260811 16:02:40.766901 13096 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:02:40.767782 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
W20260811 16:02:40.770162 13202 leader_election.cc:341] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.770481 13375 raft_consensus.cc:348] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.771268 13375 raft_consensus.cc:374] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.771592 13375 raft_consensus.cc:729] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.772367 13375 consensus_queue.cc:260] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.775892 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
I20260811 16:02:40.775895 13375 ts_tablet_manager.cc:1428] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260811 16:02:40.774425 13387 raft_consensus.cc:348] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.776798 13387 raft_consensus.cc:374] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.777132 13387 raft_consensus.cc:729] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.777374 13375 tablet_bootstrap.cc:492] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
W20260811 16:02:40.777715 13201 leader_election.cc:341] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b555939358643899e1397258987535d (127.12.23.195:44149): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.778177 13201 leader_election.cc:302] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c25f197541914fd183cfc830874850bc; no voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:40.777978 13387 consensus_queue.cc:260] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.779024 13392 raft_consensus.cc:2726] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:40.781253 13378 tablet_bootstrap.cc:492] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.781751 13378 ts_tablet_manager.cc:1397] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.012s
I20260811 16:02:40.784886 13378 raft_consensus.cc:348] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.785945 13377 raft_consensus.cc:482] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.786018 13378 raft_consensus.cc:374] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.786490 13378 raft_consensus.cc:729] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.786522 13377 raft_consensus.cc:504] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.787659 13378 consensus_queue.cc:260] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.788762 13377 leader_election.cc:288] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.791266 13375 tablet_bootstrap.cc:654] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.791278 13378 ts_tablet_manager.cc:1428] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.003s
I20260811 16:02:40.791540 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
W20260811 16:02:40.794009 13117 leader_election.cc:341] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.795032 13387 ts_tablet_manager.cc:1428] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.003s
I20260811 16:02:40.795270 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
W20260811 16:02:40.797186 13116 leader_election.cc:341] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b555939358643899e1397258987535d (127.12.23.195:44149): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.797631 13116 leader_election.cc:302] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d489d42b74ee4099bc1c0a9a4a21881d; no voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc
I20260811 16:02:40.798625 13377 raft_consensus.cc:2726] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:40.801417 13378 tablet_bootstrap.cc:492] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.805526 13375 tablet_bootstrap.cc:492] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.806082 13375 ts_tablet_manager.cc:1397] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260811 16:02:40.806638 13387 tablet_bootstrap.cc:492] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.808728 13378 tablet_bootstrap.cc:654] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.808915 13375 raft_consensus.cc:348] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.809705 13375 raft_consensus.cc:374] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.810041 13375 raft_consensus.cc:729] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.811018 13375 consensus_queue.cc:260] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.814561 13375 ts_tablet_manager.cc:1428] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260811 16:02:40.815542 13375 tablet_bootstrap.cc:492] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.815829 13387 tablet_bootstrap.cc:654] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.821801 13375 tablet_bootstrap.cc:654] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.828373 13378 tablet_bootstrap.cc:492] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.828894 13378 ts_tablet_manager.cc:1397] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.012s
I20260811 16:02:40.831835 13378 raft_consensus.cc:348] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.832688 13375 tablet_bootstrap.cc:492] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.832641 13378 raft_consensus.cc:374] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.833281 13375 ts_tablet_manager.cc:1397] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.002s
I20260811 16:02:40.833137 13378 raft_consensus.cc:729] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.834147 13378 consensus_queue.cc:260] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.836175 13387 tablet_bootstrap.cc:492] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.835764 13375 raft_consensus.cc:348] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.836580 13375 raft_consensus.cc:374] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.836839 13387 ts_tablet_manager.cc:1397] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260811 16:02:40.836859 13375 raft_consensus.cc:729] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.837680 13375 consensus_queue.cc:260] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.839550 13378 ts_tablet_manager.cc:1428] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260811 16:02:40.839807 13375 ts_tablet_manager.cc:1428] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260811 16:02:40.840598 13378 tablet_bootstrap.cc:492] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.840890 13375 tablet_bootstrap.cc:492] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.847062 13375 tablet_bootstrap.cc:654] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.847289 13378 tablet_bootstrap.cc:654] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.840150 13387 raft_consensus.cc:348] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.848853 13387 raft_consensus.cc:374] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.849218 13387 raft_consensus.cc:729] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.850033 13387 consensus_queue.cc:260] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.853529 13387 ts_tablet_manager.cc:1428] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260811 16:02:40.855073 13387 tablet_bootstrap.cc:492] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.855245 13377 raft_consensus.cc:482] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.855710 13377 raft_consensus.cc:504] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.857903 13377 leader_election.cc:288] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.860262 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
W20260811 16:02:40.862375 13116 leader_election.cc:341] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b555939358643899e1397258987535d (127.12.23.195:44149): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.858901 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
W20260811 16:02:40.864955 13117 leader_election.cc:341] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:02:40.865607 13117 leader_election.cc:302] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d489d42b74ee4099bc1c0a9a4a21881d; no voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc
I20260811 16:02:40.867005 13377 raft_consensus.cc:2726] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:02:40.871008 13387 tablet_bootstrap.cc:654] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.877132 13378 tablet_bootstrap.cc:492] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.877609 13378 ts_tablet_manager.cc:1397] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.013s
I20260811 16:02:40.878362 13375 tablet_bootstrap.cc:492] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.878743 13375 ts_tablet_manager.cc:1397] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.012s
I20260811 16:02:40.879781 13378 raft_consensus.cc:348] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.880548 13378 raft_consensus.cc:374] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.880834 13378 raft_consensus.cc:729] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.881006 13375 raft_consensus.cc:348] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.881704 13387 tablet_bootstrap.cc:492] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.881744 13375 raft_consensus.cc:374] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.882189 13375 raft_consensus.cc:729] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.881639 13378 consensus_queue.cc:260] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.882329 13387 ts_tablet_manager.cc:1397] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.001s
I20260811 16:02:40.882961 13388 raft_consensus.cc:482] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.883029 13375 consensus_queue.cc:260] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.883564 13388 raft_consensus.cc:504] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.885466 13375 ts_tablet_manager.cc:1428] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260811 16:02:40.886178 13388 leader_election.cc:288] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:40.886726 13375 tablet_bootstrap.cc:492] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d: Bootstrap starting.
I20260811 16:02:40.888505 13378 ts_tablet_manager.cc:1428] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260811 16:02:40.889456 13378 tablet_bootstrap.cc:492] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.892462 13375 tablet_bootstrap.cc:654] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.885344 13387 raft_consensus.cc:348] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.895244 13387 raft_consensus.cc:374] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.895572 13387 raft_consensus.cc:729] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.897181 13378 tablet_bootstrap.cc:654] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.897744 13387 consensus_queue.cc:260] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.905190 13387 ts_tablet_manager.cc:1428] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260811 16:02:40.906675 13387 tablet_bootstrap.cc:492] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.909658 13378 tablet_bootstrap.cc:492] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.910195 13378 ts_tablet_manager.cc:1397] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260811 16:02:40.913228 13378 raft_consensus.cc:348] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.914002 13378 raft_consensus.cc:374] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.914324 13378 raft_consensus.cc:729] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.915190 13378 consensus_queue.cc:260] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.917812 13378 ts_tablet_manager.cc:1428] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260811 16:02:40.918823 13378 tablet_bootstrap.cc:492] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.925390 13378 tablet_bootstrap.cc:654] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.939009 13387 tablet_bootstrap.cc:654] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.940477 13378 tablet_bootstrap.cc:492] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.941004 13378 ts_tablet_manager.cc:1397] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260811 16:02:40.943720 13378 raft_consensus.cc:348] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.944509 13378 raft_consensus.cc:374] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.944784 13378 raft_consensus.cc:729] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.945505 13378 consensus_queue.cc:260] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.947716 13378 ts_tablet_manager.cc:1428] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260811 16:02:40.948659 13378 tablet_bootstrap.cc:492] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:40.949011 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:40.949836 13158 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:40.951303 13285 leader_election.cc:302] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:40.952214 13388 raft_consensus.cc:2781] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:40.952566 13388 raft_consensus.cc:482] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:40.952962 13388 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.953929 13387 tablet_bootstrap.cc:492] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:40.954523 13387 ts_tablet_manager.cc:1397] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.008s
I20260811 16:02:40.952631 13375 tablet_bootstrap.cc:492] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d: No bootstrap required, opened a new log
I20260811 16:02:40.955399 13378 tablet_bootstrap.cc:654] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.955621 13375 ts_tablet_manager.cc:1397] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent bootstrapping tablet: real 0.069s	user 0.040s	sys 0.018s
I20260811 16:02:40.956494 13377 raft_consensus.cc:482] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:40.956971 13377 raft_consensus.cc:504] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.959695 13377 leader_election.cc:288] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:40.961206 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
I20260811 16:02:40.962121 13325 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 0.
I20260811 16:02:40.963481 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:40.964785 13244 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 0.
I20260811 16:02:40.966295 13117 leader_election.cc:302] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:40.967685 13377 raft_consensus.cc:2781] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:40.957466 13387 raft_consensus.cc:348] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.968063 13377 raft_consensus.cc:482] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:40.968293 13387 raft_consensus.cc:374] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.968466 13377 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.968817 13387 raft_consensus.cc:729] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.969832 13387 consensus_queue.cc:260] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.973132 13387 ts_tablet_manager.cc:1428] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260811 16:02:40.967700 13388 raft_consensus.cc:504] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.975265 13387 tablet_bootstrap.cc:492] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:40.977303 13388 leader_election.cc:288] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:40.978413 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:40.979018 13158 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.981761 13377 raft_consensus.cc:504] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:40.983893 13387 tablet_bootstrap.cc:654] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:40.986352 13158 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:40.987054 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:40.987725 13244 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.987565 13285 leader_election.cc:302] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:40.990952 13378 tablet_bootstrap.cc:492] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:40.991367 13388 raft_consensus.cc:2781] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:40.991612 13378 ts_tablet_manager.cc:1397] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.012s
I20260811 16:02:40.995028 13378 raft_consensus.cc:348] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.996420 13378 raft_consensus.cc:374] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:40.996462 13243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:40.996795 13378 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:40.996992 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:40.997221 13243 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:40.997603 13244 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 1.
I20260811 16:02:40.997570 13378 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:40.998863 13117 leader_election.cc:302] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.000170 13380 raft_consensus.cc:2781] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.001389 13377 leader_election.cc:288] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.001314 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.002269 13325 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:40.984872 13375 raft_consensus.cc:348] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.002776 13375 raft_consensus.cc:374] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:41.003096 13375 raft_consensus.cc:729] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Initialized, Role: FOLLOWER
I20260811 16:02:41.005270 13378 ts_tablet_manager.cc:1428] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260811 16:02:41.005293 13375 consensus_queue.cc:260] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.007777 13375 ts_tablet_manager.cc:1428] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260811 16:02:41.008934 13388 raft_consensus.cc:686] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.009361 13325 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 1.
I20260811 16:02:41.010210 13388 consensus_queue.cc:237] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.011775 13387 tablet_bootstrap.cc:492] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:41.012248 13387 ts_tablet_manager.cc:1397] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.007s
I20260811 16:02:41.012840 13378 tablet_bootstrap.cc:492] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: Bootstrap starting.
I20260811 16:02:41.015009 13387 raft_consensus.cc:348] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.015812 13387 raft_consensus.cc:374] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:41.016109 13387 raft_consensus.cc:729] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:41.016635 13377 raft_consensus.cc:482] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.016944 13387 consensus_queue.cc:260] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.017320 13377 raft_consensus.cc:504] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.019642 13407 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.019838 13378 tablet_bootstrap.cc:654] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:41.020176 13407 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:41.021925 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
I20260811 16:02:41.022807 13325 raft_consensus.cc:2454] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 0.
I20260811 16:02:41.023764 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.024256 13116 leader_election.cc:302] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.024557 13158 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 0.
I20260811 16:02:41.024969 13380 raft_consensus.cc:686] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:41.025480 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:41.025589 13427 raft_consensus.cc:2781] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.025954 13202 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.026181 13244 raft_consensus.cc:2454] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 0.
I20260811 16:02:41.026194 13427 raft_consensus.cc:482] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.025919 13380 consensus_queue.cc:237] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.027010 13427 raft_consensus.cc:3037] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.027034 13392 raft_consensus.cc:2781] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.027456 13377 leader_election.cc:288] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.027575 13392 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.028018 13392 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.033209 13407 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.033486 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
I20260811 16:02:41.034227 13325 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 0.
I20260811 16:02:41.035437 13040 catalog_manager.cc:5495] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.041093 13392 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:41.043009 13427 raft_consensus.cc:504] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.044852 13387 ts_tablet_manager.cc:1428] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260811 16:02:41.047807 13427 leader_election.cc:288] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.048655 13387 tablet_bootstrap.cc:492] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:41.048796 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.052740 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.053575 13324 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.051484 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.056205 13325 raft_consensus.cc:3037] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.055760 13039 catalog_manager.cc:5495] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 0 to 1, leader changed from <none> to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 1 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.061532 13387 tablet_bootstrap.cc:654] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:41.052295 13392 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.053025 13244 raft_consensus.cc:3037] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.050263 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.066988 13325 raft_consensus.cc:2454] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 1.
I20260811 16:02:41.065284 13158 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.071080 13324 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 1.
I20260811 16:02:41.072170 13116 leader_election.cc:302] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.072875 13201 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:41.073086 13427 raft_consensus.cc:2781] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.073573 13427 raft_consensus.cc:686] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:41.073818 13392 raft_consensus.cc:2781] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.075083 13427 consensus_queue.cc:237] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.075300 13392 raft_consensus.cc:686] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:41.077844 13392 consensus_queue.cc:237] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:41.080400 13378 tablet_bootstrap.cc:492] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: No bootstrap required, opened a new log
I20260811 16:02:41.080904 13378 ts_tablet_manager.cc:1397] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: Time spent bootstrapping tablet: real 0.068s	user 0.027s	sys 0.005s
I20260811 16:02:41.080787 13158 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 1.
I20260811 16:02:41.084702 13378 raft_consensus.cc:348] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.085486 13378 raft_consensus.cc:374] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:41.085784 13378 raft_consensus.cc:729] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Initialized, Role: FOLLOWER
I20260811 16:02:41.086464 13378 consensus_queue.cc:260] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.089002 13378 ts_tablet_manager.cc:1428] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:02:41.090991 13426 raft_consensus.cc:482] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.091559 13426 raft_consensus.cc:504] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.087066 13244 raft_consensus.cc:2454] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 1.
I20260811 16:02:41.093801 13426 leader_election.cc:288] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.095876 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87e5f45e71374c2aa902b34b1670ba95" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.096593 13158 raft_consensus.cc:2454] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.096892 13039 catalog_manager.cc:5495] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 0 to 1, leader changed from <none> to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 1 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.097889 13285 leader_election.cc:302] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.098793 13426 raft_consensus.cc:2781] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.099184 13426 raft_consensus.cc:482] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.099516 13426 raft_consensus.cc:3037] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.100821 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87e5f45e71374c2aa902b34b1670ba95" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:41.101503 13242 raft_consensus.cc:2454] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.103606 13042 catalog_manager.cc:5495] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 0 to 1, leader changed from <none> to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 1 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.107551 13426 raft_consensus.cc:504] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.109944 13426 leader_election.cc:288] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.111553 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87e5f45e71374c2aa902b34b1670ba95" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.111924 13388 raft_consensus.cc:482] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.112207 13158 raft_consensus.cc:3037] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.112550 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87e5f45e71374c2aa902b34b1670ba95" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.113747 13244 raft_consensus.cc:3037] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.112450 13388 raft_consensus.cc:504] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.118994 13388 leader_election.cc:288] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.119283 13158 raft_consensus.cc:2454] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.120240 13285 leader_election.cc:302] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.120666 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.121336 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:41.121446 13157 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.122063 13242 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.123229 13388 raft_consensus.cc:2781] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.123602 13285 leader_election.cc:302] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:41.124560 13425 raft_consensus.cc:2781] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.123757 13388 raft_consensus.cc:686] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.124933 13425 raft_consensus.cc:482] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.125203 13387 tablet_bootstrap.cc:492] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:41.125294 13425 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.125763 13387 ts_tablet_manager.cc:1397] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.005s
I20260811 16:02:41.125520 13388 consensus_queue.cc:237] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.128037 13244 raft_consensus.cc:2454] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.128470 13387 raft_consensus.cc:348] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.129277 13387 raft_consensus.cc:374] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:41.129546 13387 raft_consensus.cc:729] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:41.130266 13387 consensus_queue.cc:260] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.132576 13387 ts_tablet_manager.cc:1428] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260811 16:02:41.133503 13387 tablet_bootstrap.cc:492] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: Bootstrap starting.
I20260811 16:02:41.134199 13425 raft_consensus.cc:504] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.136508 13425 leader_election.cc:288] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.137352 13040 catalog_manager.cc:5495] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.138602 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.139350 13387 tablet_bootstrap.cc:654] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: Neither blocks nor log segments found. Creating new log.
I20260811 16:02:41.139283 13244 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.139748 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.140345 13157 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.146641 13244 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.147841 13285 leader_election.cc:302] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:41.148782 13388 raft_consensus.cc:2781] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.148969 13157 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.149327 13388 raft_consensus.cc:686] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.150206 13388 consensus_queue.cc:237] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.153319 13387 tablet_bootstrap.cc:492] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: No bootstrap required, opened a new log
I20260811 16:02:41.153810 13387 ts_tablet_manager.cc:1397] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260811 16:02:41.155453 13425 raft_consensus.cc:482] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.155987 13425 raft_consensus.cc:504] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.156992 13387 raft_consensus.cc:348] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.157716 13387 raft_consensus.cc:374] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:02:41.158007 13387 raft_consensus.cc:729] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Initialized, Role: FOLLOWER
I20260811 16:02:41.158751 13387 consensus_queue.cc:260] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.159703 13392 raft_consensus.cc:482] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.159629 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.160382 13157 raft_consensus.cc:2454] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.160210 13392 raft_consensus.cc:504] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.161052 13387 ts_tablet_manager.cc:1428] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260811 16:02:41.161873 13425 leader_election.cc:288] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.162297 13392 leader_election.cc:288] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.163335 13285 leader_election.cc:302] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.164372 13425 raft_consensus.cc:2781] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.164800 13425 raft_consensus.cc:482] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.165330 13425 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.165799 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d" is_pre_election: true
I20260811 16:02:41.165848 13040 catalog_manager.cc:5495] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.167938 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.168609 13157 raft_consensus.cc:2454] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 0.
I20260811 16:02:41.169703 13202 leader_election.cc:302] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.170511 13392 raft_consensus.cc:2781] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.170769 13392 raft_consensus.cc:482] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.170969 13392 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.170033 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:41.172591 13425 raft_consensus.cc:504] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.173771 13324 raft_consensus.cc:2379] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c25f197541914fd183cfc830874850bc in current term 1: Already voted for candidate 7b555939358643899e1397258987535d in this term.
I20260811 16:02:41.174806 13425 leader_election.cc:288] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.175423 13425 raft_consensus.cc:482] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.175827 13425 raft_consensus.cc:504] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.176175 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.178112 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.178716 13157 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.178783 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.179504 13158 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.179942 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:41.180568 13242 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.180944 13285 leader_election.cc:302] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.181478 13425 leader_election.cc:288] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.181834 13426 raft_consensus.cc:2781] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.182125 13426 raft_consensus.cc:482] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.182435 13426 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.186641 13392 raft_consensus.cc:504] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.187774 13244 raft_consensus.cc:2379] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b555939358643899e1397258987535d in current term 1: Already voted for candidate c25f197541914fd183cfc830874850bc in this term.
I20260811 16:02:41.187559 13426 raft_consensus.cc:504] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.189328 13426 leader_election.cc:288] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.190172 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.190680 13157 raft_consensus.cc:2454] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.190820 13158 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.190757 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.191480 13244 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.191921 13285 leader_election.cc:302] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: c25f197541914fd183cfc830874850bc
I20260811 16:02:41.193214 13155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.194084 13155 raft_consensus.cc:2379] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c25f197541914fd183cfc830874850bc in current term 1: Already voted for candidate 7b555939358643899e1397258987535d in this term.
I20260811 16:02:41.195566 13388 raft_consensus.cc:2781] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.196062 13388 raft_consensus.cc:686] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.197769 13244 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.197978 13158 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.196884 13388 consensus_queue.cc:237] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.198861 13285 leader_election.cc:302] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:41.199625 13426 raft_consensus.cc:2781] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.199661 13392 leader_election.cc:288] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.200429 13426 raft_consensus.cc:686] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.200778 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.201164 13426 consensus_queue.cc:237] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.202121 13201 leader_election.cc:302] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c25f197541914fd183cfc830874850bc; no voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:41.203038 13392 raft_consensus.cc:2726] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:02:41.207996 13040 catalog_manager.cc:5495] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.220296 13040 catalog_manager.cc:5495] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.246053 13244 raft_consensus.cc:3037] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.253006 13427 consensus_queue.cc:1035] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.265482 13377 consensus_queue.cc:1035] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:41.312453 13388 raft_consensus.cc:482] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:02:41.312955 13388 raft_consensus.cc:504] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.314639 13388 leader_election.cc:288] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.315579 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" is_pre_election: true
I20260811 16:02:41.315743 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc" is_pre_election: true
I20260811 16:02:41.316174 13157 raft_consensus.cc:2454] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.316329 13244 raft_consensus.cc:2454] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 0.
I20260811 16:02:41.317173 13285 leader_election.cc:302] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.317822 13388 raft_consensus.cc:2781] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:02:41.318118 13388 raft_consensus.cc:482] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:02:41.318392 13388 raft_consensus.cc:3037] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.323036 13388 raft_consensus.cc:504] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.324692 13388 leader_election.cc:288] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.325870 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.325898 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.326520 13157 raft_consensus.cc:3037] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.326588 13244 raft_consensus.cc:3037] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.332242 13244 raft_consensus.cc:2454] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.332255 13157 raft_consensus.cc:2454] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 1.
I20260811 16:02:41.333448 13285 leader_election.cc:302] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:41.334162 13388 raft_consensus.cc:2781] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:02:41.334585 13388 raft_consensus.cc:686] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.335388 13388 consensus_queue.cc:237] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.342494 13042 catalog_manager.cc:5495] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:41.390712 13244 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:02:41.396850 13388 consensus_queue.cc:1035] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.407398 13425 consensus_queue.cc:1035] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.416887 13380 consensus_queue.cc:1035] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.428663 13377 consensus_queue.cc:1035] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.477241 13244 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "c25f197541914fd183cfc830874850bc"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:48126
I20260811 16:02:41.477854 13244 raft_consensus.cc:595] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:41.486918 13392 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.496588 13392 raft_consensus.cc:979] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:41.497138 13392 raft_consensus.cc:1067] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:41.498791 13158 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37904
I20260811 16:02:41.500711 13325 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a19c81b4088e4261992248f3e719d391"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:41.501489 13325 raft_consensus.cc:595] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:41.503103 13158 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:41.503643 13158 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.511001 13158 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:41.513844 13325 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5c57dae40cd744caba94fa022161be37"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:41.514768 13325 raft_consensus.cc:595] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 LEADER]: Received request to transfer leadership to TS c25f197541914fd183cfc830874850bc
I20260811 16:02:41.515880 13392 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:41.524317 13325 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:41.525065 13325 raft_consensus.cc:595] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 LEADER]: Received request to transfer leadership to TS c25f197541914fd183cfc830874850bc
I20260811 16:02:41.525657 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.526310 13324 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.526448 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.527220 13244 raft_consensus.cc:3032] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:41.527557 13244 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:41.528313 13244 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:41.529249 13244 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.531204 13323 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b72ef29484ad478ba56453068ac55128"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:41.531919 13323 raft_consensus.cc:595] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 LEADER]: Received request to transfer leadership to TS c25f197541914fd183cfc830874850bc
I20260811 16:02:41.531392 13158 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 2 election: Requested vote from peers 7b555939358643899e1397258987535d (127.12.23.195:44149), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:41.533828 13324 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 2.
I20260811 16:02:41.534650 13325 raft_consensus.cc:1226] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Rejecting Update request from peer c25f197541914fd183cfc830874850bc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260811 16:02:41.536921 13244 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 2.
I20260811 16:02:41.537283 13323 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:41.537912 13323 raft_consensus.cc:595] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 LEADER]: Received request to transfer leadership to TS c25f197541914fd183cfc830874850bc
I20260811 16:02:41.538257 13117 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.539245 13377 raft_consensus.cc:2781] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:41.539727 13377 raft_consensus.cc:686] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:41.540550 13377 consensus_queue.cc:237] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:41.549271 13425 consensus_queue.cc:1035] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.549029 13041 catalog_manager.cc:5495] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 1 to 2, leader changed from c25f197541914fd183cfc830874850bc (127.12.23.194) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 2 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.562479 13426 consensus_queue.cc:1035] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.571636 13426 raft_consensus.cc:979] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:41.572141 13426 raft_consensus.cc:1067] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:41.573181 13425 consensus_queue.cc:1035] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.573900 13158 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a19c81b4088e4261992248f3e719d391"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37908
I20260811 16:02:41.574631 13158 raft_consensus.cc:482] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:41.575004 13158 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.584403 13158 raft_consensus.cc:504] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.585213 13388 consensus_queue.cc:1035] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.587416 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:41.588047 13244 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.594980 13244 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 2.
I20260811 16:02:41.595738 13158 leader_election.cc:288] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 2 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.596547 13117 leader_election.cc:302] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.597395 13377 raft_consensus.cc:2781] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:41.597910 13377 raft_consensus.cc:686] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:41.598752 13377 consensus_queue.cc:237] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.600473 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.601094 13324 raft_consensus.cc:3032] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:41.601418 13324 raft_consensus.cc:729] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.602192 13324 consensus_queue.cc:260] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.603415 13324 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.608528 13042 catalog_manager.cc:5495] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 1 to 2, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 2 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.609269 13324 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 2.
I20260811 16:02:41.640729 13377 consensus_queue.cc:1035] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.647704 13388 consensus_queue.cc:1035] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.654356 13377 consensus_queue.cc:1035] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:41.657219 13388 consensus_queue.cc:1035] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.672231 13426 raft_consensus.cc:979] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: : Instructing follower c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.672739 13426 raft_consensus.cc:1067] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 LEADER]: Signalling peer c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.676904 13242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c"
dest_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:48122
I20260811 16:02:41.679443 13242 raft_consensus.cc:482] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:41.679862 13242 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.688696 13388 consensus_queue.cc:1035] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.688570 13242 raft_consensus.cc:504] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.689713 13469 consensus_queue.cc:1035] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.691630 13242 leader_election.cc:288] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.693583 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.694200 13323 raft_consensus.cc:3032] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:41.694504 13323 raft_consensus.cc:729] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.695688 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.698335 13323 consensus_queue.cc:260] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.699990 13323 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.707341 13323 raft_consensus.cc:2454] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:41.708529 13201 leader_election.cc:302] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:41.709739 13392 raft_consensus.cc:2781] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:41.710239 13392 raft_consensus.cc:686] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:41.711093 13392 consensus_queue.cc:237] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.714998 13388 raft_consensus.cc:979] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: : Instructing follower c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.715531 13469 raft_consensus.cc:1067] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 LEADER]: Signalling peer c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.717540 13242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b72ef29484ad478ba56453068ac55128"
dest_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:48122
I20260811 16:02:41.718158 13242 raft_consensus.cc:482] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:41.718546 13242 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.724066 13040 catalog_manager.cc:5495] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 1 to 2, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 2 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.725087 13242 raft_consensus.cc:504] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.727185 13242 leader_election.cc:288] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.727999 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.728341 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.728652 13158 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.729055 13323 raft_consensus.cc:3032] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:41.729449 13323 raft_consensus.cc:729] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.730394 13323 consensus_queue.cc:260] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.732483 13323 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.737318 13158 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:41.738560 13202 leader_election.cc:302] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.738619 13469 consensus_queue.cc:1035] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:41.740168 13392 raft_consensus.cc:2781] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:41.740795 13392 raft_consensus.cc:686] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:41.742930 13323 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:41.742481 13392 consensus_queue.cc:237] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.747109 13388 raft_consensus.cc:979] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: : Instructing follower c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.747655 13425 raft_consensus.cc:1067] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 LEADER]: Signalling peer c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.750011 13244 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe"
dest_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:48122
I20260811 16:02:41.751339 13244 raft_consensus.cc:482] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:41.751740 13244 raft_consensus.cc:3037] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.752861 13426 consensus_queue.cc:1035] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:02:41.754288 13040 catalog_manager.cc:5495] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 1 to 2, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 2 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.761237 13244 raft_consensus.cc:504] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.763195 13244 leader_election.cc:288] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.763996 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.765626 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff2448da3464456a9c340f87a086dfe" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.766301 13323 raft_consensus.cc:3032] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:41.766619 13323 raft_consensus.cc:729] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.767532 13323 consensus_queue.cc:260] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.768986 13323 raft_consensus.cc:3037] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.776500 13323 raft_consensus.cc:2454] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:41.777765 13201 leader_election.cc:302] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:41.779021 13392 raft_consensus.cc:2781] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:41.779525 13392 raft_consensus.cc:686] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:41.780351 13392 consensus_queue.cc:237] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.787882 13040 catalog_manager.cc:5495] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 1 to 2, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 2 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:41.962739 13426 raft_consensus.cc:979] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: : Instructing follower c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.963327 13388 raft_consensus.cc:1067] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 LEADER]: Signalling peer c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:41.965286 13244 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5c57dae40cd744caba94fa022161be37"
dest_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:48122
I20260811 16:02:41.965831 13244 raft_consensus.cc:482] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:41.966148 13244 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.973492 13244 raft_consensus.cc:504] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.975978 13244 leader_election.cc:288] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:41.977248 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:41.977624 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:41.978124 13158 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.978241 13323 raft_consensus.cc:3032] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:41.978636 13323 raft_consensus.cc:729] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:41.979568 13323 consensus_queue.cc:260] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:41.981009 13323 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:41.987890 13158 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:41.989373 13202 leader_election.cc:302] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:41.990268 13392 raft_consensus.cc:2781] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:41.990342 13323 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:41.991183 13392 raft_consensus.cc:686] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:41.992430 13392 consensus_queue.cc:237] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:42.001288 13041 catalog_manager.cc:5495] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 1 to 2, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 2 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:42.061544 13244 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.062878 13377 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:42.071092 13323 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.073413 13377 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:02:42.155346 13323 raft_consensus.cc:1261] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.157048 13392 consensus_queue.cc:1035] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:42.167362 13158 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:42.175261 13157 raft_consensus.cc:1261] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.177184 13244 raft_consensus.cc:1261] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.177404 13476 consensus_queue.cc:1035] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:42.179347 13377 consensus_queue.cc:1035] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:42.191996 13323 raft_consensus.cc:1261] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.192453 13324 raft_consensus.cc:1261] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.194288 13392 consensus_queue.cc:1035] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:42.209227 13380 consensus_queue.cc:1035] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:42.212009 13157 raft_consensus.cc:3037] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:42.220558 13158 raft_consensus.cc:1261] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.221939 13157 raft_consensus.cc:1261] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.222035 13392 consensus_queue.cc:1035] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:42.225199 13476 consensus_queue.cc:1035] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:42.237397 13324 raft_consensus.cc:1261] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.241175 13457 consensus_queue.cc:1035] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:42.434976 13324 raft_consensus.cc:1261] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.436378 13480 consensus_queue.cc:1035] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:42.446265 13157 raft_consensus.cc:1261] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:42.447984 13480 consensus_queue.cc:1035] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:44.572875 12383 auto_leader_rebalancer-test.cc:339] The leader distribution is 
I20260811 16:02:44.573684 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:44.596748 13157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
mode: GRACEFUL
new_leader_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:37922
I20260811 16:02:44.597275 13157 raft_consensus.cc:595] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Received request to transfer leadership to TS 7b555939358643899e1397258987535d
I20260811 16:02:44.599537 13157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
mode: GRACEFUL
new_leader_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:37922
I20260811 16:02:44.600065 13157 raft_consensus.cc:595] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Received request to transfer leadership to TS 7b555939358643899e1397258987535d
I20260811 16:02:44.601066 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260811 16:02:44.601528 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:44.949663 13490 raft_consensus.cc:979] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: : Instructing follower 7b555939358643899e1397258987535d to start an election
I20260811 16:02:44.950137 13377 raft_consensus.cc:1067] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Signalling peer 7b555939358643899e1397258987535d to start an election
I20260811 16:02:44.951651 13324 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:52730
I20260811 16:02:44.952229 13324 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:44.952637 13324 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:44.959620 13324 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:44.961199 13324 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [CANDIDATE]: Term 3 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:44.962311 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:44.962189 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:44.962858 13242 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:44.962916 13157 raft_consensus.cc:3032] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:44.963387 13157 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:44.964264 13157 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:44.965631 13157 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:44.970008 13242 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 3.
I20260811 16:02:44.971324 13285 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:44.972249 13486 raft_consensus.cc:2781] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:44.973760 13486 raft_consensus.cc:686] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:44.974561 13486 consensus_queue.cc:237] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:44.975951 13157 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 3.
I20260811 16:02:44.981870 13042 catalog_manager.cc:5495] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d reported cstate change: term changed from 2 to 3, leader changed from d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193) to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 3 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:45.054445 13490 raft_consensus.cc:979] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: : Instructing follower 7b555939358643899e1397258987535d to start an election
I20260811 16:02:45.054956 13490 raft_consensus.cc:1067] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Signalling peer 7b555939358643899e1397258987535d to start an election
I20260811 16:02:45.056694 13324 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03"
dest_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:52730
I20260811 16:02:45.057220 13324 raft_consensus.cc:482] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:45.057492 13324 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:45.062539 13324 raft_consensus.cc:504] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:45.064462 13324 leader_election.cc:288] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:45.065392 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:45.065603 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:45.066135 13242 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:45.066162 13157 raft_consensus.cc:3032] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:45.066642 13157 raft_consensus.cc:729] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:45.067516 13157 consensus_queue.cc:260] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:45.068887 13157 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:45.073787 13242 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 2.
I20260811 16:02:45.075059 13285 leader_election.cc:302] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:45.075969 13486 raft_consensus.cc:2781] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:45.075997 13157 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 2.
I20260811 16:02:45.076601 13486 raft_consensus.cc:686] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:45.077422 13486 consensus_queue.cc:237] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:45.084069 13042 catalog_manager.cc:5495] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d reported cstate change: term changed from 1 to 2, leader changed from d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193) to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:45.523396 13157 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:45.524690 13486 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:45.533983 13242 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:45.535878 13486 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:45.604195 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:45.617084 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:45.617733 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:45.669157 13157 raft_consensus.cc:1261] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:45.669167 13242 raft_consensus.cc:1261] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:45.670913 13491 consensus_queue.cc:1035] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:45.671988 13486 consensus_queue.cc:1035] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:46.618677 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:46.625445 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:46.625932 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:47.626825 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:47.631969 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:47.632479 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:48.769346 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:48.774663 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:48.775189 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:02:48.985153 13267 debug-util.cc:398] Leaking SignalData structure 0x7b08000977c0 after lost signal to thread 12388
W20260811 16:02:48.985955 13267 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1aa0 after lost signal to thread 13078
W20260811 16:02:48.986742 13267 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc7e0 after lost signal to thread 13187
W20260811 16:02:48.987552 13267 debug-util.cc:398] Leaking SignalData structure 0x7b080009d2c0 after lost signal to thread 13270
W20260811 16:02:48.988296 13267 debug-util.cc:398] Leaking SignalData structure 0x7b080013e5c0 after lost signal to thread 13356
I20260811 16:02:49.776087 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:49.781865 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:49.782369 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:50.783244 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:50.790961 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:50.791486 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:51.792410 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:51.797829 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:51.798353 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:52.799392 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:52.805641 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:52.806155 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:53.807060 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:53.812371 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:53.812865 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:54.857223 12383 auto_leader_rebalancer-test.cc:358] The leader distribution is 
I20260811 16:02:54.863579 13324 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:54.864390 13324 raft_consensus.cc:595] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:54.874492 13324 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03"
dest_uuid: "7b555939358643899e1397258987535d"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:52750
I20260811 16:02:54.875046 13324 raft_consensus.cc:595] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:54.886386 13244 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5c57dae40cd744caba94fa022161be37"
dest_uuid: "c25f197541914fd183cfc830874850bc"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:48126
I20260811 16:02:54.886897 13244 raft_consensus.cc:595] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:54.891736 13244 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c"
dest_uuid: "c25f197541914fd183cfc830874850bc"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:48126
I20260811 16:02:54.892237 13244 raft_consensus.cc:595] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:54.896806 13244 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b72ef29484ad478ba56453068ac55128"
dest_uuid: "c25f197541914fd183cfc830874850bc"
mode: GRACEFUL
new_leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:48126
I20260811 16:02:54.897295 13244 raft_consensus.cc:595] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Received request to transfer leadership to TS d489d42b74ee4099bc1c0a9a4a21881d
I20260811 16:02:55.097705 13523 raft_consensus.cc:979] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.098311 13525 raft_consensus.cc:1067] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.099756 13157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37908
I20260811 16:02:55.100246 13157 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:55.100540 13157 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:02:55.106216 13157 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:55.108007 13157 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 4 election: Requested vote from peers 7b555939358643899e1397258987535d (127.12.23.195:44149), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:55.108835 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:55.109198 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:55.109544 13324 raft_consensus.cc:3032] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:02:55.109795 13244 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:02:55.109912 13324 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:55.110687 13324 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:55.112020 13324 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:02:55.117358 13244 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 4.
I20260811 16:02:55.117944 13324 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 4.
I20260811 16:02:55.118924 13117 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:55.120160 13519 raft_consensus.cc:2781] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:02:55.121124 13519 raft_consensus.cc:686] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:55.122222 13519 consensus_queue.cc:237] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:55.132860 13040 catalog_manager.cc:5495] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 3 to 4, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 4 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:55.154066 13524 raft_consensus.cc:979] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.155467 13520 raft_consensus.cc:1067] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.157480 13157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37904
I20260811 16:02:55.157963 13157 raft_consensus.cc:482] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:55.158267 13157 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.163335 13157 raft_consensus.cc:504] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.164855 13157 leader_election.cc:288] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:55.165850 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:55.165999 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075052c6d7344633b1f2f0fbf6396f0c" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:55.166445 13324 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.166498 13244 raft_consensus.cc:3032] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:55.166833 13244 raft_consensus.cc:729] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:55.167532 13244 consensus_queue.cc:260] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.168671 13244 raft_consensus.cc:3037] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.171712 13324 raft_consensus.cc:2454] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.173302 13116 leader_election.cc:302] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:55.174090 13244 raft_consensus.cc:2454] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.174132 13519 raft_consensus.cc:2781] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:55.174916 13519 raft_consensus.cc:686] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:55.176306 13519 consensus_queue.cc:237] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.185801 13040 catalog_manager.cc:5495] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 2 to 3, leader changed from c25f197541914fd183cfc830874850bc (127.12.23.194) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 3 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:55.223636 13524 raft_consensus.cc:979] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.224201 13520 raft_consensus.cc:1067] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.225965 13157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5c57dae40cd744caba94fa022161be37"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37904
I20260811 16:02:55.226451 13157 raft_consensus.cc:482] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:55.226884 13157 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.233196 13157 raft_consensus.cc:504] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.234968 13157 leader_election.cc:288] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:55.236284 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:55.236176 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c57dae40cd744caba94fa022161be37" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:55.236892 13244 raft_consensus.cc:3032] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:55.236971 13324 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.237195 13244 raft_consensus.cc:729] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:55.238057 13244 consensus_queue.cc:260] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.239012 13244 raft_consensus.cc:3037] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.242408 13324 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.243443 13116 leader_election.cc:302] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:55.243891 13244 raft_consensus.cc:2454] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.244148 13519 raft_consensus.cc:2781] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:55.244771 13519 raft_consensus.cc:686] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:55.246070 13519 consensus_queue.cc:237] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.254421 13040 catalog_manager.cc:5495] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 2 to 3, leader changed from c25f197541914fd183cfc830874850bc (127.12.23.194) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 3 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:55.265997 13523 raft_consensus.cc:979] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.266489 13525 raft_consensus.cc:1067] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.268174 13157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37908
I20260811 16:02:55.268687 13157 raft_consensus.cc:482] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:55.268983 13157 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.273756 13157 raft_consensus.cc:504] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.275202 13157 leader_election.cc:288] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:55.276222 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:55.276350 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0238f8ae0914ec783617ab6546e5b03" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:55.276711 13324 raft_consensus.cc:3032] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:55.276851 13244 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.277005 13324 raft_consensus.cc:729] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:55.277710 13324 consensus_queue.cc:260] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.278558 13324 raft_consensus.cc:3037] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.281661 13244 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.282817 13117 leader_election.cc:302] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25f197541914fd183cfc830874850bc, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:55.283351 13324 raft_consensus.cc:2454] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.284015 13526 raft_consensus.cc:2781] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:55.284498 13526 raft_consensus.cc:686] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:55.285387 13526 consensus_queue.cc:237] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.292954 13040 catalog_manager.cc:5495] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 2 to 3, leader changed from 7b555939358643899e1397258987535d (127.12.23.195) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 3 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:55.342301 13524 raft_consensus.cc:979] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: : Instructing follower d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.342849 13520 raft_consensus.cc:1067] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Signalling peer d489d42b74ee4099bc1c0a9a4a21881d to start an election
I20260811 16:02:55.344367 13157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b72ef29484ad478ba56453068ac55128"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
 from {username='slave'} at 127.0.0.1:37904
I20260811 16:02:55.344832 13157 raft_consensus.cc:482] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:55.345122 13157 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.349556 13157 raft_consensus.cc:504] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.351037 13157 leader_election.cc:288] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Requested vote from peers c25f197541914fd183cfc830874850bc (127.12.23.194:32775), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:55.351979 13244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:55.352090 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72ef29484ad478ba56453068ac55128" candidate_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:55.352712 13244 raft_consensus.cc:3032] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:55.352751 13323 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.353169 13244 raft_consensus.cc:729] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:55.353986 13244 consensus_queue.cc:260] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.355297 13244 raft_consensus.cc:3037] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:55.360606 13323 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.361858 13116 leader_election.cc:302] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, d489d42b74ee4099bc1c0a9a4a21881d; no voters: 
I20260811 16:02:55.361994 13244 raft_consensus.cc:2454] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d489d42b74ee4099bc1c0a9a4a21881d in term 3.
I20260811 16:02:55.362702 13526 raft_consensus.cc:2781] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:55.363201 13526 raft_consensus.cc:686] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Becoming Leader. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:55.364130 13526 consensus_queue.cc:237] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:55.370977 13040 catalog_manager.cc:5495] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d reported cstate change: term changed from 2 to 3, leader changed from c25f197541914fd183cfc830874850bc (127.12.23.194) to d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193). New cstate: current_term: 3 leader_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:55.606940 13323 raft_consensus.cc:1261] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.608206 13526 consensus_queue.cc:1035] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:55.620083 13244 raft_consensus.cc:1261] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.621996 13519 consensus_queue.cc:1035] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:55.627616 13242 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 4 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:02:55.630563 13526 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:02:55.680974 13323 raft_consensus.cc:1261] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.684331 13519 consensus_queue.cc:1035] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:55.689195 13323 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 4 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:02:55.691596 13324 raft_consensus.cc:1261] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.691975 13526 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:02:55.694149 13526 consensus_queue.cc:1035] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:55.716034 13242 raft_consensus.cc:1261] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.717783 13551 consensus_queue.cc:1035] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:55.721324 13242 raft_consensus.cc:1261] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.726768 13551 consensus_queue.cc:1035] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260811 16:02:55.875788 13242 raft_consensus.cc:1261] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.877295 13550 consensus_queue.cc:1035] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:55.887251 13325 raft_consensus.cc:1261] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Refusing update from remote peer d489d42b74ee4099bc1c0a9a4a21881d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:55.888914 13550 consensus_queue.cc:1035] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:02:57.936127 12383 auto_leader_rebalancer-test.cc:373] The leader distribution is 
I20260811 16:02:57.936861 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:57.944276 13157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
mode: GRACEFUL
new_leader_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:37922
I20260811 16:02:57.944954 13157 raft_consensus.cc:595] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 LEADER]: Received request to transfer leadership to TS 7b555939358643899e1397258987535d
I20260811 16:02:57.947533 13157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a19c81b4088e4261992248f3e719d391"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
mode: GRACEFUL
new_leader_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:37922
I20260811 16:02:57.948045 13157 raft_consensus.cc:595] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Received request to transfer leadership to TS 7b555939358643899e1397258987535d
I20260811 16:02:57.950464 13157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
mode: GRACEFUL
new_leader_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:37922
I20260811 16:02:57.950940 13157 raft_consensus.cc:595] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Received request to transfer leadership to TS c25f197541914fd183cfc830874850bc
I20260811 16:02:57.953244 13157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406"
dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
mode: GRACEFUL
new_leader_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:37922
I20260811 16:02:57.953836 13157 raft_consensus.cc:595] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Received request to transfer leadership to TS c25f197541914fd183cfc830874850bc
I20260811 16:02:57.954919 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260811 16:02:57.955433 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:02:58.224888 13558 raft_consensus.cc:979] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: : Instructing follower c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:58.225397 13543 raft_consensus.cc:1067] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Signalling peer c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:58.226850 13242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406"
dest_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:48120
I20260811 16:02:58.227385 13242 raft_consensus.cc:482] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:58.227697 13242 raft_consensus.cc:3037] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:58.233659 13242 raft_consensus.cc:504] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.236347 13242 leader_election.cc:288] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:58.237228 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:58.237490 13325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcc638510fcb467baf7e8a4d477a1406" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:58.237821 13157 raft_consensus.cc:3032] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:58.238162 13325 raft_consensus.cc:3037] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:58.238176 13157 raft_consensus.cc:729] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:58.239023 13157 consensus_queue.cc:260] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.240007 13157 raft_consensus.cc:3037] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:58.244416 13325 raft_consensus.cc:2454] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:58.244623 13157 raft_consensus.cc:2454] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:58.245949 13201 leader_election.cc:302] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:58.246853 13524 raft_consensus.cc:2781] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:58.247766 13524 raft_consensus.cc:686] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:58.248524 13524 consensus_queue.cc:237] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.256287 13040 catalog_manager.cc:5495] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 1 to 2, leader changed from d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193) to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 2 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:58.325855 13558 raft_consensus.cc:979] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: : Instructing follower 7b555939358643899e1397258987535d to start an election
I20260811 16:02:58.326297 13543 raft_consensus.cc:1067] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 LEADER]: Signalling peer 7b555939358643899e1397258987535d to start an election
I20260811 16:02:58.327702 13325 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf"
dest_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:52730
I20260811 16:02:58.328267 13325 raft_consensus.cc:482] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:58.328567 13325 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:02:58.333837 13325 raft_consensus.cc:504] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:58.336156 13325 leader_election.cc:288] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [CANDIDATE]: Term 5 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:58.337085 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:58.337204 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bdb501dd17430bbf0cf02be659eacf" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:58.337700 13157 raft_consensus.cc:3032] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:02:58.337822 13242 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:02:58.337986 13157 raft_consensus.cc:729] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:58.338757 13157 consensus_queue.cc:260] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:58.339727 13157 raft_consensus.cc:3037] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:02:58.342458 13242 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 5.
I20260811 16:02:58.343634 13285 leader_election.cc:302] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:58.344398 13525 raft_consensus.cc:2781] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:02:58.344367 13157 raft_consensus.cc:2454] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 5.
I20260811 16:02:58.345781 13525 raft_consensus.cc:686] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 5 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:58.346706 13525 consensus_queue.cc:237] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } }
I20260811 16:02:58.353919 13040 catalog_manager.cc:5495] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d reported cstate change: term changed from 4 to 5, leader changed from d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193) to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 5 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:58.367507 13558 raft_consensus.cc:979] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: : Instructing follower c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:58.368024 13543 raft_consensus.cc:1067] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Signalling peer c25f197541914fd183cfc830874850bc to start an election
I20260811 16:02:58.369573 13242 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350"
dest_uuid: "c25f197541914fd183cfc830874850bc"
 from {username='slave'} at 127.0.0.1:48120
I20260811 16:02:58.370046 13242 raft_consensus.cc:482] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:58.370283 13242 raft_consensus.cc:3037] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:58.374768 13558 raft_consensus.cc:979] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: : Instructing follower 7b555939358643899e1397258987535d to start an election
I20260811 16:02:58.375296 13558 raft_consensus.cc:1067] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Signalling peer 7b555939358643899e1397258987535d to start an election
I20260811 16:02:58.376255 13242 raft_consensus.cc:504] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.376847 13325 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a19c81b4088e4261992248f3e719d391"
dest_uuid: "7b555939358643899e1397258987535d"
 from {username='slave'} at 127.0.0.1:52730
I20260811 16:02:58.377404 13325 raft_consensus.cc:482] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:02:58.377768 13325 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:58.378393 13242 leader_election.cc:288] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), 7b555939358643899e1397258987535d (127.12.23.195:44149)
I20260811 16:02:58.379099 13157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:58.379099 13324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba132088b4994a7dae3e355cfc29e350" candidate_uuid: "c25f197541914fd183cfc830874850bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b555939358643899e1397258987535d"
I20260811 16:02:58.379819 13324 raft_consensus.cc:3037] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:58.379815 13157 raft_consensus.cc:3032] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:02:58.380337 13157 raft_consensus.cc:729] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:58.381143 13157 consensus_queue.cc:260] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.382449 13157 raft_consensus.cc:3037] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:02:58.383720 13325 raft_consensus.cc:504] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.385394 13325 leader_election.cc:288] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 3 election: Requested vote from peers d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793), c25f197541914fd183cfc830874850bc (127.12.23.194:32775)
I20260811 16:02:58.386616 13158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d489d42b74ee4099bc1c0a9a4a21881d"
I20260811 16:02:58.386427 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c81b4088e4261992248f3e719d391" candidate_uuid: "7b555939358643899e1397258987535d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c25f197541914fd183cfc830874850bc"
I20260811 16:02:58.387307 13158 raft_consensus.cc:3032] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:02:58.387269 13324 raft_consensus.cc:2454] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:58.387806 13242 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:58.387764 13158 raft_consensus.cc:729] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d489d42b74ee4099bc1c0a9a4a21881d, State: Running, Role: LEADER
I20260811 16:02:58.388525 13201 leader_election.cc:302] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:58.388828 13158 consensus_queue.cc:260] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.389469 13524 raft_consensus.cc:2781] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:02:58.389943 13524 raft_consensus.cc:686] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Becoming Leader. State: Replica: c25f197541914fd183cfc830874850bc, State: Running, Role: LEADER
I20260811 16:02:58.390242 13158 raft_consensus.cc:3037] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:02:58.390810 13524 consensus_queue.cc:237] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.393533 13242 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 3.
I20260811 16:02:58.394605 13285 leader_election.cc:302] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b555939358643899e1397258987535d, c25f197541914fd183cfc830874850bc; no voters: 
I20260811 16:02:58.395442 13525 raft_consensus.cc:2781] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:02:58.395882 13525 raft_consensus.cc:686] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 3 LEADER]: Becoming Leader. State: Replica: 7b555939358643899e1397258987535d, State: Running, Role: LEADER
I20260811 16:02:58.396708 13525 consensus_queue.cc:237] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } }
I20260811 16:02:58.397403 13157 raft_consensus.cc:2454] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25f197541914fd183cfc830874850bc in term 2.
I20260811 16:02:58.399271 13158 raft_consensus.cc:2454] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b555939358643899e1397258987535d in term 3.
I20260811 16:02:58.404040 13040 catalog_manager.cc:5495] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc reported cstate change: term changed from 1 to 2, leader changed from d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193) to c25f197541914fd183cfc830874850bc (127.12.23.194). New cstate: current_term: 2 leader_uuid: "c25f197541914fd183cfc830874850bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: UNKNOWN } } }
I20260811 16:02:58.406358 13041 catalog_manager.cc:5495] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d reported cstate change: term changed from 2 to 3, leader changed from d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193) to 7b555939358643899e1397258987535d (127.12.23.195). New cstate: current_term: 3 leader_uuid: "7b555939358643899e1397258987535d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 } health_report { overall_health: HEALTHY } } }
I20260811 16:02:58.655387 13158 raft_consensus.cc:1261] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:58.656627 13524 consensus_queue.cc:1035] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:58.671785 13324 raft_consensus.cc:1261] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:58.673614 13559 consensus_queue.cc:1035] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:02:58.791779 13158 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 5 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:02:58.793147 13525 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:02:58.796551 13324 raft_consensus.cc:1261] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:58.798090 13559 consensus_queue.cc:1035] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b555939358643899e1397258987535d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 44149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:58.800325 13158 raft_consensus.cc:1261] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:58.803907 13242 raft_consensus.cc:1261] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 5 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:02:58.804376 13577 consensus_queue.cc:1035] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:58.805269 13566 consensus_queue.cc:1035] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:02:58.821110 13244 raft_consensus.cc:1261] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Refusing update from remote peer 7b555939358643899e1397258987535d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:02:58.823370 13576 consensus_queue.cc:1035] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25f197541914fd183cfc830874850bc" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:02:58.831764 13158 raft_consensus.cc:1261] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Refusing update from remote peer c25f197541914fd183cfc830874850bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:02:58.833642 13524 consensus_queue.cc:1035] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d489d42b74ee4099bc1c0a9a4a21881d" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:02:58.956362 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:02:58.961866 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:02:58.962354 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:00.092156 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:00.097635 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:00.098148 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:03:00.284889 13183 debug-util.cc:398] Leaking SignalData structure 0x7b08001d28c0 after lost signal to thread 12388
W20260811 16:03:00.285754 13183 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2600 after lost signal to thread 13078
W20260811 16:03:00.286597 13183 debug-util.cc:398] Leaking SignalData structure 0x7b080012bde0 after lost signal to thread 13187
W20260811 16:03:00.287482 13183 debug-util.cc:398] Leaking SignalData structure 0x7b0800194d80 after lost signal to thread 13270
W20260811 16:03:00.288332 13183 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8c60 after lost signal to thread 13356
I20260811 16:03:01.099116 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:01.105401 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:01.105948 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:02.106982 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:02.113929 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:02.114424 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:03.115481 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:03.122323 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:03.122848 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:04.123756 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:04.129106 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:04.129609 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:05.130689 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:05.137918 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:05.138414 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:06.139626 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:06.145650 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:06.146158 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:07.147001 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:07.152855 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:03:07.153343 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:08.185465 12383 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260811 16:03:08.186040 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
I20260811 16:03:08.216807 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:03:08.217636 12383 tablet_replica.cc:330] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.218439 12383 raft_consensus.cc:2229] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.219084 12383 raft_consensus.cc:2258] T 87e5f45e71374c2aa902b34b1670ba95 P d489d42b74ee4099bc1c0a9a4a21881d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.222844 12383 tablet_replica.cc:330] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.223646 12383 raft_consensus.cc:2229] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.224709 12383 raft_consensus.cc:2258] T 075052c6d7344633b1f2f0fbf6396f0c P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.226862 12383 tablet_replica.cc:330] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.227541 12383 raft_consensus.cc:2229] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.228058 12383 raft_consensus.cc:2258] T a19c81b4088e4261992248f3e719d391 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.230242 12383 tablet_replica.cc:330] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.230895 12383 raft_consensus.cc:2229] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.232017 12383 raft_consensus.cc:2258] T c0238f8ae0914ec783617ab6546e5b03 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.234088 12383 tablet_replica.cc:330] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.234659 12383 raft_consensus.cc:2229] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.235236 12383 raft_consensus.cc:2258] T 3ff2448da3464456a9c340f87a086dfe P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.237728 12383 tablet_replica.cc:330] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.238297 12383 raft_consensus.cc:2229] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.239367 12383 raft_consensus.cc:2258] T 5c57dae40cd744caba94fa022161be37 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.241613 12383 tablet_replica.cc:330] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.242363 12383 raft_consensus.cc:2229] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.243064 12383 raft_consensus.cc:2258] T ba132088b4994a7dae3e355cfc29e350 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.245978 12383 tablet_replica.cc:330] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.246650 12383 raft_consensus.cc:2229] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.247648 12383 raft_consensus.cc:2258] T b72ef29484ad478ba56453068ac55128 P d489d42b74ee4099bc1c0a9a4a21881d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.250206 12383 tablet_replica.cc:330] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.250783 12383 raft_consensus.cc:2229] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.251334 12383 raft_consensus.cc:2258] T dcc638510fcb467baf7e8a4d477a1406 P d489d42b74ee4099bc1c0a9a4a21881d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.254086 12383 tablet_replica.cc:330] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d: stopping tablet replica
I20260811 16:03:08.254911 12383 raft_consensus.cc:2229] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.255841 12383 raft_consensus.cc:2258] T 36bdb501dd17430bbf0cf02be659eacf P d489d42b74ee4099bc1c0a9a4a21881d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.308406 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
I20260811 16:03:08.328678 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:03:08.345985 13285 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260811 16:03:08.354702 13202 consensus_peers.cc:487] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc -> Peer d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793): Couldn't send request to peer d489d42b74ee4099bc1c0a9a4a21881d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:43793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:03:08.355965 13285 consensus_peers.cc:487] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d -> Peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Couldn't send request to peer c25f197541914fd183cfc830874850bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:08.373200 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:03:08.374089 12383 tablet_replica.cc:330] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.375124 12383 raft_consensus.cc:2229] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.376477 12383 raft_consensus.cc:2258] T dcc638510fcb467baf7e8a4d477a1406 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.378399 12383 tablet_replica.cc:330] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.378976 12383 raft_consensus.cc:2229] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.379529 12383 raft_consensus.cc:2258] T 5c57dae40cd744caba94fa022161be37 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.381604 12383 tablet_replica.cc:330] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.382160 12383 raft_consensus.cc:2229] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.382649 12383 raft_consensus.cc:2258] T 87e5f45e71374c2aa902b34b1670ba95 P c25f197541914fd183cfc830874850bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.384447 12383 tablet_replica.cc:330] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.385005 12383 raft_consensus.cc:2229] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.385466 12383 raft_consensus.cc:2258] T b72ef29484ad478ba56453068ac55128 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.387424 12383 tablet_replica.cc:330] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.387948 12383 raft_consensus.cc:2229] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.388814 12383 raft_consensus.cc:2258] T ba132088b4994a7dae3e355cfc29e350 P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.390625 12383 tablet_replica.cc:330] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.391233 12383 raft_consensus.cc:2229] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.392056 12383 raft_consensus.cc:2258] T 3ff2448da3464456a9c340f87a086dfe P c25f197541914fd183cfc830874850bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.393951 12383 tablet_replica.cc:330] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.394491 12383 raft_consensus.cc:2229] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.394959 12383 raft_consensus.cc:2258] T c0238f8ae0914ec783617ab6546e5b03 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.396808 12383 tablet_replica.cc:330] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.397312 12383 raft_consensus.cc:2229] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.397787 12383 raft_consensus.cc:2258] T 36bdb501dd17430bbf0cf02be659eacf P c25f197541914fd183cfc830874850bc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.399716 12383 tablet_replica.cc:330] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.400216 12383 raft_consensus.cc:2229] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.400669 12383 raft_consensus.cc:2258] T 075052c6d7344633b1f2f0fbf6396f0c P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.402464 12383 tablet_replica.cc:330] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc: stopping tablet replica
I20260811 16:03:08.402961 12383 raft_consensus.cc:2229] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.403465 12383 raft_consensus.cc:2258] T a19c81b4088e4261992248f3e719d391 P c25f197541914fd183cfc830874850bc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260811 16:03:08.431572 13285 consensus_peers.cc:487] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d -> Peer c25f197541914fd183cfc830874850bc (127.12.23.194:32775): Couldn't send request to peer c25f197541914fd183cfc830874850bc. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:32775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:03:08.439406 13285 consensus_peers.cc:487] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d -> Peer d489d42b74ee4099bc1c0a9a4a21881d (127.12.23.193:43793): Couldn't send request to peer d489d42b74ee4099bc1c0a9a4a21881d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:43793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:08.451445 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
I20260811 16:03:08.473374 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
I20260811 16:03:08.507617 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:03:08.508302 12383 tablet_replica.cc:330] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.508912 12383 raft_consensus.cc:2229] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 5 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.509855 12383 raft_consensus.cc:2258] T 36bdb501dd17430bbf0cf02be659eacf P 7b555939358643899e1397258987535d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.511859 12383 tablet_replica.cc:330] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.512401 12383 raft_consensus.cc:2229] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.512872 12383 raft_consensus.cc:2258] T 3ff2448da3464456a9c340f87a086dfe P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.514583 12383 tablet_replica.cc:330] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.515129 12383 raft_consensus.cc:2229] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.515676 12383 raft_consensus.cc:2258] T c0238f8ae0914ec783617ab6546e5b03 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.517408 12383 tablet_replica.cc:330] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.517941 12383 raft_consensus.cc:2229] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.518814 12383 raft_consensus.cc:2258] T a19c81b4088e4261992248f3e719d391 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.520630 12383 tablet_replica.cc:330] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.521129 12383 raft_consensus.cc:2229] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.521605 12383 raft_consensus.cc:2258] T 075052c6d7344633b1f2f0fbf6396f0c P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.523453 12383 tablet_replica.cc:330] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.523988 12383 raft_consensus.cc:2229] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.524456 12383 raft_consensus.cc:2258] T 5c57dae40cd744caba94fa022161be37 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.526188 12383 tablet_replica.cc:330] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.526697 12383 raft_consensus.cc:2229] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.527225 12383 raft_consensus.cc:2258] T b72ef29484ad478ba56453068ac55128 P 7b555939358643899e1397258987535d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.528934 12383 tablet_replica.cc:330] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.529440 12383 raft_consensus.cc:2229] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.529861 12383 raft_consensus.cc:2258] T ba132088b4994a7dae3e355cfc29e350 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.531580 12383 tablet_replica.cc:330] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.532087 12383 raft_consensus.cc:2229] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.532934 12383 raft_consensus.cc:2258] T 87e5f45e71374c2aa902b34b1670ba95 P 7b555939358643899e1397258987535d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.534814 12383 tablet_replica.cc:330] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d: stopping tablet replica
I20260811 16:03:08.535331 12383 raft_consensus.cc:2229] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:08.535785 12383 raft_consensus.cc:2258] T dcc638510fcb467baf7e8a4d477a1406 P 7b555939358643899e1397258987535d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.567648 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:03:08.588369 12383 master.cc:537] Master@127.12.23.254:33065 shutting down...
I20260811 16:03:08.614495 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:03:08.615193 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:08.615566 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P 259ad82890b143a28279bcc9771401eb: stopping tablet replica
I20260811 16:03:08.636176 12383 master.cc:552] Master@127.12.23.254:33065 shutdown complete.
7b555939358643899e1397258987535d  1
c25f197541914fd183cfc830874850bc  4
d489d42b74ee4099bc1c0a9a4a21881d  5
7b555939358643899e1397258987535d  3
c25f197541914fd183cfc830874850bc  4
d489d42b74ee4099bc1c0a9a4a21881d  3
7b555939358643899e1397258987535d  1
c25f197541914fd183cfc830874850bc  1
d489d42b74ee4099bc1c0a9a4a21881d  8
7b555939358643899e1397258987535d  3
c25f197541914fd183cfc830874850bc  3
d489d42b74ee4099bc1c0a9a4a21881d  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29055 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260811 16:03:08.684055 12383 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.23.254:34613
I20260811 16:03:08.685223 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:03:08.691576 13603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:08.691757 13604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:08.692854 13606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:08.694231 12383 server_base.cc:1034] running on GCE node
I20260811 16:03:08.695393 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:03:08.695588 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:03:08.695700 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464188695690 us; error 0 us; skew 500 ppm
I20260811 16:03:08.696228 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:03:08.698875 12383 webserver.cc:460] Webserver started at http://127.12.23.254:35131/ using document root <none> and password file <none>
I20260811 16:03:08.699432 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:03:08.699600 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:03:08.699838 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:03:08.701088 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/master-0-root/instance:
uuid: "a33d4003601443f4b810ff8345d6e5a9"
format_stamp: "Formatted at 2026-08-11 16:03:08 on dist-test-slave-chsk"
I20260811 16:03:08.705986 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260811 16:03:08.709678 13611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:08.710526 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260811 16:03:08.710839 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/master-0-root
uuid: "a33d4003601443f4b810ff8345d6e5a9"
format_stamp: "Formatted at 2026-08-11 16:03:08 on dist-test-slave-chsk"
I20260811 16:03:08.711194 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:03:08.727388 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:03:08.728971 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:03:08.772059 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.254:34613
I20260811 16:03:08.772162 13668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.254:34613 every 8 connection(s)
I20260811 16:03:08.776348 13670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:08.787081 13670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Bootstrap starting.
I20260811 16:03:08.791771 13670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:08.796319 13670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: No bootstrap required, opened a new log
I20260811 16:03:08.798550 13670 raft_consensus.cc:348] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a33d4003601443f4b810ff8345d6e5a9" member_type: VOTER }
I20260811 16:03:08.799077 13670 raft_consensus.cc:374] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:08.799381 13670 raft_consensus.cc:729] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33d4003601443f4b810ff8345d6e5a9, State: Initialized, Role: FOLLOWER
I20260811 16:03:08.800010 13670 consensus_queue.cc:260] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a33d4003601443f4b810ff8345d6e5a9" member_type: VOTER }
I20260811 16:03:08.800482 13670 raft_consensus.cc:388] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:03:08.800670 13670 raft_consensus.cc:482] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:03:08.800895 13670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:08.805577 13670 raft_consensus.cc:504] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a33d4003601443f4b810ff8345d6e5a9" member_type: VOTER }
I20260811 16:03:08.806174 13670 leader_election.cc:302] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a33d4003601443f4b810ff8345d6e5a9; no voters: 
I20260811 16:03:08.807415 13670 leader_election.cc:288] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 16:03:08.807850 13673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:08.809384 13673 raft_consensus.cc:686] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 LEADER]: Becoming Leader. State: Replica: a33d4003601443f4b810ff8345d6e5a9, State: Running, Role: LEADER
I20260811 16:03:08.810132 13673 consensus_queue.cc:237] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a33d4003601443f4b810ff8345d6e5a9" member_type: VOTER }
I20260811 16:03:08.810722 13670 sys_catalog.cc:564] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:03:08.816015 13675 sys_catalog.cc:455] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a33d4003601443f4b810ff8345d6e5a9. Latest consensus state: current_term: 1 leader_uuid: "a33d4003601443f4b810ff8345d6e5a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a33d4003601443f4b810ff8345d6e5a9" member_type: VOTER } }
I20260811 16:03:08.815940 13674 sys_catalog.cc:455] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a33d4003601443f4b810ff8345d6e5a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a33d4003601443f4b810ff8345d6e5a9" member_type: VOTER } }
I20260811 16:03:08.816689 13675 sys_catalog.cc:458] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:03:08.816867 13674 sys_catalog.cc:458] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:03:08.821975 13683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:03:08.827358 13683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:03:08.829972 12383 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:03:08.837881 13683 catalog_manager.cc:1347] Generated new cluster ID: bd12aa0f5a4a410eb8d3071aa6a5487a
I20260811 16:03:08.838464 13683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:03:08.858029 13683 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:03:08.859802 13683 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:03:08.880096 13683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Generated new TSK 0
I20260811 16:03:08.880820 13683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:03:08.897213 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:03:08.903718 13695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:08.905117 13696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:08.913137 13698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:08.913159 12383 server_base.cc:1034] running on GCE node
I20260811 16:03:08.914609 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:03:08.914865 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:03:08.915043 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464188915027 us; error 0 us; skew 500 ppm
I20260811 16:03:08.915637 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:03:08.918270 12383 webserver.cc:460] Webserver started at http://127.12.23.193:34305/ using document root <none> and password file <none>
I20260811 16:03:08.918809 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:03:08.919026 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:03:08.919354 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:03:08.920517 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/instance:
uuid: "cec0688f86d54789b9b9ecc924ddecf3"
format_stamp: "Formatted at 2026-08-11 16:03:08 on dist-test-slave-chsk"
I20260811 16:03:08.925611 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260811 16:03:08.929167 13705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:08.930160 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260811 16:03:08.930481 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "cec0688f86d54789b9b9ecc924ddecf3"
format_stamp: "Formatted at 2026-08-11 16:03:08 on dist-test-slave-chsk"
I20260811 16:03:08.930752 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:03:08.941960 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:03:08.943310 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:03:08.944816 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:03:08.947273 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:03:08.947456 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:08.947752 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:03:08.947914 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:08.993466 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:40411
I20260811 16:03:08.993566 13771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:40411 every 8 connection(s)
I20260811 16:03:08.998660 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:03:09.005971 13776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:09.009848 13777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:09.013113 12383 server_base.cc:1034] running on GCE node
W20260811 16:03:09.013706 13780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:09.015499 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:03:09.015764 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:03:09.015985 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464189015966 us; error 0 us; skew 500 ppm
I20260811 16:03:09.016601 13772 heartbeater.cc:347] Connected to a master server at 127.12.23.254:34613
I20260811 16:03:09.016750 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:03:09.017060 13772 heartbeater.cc:464] Registering TS with master...
I20260811 16:03:09.018150 13772 heartbeater.cc:511] Master 127.12.23.254:34613 requested a full tablet report, sending...
I20260811 16:03:09.019886 12383 webserver.cc:460] Webserver started at http://127.12.23.194:44297/ using document root <none> and password file <none>
I20260811 16:03:09.020490 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:03:09.020697 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:03:09.020743 13630 ts_manager.cc:194] Registered new tserver with Master: cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:09.021046 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:03:09.022564 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/instance:
uuid: "5f46150fac70458986206ec7af67a403"
format_stamp: "Formatted at 2026-08-11 16:03:09 on dist-test-slave-chsk"
I20260811 16:03:09.023079 13630 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60716
I20260811 16:03:09.028390 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260811 16:03:09.032478 13786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:09.033488 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:03:09.033820 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root
uuid: "5f46150fac70458986206ec7af67a403"
format_stamp: "Formatted at 2026-08-11 16:03:09 on dist-test-slave-chsk"
I20260811 16:03:09.034091 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:03:09.060439 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:03:09.061764 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:03:09.063432 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:03:09.065850 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:03:09.066098 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:09.066370 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:03:09.066543 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:09.108845 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.194:42239
I20260811 16:03:09.108973 13856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.194:42239 every 8 connection(s)
I20260811 16:03:09.114347 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:03:09.122781 13860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:09.124423 13862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:09.127893 12383 server_base.cc:1034] running on GCE node
W20260811 16:03:09.129786 13864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:09.131228 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260811 16:03:09.131388 13857 heartbeater.cc:347] Connected to a master server at 127.12.23.254:34613
W20260811 16:03:09.131575 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:03:09.131784 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464189131767 us; error 0 us; skew 500 ppm
I20260811 16:03:09.131831 13857 heartbeater.cc:464] Registering TS with master...
I20260811 16:03:09.132601 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:03:09.132881 13857 heartbeater.cc:511] Master 127.12.23.254:34613 requested a full tablet report, sending...
I20260811 16:03:09.135569 13630 ts_manager.cc:194] Registered new tserver with Master: 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:09.135880 12383 webserver.cc:460] Webserver started at http://127.12.23.195:38067/ using document root <none> and password file <none>
I20260811 16:03:09.136521 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:03:09.136773 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:03:09.137106 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:03:09.137897 13630 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60732
I20260811 16:03:09.138752 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/instance:
uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
format_stamp: "Formatted at 2026-08-11 16:03:09 on dist-test-slave-chsk"
I20260811 16:03:09.144388 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260811 16:03:09.147948 13870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:09.148787 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260811 16:03:09.149062 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root
uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
format_stamp: "Formatted at 2026-08-11 16:03:09 on dist-test-slave-chsk"
I20260811 16:03:09.149340 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:03:09.170267 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:03:09.171600 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:03:09.173098 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:03:09.175554 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:03:09.175774 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:09.176035 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:03:09.176189 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:09.219079 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.195:42003
I20260811 16:03:09.219331 13941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.195:42003 every 8 connection(s)
I20260811 16:03:09.236413 13942 heartbeater.cc:347] Connected to a master server at 127.12.23.254:34613
I20260811 16:03:09.236871 13942 heartbeater.cc:464] Registering TS with master...
I20260811 16:03:09.237701 13942 heartbeater.cc:511] Master 127.12.23.254:34613 requested a full tablet report, sending...
I20260811 16:03:09.239938 13630 ts_manager.cc:194] Registered new tserver with Master: 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:09.240139 12383 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01756275s
I20260811 16:03:09.242561 13630 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60742
I20260811 16:03:09.243450 12383 test_util.cc:268] Using random seed: -1687724003
I20260811 16:03:09.270644 13630 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60758:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:03:09.277065 13630 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:03:09.483906 13899 tablet_service.cc:1467] Processing CreateTablet for tablet 5e699b23b5a94bf7b11086e6878e0207 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260811 16:03:09.485487 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e699b23b5a94bf7b11086e6878e0207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.489301 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 93cf6e0832154e35bedbcec9d96701f2 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260811 16:03:09.490906 13727 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa7e1db174a419e955a8806d40e8a14 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260811 16:03:09.492497 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa7e1db174a419e955a8806d40e8a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.492131 13897 tablet_service.cc:1467] Processing CreateTablet for tablet 6e71c22039484c80abd86e7fa5392e68 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260811 16:03:09.497579 13894 tablet_service.cc:1467] Processing CreateTablet for tablet c8baa39d90a34a09ab0f3b46ed69e00a (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260811 16:03:09.500412 13892 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa7e1db174a419e955a8806d40e8a14 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260811 16:03:09.502849 13891 tablet_service.cc:1467] Processing CreateTablet for tablet 00d7fc8e90884ea59b440daaba753fd7 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260811 16:03:09.505249 13889 tablet_service.cc:1467] Processing CreateTablet for tablet 97076df0f82e4818b7f7318f8deff8d8 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260811 16:03:09.508476 13732 tablet_service.cc:1467] Processing CreateTablet for tablet 6e71c22039484c80abd86e7fa5392e68 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260811 16:03:09.508628 13725 tablet_service.cc:1467] Processing CreateTablet for tablet 97076df0f82e4818b7f7318f8deff8d8 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260811 16:03:09.510154 13732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e71c22039484c80abd86e7fa5392e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.510618 13726 tablet_service.cc:1467] Processing CreateTablet for tablet 00d7fc8e90884ea59b440daaba753fd7 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260811 16:03:09.511343 13733 tablet_service.cc:1467] Processing CreateTablet for tablet 93cf6e0832154e35bedbcec9d96701f2 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260811 16:03:09.512709 13728 tablet_service.cc:1467] Processing CreateTablet for tablet 111ca2b9029e420191db21651d7c7015 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260811 16:03:09.513451 13726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d7fc8e90884ea59b440daaba753fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.516023 13816 tablet_service.cc:1467] Processing CreateTablet for tablet 5e699b23b5a94bf7b11086e6878e0207 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260811 16:03:09.517856 13816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e699b23b5a94bf7b11086e6878e0207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.518412 13810 tablet_service.cc:1467] Processing CreateTablet for tablet 111ca2b9029e420191db21651d7c7015 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260811 16:03:09.520388 13729 tablet_service.cc:1467] Processing CreateTablet for tablet c8baa39d90a34a09ab0f3b46ed69e00a (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260811 16:03:09.521849 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8baa39d90a34a09ab0f3b46ed69e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.521606 13808 tablet_service.cc:1467] Processing CreateTablet for tablet 00d7fc8e90884ea59b440daaba753fd7 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260811 16:03:09.523124 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d7fc8e90884ea59b440daaba753fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.524360 13730 tablet_service.cc:1467] Processing CreateTablet for tablet d7c952fbefaf4aa7b441b3d2c248f25c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260811 16:03:09.525784 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c952fbefaf4aa7b441b3d2c248f25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.525542 13811 tablet_service.cc:1467] Processing CreateTablet for tablet c8baa39d90a34a09ab0f3b46ed69e00a (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260811 16:03:09.526955 13811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8baa39d90a34a09ab0f3b46ed69e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.530339 13734 tablet_service.cc:1467] Processing CreateTablet for tablet 5e699b23b5a94bf7b11086e6878e0207 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260811 16:03:09.531292 13810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 111ca2b9029e420191db21651d7c7015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.521606 13814 tablet_service.cc:1467] Processing CreateTablet for tablet 6e71c22039484c80abd86e7fa5392e68 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260811 16:03:09.532428 13814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e71c22039484c80abd86e7fa5392e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.533295 13893 tablet_service.cc:1467] Processing CreateTablet for tablet 111ca2b9029e420191db21651d7c7015 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260811 16:03:09.524361 13812 tablet_service.cc:1467] Processing CreateTablet for tablet d7c952fbefaf4aa7b441b3d2c248f25c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260811 16:03:09.535709 13895 tablet_service.cc:1467] Processing CreateTablet for tablet d7c952fbefaf4aa7b441b3d2c248f25c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260811 16:03:09.536245 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c952fbefaf4aa7b441b3d2c248f25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.494568 13896 tablet_service.cc:1467] Processing CreateTablet for tablet 88888e6c2eb344e0b1468ef497832be3 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260811 16:03:09.528319 13731 tablet_service.cc:1467] Processing CreateTablet for tablet 88888e6c2eb344e0b1468ef497832be3 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260811 16:03:09.520421 13815 tablet_service.cc:1467] Processing CreateTablet for tablet 93cf6e0832154e35bedbcec9d96701f2 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260811 16:03:09.540644 13815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cf6e0832154e35bedbcec9d96701f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.522846 13813 tablet_service.cc:1467] Processing CreateTablet for tablet 88888e6c2eb344e0b1468ef497832be3 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260811 16:03:09.520424 13809 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa7e1db174a419e955a8806d40e8a14 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260811 16:03:09.528407 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 97076df0f82e4818b7f7318f8deff8d8 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260811 16:03:09.530143 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cf6e0832154e35bedbcec9d96701f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.545629 13813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88888e6c2eb344e0b1468ef497832be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.556694 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa7e1db174a419e955a8806d40e8a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.559741 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97076df0f82e4818b7f7318f8deff8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.565289 13808 tablet_service.cc:1467] Processing CreateTablet for tablet 47a99d649fa64ed18701c70592b7b534 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260811 16:03:09.566920 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47a99d649fa64ed18701c70592b7b534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.490906 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cf6e0832154e35bedbcec9d96701f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.572398 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97076df0f82e4818b7f7318f8deff8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.573585 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 111ca2b9029e420191db21651d7c7015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.574813 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e71c22039484c80abd86e7fa5392e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.576252 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c952fbefaf4aa7b441b3d2c248f25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.577479 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8baa39d90a34a09ab0f3b46ed69e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.578598 13892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa7e1db174a419e955a8806d40e8a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.580034 13891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d7fc8e90884ea59b440daaba753fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.581534 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88888e6c2eb344e0b1468ef497832be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.583294 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88888e6c2eb344e0b1468ef497832be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.584803 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97076df0f82e4818b7f7318f8deff8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.586078 13734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e699b23b5a94bf7b11086e6878e0207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.587057 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 111ca2b9029e420191db21651d7c7015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.636133 13960 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:09.679096 13727 tablet_service.cc:1467] Processing CreateTablet for tablet 47a99d649fa64ed18701c70592b7b534 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260811 16:03:09.680527 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47a99d649fa64ed18701c70592b7b534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.686378 13813 tablet_service.cc:1467] Processing CreateTablet for tablet 78a0d32ee74448a6931819ee7d5e0f59 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260811 16:03:09.687922 13813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a0d32ee74448a6931819ee7d5e0f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.691092 13959 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:09.676630 13960 tablet_bootstrap.cc:654] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:09.725476 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 7d60ab9da3d047ca897a698d07779c2e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260811 16:03:09.727020 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d60ab9da3d047ca897a698d07779c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.732455 13892 tablet_service.cc:1467] Processing CreateTablet for tablet 47a99d649fa64ed18701c70592b7b534 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260811 16:03:09.733314 13730 tablet_service.cc:1467] Processing CreateTablet for tablet 1185ca07eaca4954a71d11cfa2256fd3 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260811 16:03:09.734740 13959 tablet_bootstrap.cc:654] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:09.742213 13808 tablet_service.cc:1467] Processing CreateTablet for tablet e92ba91a1eb84cef82a03bb6ed271a72 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260811 16:03:09.742491 13816 tablet_service.cc:1467] Processing CreateTablet for tablet d9c0f5b985cc420c9dad45a78187a946 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260811 16:03:09.743894 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92ba91a1eb84cef82a03bb6ed271a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.745584 13814 tablet_service.cc:1467] Processing CreateTablet for tablet f6b1798b103e4d138b728902afcc2b9b (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260811 16:03:09.745764 13815 tablet_service.cc:1467] Processing CreateTablet for tablet 9315a4a479754517bd121148cf017615 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260811 16:03:09.747049 13814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b1798b103e4d138b728902afcc2b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.751750 13809 tablet_service.cc:1467] Processing CreateTablet for tablet 801054abfed346a09c04b7cd13d7c62f (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260811 16:03:09.765005 13816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c0f5b985cc420c9dad45a78187a946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.768379 13961 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:09.773865 13899 tablet_service.cc:1467] Processing CreateTablet for tablet 78a0d32ee74448a6931819ee7d5e0f59 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260811 16:03:09.777627 13726 tablet_service.cc:1467] Processing CreateTablet for tablet d9c0f5b985cc420c9dad45a78187a946 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260811 16:03:09.781840 13891 tablet_service.cc:1467] Processing CreateTablet for tablet 1185ca07eaca4954a71d11cfa2256fd3 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260811 16:03:09.783492 13815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9315a4a479754517bd121148cf017615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.783810 13726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c0f5b985cc420c9dad45a78187a946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.783763 13810 tablet_service.cc:1467] Processing CreateTablet for tablet 1185ca07eaca4954a71d11cfa2256fd3 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260811 16:03:09.785214 13810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1185ca07eaca4954a71d11cfa2256fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.750869 13811 tablet_service.cc:1467] Processing CreateTablet for tablet f42299184ed34c10bccc7de82e5dd1bd (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260811 16:03:09.789439 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1185ca07eaca4954a71d11cfa2256fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.790061 13729 tablet_service.cc:1467] Processing CreateTablet for tablet 78a0d32ee74448a6931819ee7d5e0f59 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260811 16:03:09.791465 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a0d32ee74448a6931819ee7d5e0f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.795441 13892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47a99d649fa64ed18701c70592b7b534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.801669 13961 tablet_bootstrap.cc:654] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:09.803573 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a0d32ee74448a6931819ee7d5e0f59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.804177 13728 tablet_service.cc:1467] Processing CreateTablet for tablet 7d60ab9da3d047ca897a698d07779c2e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260811 16:03:09.805480 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d60ab9da3d047ca897a698d07779c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.789474 13811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f42299184ed34c10bccc7de82e5dd1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.807529 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 801054abfed346a09c04b7cd13d7c62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.809293 13960 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:09.809793 13960 ts_tablet_manager.cc:1397] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.175s	user 0.006s	sys 0.009s
I20260811 16:03:09.816310 13733 tablet_service.cc:1467] Processing CreateTablet for tablet e92ba91a1eb84cef82a03bb6ed271a72 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260811 16:03:09.821662 13725 tablet_service.cc:1467] Processing CreateTablet for tablet f6b1798b103e4d138b728902afcc2b9b (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260811 16:03:09.823167 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b1798b103e4d138b728902afcc2b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.823808 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92ba91a1eb84cef82a03bb6ed271a72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:09.824591 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:09.826057 13896 tablet_service.cc:1467] Processing CreateTablet for tablet 7d60ab9da3d047ca897a698d07779c2e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260811 16:03:09.822777 13895 tablet_service.cc:1467] Processing CreateTablet for tablet d9c0f5b985cc420c9dad45a78187a946 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260811 16:03:09.832782 13815 tablet_service.cc:1467] Processing CreateTablet for tablet e7c98a1b986c4db5bd4c160284e54651 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260811 16:03:09.834188 13815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c98a1b986c4db5bd4c160284e54651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.798825 13812 tablet_service.cc:1467] Processing CreateTablet for tablet 20f7937a4cf04cef96095a62cb4ef661 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260811 16:03:09.844825 13891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1185ca07eaca4954a71d11cfa2256fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.848662 13889 tablet_service.cc:1467] Processing CreateTablet for tablet 801054abfed346a09c04b7cd13d7c62f (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260811 16:03:09.848732 13960 raft_consensus.cc:348] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:09.849913 13960 raft_consensus.cc:374] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:09.850363 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 801054abfed346a09c04b7cd13d7c62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.850294 13960 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:09.855248 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 9315a4a479754517bd121148cf017615 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260811 16:03:09.855909 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f7937a4cf04cef96095a62cb4ef661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.856995 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9315a4a479754517bd121148cf017615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.857782 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c0f5b985cc420c9dad45a78187a946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.863895 13959 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:09.864599 13959 ts_tablet_manager.cc:1397] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.174s	user 0.021s	sys 0.007s
I20260811 16:03:09.868122 13959 raft_consensus.cc:348] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:09.868947 13959 raft_consensus.cc:374] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:09.869329 13727 tablet_service.cc:1467] Processing CreateTablet for tablet f42299184ed34c10bccc7de82e5dd1bd (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260811 16:03:09.870708 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f42299184ed34c10bccc7de82e5dd1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.875732 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d60ab9da3d047ca897a698d07779c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.881618 13894 tablet_service.cc:1467] Processing CreateTablet for tablet f42299184ed34c10bccc7de82e5dd1bd (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260811 16:03:09.882993 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f42299184ed34c10bccc7de82e5dd1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.883271 13960 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:09.885172 13893 tablet_service.cc:1467] Processing CreateTablet for tablet e92ba91a1eb84cef82a03bb6ed271a72 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260811 16:03:09.886543 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92ba91a1eb84cef82a03bb6ed271a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.886098 13731 tablet_service.cc:1467] Processing CreateTablet for tablet 9315a4a479754517bd121148cf017615 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260811 16:03:09.888958 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9315a4a479754517bd121148cf017615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.838992 13897 tablet_service.cc:1467] Processing CreateTablet for tablet f6b1798b103e4d138b728902afcc2b9b (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260811 16:03:09.892824 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b1798b103e4d138b728902afcc2b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.885152 13961 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:09.900367 13961 ts_tablet_manager.cc:1397] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.019s
I20260811 16:03:09.900189 13734 tablet_service.cc:1467] Processing CreateTablet for tablet 801054abfed346a09c04b7cd13d7c62f (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260811 16:03:09.901684 13734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 801054abfed346a09c04b7cd13d7c62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.869374 13959 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:09.903386 13959 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:09.921119 13960 ts_tablet_manager.cc:1428] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.111s	user 0.010s	sys 0.004s
I20260811 16:03:09.929030 13813 tablet_service.cc:1467] Processing CreateTablet for tablet d00255c500904da78a120b3431f1e31d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260811 16:03:09.935526 13857 heartbeater.cc:503] Master 127.12.23.254:34613 was elected leader, sending a full tablet report...
I20260811 16:03:09.936662 13965 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:09.937343 13965 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:09.965056 13813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d00255c500904da78a120b3431f1e31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.981523 13814 tablet_service.cc:1467] Processing CreateTablet for tablet ade10bd0a2294e86b324757afe52d216 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260811 16:03:09.984386 13814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade10bd0a2294e86b324757afe52d216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:09.984949 13965 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:10.008931 13891 tablet_service.cc:1467] Processing CreateTablet for tablet 20f7937a4cf04cef96095a62cb4ef661 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260811 16:03:10.010389 13891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f7937a4cf04cef96095a62cb4ef661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.021652 13816 tablet_service.cc:1467] Processing CreateTablet for tablet 673bb1bb89d4450ba4dbcb918a9174e0 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260811 16:03:10.027009 13772 heartbeater.cc:503] Master 127.12.23.254:34613 was elected leader, sending a full tablet report...
I20260811 16:03:10.036530 13729 tablet_service.cc:1467] Processing CreateTablet for tablet e7c98a1b986c4db5bd4c160284e54651 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260811 16:03:10.038023 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c98a1b986c4db5bd4c160284e54651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.005460 13960 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:10.068602 13816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 673bb1bb89d4450ba4dbcb918a9174e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.091737 13968 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:10.092401 13968 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.091806 13732 tablet_service.cc:1467] Processing CreateTablet for tablet d00255c500904da78a120b3431f1e31d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260811 16:03:10.101217 13732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d00255c500904da78a120b3431f1e31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.103575 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 2c5b1c77a3014dd490b50a04ca62cd4c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260811 16:03:10.105122 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5b1c77a3014dd490b50a04ca62cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.108204 13892 tablet_service.cc:1467] Processing CreateTablet for tablet e7c98a1b986c4db5bd4c160284e54651 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260811 16:03:10.109704 13892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c98a1b986c4db5bd4c160284e54651. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:10.044488 13615 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43543.7us
I20260811 16:03:10.111308 13891 tablet_service.cc:1467] Processing CreateTablet for tablet d00255c500904da78a120b3431f1e31d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260811 16:03:10.116333 13725 tablet_service.cc:1467] Processing CreateTablet for tablet 20f7937a4cf04cef96095a62cb4ef661 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260811 16:03:10.118057 13728 tablet_service.cc:1467] Processing CreateTablet for tablet 673bb1bb89d4450ba4dbcb918a9174e0 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260811 16:03:10.139106 13891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d00255c500904da78a120b3431f1e31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.139954 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f7937a4cf04cef96095a62cb4ef661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.147743 13809 tablet_service.cc:1467] Processing CreateTablet for tablet 20ad41e4f434442792e36eb47449b101 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260811 16:03:10.149632 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ad41e4f434442792e36eb47449b101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.122752 13730 tablet_service.cc:1467] Processing CreateTablet for tablet 2c5b1c77a3014dd490b50a04ca62cd4c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260811 16:03:10.122377 13808 tablet_service.cc:1467] Processing CreateTablet for tablet 580037905a064c08b39df9f9843b5448 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260811 16:03:10.124406 13959 ts_tablet_manager.cc:1428] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.259s	user 0.032s	sys 0.020s
I20260811 16:03:10.128605 13960 tablet_bootstrap.cc:654] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:10.170816 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 580037905a064c08b39df9f9843b5448. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:10.171554 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52168us
I20260811 16:03:10.175727 13897 tablet_service.cc:1467] Processing CreateTablet for tablet 673bb1bb89d4450ba4dbcb918a9174e0 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260811 16:03:10.162647 13810 tablet_service.cc:1467] Processing CreateTablet for tablet 0556c3c022b74f43b43aa6f25d418e58 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260811 16:03:10.185189 13899 tablet_service.cc:1467] Processing CreateTablet for tablet 2c5b1c77a3014dd490b50a04ca62cd4c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260811 16:03:10.203267 13961 raft_consensus.cc:348] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.167691 13968 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:10.204242 13961 raft_consensus.cc:374] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:10.204547 13961 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:10.203997 13812 tablet_service.cc:1467] Processing CreateTablet for tablet 6c9671b71f644eaf969b8bb56e717beb (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260811 16:03:10.203893 13889 tablet_service.cc:1467] Processing CreateTablet for tablet 20ad41e4f434442792e36eb47449b101 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260811 16:03:10.187665 13894 tablet_service.cc:1467] Processing CreateTablet for tablet 580037905a064c08b39df9f9843b5448 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260811 16:03:10.187875 13810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0556c3c022b74f43b43aa6f25d418e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.189738 13896 tablet_service.cc:1467] Processing CreateTablet for tablet ade10bd0a2294e86b324757afe52d216 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260811 16:03:10.205477 13961 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.218032 13811 tablet_service.cc:1467] Processing CreateTablet for tablet 993fa0c090be4f83b6e0d60b3aa8dc78 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260811 16:03:10.220115 13733 tablet_service.cc:1467] Processing CreateTablet for tablet 580037905a064c08b39df9f9843b5448 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260811 16:03:10.227710 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 673bb1bb89d4450ba4dbcb918a9174e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.231566 13959 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:10.233052 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 673bb1bb89d4450ba4dbcb918a9174e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.233798 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 580037905a064c08b39df9f9843b5448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.239454 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ad41e4f434442792e36eb47449b101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.246023 13942 heartbeater.cc:503] Master 127.12.23.254:34613 was elected leader, sending a full tablet report...
I20260811 16:03:10.228440 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c9671b71f644eaf969b8bb56e717beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.240852 13895 tablet_service.cc:1467] Processing CreateTablet for tablet 6c9671b71f644eaf969b8bb56e717beb (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260811 16:03:10.240768 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 0556c3c022b74f43b43aa6f25d418e58 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260811 16:03:10.263541 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade10bd0a2294e86b324757afe52d216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.267485 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5b1c77a3014dd490b50a04ca62cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.268435 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c9671b71f644eaf969b8bb56e717beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.274987 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5b1c77a3014dd490b50a04ca62cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.276468 13727 tablet_service.cc:1467] Processing CreateTablet for tablet ade10bd0a2294e86b324757afe52d216 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260811 16:03:10.277827 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade10bd0a2294e86b324757afe52d216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.280550 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0556c3c022b74f43b43aa6f25d418e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.298040 13959 tablet_bootstrap.cc:654] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:10.299855 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 580037905a064c08b39df9f9843b5448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.303754 13811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 993fa0c090be4f83b6e0d60b3aa8dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.315361 13814 tablet_service.cc:1467] Processing CreateTablet for tablet 18e29247552943ad9bfa10e83e0dc5dd (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260811 16:03:10.323807 13807 tablet_service.cc:1467] Processing CreateTablet for tablet c3ac106c3df9431c9323c322b9f8118b (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260811 16:03:10.324484 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:10.326630 13787 leader_election.cc:341] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.326450 13815 tablet_service.cc:1467] Processing CreateTablet for tablet defa959376494546a5395f8a56cef106 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260811 16:03:10.327869 13815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defa959376494546a5395f8a56cef106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.330502 13731 tablet_service.cc:1467] Processing CreateTablet for tablet 0556c3c022b74f43b43aa6f25d418e58 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260811 16:03:10.332329 13809 tablet_service.cc:1467] Processing CreateTablet for tablet 962f3dc40b494dc48647abd894784e8d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260811 16:03:10.333879 13960 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:10.335891 13893 tablet_service.cc:1467] Processing CreateTablet for tablet 993fa0c090be4f83b6e0d60b3aa8dc78 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260811 16:03:10.336534 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:10.338763 13814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e29247552943ad9bfa10e83e0dc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.345341 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:10.351643 13894 tablet_service.cc:1467] Processing CreateTablet for tablet 962f3dc40b494dc48647abd894784e8d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260811 16:03:10.353559 13892 tablet_service.cc:1467] Processing CreateTablet for tablet 18e29247552943ad9bfa10e83e0dc5dd (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260811 16:03:10.307783 13728 tablet_service.cc:1467] Processing CreateTablet for tablet 20ad41e4f434442792e36eb47449b101 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260811 16:03:10.358680 13960 ts_tablet_manager.cc:1397] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.372s	user 0.011s	sys 0.013s
I20260811 16:03:10.359404 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 993fa0c090be4f83b6e0d60b3aa8dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.360364 13961 ts_tablet_manager.cc:1428] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.460s	user 0.009s	sys 0.003s
I20260811 16:03:10.367630 13891 tablet_service.cc:1467] Processing CreateTablet for tablet c3ac106c3df9431c9323c322b9f8118b (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260811 16:03:10.367936 13707 leader_election.cc:341] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.370945 13960 raft_consensus.cc:348] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.371935 13960 raft_consensus.cc:374] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:10.372244 13960 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:10.373023 13960 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.375641 13960 ts_tablet_manager.cc:1428] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260811 16:03:10.381296 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962f3dc40b494dc48647abd894784e8d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:10.381681 13789 leader_election.cc:341] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.381820 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:10.382146 13789 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:10.384709 13812 tablet_service.cc:1467] Processing CreateTablet for tablet ff741363b70845aeab13c5999c9843e4 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260811 16:03:10.386157 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff741363b70845aeab13c5999c9843e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:10.387743 13613 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 74491us
I20260811 16:03:10.391258 13966 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:10.394701 13981 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:10.395279 13981 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:10.362998 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52137us
I20260811 16:03:10.412264 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0556c3c022b74f43b43aa6f25d418e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.391402 13726 tablet_service.cc:1467] Processing CreateTablet for tablet 6c9671b71f644eaf969b8bb56e717beb (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260811 16:03:10.418103 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3ac106c3df9431c9323c322b9f8118b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.424736 13960 tablet_bootstrap.cc:492] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:10.470212 13727 tablet_service.cc:1467] Processing CreateTablet for tablet c3ac106c3df9431c9323c322b9f8118b (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260811 16:03:10.426734 13961 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
W20260811 16:03:10.428478 13709 leader_election.cc:341] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.404500 13981 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:10.432694 13813 tablet_service.cc:1467] Processing CreateTablet for tablet 20097351f7854d5487483d8e78420c49 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260811 16:03:10.433506 13811 tablet_service.cc:1467] Processing CreateTablet for tablet 41b38d6f6713439aad43a191eb42cd45 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260811 16:03:10.441493 13726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c9671b71f644eaf969b8bb56e717beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.443786 13729 tablet_service.cc:1467] Processing CreateTablet for tablet 993fa0c090be4f83b6e0d60b3aa8dc78 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260811 16:03:10.447002 13889 tablet_service.cc:1467] Processing CreateTablet for tablet defa959376494546a5395f8a56cef106 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260811 16:03:10.449959 13899 tablet_service.cc:1467] Processing CreateTablet for tablet ff741363b70845aeab13c5999c9843e4 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260811 16:03:10.426954 13891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3ac106c3df9431c9323c322b9f8118b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.454272 13734 tablet_service.cc:1467] Processing CreateTablet for tablet 962f3dc40b494dc48647abd894784e8d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260811 16:03:10.489420 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3ac106c3df9431c9323c322b9f8118b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.495616 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defa959376494546a5395f8a56cef106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.496304 13897 tablet_service.cc:1467] Processing CreateTablet for tablet 41b38d6f6713439aad43a191eb42cd45 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260811 16:03:10.497709 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b38d6f6713439aad43a191eb42cd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.500648 13892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e29247552943ad9bfa10e83e0dc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.501827 13734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962f3dc40b494dc48647abd894784e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.471429 13709 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:10.513758 13968 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:10.509307 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ad41e4f434442792e36eb47449b101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.515506 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 993fa0c090be4f83b6e0d60b3aa8dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.517465 13895 tablet_service.cc:1467] Processing CreateTablet for tablet b2c264c500bb4a599103d9117a31012d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260811 16:03:10.519470 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97834.3us
I20260811 16:03:10.509936 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962f3dc40b494dc48647abd894784e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.458990 13730 tablet_service.cc:1467] Processing CreateTablet for tablet 18e29247552943ad9bfa10e83e0dc5dd (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260811 16:03:10.523845 13733 tablet_service.cc:1467] Processing CreateTablet for tablet defa959376494546a5395f8a56cef106 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260811 16:03:10.525694 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defa959376494546a5395f8a56cef106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.536439 13813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20097351f7854d5487483d8e78420c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.539405 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e29247552943ad9bfa10e83e0dc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.543212 13816 tablet_service.cc:1467] Processing CreateTablet for tablet b2c264c500bb4a599103d9117a31012d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260811 16:03:10.547919 13816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c264c500bb4a599103d9117a31012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.549319 13811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b38d6f6713439aad43a191eb42cd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.558584 13808 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40882 (request call id 25) took 1001 ms. Trace:
I20260811 16:03:10.559072 13808 rpcz_store.cc:276] 0811 16:03:09.557143 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.121225 (+564082us) service_pool.cc:227] Handling call
0811 16:03:10.170299 (+ 49074us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.170415 (+   116us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.209663 (+ 39248us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.516429 (+306766us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.558513 (+ 42084us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.561719 13808 tablet_service.cc:1467] Processing CreateTablet for tablet 7b76fe83cb6c40d0af784af645b1e956 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260811 16:03:10.566145 13959 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:10.566690 13959 ts_tablet_manager.cc:1397] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.335s	user 0.010s	sys 0.021s
I20260811 16:03:10.566922 13810 tablet_service.cc:1467] Processing CreateTablet for tablet ffb6122695854eb8a6ab98b508c17b30 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260811 16:03:10.569710 13959 raft_consensus.cc:348] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.570544 13959 raft_consensus.cc:374] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:10.573909 13960 tablet_bootstrap.cc:654] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:10.575716 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 20097351f7854d5487483d8e78420c49 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260811 16:03:10.570858 13959 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:10.578087 13725 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 20) took 1059 ms. Trace:
I20260811 16:03:10.578939 13725 rpcz_store.cc:276] 0811 16:03:09.518334 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:09.959283 (+440949us) service_pool.cc:227] Handling call
0811 16:03:10.139322 (+180039us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.139452 (+   130us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.292915 (+153463us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.577430 (+284515us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.577996 (+   566us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.582023 13725 tablet_service.cc:1467] Processing CreateTablet for tablet ff741363b70845aeab13c5999c9843e4 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260811 16:03:10.587872 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff741363b70845aeab13c5999c9843e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.591562 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c264c500bb4a599103d9117a31012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.563086 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b76fe83cb6c40d0af784af645b1e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.597631 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff741363b70845aeab13c5999c9843e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.598446 13893 tablet_service.cc:1467] Processing CreateTablet for tablet 11dc75ffca384b91994ceec6d295e6e8 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260811 16:03:10.599532 13732 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 22) took 1072 ms. Trace:
I20260811 16:03:10.599941 13732 rpcz_store.cc:276] 0811 16:03:09.526728 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.057398 (+530670us) service_pool.cc:227] Handling call
0811 16:03:10.100526 (+ 43128us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.100692 (+   166us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.350369 (+249677us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.470986 (+120617us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.587615 (+116629us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:10.599468 (+ 11853us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2351872}
I20260811 16:03:10.602403 13732 tablet_service.cc:1467] Processing CreateTablet for tablet 20097351f7854d5487483d8e78420c49 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260811 16:03:10.607743 13810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb6122695854eb8a6ab98b508c17b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.561719 13815 tablet_service.cc:1467] Processing CreateTablet for tablet 210dcf7aee994bdaa1e75860a25bdd3a (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260811 16:03:10.610383 13815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210dcf7aee994bdaa1e75860a25bdd3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.611419 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20097351f7854d5487483d8e78420c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.551193 13812 tablet_service.cc:1467] Processing CreateTablet for tablet 11dc75ffca384b91994ceec6d295e6e8 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260811 16:03:10.616452 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11dc75ffca384b91994ceec6d295e6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.621040 13809 tablet_service.cc:1467] Processing CreateTablet for tablet 930faff3981346c88c8864a1f3b15158 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260811 16:03:10.622736 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930faff3981346c88c8864a1f3b15158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.627570 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11dc75ffca384b91994ceec6d295e6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.630810 13959 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.633195 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 17293f4853fe4715a4622208f2fbb5a7 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260811 16:03:10.642335 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:10.643708 13896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60510 (request call id 26) took 1087 ms. Trace:
W20260811 16:03:10.644156 13871 leader_election.cc:341] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.644591 13732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20097351f7854d5487483d8e78420c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.635051 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17293f4853fe4715a4622208f2fbb5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.650676 13731 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 28) took 1084 ms. Trace:
I20260811 16:03:10.651903 13731 rpcz_store.cc:276] 0811 16:03:09.566356 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.329575 (+763219us) service_pool.cc:227] Handling call
0811 16:03:10.365713 (+ 36138us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.378472 (+ 12759us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.465099 (+ 86627us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.596894 (+131795us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.650610 (+ 53716us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3281}
I20260811 16:03:10.654101 13731 tablet_service.cc:1467] Processing CreateTablet for tablet 41b38d6f6713439aad43a191eb42cd45 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260811 16:03:10.657531 13726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 29) took 1037 ms. Trace:
I20260811 16:03:10.657925 13726 rpcz_store.cc:276] 0811 16:03:09.620382 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.388083 (+767701us) service_pool.cc:227] Handling call
0811 16:03:10.439241 (+ 51158us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.440926 (+  1685us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.519270 (+ 78344us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.576307 (+ 57037us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.619724 (+ 43417us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:10.640210 (+ 20486us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9acf98 00007f5c4e9acebb 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:10.657440 (+ 17230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":71042560}
I20260811 16:03:10.644295 13896 rpcz_store.cc:276] 0811 16:03:09.556031 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.188841 (+632810us) service_pool.cc:227] Handling call
0811 16:03:10.221993 (+ 33152us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.222128 (+   135us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.461963 (+239835us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.606715 (+144752us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.643618 (+ 36903us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.693421 13896 tablet_service.cc:1467] Processing CreateTablet for tablet 17293f4853fe4715a4622208f2fbb5a7 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260811 16:03:10.694947 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17293f4853fe4715a4622208f2fbb5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.674780 13811 tablet_service.cc:1467] Processing CreateTablet for tablet 7f329d644e014d3fad21c11a415e907c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260811 16:03:10.716033 13811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f329d644e014d3fad21c11a415e907c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.717521 13889 tablet_service.cc:1467] Processing CreateTablet for tablet af4dc0ff3ced489a86fe70cfbac98798 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260811 16:03:10.683434 13892 tablet_service.cc:1467] Processing CreateTablet for tablet 7b76fe83cb6c40d0af784af645b1e956 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260811 16:03:10.685489 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:10.686331 13891 tablet_service.cc:1467] Processing CreateTablet for tablet ffb6122695854eb8a6ab98b508c17b30 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260811 16:03:10.687647 13959 ts_tablet_manager.cc:1428] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.003s
I20260811 16:03:10.730676 13959 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:10.695732 13968 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:10.731254 13968 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.733283 13968 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:10.695438 13894 tablet_service.cc:1467] Processing CreateTablet for tablet 7f329d644e014d3fad21c11a415e907c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260811 16:03:10.696601 13808 tablet_service.cc:1467] Processing CreateTablet for tablet c390fd23cec5435d81b38a50b2988a60 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260811 16:03:10.736867 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c390fd23cec5435d81b38a50b2988a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.668601 13816 tablet_service.cc:1467] Processing CreateTablet for tablet af4dc0ff3ced489a86fe70cfbac98798 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260811 16:03:10.740641 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:10.741073 13816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af4dc0ff3ced489a86fe70cfbac98798. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:10.742143 13707 leader_election.cc:341] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:10.745708 13874 leader_election.cc:341] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.746203 13874 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:10.744875 13898 tablet_service.cc:1467] Processing CreateTablet for tablet c390fd23cec5435d81b38a50b2988a60 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260811 16:03:10.701824 13728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 27) took 1143 ms. Trace:
I20260811 16:03:10.748575 13983 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:10.748804 13728 rpcz_store.cc:276] 0811 16:03:09.558828 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.303585 (+744757us) service_pool.cc:227] Handling call
0811 16:03:10.389267 (+ 85682us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.405060 (+ 15793us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.586471 (+181411us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.663512 (+ 77041us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.701759 (+ 38247us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.700704 13812 tablet_service.cc:1467] Processing CreateTablet for tablet a48002159c1643c489d152b863d3d839 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260811 16:03:10.702603 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b38d6f6713439aad43a191eb42cd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.750599 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48002159c1643c489d152b863d3d839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.701985 13734 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 31) took 1061 ms. Trace:
W20260811 16:03:10.751509 13773 tablet.cc:2369] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:03:10.751379 13734 rpcz_store.cc:276] 0811 16:03:09.640493 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.452825 (+812332us) service_pool.cc:227] Handling call
0811 16:03:10.501192 (+ 48367us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.501325 (+   133us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.653207 (+151882us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.667381 (+ 14174us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.701921 (+ 34540us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.753069 13811 tablet_service.cc:1467] Processing CreateTablet for tablet 94d079a9604d4ed3832dbb48ba12cd16 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260811 16:03:10.753322 13734 tablet_service.cc:1467] Processing CreateTablet for tablet ffb6122695854eb8a6ab98b508c17b30 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260811 16:03:10.754633 13734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb6122695854eb8a6ab98b508c17b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.703926 13814 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5f6467bf4b427f873ea8d2990f2945 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260811 16:03:10.705504 13733 tablet_service.cc:1467] Processing CreateTablet for tablet b2c264c500bb4a599103d9117a31012d (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260811 16:03:10.707165 13727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 33) took 1004 ms. Trace:
I20260811 16:03:10.755918 13727 rpcz_store.cc:276] 0811 16:03:09.703036 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.469261 (+766225us) service_pool.cc:227] Handling call
0811 16:03:10.472355 (+  3094us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.482786 (+ 10431us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.626396 (+143610us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.677231 (+ 50835us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.707076 (+ 29845us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.750772 13728 tablet_service.cc:1467] Processing CreateTablet for tablet 7b76fe83cb6c40d0af784af645b1e956 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260811 16:03:10.707988 13729 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 30) took 1070 ms. Trace:
I20260811 16:03:10.710103 13815 tablet_service.cc:1467] Processing CreateTablet for tablet 98ab517b34b7491eabb89d31d262a45e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260811 16:03:10.714375 13960 tablet_bootstrap.cc:492] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:10.679373 13897 tablet_service.cc:1467] Processing CreateTablet for tablet 210dcf7aee994bdaa1e75860a25bdd3a (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260811 16:03:10.758190 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b76fe83cb6c40d0af784af645b1e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.758031 13727 tablet_service.cc:1467] Processing CreateTablet for tablet 17293f4853fe4715a4622208f2fbb5a7 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260811 16:03:10.760478 13729 rpcz_store.cc:276] 0811 16:03:09.637965 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.442527 (+804562us) service_pool.cc:227] Handling call
0811 16:03:10.486228 (+ 43701us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.502825 (+ 16597us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.560666 (+ 57841us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.707481 (+146815us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.707931 (+   450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.761019 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17293f4853fe4715a4622208f2fbb5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.762424 13729 tablet_service.cc:1467] Processing CreateTablet for tablet af4dc0ff3ced489a86fe70cfbac98798 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260811 16:03:10.763538 13960 ts_tablet_manager.cc:1397] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.346s	user 0.012s	sys 0.005s
I20260811 16:03:10.763851 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c264c500bb4a599103d9117a31012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.720427 13726 tablet_service.cc:1467] Processing CreateTablet for tablet 11dc75ffca384b91994ceec6d295e6e8 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260811 16:03:10.766749 13960 raft_consensus.cc:348] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.767863 13960 raft_consensus.cc:374] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:10.768163 13960 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:10.768936 13960 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.721007 13725 tablet_service.cc:1467] Processing CreateTablet for tablet 210dcf7aee994bdaa1e75860a25bdd3a (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260811 16:03:10.779484 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af4dc0ff3ced489a86fe70cfbac98798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.784896 13726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11dc75ffca384b91994ceec6d295e6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.788578 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210dcf7aee994bdaa1e75860a25bdd3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.789574 13807 tablet_service.cc:1467] Processing CreateTablet for tablet a97fbe9fd7534b9e93a8abec637a8c1e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260811 16:03:10.726365 13813 tablet_service.cc:1467] Processing CreateTablet for tablet 02554b9e1cd54e1dbcfb941296b23093 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260811 16:03:10.727960 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af4dc0ff3ced489a86fe70cfbac98798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.747946 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:10.705888 13961 tablet_bootstrap.cc:654] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:10.792990 13709 leader_election.cc:341] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.793474 13709 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:10.794763 13968 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:10.795626 13892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b76fe83cb6c40d0af784af645b1e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.796236 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f329d644e014d3fad21c11a415e907c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.797279 13960 ts_tablet_manager.cc:1428] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260811 16:03:10.797876 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210dcf7aee994bdaa1e75860a25bdd3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.754657 13811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d079a9604d4ed3832dbb48ba12cd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.804250 13895 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5f6467bf4b427f873ea8d2990f2945 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260811 16:03:10.805192 13891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb6122695854eb8a6ab98b508c17b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.805994 13959 tablet_bootstrap.cc:654] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:10.805207 13814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5f6467bf4b427f873ea8d2990f2945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.812431 13815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98ab517b34b7491eabb89d31d262a45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.815600 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c390fd23cec5435d81b38a50b2988a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.816067 13960 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:10.817162 13813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02554b9e1cd54e1dbcfb941296b23093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.823210 13730 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 32) took 1122 ms. Trace:
I20260811 16:03:10.823832 13730 rpcz_store.cc:276] 0811 16:03:09.700883 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.458047 (+757164us) service_pool.cc:227] Handling call
0811 16:03:10.536410 (+ 78363us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.536506 (+    96us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.615991 (+ 79485us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.714984 (+ 98993us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.823087 (+108103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.830881 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97fbe9fd7534b9e93a8abec637a8c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.844877 13899 tablet_service.cc:1467] Processing CreateTablet for tablet 98ab517b34b7491eabb89d31d262a45e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260811 16:03:10.847262 13961 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:10.847498 13966 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:10.887130 13966 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:10.889330 13966 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:10.889868 13966 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:10.890295 13966 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:10.865331 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:10.893853 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:10.895881 13789 leader_election.cc:341] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.897300 13961 ts_tablet_manager.cc:1397] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.481s	user 0.014s	sys 0.011s
I20260811 16:03:10.900832 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:10.907900 13960 tablet_bootstrap.cc:654] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:10.870457 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5f6467bf4b427f873ea8d2990f2945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.876477 13730 tablet_service.cc:1467] Processing CreateTablet for tablet 7f329d644e014d3fad21c11a415e907c (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260811 16:03:10.868003 13810 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6a000330b3415da4f525eae84f33fb (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260811 16:03:10.923213 13810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6a000330b3415da4f525eae84f33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.937366 13809 tablet_service.cc:1467] Processing CreateTablet for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260811 16:03:10.919305 13893 tablet_service.cc:1467] Processing CreateTablet for tablet a48002159c1643c489d152b863d3d839 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260811 16:03:10.941419 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48002159c1643c489d152b863d3d839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.943228 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98ab517b34b7491eabb89d31d262a45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.957406 13966 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:10.958700 13808 tablet_service.cc:1467] Processing CreateTablet for tablet bc7ec7085e27482fa91e60b9993522de (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260811 16:03:10.957456 13728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 41) took 1060 ms. Trace:
I20260811 16:03:10.959589 13728 rpcz_store.cc:276] 0811 16:03:09.896740 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.749853 (+853113us) service_pool.cc:227] Handling call
0811 16:03:10.757713 (+  7860us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.757807 (+    94us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.805920 (+ 48113us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.875049 (+ 69129us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.957380 (+ 82331us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:10.960378 13959 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:10.960933 13959 ts_tablet_manager.cc:1397] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.230s	user 0.002s	sys 0.013s
I20260811 16:03:10.960666 13812 tablet_service.cc:1467] Processing CreateTablet for tablet 85bed8270f474c2e80653bbdc5806659 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260811 16:03:10.963027 13789 leader_election.cc:341] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.966708 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:10.965592 13734 tablet_service.cc:1467] Processing CreateTablet for tablet c390fd23cec5435d81b38a50b2988a60 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260811 16:03:10.968535 13787 leader_election.cc:341] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:10.969161 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:10.972389 13731 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 37) took 1152 ms. Trace:
I20260811 16:03:10.972330 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:10.972978 13731 rpcz_store.cc:276] 0811 16:03:09.820058 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.653071 (+833013us) service_pool.cc:227] Handling call
0811 16:03:10.662494 (+  9423us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.702213 (+ 39719us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.812008 (+109795us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.960443 (+148435us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.971936 (+ 11493us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:10.972326 (+   390us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50309,"spinlock_wait_cycles":23761664}
I20260811 16:03:10.975610 13734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c390fd23cec5435d81b38a50b2988a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:10.978158 13733 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 38) took 1144 ms. Trace:
I20260811 16:03:10.978618 13731 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5f6467bf4b427f873ea8d2990f2945 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260811 16:03:10.978567 13733 rpcz_store.cc:276] 0811 16:03:09.833797 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.704572 (+870775us) service_pool.cc:227] Handling call
0811 16:03:10.755536 (+ 50964us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.755638 (+   102us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.813917 (+ 58279us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.874904 (+ 60987us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.977777 (+102873us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:10.978097 (+   320us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24838912}
I20260811 16:03:10.970220 13728 tablet_service.cc:1467] Processing CreateTablet for tablet a48002159c1643c489d152b863d3d839 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260811 16:03:10.974594 13732 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 36) took 1216 ms. Trace:
I20260811 16:03:10.998740 13732 rpcz_store.cc:276] 0811 16:03:09.757806 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.601335 (+843529us) service_pool.cc:227] Handling call
0811 16:03:10.643781 (+ 42446us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.643904 (+   123us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.674716 (+ 30812us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:10.959730 (+285014us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:10.974226 (+ 14496us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:10.974533 (+   307us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":31608576}
I20260811 16:03:11.006268 13732 tablet_service.cc:1467] Processing CreateTablet for tablet 98ab517b34b7491eabb89d31d262a45e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260811 16:03:11.006284 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5f6467bf4b427f873ea8d2990f2945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.013751 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f329d644e014d3fad21c11a415e907c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.016132 13733 tablet_service.cc:1467] Processing CreateTablet for tablet 930faff3981346c88c8864a1f3b15158 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260811 16:03:11.017115 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48002159c1643c489d152b863d3d839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.018589 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.020967 13812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bed8270f474c2e80653bbdc5806659. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:11.023353 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54884.7us
W20260811 16:03:11.024217 13787 leader_election.cc:341] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.024679 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:11.025812 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7ec7085e27482fa91e60b9993522de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.025893 13966 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.026652 13966 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.024242 13816 tablet_service.cc:1467] Processing CreateTablet for tablet 583cc1a296dd4344b3aaf399b8d5b17f (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260811 16:03:11.028610 13816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 583cc1a296dd4344b3aaf399b8d5b17f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:11.032697 13615 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75248.2us
I20260811 16:03:11.052039 13726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 39) took 1211 ms. Trace:
I20260811 16:03:11.053936 13727 tablet_service.cc:1467] Processing CreateTablet for tablet 02554b9e1cd54e1dbcfb941296b23093 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260811 16:03:11.034490 13961 raft_consensus.cc:348] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.062479 13961 raft_consensus.cc:374] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.054127 13726 rpcz_store.cc:276] 0811 16:03:09.840131 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.719309 (+879178us) service_pool.cc:227] Handling call
0811 16:03:10.784139 (+ 64830us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c568bad21 00007f5c568981e3 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2 00007f5c4fe4bb01
0811 16:03:10.784270 (+   131us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.784391 (+   121us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.914681 (+130290us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.046311 (+131630us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.050686 (+  4375us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:03:11.051736 (+  1050us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":43197056}
I20260811 16:03:11.060706 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930faff3981346c88c8864a1f3b15158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.071969 13732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98ab517b34b7491eabb89d31d262a45e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:03:11.064961 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 103968us
I20260811 16:03:11.028754 13959 raft_consensus.cc:348] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.078588 13959 raft_consensus.cc:374] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.079006 13959 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.082754 13959 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.077673 13961 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.080514 13726 tablet_service.cc:1467] Processing CreateTablet for tablet 94d079a9604d4ed3832dbb48ba12cd16 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260811 16:03:11.088274 13729 tablet_service.cc:1467] Processing CreateTablet for tablet a97fbe9fd7534b9e93a8abec637a8c1e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260811 16:03:11.088305 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 930faff3981346c88c8864a1f3b15158 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260811 16:03:11.090752 13725 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 40) took 1215 ms. Trace:
I20260811 16:03:11.075212 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02554b9e1cd54e1dbcfb941296b23093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.099793 13961 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.100513 13959 ts_tablet_manager.cc:1428] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.008s
I20260811 16:03:11.102227 13961 ts_tablet_manager.cc:1428] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.205s	user 0.006s	sys 0.007s
I20260811 16:03:11.103179 13896 tablet_service.cc:1467] Processing CreateTablet for tablet 94d079a9604d4ed3832dbb48ba12cd16 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260811 16:03:11.111454 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930faff3981346c88c8864a1f3b15158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.097980 13725 rpcz_store.cc:276] 0811 16:03:09.875535 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.719952 (+844417us) service_pool.cc:227] Handling call
0811 16:03:10.787851 (+ 67899us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c568bad21 00007f5c568981e3 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2 00007f5c4fe4bb01
0811 16:03:10.788013 (+   162us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.788140 (+   127us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.920979 (+132839us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.090188 (+169209us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.090688 (+   500us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19732224}
I20260811 16:03:11.114581 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d079a9604d4ed3832dbb48ba12cd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.117508 13968 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.117923 13899 tablet_service.cc:1467] Processing CreateTablet for tablet a97fbe9fd7534b9e93a8abec637a8c1e (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260811 16:03:11.118038 13968 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.119562 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97fbe9fd7534b9e93a8abec637a8c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.122118 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:11.124377 13709 leader_election.cc:341] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.124691 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:11.126119 13707 leader_election.cc:341] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.126572 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:11.128986 13726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d079a9604d4ed3832dbb48ba12cd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.131498 13729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97fbe9fd7534b9e93a8abec637a8c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.132905 13725 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6a000330b3415da4f525eae84f33fb (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260811 16:03:11.138727 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6a000330b3415da4f525eae84f33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.136776 13968 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.141706 13968 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.143850 13961 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.147909 13897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60510 (request call id 40) took 1253 ms. Trace:
I20260811 16:03:11.139046 13899 tablet_service.cc:1467] Processing CreateTablet for tablet bc7ec7085e27482fa91e60b9993522de (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260811 16:03:11.144785 13892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60510 (request call id 41) took 1224 ms. Trace:
I20260811 16:03:11.149677 13892 rpcz_store.cc:276] 0811 16:03:09.920865 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.682461 (+761596us) service_pool.cc:227] Handling call
0811 16:03:10.727804 (+ 45343us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.727902 (+    98us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.931522 (+203620us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.138894 (+207372us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.144722 (+  5828us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:11.150300 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7ec7085e27482fa91e60b9993522de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.148326 13897 rpcz_store.cc:276] 0811 16:03:09.894530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.656112 (+761582us) service_pool.cc:227] Handling call
0811 16:03:10.759650 (+103538us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.759744 (+    94us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.931970 (+172226us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.147189 (+215219us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.147848 (+   659us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:11.152426 13960 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.152944 13960 ts_tablet_manager.cc:1397] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.005s
I20260811 16:03:11.153172 13897 tablet_service.cc:1467] Processing CreateTablet for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260811 16:03:11.153781 13892 tablet_service.cc:1467] Processing CreateTablet for tablet 85bed8270f474c2e80653bbdc5806659 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260811 16:03:11.145016 13959 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.136049 13895 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6a000330b3415da4f525eae84f33fb (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260811 16:03:11.154757 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.156147 13960 raft_consensus.cc:348] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.169076 13960 raft_consensus.cc:374] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.169446 13960 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.170195 13960 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.173501 13894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60510 (request call id 45) took 1009 ms. Trace:
I20260811 16:03:11.173939 13894 rpcz_store.cc:276] 0811 16:03:10.163657 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.694300 (+530643us) service_pool.cc:227] Handling call
0811 16:03:10.739511 (+ 45211us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.739626 (+   115us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.947443 (+207817us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.172941 (+225498us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.173432 (+   491us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:11.158272 13889 tablet_service.cc:1467] Processing CreateTablet for tablet 02554b9e1cd54e1dbcfb941296b23093 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260811 16:03:11.181661 13960 ts_tablet_manager.cc:1428] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260811 16:03:11.183665 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02554b9e1cd54e1dbcfb941296b23093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.179584 13961 tablet_bootstrap.cc:654] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:11.184862 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58784.1us
I20260811 16:03:11.192565 13891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60510 (request call id 42) took 1216 ms. Trace:
I20260811 16:03:11.193279 13892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bed8270f474c2e80653bbdc5806659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.192582 13725 tablet_service.cc:1467] Processing CreateTablet for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260811 16:03:11.194496 13725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.193043 13891 rpcz_store.cc:276] 0811 16:03:09.976088 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.685523 (+709435us) service_pool.cc:227] Handling call
0811 16:03:10.728991 (+ 43468us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.729100 (+   109us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:10.923411 (+194311us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.192050 (+268639us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.192500 (+   450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:11.200989 13894 tablet_service.cc:1467] Processing CreateTablet for tablet 583cc1a296dd4344b3aaf399b8d5b17f (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260811 16:03:11.202806 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 583cc1a296dd4344b3aaf399b8d5b17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.205458 13960 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.225600 13730 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 45) took 1009 ms. Trace:
I20260811 16:03:11.226089 13730 rpcz_store.cc:276] 0811 16:03:10.215891 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.875415 (+659524us) service_pool.cc:227] Handling call
0811 16:03:11.006942 (+131527us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c568bad21 00007f5c568981e3 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2 00007f5c4fe4bb01
0811 16:03:11.013054 (+  6112us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:11.013208 (+   154us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:11.095765 (+ 82557us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.224913 (+129148us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.225526 (+   613us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":104452992}
I20260811 16:03:11.227952 13733 tablet_service.cc:1467] Processing CreateTablet for tablet bc7ec7085e27482fa91e60b9993522de (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260811 16:03:11.229388 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7ec7085e27482fa91e60b9993522de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.188236 13893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60510 (request call id 47) took 1022 ms. Trace:
I20260811 16:03:11.235476 13893 rpcz_store.cc:276] 0811 16:03:10.164322 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:10.750233 (+585911us) service_pool.cc:227] Handling call
0811 16:03:10.940611 (+190378us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:10.940761 (+   150us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:11.146049 (+205288us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.173838 (+ 27789us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.186938 (+ 13100us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:11.238277 13728 tablet_service.cc:1467] Processing CreateTablet for tablet 583cc1a296dd4344b3aaf399b8d5b17f (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260811 16:03:11.239677 13728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 583cc1a296dd4344b3aaf399b8d5b17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.244896 13730 tablet_service.cc:1467] Processing CreateTablet for tablet 85bed8270f474c2e80653bbdc5806659 (DEFAULT_TABLE table=test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260811 16:03:11.246109 13960 tablet_bootstrap.cc:654] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.246888 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bed8270f474c2e80653bbdc5806659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.254460 13959 tablet_bootstrap.cc:654] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.259722 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6a000330b3415da4f525eae84f33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:11.269266 13961 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.269843 13961 ts_tablet_manager.cc:1397] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.126s	user 0.006s	sys 0.006s
I20260811 16:03:11.273213 13988 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.273748 13988 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.276057 13988 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.277894 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.279968 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:11.280241 13789 leader_election.cc:341] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:11.281569 13787 leader_election.cc:341] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.281986 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:11.282394 13961 raft_consensus.cc:348] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.283130 13961 raft_consensus.cc:374] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.283319 13988 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.283485 13961 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.296707 13960 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.297273 13960 ts_tablet_manager.cc:1397] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.028s
I20260811 16:03:11.301402 13961 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.305747 13961 ts_tablet_manager.cc:1428] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260811 16:03:11.305946 13983 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.306820 13961 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.306468 13983 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.308162 13726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37762 (request call id 52) took 1019 ms. Trace:
I20260811 16:03:11.308568 13726 rpcz_store.cc:276] 0811 16:03:10.288675 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:11.079543 (+790868us) service_pool.cc:227] Handling call
0811 16:03:11.098497 (+ 18954us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:03:11.122231 (+ 23734us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:03:11.299494 (+177263us) tablet_metadata.cc:641] Metadata flushed
0811 16:03:11.307634 (+  8140us) tablet_replica.cc:205] Creating consensus instance
0811 16:03:11.308101 (+   467us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:03:11.310485 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:11.311947 13874 leader_election.cc:341] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.312739 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.313237 13744 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:11.314249 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:11.314792 13961 tablet_bootstrap.cc:654] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.314844 13983 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:11.315883 13983 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.316432 13983 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.316944 13983 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.322180 13959 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.322800 13959 ts_tablet_manager.cc:1397] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.000s
I20260811 16:03:11.328838 13959 raft_consensus.cc:348] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.329222 13960 raft_consensus.cc:348] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.329715 13959 raft_consensus.cc:374] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.329934 13960 raft_consensus.cc:374] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.330039 13959 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.330307 13960 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.330659 13983 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.330957 13959 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.332386 13960 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.333808 13959 ts_tablet_manager.cc:1428] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260811 16:03:11.334980 13960 ts_tablet_manager.cc:1428] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260811 16:03:11.335237 13959 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.335271 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:11.335736 13983 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:03:11.337095 13874 leader_election.cc:341] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.337644 13960 tablet_bootstrap.cc:492] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.340963 13961 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.341629 13961 ts_tablet_manager.cc:1397] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260811 16:03:11.342648 13959 tablet_bootstrap.cc:654] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.344518 13960 tablet_bootstrap.cc:654] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.344939 13961 raft_consensus.cc:348] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.345881 13961 raft_consensus.cc:374] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.346222 13961 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.347286 13961 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.350131 13961 ts_tablet_manager.cc:1428] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:03:11.352505 13961 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.353844 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:11.354669 13744 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.358914 13961 tablet_bootstrap.cc:654] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.365450 13744 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:11.361941 13959 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.366583 13959 ts_tablet_manager.cc:1397] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.010s
I20260811 16:03:11.366977 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:11.367527 13960 tablet_bootstrap.cc:492] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.368027 13960 ts_tablet_manager.cc:1397] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.000s
I20260811 16:03:11.367990 13983 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.368633 13983 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:11.369493 13959 raft_consensus.cc:348] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.370363 13959 raft_consensus.cc:374] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.369459 13983 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.370671 13959 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.370965 13960 raft_consensus.cc:348] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.371752 13960 raft_consensus.cc:374] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.371538 13959 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.372035 13960 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.372759 13960 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.373936 13959 ts_tablet_manager.cc:1428] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260811 16:03:11.375036 13959 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.375144 13960 ts_tablet_manager.cc:1428] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260811 16:03:11.380084 13960 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.382339 13959 tablet_bootstrap.cc:654] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.387223 13960 tablet_bootstrap.cc:654] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.388749 13959 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.389430 13959 ts_tablet_manager.cc:1397] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260811 16:03:11.391134 13630 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:11.392484 13959 raft_consensus.cc:348] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.395900 13959 raft_consensus.cc:374] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.396231 13959 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.397091 13959 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.398278 13983 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.398800 13983 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.400942 13983 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:11.401026 13960 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.401744 13960 ts_tablet_manager.cc:1397] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260811 16:03:11.402072 13988 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.402287 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:11.402573 13988 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.402930 13827 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:11.404459 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:11.405746 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.405543 13960 raft_consensus.cc:348] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.406363 13960 raft_consensus.cc:374] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.406452 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.406924 13960 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.407240 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.408035 13959 ts_tablet_manager.cc:1428] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260811 16:03:11.408116 13789 leader_election.cc:341] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.407851 13960 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.404636 13988 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:11.408702 13787 leader_election.cc:341] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.408965 13983 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.409183 13959 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.409140 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:11.410061 13988 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.406402 13744 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:11.409415 13983 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.411530 13960 ts_tablet_manager.cc:1428] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.003s
I20260811 16:03:11.411697 13983 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.414721 13960 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.416672 13959 tablet_bootstrap.cc:654] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.419673 13983 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.422698 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:11.423401 13744 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.428416 13960 tablet_bootstrap.cc:654] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.430886 13744 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:11.432256 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.433759 13996 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.434162 13983 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:11.435524 13991 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.435468 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:11.436313 13961 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.437649 13961 ts_tablet_manager.cc:1397] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.024s
I20260811 16:03:11.437372 13991 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.437388 13827 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.440554 13961 raft_consensus.cc:348] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.441568 13961 raft_consensus.cc:374] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.441932 13961 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.442984 13961 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.445222 13959 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.445739 13961 ts_tablet_manager.cc:1428] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:03:11.447201 13961 tablet_bootstrap.cc:492] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.446799 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:11.449596 13709 leader_election.cc:341] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.452862 13991 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.453154 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.445755 13959 ts_tablet_manager.cc:1397] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.013s
I20260811 16:03:11.453909 13908 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.455533 13707 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:11.457136 13991 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.457692 13991 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.458173 13991 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.460881 13959 raft_consensus.cc:348] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.457217 13961 tablet_bootstrap.cc:654] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.461752 13959 raft_consensus.cc:374] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.462117 13959 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.464759 13827 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:11.467267 13996 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:11.467794 13959 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.468618 13996 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.471329 13991 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.473637 13959 ts_tablet_manager.cc:1428] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260811 16:03:11.476964 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:03:11.478943 13709 leader_election.cc:341] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.479959 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:11.480665 13908 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.482645 13960 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.483160 13960 ts_tablet_manager.cc:1397] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.037s
I20260811 16:03:11.476500 13959 tablet_bootstrap.cc:492] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.485998 13960 raft_consensus.cc:348] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.486724 13960 raft_consensus.cc:374] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.486980 13960 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.487761 13960 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.488934 13908 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:11.489961 13960 ts_tablet_manager.cc:1428] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260811 16:03:11.490366 13707 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:11.491832 13960 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.494316 13959 tablet_bootstrap.cc:654] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.495810 13968 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.499583 13988 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.500270 13988 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.507454 13988 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.497211 13991 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.510958 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.512809 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.517163 13908 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:11.515539 13968 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:11.518165 13968 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.530078 13961 tablet_bootstrap.cc:492] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.530337 13960 tablet_bootstrap.cc:654] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.530791 13961 ts_tablet_manager.cc:1397] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.018s
I20260811 16:03:11.538829 13961 raft_consensus.cc:348] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.539696 13961 raft_consensus.cc:374] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.539846 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:11.540037 13961 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.540046 13959 tablet_bootstrap.cc:492] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.540830 13959 ts_tablet_manager.cc:1397] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.004s
I20260811 16:03:11.541137 13988 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.546739 13959 raft_consensus.cc:348] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.547709 13959 raft_consensus.cc:374] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.547976 13959 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.540839 13961 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.550673 13988 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.551003 13961 ts_tablet_manager.cc:1428] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260811 16:03:11.552114 13961 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.554067 13628 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:11.554783 13960 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.555388 13960 ts_tablet_manager.cc:1397] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.014s
I20260811 16:03:11.558023 13960 raft_consensus.cc:348] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.558588 13961 tablet_bootstrap.cc:654] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.558813 13960 raft_consensus.cc:374] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.559118 13960 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.560009 13960 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.560053 13959 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.562355 13960 ts_tablet_manager.cc:1428] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260811 16:03:11.563391 13960 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.562443 13959 ts_tablet_manager.cc:1428] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260811 16:03:11.568392 13959 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.568848 13960 tablet_bootstrap.cc:654] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.574890 13959 tablet_bootstrap.cc:654] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.584497 13960 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.585196 13960 ts_tablet_manager.cc:1397] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260811 16:03:11.586095 13626 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:11.588532 13960 raft_consensus.cc:348] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.589331 13960 raft_consensus.cc:374] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.589617 13960 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.590412 13960 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.591277 13959 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.591727 13959 ts_tablet_manager.cc:1397] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260811 16:03:11.592739 13960 ts_tablet_manager.cc:1428] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260811 16:03:11.594237 13988 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.594718 13988 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.595744 13961 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.596637 13961 ts_tablet_manager.cc:1397] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260811 16:03:11.596802 13988 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.598464 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.599503 13968 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.599401 13961 raft_consensus.cc:348] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.599977 13968 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.600257 13961 raft_consensus.cc:374] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.600734 13961 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.600203 13959 raft_consensus.cc:348] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.600867 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.601153 13959 raft_consensus.cc:374] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.601444 13959 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.601704 13744 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:11.601541 13961 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.602252 13959 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.604490 13959 ts_tablet_manager.cc:1428] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260811 16:03:11.604369 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.605006 13908 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.605907 13959 tablet_bootstrap.cc:492] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.606065 13787 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:11.606173 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:11.606844 13827 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.607067 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.608908 14013 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.602036 13968 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.609313 14013 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.609514 13961 ts_tablet_manager.cc:1428] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260811 16:03:11.609665 14013 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.610575 13961 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.611922 13959 tablet_bootstrap.cc:654] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.612699 13988 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.622494 13961 tablet_bootstrap.cc:654] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.623895 13959 tablet_bootstrap.cc:492] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.624418 13959 ts_tablet_manager.cc:1397] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260811 16:03:11.627336 13966 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.626969 13959 raft_consensus.cc:348] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.593839 13960 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.627869 13966 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.629923 13966 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.632536 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.633338 13744 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:11.632148 14013 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.634843 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.638053 13966 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.638424 13966 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.638787 13966 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.639876 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:11.640486 13827 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.635772 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.641897 13908 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:11.636168 13961 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.643054 13961 ts_tablet_manager.cc:1397] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.004s
I20260811 16:03:11.646601 13961 raft_consensus.cc:348] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.647419 13961 raft_consensus.cc:374] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.647696 13961 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.627877 13959 raft_consensus.cc:374] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.632607 13988 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:11.649559 14013 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.637298 13960 tablet_bootstrap.cc:654] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.648356 13961 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.648363 13959 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.650668 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:11.651481 13959 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.654299 13827 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:11.656011 13908 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.656958 13709 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.657405 13959 ts_tablet_manager.cc:1428] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260811 16:03:11.655505 13961 ts_tablet_manager.cc:1428] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260811 16:03:11.657785 14013 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.658317 13959 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.658376 13961 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.658314 14013 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:11.659580 14013 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.654299 13966 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.660734 13968 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.661196 13968 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.663096 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:11.663784 13744 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.664640 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:11.665259 13909 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.666141 13959 tablet_bootstrap.cc:654] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.670195 13968 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.670778 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.671995 13744 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
W20260811 16:03:11.672968 13707 leader_election.cc:341] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.675504 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.676544 13988 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.678629 13909 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:11.683279 13908 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:11.675554 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:11.685901 13961 tablet_bootstrap.cc:654] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.686311 13966 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.687870 13827 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.690017 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:11.691987 13988 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:11.692018 13968 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.692569 13968 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.692899 13968 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.693037 13988 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } }
I20260811 16:03:11.696995 13959 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.697657 13959 ts_tablet_manager.cc:1397] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.019s
I20260811 16:03:11.701603 13959 raft_consensus.cc:348] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.702801 13959 raft_consensus.cc:374] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.703194 13959 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.704458 13959 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.707895 13959 ts_tablet_manager.cc:1428] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260811 16:03:11.709421 13959 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.709959 13960 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.706984 13968 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.710448 13960 ts_tablet_manager.cc:1397] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.006s
I20260811 16:03:11.714330 13960 raft_consensus.cc:348] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.715107 13960 raft_consensus.cc:374] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.715432 13960 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.716272 13960 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.719228 13960 ts_tablet_manager.cc:1428] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260811 16:03:11.719431 13959 tablet_bootstrap.cc:654] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.720398 13960 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.730769 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:11.732152 13827 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.737506 13630 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:11.749473 13960 tablet_bootstrap.cc:654] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.755002 13968 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.756078 13996 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.749473 13827 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:11.759179 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:03:11.762163 13707 leader_election.cc:341] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:11.764724 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:11.767256 13968 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.768829 14013 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.768464 13968 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.757025 13996 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.770227 13961 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.771672 13961 ts_tablet_manager.cc:1397] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.113s	user 0.029s	sys 0.021s
I20260811 16:03:11.771960 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.772591 13996 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:11.772840 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.774147 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:11.774420 13909 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.774487 13961 raft_consensus.cc:348] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.774880 13827 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.775224 13959 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.775247 13961 raft_consensus.cc:374] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.775664 13961 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.769380 14013 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:11.775913 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.772682 13744 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:11.776397 13961 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.776590 14013 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.777281 13968 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.777951 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.778131 13968 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.778602 13961 ts_tablet_manager.cc:1428] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260811 16:03:11.778577 13968 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.773728 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:11.775751 13959 ts_tablet_manager.cc:1397] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.017s
I20260811 16:03:11.779222 13968 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.779498 14010 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.779781 13961 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:11.780004 14010 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.780445 14010 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.782217 13959 raft_consensus.cc:348] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.770514 13628 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:11.786242 13961 tablet_bootstrap.cc:654] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.783138 13959 raft_consensus.cc:374] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.787214 13959 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.787875 13959 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.790614 13959 ts_tablet_manager.cc:1428] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260811 16:03:11.791631 13959 tablet_bootstrap.cc:492] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.792444 14010 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.779505 13826 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:11.799789 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:11.800514 13744 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.802994 13630 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:11.808808 13744 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:11.809305 13960 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.809794 13960 ts_tablet_manager.cc:1397] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.006s
I20260811 16:03:11.809396 13996 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:11.810233 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.811266 13983 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.812870 13960 raft_consensus.cc:348] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.813685 13960 raft_consensus.cc:374] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.813974 13960 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.814708 13960 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.815682 13959 tablet_bootstrap.cc:654] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.817067 13960 ts_tablet_manager.cc:1428] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260811 16:03:11.818271 13960 tablet_bootstrap.cc:492] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.822296 13988 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.822966 13988 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.829092 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.830091 13909 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:11.831439 13968 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.834081 13968 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.841883 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:11.843178 13996 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:11.843531 13789 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:11.841991 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:11.846689 14029 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.853111 14029 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.843284 13909 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.853847 14029 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.857481 13960 tablet_bootstrap.cc:654] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.845408 13988 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.848428 13827 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.865949 13983 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:11.868575 13983 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.874720 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:11.876039 13825 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.867314 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:11.873924 14010 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:11.888679 13744 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:11.892968 13909 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:11.898941 13959 tablet_bootstrap.cc:492] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:11.905701 14029 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.906540 13959 ts_tablet_manager.cc:1397] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.004s
I20260811 16:03:11.906947 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.908030 13968 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 16:03:11.905225 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:11.908723 13968 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:11.909646 13968 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.910333 13959 raft_consensus.cc:348] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.911191 13959 raft_consensus.cc:374] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.911397 13960 tablet_bootstrap.cc:492] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:11.911475 13959 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.912364 13959 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.916823 13959 ts_tablet_manager.cc:1428] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260811 16:03:11.917982 13959 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:11.918299 13960 ts_tablet_manager.cc:1397] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.014s
I20260811 16:03:11.920006 13825 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:11.920557 13961 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:11.921664 13961 ts_tablet_manager.cc:1397] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.142s	user 0.026s	sys 0.053s
I20260811 16:03:11.921247 14013 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.923120 14013 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.923882 13960 raft_consensus.cc:348] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.924671 13960 raft_consensus.cc:374] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.925072 13960 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.933382 13960 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.942826 13960 ts_tablet_manager.cc:1428] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.004s
I20260811 16:03:11.943935 13960 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:11.941777 14013 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.953158 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:11.953902 13744 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.948071 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:11.960963 13825 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.962538 14029 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:11.962616 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.954480 13961 raft_consensus.cc:348] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.964746 13961 raft_consensus.cc:374] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:11.965154 13961 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:11.964206 13744 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:11.972371 13961 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.975549 13961 ts_tablet_manager.cc:1428] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260811 16:03:11.976563 13787 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:11.977080 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:11.978008 13909 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.973973 13827 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:11.981011 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:11.981669 13908 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:11.983506 14029 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:11.974143 14013 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:11.988207 14013 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:11.988814 14013 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:11.990540 13959 tablet_bootstrap.cc:654] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.988139 14029 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:11.992190 14029 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.985471 13630 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:11.992775 13626 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:11.994537 14010 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:11.995252 13909 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:11.994993 14010 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:11.998109 13960 tablet_bootstrap.cc:654] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:11.998623 14010 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:11.999717 13983 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:12.000344 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:12.000638 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.001168 13827 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:12.001488 13744 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:12.003356 13874 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:12.007791 13996 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:12.011677 13996 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:12.012133 13996 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:12.012534 13996 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.021728 13961 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:12.033306 14013 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.036336 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:12.037201 13825 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.036131 13996 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.041862 13996 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:12.045975 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:12.046715 13744 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.046929 13961 tablet_bootstrap.cc:654] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.048790 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:12.049468 13909 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.051887 13968 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:12.044056 14013 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.058219 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:12.058985 13826 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.061364 13968 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.062439 13968 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.072883 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:12.073889 13968 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:12.074676 13709 leader_election.cc:341] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.070611 13630 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:12.100445 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:12.100893 13960 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:12.101333 13960 ts_tablet_manager.cc:1397] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.037s
I20260811 16:03:12.104303 13968 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:03:12.102991 13707 leader_election.cc:341] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.108135 13707 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:12.109208 13968 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.111617 13988 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:12.106478 13960 raft_consensus.cc:348] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.117117 13960 raft_consensus.cc:374] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.117544 13960 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.118906 13960 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.094352 13909 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:12.124531 13960 ts_tablet_manager.cc:1428] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260811 16:03:12.125923 13960 tablet_bootstrap.cc:492] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:12.129505 13707 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:12.132205 13968 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:12.132694 13968 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:12.133867 13968 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.123312 13826 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:12.136067 14029 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.136495 13874 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:12.137516 13983 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:12.138053 13983 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:12.146560 13961 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:12.144632 13744 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:12.147363 13991 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260811 16:03:12.147107 13961 ts_tablet_manager.cc:1397] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.021s
I20260811 16:03:12.148406 13983 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.163486 14029 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.166800 14029 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.174152 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:12.176878 13789 leader_election.cc:341] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.181167 13959 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:12.181787 13959 ts_tablet_manager.cc:1397] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.264s	user 0.010s	sys 0.020s
I20260811 16:03:12.188777 13960 tablet_bootstrap.cc:654] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.176487 14029 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.191453 13628 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:12.190027 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.200538 13959 raft_consensus.cc:348] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.201654 13968 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:12.201637 13959 raft_consensus.cc:374] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.203449 13959 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.204950 13959 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.207886 13825 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:12.215617 13959 ts_tablet_manager.cc:1428] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.008s
I20260811 16:03:12.205173 13744 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:12.217021 13959 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:12.224613 13961 raft_consensus.cc:348] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.225503 13961 raft_consensus.cc:374] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.225801 13961 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.230156 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:12.232436 13961 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.235927 13988 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:12.236967 13988 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:12.237417 13988 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.241819 13961 ts_tablet_manager.cc:1428] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.083s	user 0.002s	sys 0.006s
I20260811 16:03:12.242652 13961 tablet_bootstrap.cc:492] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:12.263783 13628 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:12.296010 13959 tablet_bootstrap.cc:654] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.323166 14013 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.324651 13961 tablet_bootstrap.cc:654] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.325655 13988 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.330137 13988 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.330684 13988 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.331163 13988 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.333070 14013 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.333552 14013 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.335378 14013 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.366004 13983 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.369539 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:12.370272 13744 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.374431 14073 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.375133 14073 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:12.344753 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87754.2us
I20260811 16:03:12.370307 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.462437 13959 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:12.462960 13959 ts_tablet_manager.cc:1397] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.246s	user 0.021s	sys 0.041s
I20260811 16:03:12.461531 13988 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.457295 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:12.465839 13968 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.474045 13968 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.477151 13959 raft_consensus.cc:348] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.477936 13968 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.478235 13959 raft_consensus.cc:374] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.478662 13959 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.394112 13742 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:12.479490 13823 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:12.401371 14073 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.405153 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.405560 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:12.470134 13960 tablet_bootstrap.cc:492] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:12.472376 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:12.472812 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:12.486059 13960 ts_tablet_manager.cc:1397] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.361s	user 0.023s	sys 0.031s
I20260811 16:03:12.486825 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:12.488030 14029 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 16:03:12.488204 13787 leader_election.cc:341] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.488678 14029 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:12.479559 13959 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:12.463689 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59383.5us
I20260811 16:03:12.489513 13960 raft_consensus.cc:348] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.501472 13960 raft_consensus.cc:374] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.489768 14029 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.501670 14067 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:03:12.499208 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:12.498724 13968 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.497655 13996 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.505637 13960 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.506429 13960 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.508347 13960 ts_tablet_manager.cc:1428] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260811 16:03:12.507853 13996 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:12.502688 13707 leader_election.cc:341] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.514160 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.515522 13742 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:12.517561 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:12.510757 13996 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:12.519353 13983 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:12.519990 13983 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:12.520571 13983 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.528406 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:12.532536 13707 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:12.540020 13960 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:12.539783 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:12.542471 13959 ts_tablet_manager.cc:1428] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
I20260811 16:03:12.543946 13959 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:12.547791 13961 tablet_bootstrap.cc:492] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:12.548410 13961 ts_tablet_manager.cc:1397] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.306s	user 0.036s	sys 0.006s
I20260811 16:03:12.497713 13744 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:12.551563 13983 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.553398 14029 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:12.549628 13789 leader_election.cc:341] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.559580 14029 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.560547 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:12.561055 13983 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:12.561551 13959 tablet_bootstrap.cc:654] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:12.555367 13874 leader_election.cc:341] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.555120 13988 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.554201 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:12.563346 14029 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 16:03:12.566218 13707 leader_election.cc:341] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.566778 13983 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.564864 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:12.569456 14013 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:12.573580 14013 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:12.574187 14013 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.579382 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:12.580458 13744 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.583994 14013 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.579820 14029 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:12.585440 13741 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:12.585577 14029 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:12.570159 13789 leader_election.cc:341] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:12.594713 13789 leader_election.cc:341] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.596688 13789 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:12.596280 13961 raft_consensus.cc:348] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.606137 13961 raft_consensus.cc:374] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.606513 13961 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.607622 13961 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.608695 14069 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.592207 13744 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:12.611164 13960 tablet_bootstrap.cc:654] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.611905 13961 ts_tablet_manager.cc:1428] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260811 16:03:12.599659 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:12.615048 13961 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:12.618847 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:12.619107 14069 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:12.618924 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:12.623157 13959 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:12.623821 13959 ts_tablet_manager.cc:1397] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.032s
I20260811 16:03:12.621021 13983 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:12.626387 13983 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:03:12.627003 13874 leader_election.cc:341] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.627800 13983 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.623209 14013 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.648499 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:03:12.657138 13707 leader_election.cc:341] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.658469 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:03:12.659477 13709 leader_election.cc:341] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.659658 13824 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:12.660223 13709 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:12.664968 13991 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.665771 13991 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 16:03:12.660223 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:12.674507 13961 tablet_bootstrap.cc:654] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.667789 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:12.703642 13968 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.706231 13968 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:03:12.712102 13789 leader_election.cc:341] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.712874 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:12.713999 14029 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.715389 13959 raft_consensus.cc:348] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.716359 13959 raft_consensus.cc:374] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.716610 13959 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.717298 13959 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.721040 13959 ts_tablet_manager.cc:1428] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.001s
I20260811 16:03:12.723541 13959 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:12.744045 14010 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:03:12.748129 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44178.4us
I20260811 16:03:12.754454 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:12.744683 14010 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.764593 14010 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:12.765719 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.769333 14029 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:12.770017 14029 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.743063 13983 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260811 16:03:12.780946 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:12.783545 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:12.794137 13787 leader_election.cc:341] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.794946 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:12.796466 13983 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.781133 14029 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:12.818449 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:12.819427 14037 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260811 16:03:12.820827 13789 leader_election.cc:341] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:12.821408 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:12.825918 14069 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:12.842918 13960 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:12.843549 13961 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:12.843645 13960 ts_tablet_manager.cc:1397] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.304s	user 0.021s	sys 0.042s
I20260811 16:03:12.844278 13961 ts_tablet_manager.cc:1397] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.229s	user 0.019s	sys 0.016s
I20260811 16:03:12.849109 13906 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:12.871832 13961 raft_consensus.cc:348] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.874612 13961 raft_consensus.cc:374] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.875022 13961 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.884256 13961 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.895866 13961 ts_tablet_manager.cc:1428] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
I20260811 16:03:12.896756 13961 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:12.914750 13628 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:12.917213 13960 raft_consensus.cc:348] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.917984 13960 raft_consensus.cc:374] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.918273 13960 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.919059 13960 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.923194 13959 tablet_bootstrap.cc:654] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.928609 13961 tablet_bootstrap.cc:654] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.930778 13960 ts_tablet_manager.cc:1428] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.087s	user 0.002s	sys 0.005s
I20260811 16:03:12.936368 13960 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
W20260811 16:03:12.966455 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:12.966579 13960 tablet_bootstrap.cc:654] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:12.970849 13959 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:12.971561 13959 ts_tablet_manager.cc:1397] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.249s	user 0.023s	sys 0.015s
I20260811 16:03:12.975860 13959 raft_consensus.cc:348] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.976819 13959 raft_consensus.cc:374] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:12.977123 13959 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:12.989163 13959 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:12.996323 13959 ts_tablet_manager.cc:1428] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.004s
I20260811 16:03:12.997449 13959 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.004441 13959 tablet_bootstrap.cc:654] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.009009 13961 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.009476 13961 ts_tablet_manager.cc:1397] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.011s
I20260811 16:03:13.012868 13960 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.012460 13961 raft_consensus.cc:348] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.013372 13960 ts_tablet_manager.cc:1397] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.016s
I20260811 16:03:13.013476 13961 raft_consensus.cc:374] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.013784 13961 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.014631 13961 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.016875 13961 ts_tablet_manager.cc:1428] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260811 16:03:13.017684 13959 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.017910 13961 tablet_bootstrap.cc:492] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.018337 13959 ts_tablet_manager.cc:1397] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260811 16:03:13.020999 13959 raft_consensus.cc:348] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.021981 13959 raft_consensus.cc:374] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.022358 13959 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.023080 13959 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.024978 13961 tablet_bootstrap.cc:654] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.025345 13959 ts_tablet_manager.cc:1428] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260811 16:03:13.026623 13959 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.027894 13960 raft_consensus.cc:348] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.028913 13960 raft_consensus.cc:374] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.029249 13960 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.030234 13960 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.032859 13959 tablet_bootstrap.cc:654] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.038264 13961 tablet_bootstrap.cc:492] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.038654 13960 ts_tablet_manager.cc:1428] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260811 16:03:13.038739 13961 ts_tablet_manager.cc:1397] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260811 16:03:13.041110 13959 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.041591 13959 ts_tablet_manager.cc:1397] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260811 16:03:13.041955 13961 raft_consensus.cc:348] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.042726 13961 raft_consensus.cc:374] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.042984 13961 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.044360 13960 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.044124 13959 raft_consensus.cc:348] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.044883 13959 raft_consensus.cc:374] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.045154 13959 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.045815 13959 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.047439 13961 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.047981 13959 ts_tablet_manager.cc:1428] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260811 16:03:13.050220 13961 ts_tablet_manager.cc:1428] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260811 16:03:13.051344 13961 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.051820 13959 tablet_bootstrap.cc:492] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.052066 13960 tablet_bootstrap.cc:654] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.059398 13961 tablet_bootstrap.cc:654] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.071916 14029 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.084281 13959 tablet_bootstrap.cc:654] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.091619 13960 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.092300 13960 ts_tablet_manager.cc:1397] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.004s
I20260811 16:03:13.094679 13960 raft_consensus.cc:348] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.097404 13960 raft_consensus.cc:374] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.097735 13960 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.098664 13960 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.106395 13960 ts_tablet_manager.cc:1428] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260811 16:03:13.107717 13960 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.105269 14013 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.109985 13961 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.110632 13961 ts_tablet_manager.cc:1397] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.031s
I20260811 16:03:13.115242 14013 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.120067 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.120750 14013 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:13.123349 13707 leader_election.cc:341] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.120155 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.126549 13827 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:13.127959 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.128351 13906 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.129256 13961 raft_consensus.cc:348] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.129671 14013 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.130331 14013 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.130784 14013 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.130017 13961 raft_consensus.cc:374] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.133363 13961 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.134097 13961 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.135299 14090 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.136587 13961 ts_tablet_manager.cc:1428] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260811 16:03:13.135931 14090 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.138077 13961 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.138636 14090 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.140470 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:13.142457 13707 leader_election.cc:341] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.146471 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:13.148439 13709 leader_election.cc:341] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.149034 13709 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:13.150013 14090 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.151376 13959 tablet_bootstrap.cc:492] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.151912 13959 ts_tablet_manager.cc:1397] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.018s
I20260811 16:03:13.151319 14029 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.153406 13961 tablet_bootstrap.cc:654] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:13.153489 13874 consensus_peers.cc:487] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:13.142673 14013 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.159368 13960 tablet_bootstrap.cc:654] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.155131 13959 raft_consensus.cc:348] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.161880 13959 raft_consensus.cc:374] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.162452 13959 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.163322 14029 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.163932 14029 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.161870 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:13.167860 13827 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.173112 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.165231 14013 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.165990 13959 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.174096 13744 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:13.175921 13787 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:13.176159 13959 ts_tablet_manager.cc:1428] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260811 16:03:13.166898 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.176812 14072 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.177358 14072 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.177834 14072 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.179597 13959 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
W20260811 16:03:13.178025 13707 leader_election.cc:341] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.185470 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.180845 14029 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:13.188596 13789 leader_election.cc:341] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.189232 13961 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.189754 13961 ts_tablet_manager.cc:1397] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.011s
I20260811 16:03:13.197503 13959 tablet_bootstrap.cc:654] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.202162 14072 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.205637 14072 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.207098 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.207682 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:13.209794 13744 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:13.209859 13789 leader_election.cc:341] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.209798 13961 raft_consensus.cc:348] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.210716 13961 raft_consensus.cc:374] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.211035 13961 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.212064 13960 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.211767 13961 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.212493 13960 ts_tablet_manager.cc:1397] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.018s
I20260811 16:03:13.214087 13961 ts_tablet_manager.cc:1428] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260811 16:03:13.214991 13961 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.214924 13960 raft_consensus.cc:348] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.215696 13960 raft_consensus.cc:374] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.215947 13960 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.216478 13960 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.218850 13744 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:13.220145 13960 ts_tablet_manager.cc:1428] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260811 16:03:13.221051 13787 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.221346 13960 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.222448 14072 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.223205 14072 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:13.223908 13961 tablet_bootstrap.cc:654] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.224256 14072 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.228236 13960 tablet_bootstrap.cc:654] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.239025 13827 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:13.243806 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.253593 14094 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.249482 14013 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.259789 14013 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:13.261066 14013 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.266664 14094 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.267295 14094 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.277781 13959 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.280277 13959 ts_tablet_manager.cc:1397] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.009s
I20260811 16:03:13.281733 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:13.283932 13874 leader_election.cc:341] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.286005 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:13.288574 13871 leader_election.cc:341] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.289266 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.290408 13983 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.278345 14094 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.297606 14090 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.299453 13968 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.300026 13968 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.298581 14090 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.301440 13961 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.301913 13961 ts_tablet_manager.cc:1397] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.006s
I20260811 16:03:13.302256 13968 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.302676 14090 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.306265 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.306694 13961 raft_consensus.cc:348] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.308014 13961 raft_consensus.cc:374] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.308380 13961 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.309731 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.310953 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.311764 13827 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
W20260811 16:03:13.312268 13707 leader_election.cc:341] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.312821 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:13.313047 13707 leader_election.cc:341] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.309454 13961 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.313544 13824 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:13.315670 13959 raft_consensus.cc:348] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.316402 13709 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.316797 13959 raft_consensus.cc:374] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.317293 13959 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.317662 14090 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.318040 14090 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.317972 13959 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.318490 14090 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.318463 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.322889 13968 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.323321 13968 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.323746 13960 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.323184 13628 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.324272 13960 ts_tablet_manager.cc:1397] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.103s	user 0.029s	sys 0.040s
I20260811 16:03:13.320647 13959 ts_tablet_manager.cc:1428] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260811 16:03:13.323782 13968 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.325554 13959 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.328490 13961 ts_tablet_manager.cc:1428] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260811 16:03:13.331341 13961 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.335549 14072 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.336110 14072 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.341851 13960 raft_consensus.cc:348] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.342660 13960 raft_consensus.cc:374] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.342983 13960 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.341753 13968 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.347317 13960 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.347890 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.350502 13960 ts_tablet_manager.cc:1428] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260811 16:03:13.350927 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.351608 13960 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.351756 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:13.352309 13824 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.343034 14094 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.355644 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.345155 14072 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.359817 14072 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.360538 14094 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.362874 14094 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.349823 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.364558 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.366478 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:03:13.367691 13874 leader_election.cc:341] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.368376 13959 tablet_bootstrap.cc:654] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.368059 14090 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:13.368899 13707 leader_election.cc:341] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.369019 13824 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:13.370666 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.371719 14067 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.370182 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.372277 14067 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:13.372777 13960 tablet_bootstrap.cc:654] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.371575 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.370385 14090 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.373420 14067 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:13.375245 13707 leader_election.cc:341] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.349560 13968 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.382835 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:13.383669 13824 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.379302 13744 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:13.386240 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:13.387409 14094 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.388031 14094 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.388794 13961 tablet_bootstrap.cc:654] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.388628 14094 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.402920 13824 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:13.405892 13709 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.409363 14090 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.409927 14090 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:13.410797 14090 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.412981 14013 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.413561 14013 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.418022 14013 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.417950 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.418051 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:13.420593 13709 leader_election.cc:341] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:13.421882 13707 leader_election.cc:341] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.422595 13707 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:13.421406 14094 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.423656 14013 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.425158 14094 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.437377 14094 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.426380 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:13.442931 13959 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.426297 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:03:13.444702 13874 leader_election.cc:341] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.444207 13959 ts_tablet_manager.cc:1397] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.029s
I20260811 16:03:13.445537 13744 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.450354 14094 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.455485 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.456382 13742 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:13.457151 14072 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.457647 14072 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.457820 13959 raft_consensus.cc:348] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.458923 13959 raft_consensus.cc:374] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.459244 13959 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.460018 14072 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.460009 13959 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.461681 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.462380 13906 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:13.462543 13959 ts_tablet_manager.cc:1428] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260811 16:03:13.464248 13959 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.469339 14094 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.464200 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.465652 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:13.470589 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.466445 14072 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:03:13.470971 13787 leader_election.cc:341] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.471026 14069 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.471603 14069 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.471340 14072 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.472051 14069 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.471422 13626 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.473469 13744 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:13.473902 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.474799 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.475026 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:13.475556 13906 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:13.473495 14072 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.476922 13827 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:13.478190 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.478662 13960 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.479110 13960 ts_tablet_manager.cc:1397] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.128s	user 0.006s	sys 0.011s
I20260811 16:03:13.476657 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:13.479365 13983 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.479828 14072 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.482146 13961 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.482616 13961 ts_tablet_manager.cc:1397] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.008s
I20260811 16:03:13.485780 13961 raft_consensus.cc:348] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.486529 13961 raft_consensus.cc:374] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.486800 13961 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.480192 14072 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.486891 13983 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.487509 14072 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.488184 14069 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.490454 14069 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.491426 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:13.492112 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.492383 13960 raft_consensus.cc:348] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.492725 13906 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.493129 13960 raft_consensus.cc:374] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 16:03:13.493134 13787 leader_election.cc:341] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.493471 13960 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.494174 13960 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.476701 14094 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.496027 14094 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:13.496953 14094 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.499022 13959 tablet_bootstrap.cc:654] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.499672 13961 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.504855 13906 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:13.506577 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.508164 14029 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.515005 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.516997 13961 ts_tablet_manager.cc:1428] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.005s
I20260811 16:03:13.525182 13744 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:13.526044 13961 tablet_bootstrap.cc:492] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.523187 14029 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:13.503023 13960 ts_tablet_manager.cc:1428] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.003s
I20260811 16:03:13.529794 14029 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.530265 13960 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.528939 14072 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.538399 14094 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.538123 13627 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:13.539211 14094 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.544023 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:13.545440 13744 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.546085 14094 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.548415 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.545020 14072 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.548472 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.550977 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.551630 13906 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.552489 13960 tablet_bootstrap.cc:654] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.553799 13742 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:13.555245 13961 tablet_bootstrap.cc:654] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.558007 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.561772 13626 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.562943 13959 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.563627 13959 ts_tablet_manager.cc:1397] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.100s	user 0.028s	sys 0.019s
I20260811 16:03:13.566041 13959 raft_consensus.cc:348] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.567564 13959 raft_consensus.cc:374] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.567884 13959 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.568691 13959 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.569260 13906 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:13.574290 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:13.576025 13959 ts_tablet_manager.cc:1428] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260811 16:03:13.577332 13959 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.565347 13744 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:13.564028 14094 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.575381 14029 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.583036 14029 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:13.585453 14029 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.589111 13959 tablet_bootstrap.cc:654] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.593802 13960 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.594343 13960 ts_tablet_manager.cc:1397] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.006s
I20260811 16:03:13.599779 13960 raft_consensus.cc:348] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.600620 13960 raft_consensus.cc:374] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.600977 13960 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.602200 13961 tablet_bootstrap.cc:492] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.602797 13961 ts_tablet_manager.cc:1397] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.008s
I20260811 16:03:13.603516 13960 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.606003 13961 raft_consensus.cc:348] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.606725 13961 raft_consensus.cc:374] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.607002 13961 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.608317 13960 ts_tablet_manager.cc:1428] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260811 16:03:13.607013 14094 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.610025 13960 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.610257 13627 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.611295 13961 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.613204 14094 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.613660 14094 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.615427 13961 ts_tablet_manager.cc:1428] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260811 16:03:13.615762 14094 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.616981 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.617831 13827 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:13.619715 13960 tablet_bootstrap.cc:654] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.620409 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.621522 13961 tablet_bootstrap.cc:492] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.622225 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.614089 13959 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.623167 13959 ts_tablet_manager.cc:1397] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.046s	user 0.003s	sys 0.010s
I20260811 16:03:13.623530 14094 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.626180 13959 raft_consensus.cc:348] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.626964 13959 raft_consensus.cc:374] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.627274 13959 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.628060 13959 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.633599 13961 tablet_bootstrap.cc:654] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.635743 14094 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.640256 13961 tablet_bootstrap.cc:492] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.640769 13961 ts_tablet_manager.cc:1397] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.008s
I20260811 16:03:13.643612 13959 ts_tablet_manager.cc:1428] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260811 16:03:13.643354 13961 raft_consensus.cc:348] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.644116 13961 raft_consensus.cc:374] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.644385 13961 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.644996 13961 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.647104 13961 ts_tablet_manager.cc:1428] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260811 16:03:13.647814 13959 tablet_bootstrap.cc:492] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.648916 13961 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.652177 13960 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.652839 13960 ts_tablet_manager.cc:1397] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260811 16:03:13.655256 14029 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.656981 13960 raft_consensus.cc:348] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.657804 13960 raft_consensus.cc:374] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.658078 13960 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.658774 13960 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.663564 14029 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.664111 14029 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.665634 14072 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.666190 14072 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.667659 14029 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.672700 13961 tablet_bootstrap.cc:654] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.674316 13827 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.676014 13959 tablet_bootstrap.cc:654] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.679212 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.679774 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.680347 13744 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:13.682595 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:13.685668 13960 ts_tablet_manager.cc:1428] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260811 16:03:13.682596 14072 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.684870 14029 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.687602 13960 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.688007 14029 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.688369 14029 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.688409 14094 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.688925 14094 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.690944 14094 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.692067 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.692375 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:13.692816 13789 leader_election.cc:341] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.694511 14072 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:13.695858 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:13.697093 13787 leader_election.cc:341] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.693483 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.698854 13824 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:13.699926 14029 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.702904 14029 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.704404 13874 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.705437 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.706600 14094 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:13.713053 13789 leader_election.cc:341] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.715744 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:13.714018 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.716627 13742 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.718796 14029 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:03:13.720834 13789 leader_election.cc:341] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.733232 14010 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.733980 14010 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.738338 14010 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:13.739877 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:13.741813 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:13.742553 13874 leader_election.cc:341] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:13.743326 13871 leader_election.cc:341] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.743765 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.746378 14010 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.750160 13960 tablet_bootstrap.cc:654] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.756845 13742 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:13.760890 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.761845 14072 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.762367 14072 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:13.763957 14094 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:13.763257 14072 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.767840 13960 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.768401 13960 ts_tablet_manager.cc:1397] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.082s	user 0.004s	sys 0.009s
I20260811 16:03:13.771459 13960 raft_consensus.cc:348] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.772228 13960 raft_consensus.cc:374] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.772547 13960 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.773170 13960 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.778400 13960 ts_tablet_manager.cc:1428] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260811 16:03:13.779492 13960 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.780790 14072 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.781327 14072 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.786419 13959 tablet_bootstrap.cc:492] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.787252 14072 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.787465 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.787845 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.788574 13742 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
W20260811 16:03:13.789441 13789 leader_election.cc:341] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.790287 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.791520 14072 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:13.791102 13627 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:13.792150 14072 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:13.792774 14072 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.791733 13960 tablet_bootstrap.cc:654] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.786952 13959 ts_tablet_manager.cc:1397] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.026s
I20260811 16:03:13.796432 13961 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.798943 13961 ts_tablet_manager.cc:1397] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.151s	user 0.026s	sys 0.053s
I20260811 16:03:13.801759 14013 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.798664 13959 raft_consensus.cc:348] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.802666 13961 raft_consensus.cc:348] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.803682 13961 raft_consensus.cc:374] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.804304 13961 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.805078 13961 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.803488 13959 raft_consensus.cc:374] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.811573 13959 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.812808 13959 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.815680 13961 ts_tablet_manager.cc:1428] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260811 16:03:13.816741 13961 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.823894 13959 ts_tablet_manager.cc:1428] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260811 16:03:13.826671 13961 tablet_bootstrap.cc:654] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.828861 13959 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:13.834002 13909 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.810493 14072 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.845124 13961 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.860895 14013 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.857865 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:13.862231 13742 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.857481 14090 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260811 16:03:13.861231 13961 ts_tablet_manager.cc:1397] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.006s
I20260811 16:03:13.868924 14013 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:13.871054 13961 raft_consensus.cc:348] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.871829 13961 raft_consensus.cc:374] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.872068 13961 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.880390 13960 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:13.880923 13960 ts_tablet_manager.cc:1397] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.102s	user 0.028s	sys 0.060s
I20260811 16:03:13.882409 14090 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:13.883715 13960 raft_consensus.cc:348] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.884451 13960 raft_consensus.cc:374] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.884732 13960 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.885438 13960 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.886214 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:13.886051 13961 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:13.888078 13789 leader_election.cc:341] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:13.888551 13960 ts_tablet_manager.cc:1428] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260811 16:03:13.888710 14072 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.889513 13960 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:13.890707 13961 ts_tablet_manager.cc:1428] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260811 16:03:13.891713 13961 tablet_bootstrap.cc:492] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:13.895612 13959 tablet_bootstrap.cc:654] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.901938 13961 tablet_bootstrap.cc:654] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.922262 13960 tablet_bootstrap.cc:654] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:13.924674 13742 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:13.950138 14090 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:13.950762 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:13.952137 14072 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:13.952793 14072 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:13.953956 14072 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.958802 14029 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:13.959571 14029 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.965200 13961 tablet_bootstrap.cc:492] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:13.965776 13961 ts_tablet_manager.cc:1397] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.006s
I20260811 16:03:13.966640 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:13.969271 13961 raft_consensus.cc:348] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.970194 13961 raft_consensus.cc:374] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.970475 13961 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.970470 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:13.972173 13961 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.973009 13744 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:13.974512 13961 ts_tablet_manager.cc:1428] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260811 16:03:13.975988 13961 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
W20260811 16:03:13.977563 13787 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:13.978806 13787 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:13.986929 14129 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:13.968611 14029 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:13.987396 13959 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:13.988409 13959 ts_tablet_manager.cc:1397] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.160s	user 0.021s	sys 0.007s
I20260811 16:03:13.994980 13959 raft_consensus.cc:348] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.995824 13959 raft_consensus.cc:374] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:13.996124 13959 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:13.996739 13959 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:13.998916 13959 ts_tablet_manager.cc:1428] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260811 16:03:13.999859 13959 tablet_bootstrap.cc:492] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.001166 14129 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.022809 14010 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.023182 14029 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:14.028618 13960 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:14.029173 13960 ts_tablet_manager.cc:1397] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.020s
I20260811 16:03:14.032430 13626 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.039670 13960 raft_consensus.cc:348] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.042544 13960 raft_consensus.cc:374] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.043067 13961 tablet_bootstrap.cc:654] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.043469 13960 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.049034 13960 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.051563 13959 tablet_bootstrap.cc:654] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.053015 13960 ts_tablet_manager.cc:1428] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260811 16:03:14.056138 13960 tablet_bootstrap.cc:492] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
W20260811 16:03:14.058491 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:14.058290 14010 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.066349 14069 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.087240 14069 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.101037 13960 tablet_bootstrap.cc:654] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.118307 14129 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.119051 14129 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.123014 14129 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.126173 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.127240 13742 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:14.131407 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.132093 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.132982 13906 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:14.133314 14029 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.133849 14029 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.134303 14029 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.136427 14013 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.137079 14013 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.147401 14013 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.148149 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.148342 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.154981 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:14.159999 14129 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.162002 14013 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.167069 13961 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:14.168783 13961 ts_tablet_manager.cc:1397] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.035s
I20260811 16:03:14.170894 13959 tablet_bootstrap.cc:492] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.171425 13959 ts_tablet_manager.cc:1397] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.172s	user 0.033s	sys 0.041s
I20260811 16:03:14.171597 13961 raft_consensus.cc:348] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.172338 13961 raft_consensus.cc:374] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.172610 13961 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.174093 13959 raft_consensus.cc:348] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.174638 13959 raft_consensus.cc:374] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.174923 13959 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.175511 13959 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.177325 13959 ts_tablet_manager.cc:1428] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260811 16:03:14.180485 14029 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.183482 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:14.184144 13744 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.186360 13959 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.193255 13744 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:14.193892 13959 tablet_bootstrap.cc:654] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.196444 13960 tablet_bootstrap.cc:492] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
W20260811 16:03:14.196363 13789 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:14.196980 13960 ts_tablet_manager.cc:1397] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.141s	user 0.041s	sys 0.028s
I20260811 16:03:14.199071 14010 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.199970 14010 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.200596 13960 raft_consensus.cc:348] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.201385 13960 raft_consensus.cc:374] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.201664 13960 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.202564 13960 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.207520 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.211310 13960 ts_tablet_manager.cc:1428] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260811 16:03:14.220449 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.220975 13960 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:14.212569 14069 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.223794 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.223513 14069 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.221398 13742 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:14.174816 13961 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.222184 14010 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:14.224221 14072 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.226639 13824 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:14.230932 14072 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:14.231979 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:14.232267 14072 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.233599 14010 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.233364 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.234123 14010 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.234665 14010 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.236446 13961 ts_tablet_manager.cc:1428] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260811 16:03:14.238169 13961 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:14.251840 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.249550 14029 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.236560 14069 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.261831 13960 tablet_bootstrap.cc:654] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.270876 13959 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.271610 13959 ts_tablet_manager.cc:1397] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.015s
W20260811 16:03:14.275441 13787 leader_election.cc:341] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.276320 13959 raft_consensus.cc:348] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.277329 13959 raft_consensus.cc:374] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.277663 13959 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.278499 13959 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.286048 13959 ts_tablet_manager.cc:1428] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260811 16:03:14.292279 13961 tablet_bootstrap.cc:654] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.296200 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.296963 13909 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.300887 14157 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.301648 14157 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.306134 14157 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.315801 13959 tablet_bootstrap.cc:492] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
W20260811 16:03:14.335484 13789 leader_election.cc:341] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.336041 13789 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.338512 13630 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.339844 14072 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.342850 14010 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.347431 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.349566 13909 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:14.349884 13907 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:14.353214 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.354244 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.353518 13960 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:14.355088 14157 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.355697 13960 ts_tablet_manager.cc:1397] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.023s
I20260811 16:03:14.355676 14157 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.356330 14157 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.366079 13961 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:14.366700 13961 ts_tablet_manager.cc:1397] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.007s
I20260811 16:03:14.371577 13960 raft_consensus.cc:348] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.376329 14010 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:14.376579 13960 raft_consensus.cc:374] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.376926 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:14.373431 14157 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.377597 13744 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.379347 14157 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.377628 13959 tablet_bootstrap.cc:654] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.377139 13960 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.381443 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.382927 13906 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.385283 13959 tablet_bootstrap.cc:492] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.385807 13959 ts_tablet_manager.cc:1397] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.006s
I20260811 16:03:14.381487 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.387687 13825 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:14.388047 13789 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:14.388299 13744 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:14.388368 13959 raft_consensus.cc:348] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.389143 13959 raft_consensus.cc:374] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.389400 13959 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.389482 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.389971 13959 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.390360 14010 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.390858 14010 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:03:14.374817 13709 leader_election.cc:341] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.391669 14010 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.392786 14157 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.393249 14157 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.395102 13742 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.399533 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.395125 14157 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.403460 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.404361 13824 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
W20260811 16:03:14.405500 13709 leader_election.cc:341] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.407243 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.408565 14067 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:03:14.410174 14067 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.410490 14067 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:14.410990 13959 ts_tablet_manager.cc:1428] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260811 16:03:14.412117 13959 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.381410 13961 raft_consensus.cc:348] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.415413 13961 raft_consensus.cc:374] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.415752 13961 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.409379 13960 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.406299 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.417284 13907 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:14.419303 13626 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:14.421569 13825 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:14.425715 13960 ts_tablet_manager.cc:1428] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.006s
I20260811 16:03:14.426664 13960 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:14.426246 14067 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.418529 13961 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.429773 13961 ts_tablet_manager.cc:1428] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260811 16:03:14.430583 14067 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.430667 13961 tablet_bootstrap.cc:492] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:14.440317 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.436496 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.440977 13907 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:14.441468 13825 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:14.444110 13906 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:14.445250 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:14.448190 14180 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:14.449364 14067 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.450300 13907 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:03:14.450505 14067 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:14.451372 13960 tablet_bootstrap.cc:654] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.451543 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.453083 14157 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:14.454197 14157 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:14.456419 14157 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.474074 13959 tablet_bootstrap.cc:654] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.475427 13961 tablet_bootstrap.cc:654] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.466078 14067 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.492782 13960 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:14.493317 13960 ts_tablet_manager.cc:1397] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.008s
I20260811 16:03:14.500034 13960 raft_consensus.cc:348] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.500744 13960 raft_consensus.cc:374] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.500922 13960 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.503572 13960 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.539534 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:03:14.545264 13960 ts_tablet_manager.cc:1428] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.025s
I20260811 16:03:14.548148 13959 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.548646 13959 ts_tablet_manager.cc:1397] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.137s	user 0.007s	sys 0.010s
I20260811 16:03:14.546535 13961 tablet_bootstrap.cc:492] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:14.551532 13961 ts_tablet_manager.cc:1397] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.006s
I20260811 16:03:14.552340 13960 tablet_bootstrap.cc:492] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:14.553323 13627 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.554065 13961 raft_consensus.cc:348] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.554796 13961 raft_consensus.cc:374] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.555653 13627 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 2, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.551064 13959 raft_consensus.cc:348] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.566447 13959 raft_consensus.cc:374] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.566802 13959 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.570554 13959 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.571887 13961 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.572434 13960 tablet_bootstrap.cc:654] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.572647 13961 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.574324 13959 ts_tablet_manager.cc:1428] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260811 16:03:14.575368 13959 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.578872 13961 ts_tablet_manager.cc:1428] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260811 16:03:14.579985 13961 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:14.583456 13959 tablet_bootstrap.cc:654] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.588279 13961 tablet_bootstrap.cc:654] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.593315 14090 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.594100 14090 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.597031 14090 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.598862 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:14.600612 13707 leader_election.cc:341] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.601719 13959 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.602209 13959 ts_tablet_manager.cc:1397] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.008s
I20260811 16:03:14.604954 13959 raft_consensus.cc:348] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.606786 13961 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:14.606755 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.608368 13961 ts_tablet_manager.cc:1397] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.014s
I20260811 16:03:14.605830 13959 raft_consensus.cc:374] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.608553 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:14.608827 13959 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.609989 14192 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.610049 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:14.611094 14090 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.610571 14192 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.611485 14090 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.611392 13961 raft_consensus.cc:348] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.611989 14090 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.612221 13961 raft_consensus.cc:374] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.612653 13961 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.613309 14192 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.613587 13961 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.615773 13961 ts_tablet_manager.cc:1428] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260811 16:03:14.616971 13961 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:14.618438 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:14.622295 13709 leader_election.cc:341] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.619071 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.624536 13907 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:14.625447 13961 tablet_bootstrap.cc:654] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.626855 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:14.628146 14067 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.628499 14067 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.628861 14067 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.629323 14090 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.632302 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.632966 13824 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.635776 14010 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.636492 14010 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.639593 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.640215 13744 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:14.641396 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.642632 14173 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.643116 14173 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.643561 14173 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.645614 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.647867 14010 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:14.649523 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.650774 13825 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
W20260811 16:03:14.647869 13707 leader_election.cc:341] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.654561 14090 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.642468 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:14.656489 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:14.658087 14090 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.639642 13959 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.659515 14090 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:14.662081 14090 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.664985 13959 ts_tablet_manager.cc:1428] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260811 16:03:14.669333 13960 tablet_bootstrap.cc:492] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:14.670512 13960 ts_tablet_manager.cc:1397] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.041s
I20260811 16:03:14.666494 14067 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.673111 13959 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.673991 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.668717 14173 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.674580 13960 raft_consensus.cc:348] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:14.675658 13709 leader_election.cc:341] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.675628 13960 raft_consensus.cc:374] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.676869 13960 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.677802 13960 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.680853 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:14.681718 13744 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.689529 13744 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:14.691217 14067 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.693245 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.693565 14173 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:14.693956 13824 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.699553 13959 tablet_bootstrap.cc:654] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.701077 13630 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.694555 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.691455 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.704059 14173 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.698050 14010 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.704259 13907 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.704655 14173 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:14.704741 14010 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.705716 14173 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.698815 13960 ts_tablet_manager.cc:1428] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260811 16:03:14.707453 14180 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.707609 14010 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:14.708001 14180 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.709395 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.711979 14090 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.712383 13824 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:14.712561 14090 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.715088 13961 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:14.715595 13961 ts_tablet_manager.cc:1397] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.025s
I20260811 16:03:14.715499 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.716311 13744 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:14.714839 14090 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.717906 13960 tablet_bootstrap.cc:492] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:14.718905 13787 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.719798 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.720913 13906 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:14.721944 14179 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.722427 14179 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.722857 14179 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.723616 13959 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.724201 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.725099 13959 ts_tablet_manager.cc:1397] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.007s
I20260811 16:03:14.727746 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:14.727854 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.720032 14180 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.727854 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.729673 13906 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:14.732796 14090 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:14.733304 14090 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:14.733197 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.733744 14090 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.734786 13960 tablet_bootstrap.cc:654] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.734845 14010 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.735749 13959 raft_consensus.cc:348] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.736747 13959 raft_consensus.cc:374] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.737165 13959 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.738054 13959 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.745934 14090 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.748878 13961 raft_consensus.cc:348] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.749752 13961 raft_consensus.cc:374] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.750093 13961 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.750984 13961 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.752305 13959 ts_tablet_manager.cc:1428] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260811 16:03:14.753613 13959 tablet_bootstrap.cc:492] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.757930 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:14.762161 14179 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.761119 13907 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:14.764613 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:14.765257 13961 ts_tablet_manager.cc:1428] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.005s
I20260811 16:03:14.765605 14067 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.767227 13961 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:14.766264 14067 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:14.768394 13824 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:14.769356 14090 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.777232 13960 tablet_bootstrap.cc:492] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:14.777681 13960 ts_tablet_manager.cc:1397] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.007s
I20260811 16:03:14.778299 14067 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.779597 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:14.779906 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.780584 14180 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.783249 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:14.784338 13742 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:14.784088 14180 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.784812 13630 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:14.786562 14180 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.783612 13907 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.781971 14072 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.781096 14179 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.790650 13961 tablet_bootstrap.cc:654] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.791395 14072 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.796039 13959 tablet_bootstrap.cc:654] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.797402 14072 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.806262 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.807220 13907 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:14.808476 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:14.809301 14090 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:14.794790 13960 raft_consensus.cc:348] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.809871 13960 raft_consensus.cc:374] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.809796 14090 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:14.810227 13960 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.811494 14173 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.810956 14090 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.811959 14173 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.813947 14173 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:14.814808 14157 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.815500 13959 tablet_bootstrap.cc:492] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.815315 14157 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.823443 14157 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.809046 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.824805 13959 ts_tablet_manager.cc:1397] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.071s	user 0.005s	sys 0.013s
I20260811 16:03:14.825745 13628 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.828636 13959 raft_consensus.cc:348] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.829510 13959 raft_consensus.cc:374] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.829850 13959 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.830634 13959 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.832502 13959 ts_tablet_manager.cc:1428] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260811 16:03:14.833544 13959 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.830953 13787 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.835216 14206 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260811 16:03:14.836570 13787 leader_election.cc:341] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:14.837260 13787 leader_election.cc:341] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.841212 13961 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:14.841738 13961 ts_tablet_manager.cc:1397] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.005s
I20260811 16:03:14.810878 13960 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.816744 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.817451 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.843094 13824 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:14.846745 13871 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.847909 14173 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:14.850960 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.853206 13959 tablet_bootstrap.cc:654] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.856529 13960 ts_tablet_manager.cc:1428] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260811 16:03:14.856882 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.853595 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.857797 13960 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:14.858137 13961 raft_consensus.cc:348] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.858865 13961 raft_consensus.cc:374] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.859237 13961 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.859498 14208 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.859858 13961 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.862149 13961 ts_tablet_manager.cc:1428] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.008s
I20260811 16:03:14.861933 13628 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:14.863047 13961 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:14.865016 14072 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.865733 14072 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.868144 14072 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:14.866263 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:14.873332 13707 leader_election.cc:341] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.875696 14157 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.879046 14157 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:14.874073 13789 leader_election.cc:341] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.880735 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.881430 14157 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:14.881971 13789 leader_election.cc:341] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.882421 13789 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.883217 14208 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.883239 14010 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.885542 14173 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.887722 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:14.890591 13908 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:03:14.893013 14094 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:14.883189 14072 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.897706 13960 tablet_bootstrap.cc:654] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.897531 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:14.904699 13709 leader_election.cc:341] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.905191 13709 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:03:14.905391 13707 leader_election.cc:341] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.906517 14067 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:14.908339 14067 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.923883 14067 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:03:14.929514 13959 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:14.930255 13959 ts_tablet_manager.cc:1397] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.010s
I20260811 16:03:14.933715 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:14.935042 13908 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:14.936335 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:14.941111 13907 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:14.958515 13709 leader_election.cc:341] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:14.958168 13959 raft_consensus.cc:348] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.959343 13959 raft_consensus.cc:374] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:14.959242 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:14.960487 14191 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:14.959735 13959 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:14.962031 13959 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:14.968495 13961 tablet_bootstrap.cc:654] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:14.970779 13959 ts_tablet_manager.cc:1428] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.006s
I20260811 16:03:14.972129 13959 tablet_bootstrap.cc:492] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:14.979249 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:14.944617 14094 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:14.980456 14072 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.032428 13961 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:15.033159 13961 ts_tablet_manager.cc:1397] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.170s	user 0.017s	sys 0.003s
I20260811 16:03:15.002698 14094 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.046506 14180 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260811 16:03:15.059494 14217 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260811 16:03:15.063354 13827 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:03:15.063902 14094 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:15.072703 13959 tablet_bootstrap.cc:654] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:15.079419 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:15.080154 13740 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:15.084571 14157 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:15.085878 14191 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:15.086371 14191 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.088498 14191 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:15.093287 13961 raft_consensus.cc:348] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.094246 13961 raft_consensus.cc:374] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:15.094579 13961 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:15.095326 13961 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.096386 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:15.099751 13961 ts_tablet_manager.cc:1428] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
W20260811 16:03:15.100450 13709 leader_election.cc:341] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:15.107101 13960 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:15.108023 13960 ts_tablet_manager.cc:1397] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.250s	user 0.011s	sys 0.039s
I20260811 16:03:15.100713 13961 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
W20260811 16:03:15.151669 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56103.8us
I20260811 16:03:15.153347 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:15.154536 14222 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:15.155119 14222 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:15.155634 14222 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.162410 14010 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:15.162979 13959 tablet_bootstrap.cc:492] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:15.165071 13959 ts_tablet_manager.cc:1397] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.193s	user 0.020s	sys 0.004s
I20260811 16:03:15.242693 14226 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:15.243520 14226 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.246452 14226 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:15.196441 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:15.260092 13825 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
W20260811 16:03:15.288617 14187 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260811 16:03:15.272831 14222 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.290609 13959 raft_consensus.cc:348] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.296893 13959 raft_consensus.cc:374] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:15.297328 13959 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
W20260811 16:03:15.289289 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 115666us
I20260811 16:03:15.345813 13959 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.327702 14072 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:15.364464 13959 ts_tablet_manager.cc:1428] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.198s	user 0.009s	sys 0.000s
I20260811 16:03:15.366032 13959 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:15.366716 14222 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:03:15.380957 14195 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.101s	user 0.028s	sys 0.039s
I20260811 16:03:15.394788 13960 raft_consensus.cc:348] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:15.395535 13709 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:15.395977 13960 raft_consensus.cc:374] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:15.396392 13960 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:15.397189 13960 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.424196 14157 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260811 16:03:15.379376 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 144303us
I20260811 16:03:15.468855 13909 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.479378 13961 tablet_bootstrap.cc:654] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:15.472470 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:15.491448 13960 ts_tablet_manager.cc:1428] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.383s	user 0.026s	sys 0.021s
I20260811 16:03:15.482558 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:15.488581 13743 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:15.492233 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:15.506572 13959 tablet_bootstrap.cc:654] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:15.511102 14237 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:03:15.550539 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:15.541224 14192 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260811 16:03:15.594895 13960 tablet_bootstrap.cc:492] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
W20260811 16:03:15.616348 13707 leader_election.cc:341] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:15.616964 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:15.626472 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:15.628346 13743 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:15.663923 14234 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:15.655882 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:15.680709 13823 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.680580 14234 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:15.683828 13959 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:15.683998 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:15.684682 13959 ts_tablet_manager.cc:1397] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.319s	user 0.016s	sys 0.016s
I20260811 16:03:15.686597 14222 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:15.694164 14222 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:15.710309 14248 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 16:03:15.706538 14222 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.780457 14234 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:15.781201 14234 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.805509 14180 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:15.805673 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:15.806384 14180 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.806799 13825 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:15.808969 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:15.810012 14248 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:15.809175 14180 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:15.810391 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:15.810423 14248 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:15.811264 13741 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:15.811949 14248 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.813113 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:15.814123 14180 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:15.814493 14180 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:15.814800 14180 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.816047 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:15.817571 13789 leader_election.cc:341] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:15.824043 13961 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:15.824676 13961 ts_tablet_manager.cc:1397] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.724s	user 0.013s	sys 0.038s
I20260811 16:03:15.828184 13961 raft_consensus.cc:348] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.829149 13961 raft_consensus.cc:374] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:15.829490 13961 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:15.833139 13961 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.834982 13961 ts_tablet_manager.cc:1428] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260811 16:03:15.835361 13960 tablet_bootstrap.cc:700] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent opening tablet: real 0.139s	user 0.044s	sys 0.039s
I20260811 16:03:15.836012 13961 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:15.836364 13960 tablet_bootstrap.cc:654] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:15.838955 14191 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:15.842202 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:15.846073 13823 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:15.830613 14180 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.848785 14234 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:15.852192 13959 raft_consensus.cc:348] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.853440 13959 raft_consensus.cc:374] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:15.853783 13959 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:15.856046 13959 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.859431 14180 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:15.863405 14248 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:15.912351 13961 tablet_bootstrap.cc:654] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:15.912194 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:15.916543 14248 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:15.939742 13874 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:15.941780 14235 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:15.944464 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:15.945623 13743 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:15.956575 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:15.957736 13823 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:15.959714 13789 leader_election.cc:341] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:15.960647 13707 leader_election.cc:341] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:15.973124 14235 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:15.984023 13959 ts_tablet_manager.cc:1428] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.299s	user 0.007s	sys 0.006s
I20260811 16:03:15.998687 13960 tablet_bootstrap.cc:492] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.002117 13959 tablet_bootstrap.cc:492] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.003036 13960 ts_tablet_manager.cc:1397] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.408s	user 0.073s	sys 0.053s
I20260811 16:03:16.007638 13960 raft_consensus.cc:348] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.008745 13960 raft_consensus.cc:374] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.009079 13960 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.010106 13960 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.022019 13961 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.022733 13961 ts_tablet_manager.cc:1397] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.187s	user 0.017s	sys 0.004s
I20260811 16:03:16.025661 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.028836 13961 raft_consensus.cc:348] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.029740 13961 raft_consensus.cc:374] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.030036 13961 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.021050 13823 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:16.030758 13961 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.058715 13627 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:16.066169 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.067433 14237 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:16.067960 14237 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:16.068467 13961 ts_tablet_manager.cc:1428] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260811 16:03:16.069056 14237 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:16.073348 13707 leader_election.cc:341] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.069809 13961 tablet_bootstrap.cc:492] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.050086 13743 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:16.090585 13960 ts_tablet_manager.cc:1428] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260811 16:03:16.092067 13960 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.099922 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:16.101207 14072 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:16.103237 14072 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:16.106302 14072 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.117673 14232 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.118502 14232 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.156193 13959 tablet_bootstrap.cc:654] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.157300 13961 tablet_bootstrap.cc:654] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.173092 14232 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.172966 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:16.176015 13871 leader_election.cc:341] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.177688 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:16.179883 13874 leader_election.cc:341] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.180374 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:16.180583 13960 tablet_bootstrap.cc:654] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.182088 14232 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:16.186685 13960 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.187490 13960 ts_tablet_manager.cc:1397] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.000s
I20260811 16:03:16.187507 13961 tablet_bootstrap.cc:492] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.188252 13961 ts_tablet_manager.cc:1397] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.119s	user 0.017s	sys 0.006s
I20260811 16:03:16.190871 13960 raft_consensus.cc:348] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.191037 13961 raft_consensus.cc:348] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.192004 13960 raft_consensus.cc:374] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.192047 13961 raft_consensus.cc:374] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.192659 13960 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.192692 13961 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.193720 13960 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.193791 13961 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.195420 13959 tablet_bootstrap.cc:492] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.195894 13959 ts_tablet_manager.cc:1397] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.194s	user 0.018s	sys 0.005s
I20260811 16:03:16.196599 13960 ts_tablet_manager.cc:1428] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260811 16:03:16.196857 13961 ts_tablet_manager.cc:1428] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:03:16.197873 13960 tablet_bootstrap.cc:492] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.198318 13961 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.198671 13959 raft_consensus.cc:348] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.199465 13959 raft_consensus.cc:374] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.199738 13959 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.200492 13959 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.203605 13959 ts_tablet_manager.cc:1428] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260811 16:03:16.205282 13960 tablet_bootstrap.cc:654] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.207329 13824 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.209884 13961 tablet_bootstrap.cc:654] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.218083 13960 tablet_bootstrap.cc:492] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.218686 13960 ts_tablet_manager.cc:1397] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260811 16:03:16.223310 13959 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.234103 13959 tablet_bootstrap.cc:654] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.240031 14232 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:16.221554 13960 raft_consensus.cc:348] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.245124 13960 raft_consensus.cc:374] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.245472 13960 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.246233 13960 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.248615 13960 ts_tablet_manager.cc:1428] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260811 16:03:16.250705 13960 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.260526 13959 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.261065 13959 ts_tablet_manager.cc:1397] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260811 16:03:16.261130 13961 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.261683 13961 ts_tablet_manager.cc:1397] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.033s
I20260811 16:03:16.264353 13960 tablet_bootstrap.cc:654] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.264143 13961 raft_consensus.cc:348] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.264011 13959 raft_consensus.cc:348] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.264879 13961 raft_consensus.cc:374] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.264983 13959 raft_consensus.cc:374] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.265230 13961 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.265378 13959 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.260725 13628 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:16.265939 13961 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.266435 13959 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.268471 13961 ts_tablet_manager.cc:1428] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260811 16:03:16.269345 13959 ts_tablet_manager.cc:1428] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260811 16:03:16.269688 13961 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.270686 13959 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.276829 13961 tablet_bootstrap.cc:654] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.280853 13959 tablet_bootstrap.cc:654] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.284219 14226 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:16.288404 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:16.307274 13961 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.307757 13961 ts_tablet_manager.cc:1397] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.012s
I20260811 16:03:16.310570 13961 raft_consensus.cc:348] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.311406 13961 raft_consensus.cc:374] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.311695 13961 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.312359 13961 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.313212 13960 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.313681 13960 ts_tablet_manager.cc:1397] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.022s
I20260811 16:03:16.313841 13959 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.314275 13959 ts_tablet_manager.cc:1397] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.003s
I20260811 16:03:16.314481 13961 ts_tablet_manager.cc:1428] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260811 16:03:16.315584 13961 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.316418 13960 raft_consensus.cc:348] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.317152 13960 raft_consensus.cc:374] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.317430 13960 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.322459 13961 tablet_bootstrap.cc:654] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.321220 13959 raft_consensus.cc:348] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.323292 13959 raft_consensus.cc:374] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.323072 13960 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.323611 13959 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.324790 14237 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.324635 13959 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.325456 13960 ts_tablet_manager.cc:1428] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260811 16:03:16.325243 14237 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.326462 13960 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.330061 14237 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.331986 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.334331 13959 ts_tablet_manager.cc:1428] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
W20260811 16:03:16.336655 13709 leader_election.cc:341] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.337765 13959 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.341496 13960 tablet_bootstrap.cc:654] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.334945 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.346333 13909 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.351111 13707 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:16.355825 14013 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.356298 14013 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.356745 14013 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.394420 13959 tablet_bootstrap.cc:654] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.398447 13961 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.399020 13961 ts_tablet_manager.cc:1397] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.084s	user 0.029s	sys 0.008s
I20260811 16:03:16.403322 13960 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.405315 13961 raft_consensus.cc:348] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.406100 13961 raft_consensus.cc:374] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.406387 13961 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.407042 13961 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.409294 13961 ts_tablet_manager.cc:1428] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260811 16:03:16.409756 13960 ts_tablet_manager.cc:1397] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.012s
I20260811 16:03:16.411598 14013 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.412385 13960 raft_consensus.cc:348] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.413188 13960 raft_consensus.cc:374] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.413528 13960 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.416208 13961 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.416301 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.416963 13909 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.419865 13960 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.424517 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:03:16.426072 13709 leader_election.cc:341] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.428222 13960 ts_tablet_manager.cc:1428] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260811 16:03:16.428635 13961 tablet_bootstrap.cc:654] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.432057 13960 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.430240 13909 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:16.441454 13959 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.442016 13959 ts_tablet_manager.cc:1397] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.000s
I20260811 16:03:16.437901 14013 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.444778 13707 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:16.445847 14237 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:16.446339 14237 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:16.447257 14237 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.447819 13959 raft_consensus.cc:348] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.448561 13959 raft_consensus.cc:374] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.448834 13959 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.449719 13959 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.451287 13960 tablet_bootstrap.cc:654] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.451959 13959 ts_tablet_manager.cc:1428] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260811 16:03:16.453104 13959 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.458763 13959 tablet_bootstrap.cc:654] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.467067 14235 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.467677 14235 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.470007 13961 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.470517 13961 ts_tablet_manager.cc:1397] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260811 16:03:16.471992 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.473201 13742 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:16.473110 13961 raft_consensus.cc:348] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.473850 13961 raft_consensus.cc:374] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.474125 13961 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.474659 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.474776 13961 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.476344 14235 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.474960 13628 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:16.479579 13961 ts_tablet_manager.cc:1428] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260811 16:03:16.482088 13960 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.482575 13960 ts_tablet_manager.cc:1397] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.021s
I20260811 16:03:16.485082 13959 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.485581 13959 ts_tablet_manager.cc:1397] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.007s
I20260811 16:03:16.485338 13960 raft_consensus.cc:348] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.486073 13960 raft_consensus.cc:374] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.486354 13960 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.487006 13960 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.487881 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:16.488461 13959 raft_consensus.cc:348] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.489058 14235 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.489151 13959 raft_consensus.cc:374] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.489614 13960 ts_tablet_manager.cc:1428] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260811 16:03:16.489578 13959 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.490835 13960 tablet_bootstrap.cc:492] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.490473 13959 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.493162 13961 tablet_bootstrap.cc:492] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.497149 13959 ts_tablet_manager.cc:1428] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260811 16:03:16.498277 13959 tablet_bootstrap.cc:492] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.502142 13961 tablet_bootstrap.cc:654] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.503543 14235 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:16.503953 13959 tablet_bootstrap.cc:654] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.509611 13960 tablet_bootstrap.cc:654] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.547369 14235 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.548182 14235 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:16.549676 13707 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:16.565822 14242 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.567327 14237 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.567977 14237 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.566673 14242 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.571605 14013 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.572407 14013 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.579340 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.585402 14237 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.586108 14235 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.583195 13825 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.587527 14242 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.583076 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.587581 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.588392 13742 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:16.588346 13823 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.589136 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.590298 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.591439 14246 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.591910 14246 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.592291 14246 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.593163 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.595470 13961 tablet_bootstrap.cc:492] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.595726 14237 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.595986 13961 ts_tablet_manager.cc:1397] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.005s
I20260811 16:03:16.596079 14237 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.596451 14237 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.599228 14226 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.599661 14226 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.600000 14226 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.582212 14013 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.598834 13961 raft_consensus.cc:348] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.601902 13961 raft_consensus.cc:374] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.603233 14090 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:16.603554 13961 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.604902 14234 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.605049 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.605407 14234 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.606027 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.606616 13742 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:16.607853 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.608677 14242 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.607817 14234 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.609045 14242 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.609620 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.604502 13961 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.609656 14242 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.612524 13961 ts_tablet_manager.cc:1428] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
W20260811 16:03:16.612460 13709 leader_election.cc:341] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.614252 13960 tablet_bootstrap.cc:492] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.615067 13960 ts_tablet_manager.cc:1397] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.125s	user 0.026s	sys 0.046s
I20260811 16:03:16.620069 13961 tablet_bootstrap.cc:492] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.622246 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.630261 14232 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.634881 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.630928 14232 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.636812 14222 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.636921 13960 raft_consensus.cc:348] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.637387 14222 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.638195 13960 raft_consensus.cc:374] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.638307 13959 tablet_bootstrap.cc:492] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.638700 13960 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.638908 13959 ts_tablet_manager.cc:1397] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.141s	user 0.024s	sys 0.042s
I20260811 16:03:16.641350 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.641557 14222 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.642668 13960 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.643663 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.644412 13743 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:16.645228 13960 ts_tablet_manager.cc:1428] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260811 16:03:16.645768 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.646595 14222 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.646944 14222 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.647276 14222 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.637661 14232 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.611991 14237 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.650482 14226 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.655882 13960 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.666118 13909 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:03:16.667378 13707 leader_election.cc:341] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.667637 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:16.668255 13825 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.666754 14237 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.676493 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.677307 13821 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
W20260811 16:03:16.678215 13871 leader_election.cc:341] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.678562 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.679292 13827 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:16.680230 14233 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.680704 14233 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.682487 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.683239 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.680876 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.684113 13902 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.684445 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.685138 13743 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:16.682902 14233 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.688450 13959 raft_consensus.cc:348] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.689043 13959 raft_consensus.cc:374] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.689294 13959 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.692684 13959 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.696967 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.698583 14180 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.691548 14234 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.670410 14246 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.707341 14234 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.725034 13960 tablet_bootstrap.cc:654] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.699060 14180 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.712863 14013 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:03:16.707384 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:16.710101 13825 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:16.708964 14242 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.739848 13959 ts_tablet_manager.cc:1428] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.004s
I20260811 16:03:16.732898 14072 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.749888 13961 tablet_bootstrap.cc:654] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.750123 14072 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.750555 14072 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.736754 14233 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260811 16:03:16.739166 14013 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.760296 14234 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.775390 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:16.776252 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.761474 14226 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.765448 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.775247 13824 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:16.785367 13959 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:16.779047 14299 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.791718 14299 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.792160 14299 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.791739 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:16.775316 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.794288 13741 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.794461 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:16.798615 14222 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.801016 14222 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.802733 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:16.782903 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.796381 14246 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.811717 14305 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:16.786705 13823 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.812683 14242 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.815464 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.815801 14180 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.816200 13906 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:16.819247 13902 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:16.818727 14305 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:16.834496 13709 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.835233 14013 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.835646 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.835178 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.835841 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.836246 13901 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.836150 14013 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.836675 13909 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:16.836961 14013 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.836479 13907 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:16.840085 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:16.838753 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.841739 14242 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.842157 14242 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.842489 14242 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:16.844141 13709 leader_election.cc:341] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.838784 14013 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.849439 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:16.851814 13961 tablet_bootstrap.cc:492] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:16.852427 13961 ts_tablet_manager.cc:1397] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.236s	user 0.014s	sys 0.008s
I20260811 16:03:16.850283 13821 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.823652 14072 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.855073 14305 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.857892 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:16.866109 13742 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.867554 13827 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:16.833937 14303 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.083s
I20260811 16:03:16.868782 13741 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:16.869889 14072 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.873317 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.874195 13906 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:16.874927 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:16.876639 14237 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:16.877018 14237 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:16.877358 14237 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.877916 14242 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:16.879642 13707 leader_election.cc:341] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.885321 14237 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.881069 14242 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.882193 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.887391 13906 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.887595 14237 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.888633 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:03:16.890937 13709 leader_election.cc:341] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.885272 13901 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:16.901280 13961 raft_consensus.cc:348] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.901990 13961 raft_consensus.cc:374] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.902288 13961 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.902823 13961 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.893266 14299 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.903390 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:16.912734 13906 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:16.906983 13742 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:16.918627 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:16.919023 13961 ts_tablet_manager.cc:1428] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.002s
I20260811 16:03:16.920723 13821 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:16.921356 13959 tablet_bootstrap.cc:654] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.927029 13961 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:16.921787 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:16.927778 13743 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:16.928218 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:16.925143 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:16.934517 14242 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:16.935088 14242 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:16.936110 14242 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.929834 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:16.922827 13960 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:16.945226 13960 ts_tablet_manager.cc:1397] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.290s	user 0.020s	sys 0.025s
I20260811 16:03:16.945436 13742 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:16.932267 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:16.950388 14222 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:16.933461 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:16.950910 14222 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.938715 13901 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.941351 13961 tablet_bootstrap.cc:654] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:16.939679 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:16.954159 14237 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:16.956653 13821 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:16.957118 14237 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:16.924564 14013 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:16.959208 13707 leader_election.cc:341] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:16.958128 14237 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.959872 13741 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:16.931056 14299 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.961215 14013 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:16.948573 13960 raft_consensus.cc:348] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.966522 13960 raft_consensus.cc:374] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:16.966933 13960 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:16.966395 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:16.968482 14222 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:16.969293 13960 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:16.973681 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:16.978456 13960 ts_tablet_manager.cc:1428] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260811 16:03:16.979537 13960 tablet_bootstrap.cc:492] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:16.984449 13959 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:16.984970 13959 ts_tablet_manager.cc:1397] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.211s	user 0.015s	sys 0.004s
I20260811 16:03:16.974037 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:16.997821 13821 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:17.010874 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:17.030290 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:17.036621 13740 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.037032 14222 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:17.037519 13961 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:17.037628 14222 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:17.012508 14013 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.038115 13961 ts_tablet_manager.cc:1397] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.010s
I20260811 16:03:17.028990 13960 tablet_bootstrap.cc:654] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.011864 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:17.038631 14222 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.042366 13961 raft_consensus.cc:348] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.043358 13961 raft_consensus.cc:374] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.043668 13961 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.044703 13961 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:17.046438 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87295.4us
I20260811 16:03:17.047813 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.048889 14308 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.050143 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.051326 14303 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.055902 13901 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:17.062613 13906 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.066562 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:17.067534 13902 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:17.008091 13630 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:17.017035 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:03:17.071931 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55037.4us
I20260811 16:03:17.072886 13959 raft_consensus.cc:348] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.073958 13959 raft_consensus.cc:374] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.074955 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:17.074311 13959 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.078428 13959 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.076221 14299 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:17.077364 14226 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:17.097944 13961 ts_tablet_manager.cc:1428] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.002s
I20260811 16:03:17.098968 13959 ts_tablet_manager.cc:1428] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.003s
I20260811 16:03:17.101668 14299 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:17.102222 14226 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:17.113090 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.116056 14226 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.123385 14306 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.124190 14306 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.131958 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:17.132647 14306 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.103976 14299 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.141496 13959 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:17.143165 14307 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:17.143781 14307 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:17.145869 13961 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:17.144784 14307 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.158424 13960 tablet_bootstrap.cc:492] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:17.159356 13960 ts_tablet_manager.cc:1397] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.180s	user 0.025s	sys 0.023s
I20260811 16:03:17.173974 13959 tablet_bootstrap.cc:654] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.192484 13707 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:17.194137 13961 tablet_bootstrap.cc:654] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.192689 13740 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:03:17.196702 14331 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.200126 14299 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.201351 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.204241 13827 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.203521 14299 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.213496 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:17.215046 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:17.216647 13709 leader_election.cc:341] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:17.217221 13871 leader_election.cc:341] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.219336 14232 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:03:17.226569 13707 leader_election.cc:341] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.227134 13707 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:17.232894 14299 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:17.233326 14331 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.234508 14331 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:17.245389 14306 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:17.248214 13960 raft_consensus.cc:348] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.249379 13960 raft_consensus.cc:374] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.250790 13960 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.253309 13960 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.257169 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.267643 13628 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:17.266655 13627 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:03:17.279203 13874 leader_election.cc:341] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.279677 13874 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.280375 14299 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.285009 13960 ts_tablet_manager.cc:1428] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.000s
I20260811 16:03:17.286067 13960 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:17.291054 13961 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:17.291719 13961 ts_tablet_manager.cc:1397] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.179s	user 0.007s	sys 0.011s
I20260811 16:03:17.294690 13961 raft_consensus.cc:348] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.296686 13961 raft_consensus.cc:374] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.297084 13961 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.298035 13961 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.295960 13960 tablet_bootstrap.cc:654] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.305860 13961 ts_tablet_manager.cc:1428] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260811 16:03:17.307924 13961 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:17.309669 13959 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:17.310189 13959 ts_tablet_manager.cc:1397] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.169s	user 0.037s	sys 0.034s
I20260811 16:03:17.313244 13959 raft_consensus.cc:348] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.313989 13959 raft_consensus.cc:374] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.314311 13959 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.315021 13959 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.317106 13960 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:17.317625 13960 ts_tablet_manager.cc:1397] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260811 16:03:17.318677 13959 ts_tablet_manager.cc:1428] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260811 16:03:17.319885 13959 tablet_bootstrap.cc:492] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:17.320256 13961 tablet_bootstrap.cc:654] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.319994 13960 raft_consensus.cc:348] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.320779 13960 raft_consensus.cc:374] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.321063 13960 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.321851 13960 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.324249 13960 ts_tablet_manager.cc:1428] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260811 16:03:17.325683 13960 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:17.324344 13630 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:17.334017 13960 tablet_bootstrap.cc:654] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.333899 13630 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:17.348906 14299 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.348862 13628 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:17.347114 14331 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260811 16:03:17.354012 13628 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:17.351460 14299 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.364054 13959 tablet_bootstrap.cc:654] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.371572 14299 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:17.372344 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.371418 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:17.374251 13874 leader_election.cc:341] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.376322 14242 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:03:17.380215 13871 leader_election.cc:341] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.380686 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.384948 14299 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.392630 13961 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:17.393213 13961 ts_tablet_manager.cc:1397] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.040s
I20260811 16:03:17.395987 13961 raft_consensus.cc:348] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.396836 13961 raft_consensus.cc:374] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.397123 13961 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.397814 13961 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.399549 13961 ts_tablet_manager.cc:1428] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260811 16:03:17.400660 13961 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:17.404484 13960 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:17.405022 13960 ts_tablet_manager.cc:1397] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.007s
I20260811 16:03:17.408217 13960 raft_consensus.cc:348] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.409035 13960 raft_consensus.cc:374] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.409346 13960 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.410027 13960 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.412629 13960 ts_tablet_manager.cc:1428] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260811 16:03:17.413709 13960 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:17.422501 13960 tablet_bootstrap.cc:654] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.427835 13961 tablet_bootstrap.cc:654] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.433399 14308 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:17.439463 13960 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:17.440085 13960 ts_tablet_manager.cc:1397] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260811 16:03:17.444720 14307 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:17.448460 13960 raft_consensus.cc:348] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.449337 13960 raft_consensus.cc:374] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.449739 13960 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.450541 13960 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.459548 13960 ts_tablet_manager.cc:1428] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260811 16:03:17.460703 13960 tablet_bootstrap.cc:492] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:17.467837 13960 tablet_bootstrap.cc:654] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:17.470655 13707 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:17.474819 13961 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:17.475487 13961 ts_tablet_manager.cc:1397] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.032s
I20260811 16:03:17.446166 13959 tablet_bootstrap.cc:492] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:17.479564 13959 ts_tablet_manager.cc:1397] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.008s
I20260811 16:03:17.484869 13961 raft_consensus.cc:348] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.485795 13961 raft_consensus.cc:374] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.485227 14303 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.486754 13961 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.487262 14303 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.487720 13961 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.489765 13959 raft_consensus.cc:348] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.490496 13959 raft_consensus.cc:374] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.490767 13959 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.491622 13961 ts_tablet_manager.cc:1428] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260811 16:03:17.491430 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:17.492519 13743 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:17.493108 13961 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:17.495671 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:17.496951 14304 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:17.497443 14304 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:17.497864 14304 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.498420 13959 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.500756 13959 ts_tablet_manager.cc:1428] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260811 16:03:17.501854 13959 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:17.514492 14299 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.475423 14305 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260811 16:03:17.516999 14232 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:17.526727 14304 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.533000 14226 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 16:03:17.539279 13960 tablet_bootstrap.cc:492] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:17.539109 14307 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.539829 13960 ts_tablet_manager.cc:1397] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.020s
I20260811 16:03:17.540005 14307 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.542135 14307 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.542423 13960 raft_consensus.cc:348] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.548674 13821 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.515054 14299 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.550549 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.551618 14303 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.553128 13960 raft_consensus.cc:374] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.553625 13960 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.553941 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:17.554045 13709 leader_election.cc:341] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.554682 13906 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:17.554849 13960 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.557677 13960 ts_tablet_manager.cc:1428] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260811 16:03:17.557511 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:17.558100 13743 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.558702 13960 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:17.562520 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:17.563203 13906 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:17.568501 13707 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:17.570648 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:17.571537 14305 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:17.571944 14305 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:17.572258 14305 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.589758 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:17.590377 13906 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.592476 13961 tablet_bootstrap.cc:654] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.596568 13906 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:17.597779 13959 tablet_bootstrap.cc:654] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.597663 13789 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:17.599637 14308 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:17.601084 14308 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:17.601159 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.601984 14308 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.605870 13743 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:17.593619 14299 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:17.589473 14304 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.609894 14090 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:17.611280 14328 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:17.614308 13874 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.619645 14328 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.620622 14305 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.640451 14246 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.641043 14246 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.642426 14305 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.642989 14246 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.652875 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:17.653517 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:17.653661 13906 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.653759 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.654357 13823 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:17.656001 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:17.657387 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:17.660046 14234 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:17.660431 14234 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:17.660796 14234 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:17.667327 13709 leader_election.cc:341] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.667992 14232 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:17.671550 14234 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.673915 14234 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:17.677299 13707 leader_election.cc:341] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.684618 13906 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:17.682482 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:17.692620 13707 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:03:17.694149 14013 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:17.694881 14013 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:17.698693 13960 tablet_bootstrap.cc:654] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:17.698612 13825 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:17.696030 14013 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.699326 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:17.725244 14232 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.708806 14234 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
W20260811 16:03:17.750809 13707 leader_election.cc:341] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.699852 14328 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260811 16:03:17.751719 14232 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:17.847409 14364 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260811 16:03:17.848990 14232 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:17.822326 14242 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:17.852600 14242 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.854624 14242 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:17.858343 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:17.861243 13961 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:17.861783 13961 ts_tablet_manager.cc:1397] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.369s	user 0.017s	sys 0.019s
I20260811 16:03:17.874449 13825 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:17.875730 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:17.879830 13961 raft_consensus.cc:348] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.880844 13961 raft_consensus.cc:374] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:17.881202 13961 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:17.881003 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:17.843734 13630 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:03:17.887348 13874 leader_election.cc:341] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.883654 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:17.896898 14013 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 16:03:17.897163 13871 leader_election.cc:341] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:17.897409 14013 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:17.897631 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:17.904660 14013 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.930096 14232 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:17.943099 14242 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:03:17.953373 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:17.943663 14242 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:18.058483 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 161317us
I20260811 16:03:18.054598 13959 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:18.059836 13959 ts_tablet_manager.cc:1397] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.558s	user 0.038s	sys 0.028s
I20260811 16:03:18.054993 13961 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:17.989907 14242 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:18.011281 14361 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260811 16:03:18.064819 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:18.075062 13787 leader_election.cc:341] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.084959 13960 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:18.085347 13960 ts_tablet_manager.cc:1397] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.527s	user 0.011s	sys 0.018s
W20260811 16:03:18.081777 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93505.3us
I20260811 16:03:18.097863 13960 raft_consensus.cc:348] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.098627 13960 raft_consensus.cc:374] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.098878 13960 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.099521 13960 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.107455 13960 ts_tablet_manager.cc:1428] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260811 16:03:18.111112 13960 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:18.115435 13959 raft_consensus.cc:348] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.127880 13960 tablet_bootstrap.cc:654] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:18.128538 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69397.6us
I20260811 16:03:18.127727 13959 raft_consensus.cc:374] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.131084 13959 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.132292 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.133837 13961 ts_tablet_manager.cc:1428] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.272s	user 0.008s	sys 0.003s
I20260811 16:03:18.135308 13961 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
W20260811 16:03:18.139599 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71052.1us
I20260811 16:03:18.136914 13959 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.159291 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:18.147370 13789 leader_election.cc:341] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.160073 13739 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:18.160197 13789 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.161108 14303 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:03:18.163344 13789 leader_election.cc:341] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.148290 13961 tablet_bootstrap.cc:654] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.148355 13959 ts_tablet_manager.cc:1428] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260811 16:03:18.158388 13960 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:18.152019 14378 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260811 16:03:18.169529 13959 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:18.169775 13960 ts_tablet_manager.cc:1397] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.001s
I20260811 16:03:18.175789 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:18.176682 14304 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:18.177029 14304 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:18.177353 14304 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.178656 14242 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:18.185283 14304 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.187336 14304 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.172755 13960 raft_consensus.cc:348] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.195364 13960 raft_consensus.cc:374] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.195663 13960 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.197414 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:18.198079 13743 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.200278 13960 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.218281 13960 ts_tablet_manager.cc:1428] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260811 16:03:18.215857 13628 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.222270 14013 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:18.224850 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:18.235440 13960 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
W20260811 16:03:18.237826 13789 leader_election.cc:341] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.238035 13628 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.259191 13959 tablet_bootstrap.cc:654] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.260046 13960 tablet_bootstrap.cc:654] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.259819 13743 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:18.264565 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:18.265736 14308 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:18.266410 14308 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:18.274801 14308 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.282181 13961 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:18.282754 13961 ts_tablet_manager.cc:1397] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.007s
I20260811 16:03:18.303893 13960 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:18.303638 13961 raft_consensus.cc:348] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.304368 13960 ts_tablet_manager.cc:1397] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.005s
I20260811 16:03:18.304333 13961 raft_consensus.cc:374] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.304729 13961 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.305439 13961 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.308820 13961 ts_tablet_manager.cc:1428] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260811 16:03:18.310245 13961 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:18.314815 13959 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:18.315548 13959 ts_tablet_manager.cc:1397] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.017s
W20260811 16:03:18.315510 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49088.6us
I20260811 16:03:18.318158 14310 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.318717 14310 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.318989 13959 raft_consensus.cc:348] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.320000 13959 raft_consensus.cc:374] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.320272 13959 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.320911 13959 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.321419 14310 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.323562 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:18.324419 13959 ts_tablet_manager.cc:1428] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260811 16:03:18.324697 13742 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:18.328346 13959 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:18.329780 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:18.331002 14310 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:18.331597 14310 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:18.332029 14310 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.342471 13959 tablet_bootstrap.cc:654] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.342933 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.347301 14393 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:03:18.351207 13789 leader_election.cc:341] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.357201 13959 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:18.357776 13959 ts_tablet_manager.cc:1397] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.006s
W20260811 16:03:18.361670 13709 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:18.362914 13960 raft_consensus.cc:348] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.363708 13960 raft_consensus.cc:374] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.363963 13960 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.364099 13626 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.364638 13960 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.367012 14303 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.366632 13959 raft_consensus.cc:348] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.367656 13959 raft_consensus.cc:374] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.367947 13959 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.367676 14303 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.368635 13959 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.370348 13959 ts_tablet_manager.cc:1428] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260811 16:03:18.370771 14303 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.372378 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:18.377645 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.378471 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
W20260811 16:03:18.379041 13787 leader_election.cc:341] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.380419 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.382225 14303 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:18.382690 14303 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:18.383109 14303 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.373697 13961 tablet_bootstrap.cc:654] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.374671 14310 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.375926 13960 ts_tablet_manager.cc:1428] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260811 16:03:18.393926 13960 tablet_bootstrap.cc:492] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:18.394577 14310 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.394771 13959 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:18.400188 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:18.400838 13742 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.406157 13959 tablet_bootstrap.cc:654] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.411079 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:03:18.412838 13789 leader_election.cc:341] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.430282 13742 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:18.431444 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:18.432399 14308 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:18.432951 14308 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:18.433706 13959 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:18.433782 14308 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.434459 13959 ts_tablet_manager.cc:1397] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.014s
I20260811 16:03:18.425575 13960 tablet_bootstrap.cc:654] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.391004 14303 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.440718 14303 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.442385 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:18.443045 13906 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.446230 14303 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.446697 14303 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.449409 14303 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.451560 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.453560 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:03:18.455209 13787 leader_election.cc:341] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.455049 13959 raft_consensus.cc:348] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.456230 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:18.456559 13959 raft_consensus.cc:374] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.457163 13959 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.458436 13959 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.460358 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:18.457779 13628 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.461344 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:18.463109 13961 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:18.463620 13961 ts_tablet_manager.cc:1397] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.000s
W20260811 16:03:18.453593 13789 leader_election.cc:341] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.464934 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:18.465763 14308 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:18.466147 14308 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:18.466504 14308 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.474309 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.475201 14303 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:18.475749 14303 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:18.476595 14303 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.477850 14382 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.478543 14382 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.481534 14378 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.482038 14378 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.482846 13961 raft_consensus.cc:348] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.483649 13961 raft_consensus.cc:374] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.483911 13961 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.485165 13961 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.485574 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:18.487313 13871 leader_election.cc:341] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.488610 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:18.489287 13821 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:18.490128 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:18.491636 13709 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:18.492600 14381 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:18.492805 13961 ts_tablet_manager.cc:1428] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260811 16:03:18.492960 14381 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:18.493348 14381 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.493813 13961 tablet_bootstrap.cc:492] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
W20260811 16:03:18.493666 13874 leader_election.cc:341] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.494275 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.495437 14383 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:18.489473 14378 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:18.502275 13961 tablet_bootstrap.cc:654] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.503832 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.505769 14381 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.507022 14382 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:18.508347 13707 leader_election.cc:341] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.523499 13959 ts_tablet_manager.cc:1428] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.003s
I20260811 16:03:18.523967 13961 tablet_bootstrap.cc:492] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:18.524531 13961 ts_tablet_manager.cc:1397] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.012s
I20260811 16:03:18.527872 13626 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.529313 13961 raft_consensus.cc:348] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.530012 13961 raft_consensus.cc:374] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.530287 13961 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.530922 13961 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.533898 14383 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.534368 14383 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.536919 14383 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:18.539556 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:18.540431 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:18.541210 13871 leader_election.cc:341] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:18.546922 13874 leader_election.cc:341] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.547650 13874 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.549304 14375 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:18.549840 13959 tablet_bootstrap.cc:492] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:18.549243 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:18.550608 13827 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.551235 14381 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.552652 14308 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.555080 13961 ts_tablet_manager.cc:1428] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260811 16:03:18.556679 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:18.557564 13743 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.559015 14308 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.560601 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:18.559087 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:03:18.573982 13789 leader_election.cc:341] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:18.574064 13707 leader_election.cc:341] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.573618 14381 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:18.565492 13961 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:18.560703 13960 tablet_bootstrap.cc:492] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:18.578142 13960 ts_tablet_manager.cc:1397] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.184s	user 0.073s	sys 0.039s
I20260811 16:03:18.580835 13960 raft_consensus.cc:348] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.581542 13960 raft_consensus.cc:374] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.569363 13827 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:18.585309 13959 tablet_bootstrap.cc:654] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.586275 13961 tablet_bootstrap.cc:654] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.589210 13709 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:18.592746 14381 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:18.594012 14381 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:18.595444 14381 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.599370 13902 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.582010 13960 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.573637 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:18.600502 13960 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.605413 13960 ts_tablet_manager.cc:1428] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260811 16:03:18.606738 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:18.607954 14303 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:18.608482 14303 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:18.609444 14303 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.614018 13909 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:18.611990 13960 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:18.618255 14383 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.618778 14383 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.647567 14382 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.648125 14382 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.645823 13626 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.672771 13628 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:18.650592 14382 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.701202 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:18.705803 13709 leader_election.cc:341] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.733220 14393 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:18.741142 13959 tablet_bootstrap.cc:492] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:18.741679 13959 ts_tablet_manager.cc:1397] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.023s
I20260811 16:03:18.748741 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.751333 13959 raft_consensus.cc:348] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.722774 14307 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260811 16:03:18.755012 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:18.757536 13961 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:18.758068 13961 ts_tablet_manager.cc:1397] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.193s	user 0.006s	sys 0.026s
I20260811 16:03:18.752174 13959 raft_consensus.cc:374] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.762008 13959 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.762842 13959 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.752233 13960 tablet_bootstrap.cc:654] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:18.742070 14383 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:18.774765 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:18.785116 13789 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:03:18.772639 13707 leader_election.cc:341] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.786441 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:18.793102 14382 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:18.800745 13959 ts_tablet_manager.cc:1428] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
W20260811 16:03:18.834164 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64778us
I20260811 16:03:18.846700 13959 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:18.849601 14378 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:18.851321 14378 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.856575 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.862411 13961 raft_consensus.cc:348] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.863245 13961 raft_consensus.cc:374] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.863499 13961 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.864249 13961 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:18.883919 13789 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:18.881364 14376 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.879086 14242 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:18.890903 13961 ts_tablet_manager.cc:1428] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.132s	user 0.012s	sys 0.000s
I20260811 16:03:18.909049 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:18.914677 13961 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:18.898420 14378 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:18.917639 14375 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:18.918004 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:18.919824 13874 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.920956 14375 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:18.919324 14376 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.925608 14242 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.926311 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:18.928918 14376 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:18.952558 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:18.953593 13827 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:18.954167 14242 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:18.955502 13874 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:18.956815 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:18.963389 14310 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 16:03:18.964906 13960 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:18.965415 13960 ts_tablet_manager.cc:1397] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.354s	user 0.012s	sys 0.015s
I20260811 16:03:18.970892 14376 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:18.976514 13789 leader_election.cc:341] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:18.983013 13960 raft_consensus.cc:348] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.985649 13960 raft_consensus.cc:374] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:18.986079 13960 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:18.987178 13960 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:18.999452 13960 ts_tablet_manager.cc:1428] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260811 16:03:19.000602 13960 tablet_bootstrap.cc:492] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:19.015167 13959 tablet_bootstrap.cc:654] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.028119 14376 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.028501 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.029733 13960 tablet_bootstrap.cc:654] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.037815 13961 tablet_bootstrap.cc:654] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.043222 13960 tablet_bootstrap.cc:492] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:19.048684 13960 ts_tablet_manager.cc:1397] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260811 16:03:19.051414 14420 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:19.052862 13959 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:19.053370 13959 ts_tablet_manager.cc:1397] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.207s	user 0.021s	sys 0.005s
I20260811 16:03:19.056427 13959 raft_consensus.cc:348] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.057194 13959 raft_consensus.cc:374] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.057463 13959 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
W20260811 16:03:19.058344 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:19.059326 13960 raft_consensus.cc:348] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.060070 13960 raft_consensus.cc:374] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 16:03:19.060176 13787 leader_election.cc:341] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.060349 13960 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.060619 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:19.061332 14242 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.061038 13960 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.062680 13960 ts_tablet_manager.cc:1428] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.000s
I20260811 16:03:19.066373 13961 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:19.066890 13961 ts_tablet_manager.cc:1397] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.005s
I20260811 16:03:19.069545 13961 raft_consensus.cc:348] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.070266 13961 raft_consensus.cc:374] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.070523 13961 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.071290 13961 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.073439 13961 ts_tablet_manager.cc:1428] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260811 16:03:19.074983 13961 tablet_bootstrap.cc:492] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:19.086720 13906 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.085397 13959 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.099361 13959 ts_tablet_manager.cc:1428] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.002s
I20260811 16:03:19.088145 13960 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:19.095407 14242 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:19.111881 14420 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:19.118777 13960 tablet_bootstrap.cc:654] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.087826 13961 tablet_bootstrap.cc:654] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.119895 13959 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
W20260811 16:03:19.105466 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:19.143062 14379 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.143595 14379 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.145617 14379 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.149300 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:19.149080 14382 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:19.150051 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.150712 13744 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:19.152042 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:19.152781 14242 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:19.153143 14242 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:19.153461 14242 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:19.156041 13789 leader_election.cc:341] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.160140 13961 tablet_bootstrap.cc:492] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:19.160920 13961 ts_tablet_manager.cc:1397] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.009s
I20260811 16:03:19.162109 13959 tablet_bootstrap.cc:654] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.163653 13961 raft_consensus.cc:348] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.164446 13961 raft_consensus.cc:374] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.164842 13961 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.165870 13961 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.169186 13961 ts_tablet_manager.cc:1428] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260811 16:03:19.172057 14415 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.172550 14415 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.174767 14415 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:19.175565 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.176816 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:19.178773 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:19.179910 14378 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.162911 14242 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.182461 13961 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:19.190128 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:19.190902 14419 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:19.199793 13744 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.202260 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:03:19.208645 13789 leader_election.cc:341] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.214371 13960 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:19.192476 14242 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.220193 13744 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:19.220278 13960 ts_tablet_manager.cc:1397] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.005s
I20260811 16:03:19.228318 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:19.229212 14420 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:19.229830 14420 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:19.231038 14420 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.286664 13961 tablet_bootstrap.cc:654] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
W20260811 16:03:19.298806 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63206.8us
I20260811 16:03:19.306504 13959 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:19.307020 13959 ts_tablet_manager.cc:1397] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.187s	user 0.047s	sys 0.040s
I20260811 16:03:19.307308 13960 raft_consensus.cc:348] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.308135 13960 raft_consensus.cc:374] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.308415 13960 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.309496 13960 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.314409 13959 raft_consensus.cc:348] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.315191 13959 raft_consensus.cc:374] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.315459 13959 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.316010 13959 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.321684 13906 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.331230 13960 ts_tablet_manager.cc:1428] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.004s
I20260811 16:03:19.332353 13960 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:19.336396 13959 ts_tablet_manager.cc:1428] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260811 16:03:19.359577 14379 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.374336 13959 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:19.379750 14379 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.390604 14310 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.461561 13960 tablet_bootstrap.cc:654] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.488369 14379 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.492311 13824 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.448323 14310 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.512825 14013 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.497306 14382 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.515265 14013 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.501184 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:19.527133 14013 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.530164 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:03:19.531873 13709 leader_election.cc:341] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.533362 13961 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:19.533898 13961 ts_tablet_manager.cc:1397] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.352s	user 0.022s	sys 0.018s
I20260811 16:03:19.537218 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.546372 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:19.546452 14441 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.547242 14441 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.521603 14382 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.556223 14379 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:03:19.561110 14436 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260811 16:03:19.567299 14310 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.569859 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:19.570556 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:19.574054 14382 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.553218 14441 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:19.577481 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:19.578621 13961 raft_consensus.cc:348] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.575311 13909 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:19.583019 13960 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:19.583494 13961 raft_consensus.cc:374] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.583819 13961 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.584110 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:19.584326 13961 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.584945 14242 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:19.585319 14242 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:19.583581 13960 ts_tablet_manager.cc:1397] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.010s
I20260811 16:03:19.585682 14242 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.588373 13961 ts_tablet_manager.cc:1428] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260811 16:03:19.589812 13960 raft_consensus.cc:348] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.590581 13960 raft_consensus.cc:374] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.602483 13959 tablet_bootstrap.cc:654] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.605144 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:19.614719 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.617345 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:19.620064 13707 leader_election.cc:341] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.620618 13707 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:19.621330 14439 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.608466 13626 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:19.608861 14242 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.624341 13961 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:19.624919 14242 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:19.626093 13740 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.636857 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:19.635535 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:19.640435 13902 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.590863 13960 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.641608 13960 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.643411 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:19.646191 13824 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 0.
I20260811 16:03:19.651798 13960 ts_tablet_manager.cc:1428] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.002s
I20260811 16:03:19.652208 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:19.654944 14415 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:19.655364 14415 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:19.655686 14415 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.655824 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.709664 14376 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.710408 14376 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.716279 14376 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:19.721593 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:19.721741 14415 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.724045 14415 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:03:19.727488 13789 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:03:19.727555 13874 leader_election.cc:341] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.726518 13902 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:19.730830 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:19.731622 13825 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:19.736169 13960 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:19.736938 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.737542 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:19.743781 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:19.745430 13959 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
W20260811 16:03:19.747907 13787 leader_election.cc:341] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:03:19.749771 13871 leader_election.cc:341] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.750216 13959 ts_tablet_manager.cc:1397] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.381s	user 0.035s	sys 0.010s
W20260811 16:03:19.752161 13787 leader_election.cc:341] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.756896 14242 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:19.772248 14242 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:19.774457 14242 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.786705 13959 raft_consensus.cc:348] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.787734 13959 raft_consensus.cc:374] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.788033 13959 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.790680 14237 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.788803 13959 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.791352 13961 tablet_bootstrap.cc:654] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.794781 13959 ts_tablet_manager.cc:1428] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260811 16:03:19.799753 13959 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
W20260811 16:03:19.802188 13871 leader_election.cc:341] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.804522 13825 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
W20260811 16:03:19.804877 13871 leader_election.cc:341] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:19.805344 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:19.807013 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:19.810703 14378 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:19.811266 14378 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:19.809242 14438 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.812165 14378 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.816435 14443 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:19.829000 13961 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:19.829744 13961 ts_tablet_manager.cc:1397] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.008s
I20260811 16:03:19.832716 13960 tablet_bootstrap.cc:654] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.838793 13959 tablet_bootstrap.cc:654] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.846019 13961 raft_consensus.cc:348] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.846963 13961 raft_consensus.cc:374] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.847385 13961 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.848446 13961 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.859838 13959 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:19.860473 13959 ts_tablet_manager.cc:1397] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.002s
I20260811 16:03:19.864553 14378 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:19.865178 14378 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.866514 13961 ts_tablet_manager.cc:1428] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.004s
I20260811 16:03:19.866328 13627 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:19.872459 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:19.887108 13961 tablet_bootstrap.cc:492] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:19.888827 14378 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:19.893757 13960 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:19.893626 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:19.894279 13960 ts_tablet_manager.cc:1397] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.017s
I20260811 16:03:19.895174 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:19.872510 13959 raft_consensus.cc:348] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.896221 13959 raft_consensus.cc:374] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.896567 13959 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.897447 13959 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.896600 14378 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:19.899916 13961 tablet_bootstrap.cc:654] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.900185 13959 ts_tablet_manager.cc:1428] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260811 16:03:19.900555 13628 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:19.901463 13959 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:19.901461 13960 raft_consensus.cc:348] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.906706 13960 raft_consensus.cc:374] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.907127 13960 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.908622 13960 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.910241 13960 ts_tablet_manager.cc:1428] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260811 16:03:19.913587 13960 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:19.922982 13960 tablet_bootstrap.cc:654] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:19.977319 13961 tablet_bootstrap.cc:492] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:19.977941 13961 ts_tablet_manager.cc:1397] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.005s
W20260811 16:03:19.970413 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54388.4us
I20260811 16:03:19.980485 13961 raft_consensus.cc:348] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.981463 13961 raft_consensus.cc:374] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:19.981792 13961 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:19.982581 13961 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:19.984620 13961 ts_tablet_manager.cc:1428] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260811 16:03:19.986052 13961 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:20.005822 13959 tablet_bootstrap.cc:654] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.016304 13960 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:20.025471 13960 ts_tablet_manager.cc:1397] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.112s	user 0.032s	sys 0.013s
I20260811 16:03:20.028439 13960 raft_consensus.cc:348] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.029126 13961 tablet_bootstrap.cc:654] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.029089 13960 raft_consensus.cc:374] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.029695 13960 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.030553 13960 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.036072 13960 ts_tablet_manager.cc:1428] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260811 16:03:20.037369 13960 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:20.044485 14456 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.045225 14456 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.051810 13960 tablet_bootstrap.cc:654] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.056677 14456 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:20.065795 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:20.069440 13960 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:20.069952 13960 ts_tablet_manager.cc:1397] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260811 16:03:20.072844 13960 raft_consensus.cc:348] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.073542 13960 raft_consensus.cc:374] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.073782 13960 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.074409 13960 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.076556 13960 ts_tablet_manager.cc:1428] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260811 16:03:20.077940 13960 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:20.091117 13960 tablet_bootstrap.cc:654] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.094024 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:20.108731 13960 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:20.109822 13960 ts_tablet_manager.cc:1397] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.002s
I20260811 16:03:20.116607 13960 raft_consensus.cc:348] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.118487 14440 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.117383 13960 raft_consensus.cc:374] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.119156 14440 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.119601 13960 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.120370 13960 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.122303 14440 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.123519 13960 ts_tablet_manager.cc:1428] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260811 16:03:20.124837 13960 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:20.124833 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:20.135020 13825 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 1: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:03:20.143818 13959 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:20.144567 13959 ts_tablet_manager.cc:1397] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.243s	user 0.010s	sys 0.007s
I20260811 16:03:20.147351 13959 raft_consensus.cc:348] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.148305 13959 raft_consensus.cc:374] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.148697 13959 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.149554 13959 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.153719 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:20.155691 13959 ts_tablet_manager.cc:1428] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260811 16:03:20.156262 14456 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:20.157806 13960 tablet_bootstrap.cc:654] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.157549 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.161326 13900 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.162609 13707 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:20.165268 14237 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.168228 13960 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:20.169694 13960 ts_tablet_manager.cc:1397] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.009s
I20260811 16:03:20.170661 13961 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:20.171497 13961 ts_tablet_manager.cc:1397] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.185s	user 0.064s	sys 0.071s
I20260811 16:03:20.189399 13959 tablet_bootstrap.cc:492] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:20.190236 14381 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.190304 13960 raft_consensus.cc:348] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.191085 13960 raft_consensus.cc:374] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.191455 13960 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.190984 14381 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.193082 13960 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.196415 13961 raft_consensus.cc:348] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.197161 13961 raft_consensus.cc:374] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.197434 13961 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.198051 13961 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.202931 13959 tablet_bootstrap.cc:654] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.206800 13902 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.208416 14237 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:20.210676 13960 ts_tablet_manager.cc:1428] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.003s
I20260811 16:03:20.209061 13961 ts_tablet_manager.cc:1428] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.006s
I20260811 16:03:20.213383 14381 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:20.215745 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:20.218601 13961 tablet_bootstrap.cc:492] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:20.219719 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.220356 13906 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:20.221451 13707 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:20.222088 13960 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Bootstrap starting.
I20260811 16:03:20.222642 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:20.224515 14443 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.225544 14242 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.225909 14443 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.226202 14242 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.223491 13821 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:20.228792 14381 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:20.228994 14242 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.229228 14381 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:20.229633 14381 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.231128 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.231312 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:20.231844 13906 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:20.233408 13789 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:03:20.233985 13787 leader_election.cc:341] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.232791 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:20.236387 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.239468 13741 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:20.228925 14443 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.236969 14242 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:20.244220 14242 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:20.246337 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:20.247637 14308 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:20.248111 14308 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:20.248602 14308 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.249769 14242 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:20.264791 13789 leader_election.cc:341] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.308012 13961 tablet_bootstrap.cc:654] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.290397 14381 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.315043 14242 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.317781 14308 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.318926 14242 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.319797 14308 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.322146 13960 tablet_bootstrap.cc:654] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.317209 14381 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.329013 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:20.323171 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:20.329315 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:20.329461 14438 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:20.329079 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:20.334784 13903 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.334846 13740 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:20.336556 13787 leader_election.cc:341] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.323252 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:20.341286 14379 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.342439 14379 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.343099 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:20.346312 13959 tablet_bootstrap.cc:492] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:20.346817 13959 ts_tablet_manager.cc:1397] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.158s	user 0.012s	sys 0.012s
W20260811 16:03:20.348696 13789 leader_election.cc:341] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.337316 13821 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.350984 14444 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.351469 14444 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.352504 14379 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.353431 14444 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.356594 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:20.359781 13787 leader_election.cc:341] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.360601 13959 raft_consensus.cc:348] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.361419 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:20.361588 13959 raft_consensus.cc:374] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.362124 13959 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
W20260811 16:03:20.363512 13787 leader_election.cc:341] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.363029 13959 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.364717 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.365787 13959 ts_tablet_manager.cc:1428] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
W20260811 16:03:20.370621 13789 leader_election.cc:341] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.371073 13789 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:20.374132 14444 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:20.375253 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.379570 13904 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 0.
I20260811 16:03:20.380867 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:20.381912 14310 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:20.382289 14310 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:20.382601 14310 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.384533 13959 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:20.366564 13905 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.385809 14379 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260811 16:03:20.400499 13960 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: No bootstrap required, opened a new log
I20260811 16:03:20.401050 13960 ts_tablet_manager.cc:1397] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.003s
I20260811 16:03:20.404342 13743 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.409188 13903 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:20.410996 13707 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:20.412734 14381 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:20.413210 14381 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:20.413556 13740 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:20.414090 14381 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.415596 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:20.417418 14444 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:20.417917 14444 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:20.418817 14444 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.420397 13821 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:20.433959 13959 tablet_bootstrap.cc:654] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.440016 14310 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.442607 14310 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.445797 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:20.447870 13903 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.452251 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:03:20.454141 13787 leader_election.cc:341] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.456681 13960 raft_consensus.cc:348] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.459491 13960 raft_consensus.cc:374] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.459775 13960 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.456331 14456 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 16:03:20.456372 13905 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:20.465035 13961 tablet_bootstrap.cc:492] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:20.465564 13961 ts_tablet_manager.cc:1397] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.247s	user 0.015s	sys 0.015s
I20260811 16:03:20.465827 13789 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:20.461015 13960 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.469377 14379 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:20.470006 14242 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:20.470490 14242 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:20.471343 14242 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.478047 13960 ts_tablet_manager.cc:1428] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.002s
I20260811 16:03:20.477469 13630 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:20.491233 14013 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.492581 14013 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.499034 14013 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.500507 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.503721 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:20.504437 13824 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:20.507588 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:03:20.508589 13707 leader_election.cc:341] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.509289 14013 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:20.509691 14013 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:20.509996 14013 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.517256 13903 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:03:20.534448 14013 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.536283 14013 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.554620 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:20.566064 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:20.566916 13961 raft_consensus.cc:348] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.583797 13961 raft_consensus.cc:374] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.584110 13961 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.584699 13961 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:20.585434 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56495.6us
W20260811 16:03:20.577778 14480 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260811 16:03:20.566685 14310 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:20.618402 13961 ts_tablet_manager.cc:1428] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.153s	user 0.010s	sys 0.005s
W20260811 16:03:20.621251 13707 leader_election.cc:341] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:20.618094 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:20.629256 13825 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.622483 14310 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:20.631268 14310 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.647454 13961 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:20.649374 13959 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:20.649858 13959 ts_tablet_manager.cc:1397] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.266s	user 0.022s	sys 0.022s
I20260811 16:03:20.655337 13825 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:20.658569 13959 raft_consensus.cc:348] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.659829 13959 raft_consensus.cc:374] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.660166 13959 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.661091 13959 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.662807 13959 ts_tablet_manager.cc:1428] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260811 16:03:20.665056 13959 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:20.666066 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:20.680222 14237 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:20.680946 14237 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:20.705790 14237 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.717938 13961 tablet_bootstrap.cc:654] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.760237 14013 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.760888 14013 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.770329 14013 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.789486 13961 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:20.790235 13961 ts_tablet_manager.cc:1397] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.143s	user 0.008s	sys 0.009s
I20260811 16:03:20.783427 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:20.802662 14382 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:03:20.804004 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52648us
I20260811 16:03:20.806550 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.807646 13905 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 1: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:03:20.803539 14382 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.814126 14382 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.814790 13707 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:03:20.816665 14440 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.819110 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:20.820150 13905 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:20.821898 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:20.821918 13959 tablet_bootstrap.cc:654] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.824555 14382 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:20.825938 14382 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:20.827008 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:20.827639 14382 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.828004 13821 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:20.828984 14440 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:20.833293 13961 raft_consensus.cc:348] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.839900 13961 raft_consensus.cc:374] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.840360 13961 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.840987 13961 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.843863 14382 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.844002 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:20.846047 14382 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:20.847736 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:20.848417 13821 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.849858 13961 ts_tablet_manager.cc:1428] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260811 16:03:20.850929 13961 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:20.853117 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:20.855273 13905 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:20.857414 14242 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:20.859767 13961 tablet_bootstrap.cc:654] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:20.865971 14382 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:20.884632 13628 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:20.890208 13821 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:20.964710 13959 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:20.965400 13959 ts_tablet_manager.cc:1397] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.302s	user 0.015s	sys 0.008s
I20260811 16:03:20.967341 13961 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:20.967983 13961 ts_tablet_manager.cc:1397] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.016s
I20260811 16:03:20.973101 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:20.973997 14382 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:20.974699 14382 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:20.975914 14382 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.979512 14442 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:20.979415 14242 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:20.980329 14442 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.980525 13961 raft_consensus.cc:348] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.981237 13961 raft_consensus.cc:374] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.981577 13626 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:20.981573 13961 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.983335 13961 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.984952 13626 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:20.983019 14442 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:20.991925 13959 raft_consensus.cc:348] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.998628 13959 raft_consensus.cc:374] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:20.998970 13959 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:20.999893 13959 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:20.993124 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:20.992851 13905 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:21.009793 13961 ts_tablet_manager.cc:1428] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260811 16:03:21.072305 13959 ts_tablet_manager.cc:1428] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.107s	user 0.015s	sys 0.003s
I20260811 16:03:21.080017 13959 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: Bootstrap starting.
I20260811 16:03:21.083026 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:21.084985 13824 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 1: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:03:21.089829 14442 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:21.090442 14442 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.093199 14442 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:21.102098 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:03:21.106554 13787 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:21.119527 13901 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:21.135995 13961 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: Bootstrap starting.
I20260811 16:03:21.144749 13908 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:21.145689 14379 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:21.149031 14498 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:21.160298 14308 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:21.168857 13959 tablet_bootstrap.cc:654] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:21.175617 13626 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:21.185081 14420 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:21.229040 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:21.236032 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:21.235235 14508 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:03:21.255666 14442 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:21.299201 14508 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:21.312842 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:21.341908 14441 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:03:21.390609 13961 tablet_bootstrap.cc:654] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: Neither blocks nor log segments found. Creating new log.
I20260811 16:03:21.405381 13959 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: No bootstrap required, opened a new log
I20260811 16:03:21.406086 13959 ts_tablet_manager.cc:1397] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: Time spent bootstrapping tablet: real 0.326s	user 0.027s	sys 0.012s
I20260811 16:03:21.406687 14455 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:21.410890 13959 raft_consensus.cc:348] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.412387 13959 raft_consensus.cc:374] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:21.414229 13959 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Initialized, Role: FOLLOWER
I20260811 16:03:21.415729 13959 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.418598 13959 ts_tablet_manager.cc:1428] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260811 16:03:21.419373 13740 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:21.453296 14455 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:03:21.453845 14455 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:21.468557 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:03:21.469447 14382 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:21.482780 14455 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:21.487164 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:21.488443 13825 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 0.
I20260811 16:03:21.490267 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:21.491533 14455 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:03:21.491652 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:21.492125 14455 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:03:21.492772 14455 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:03:21.494720 13707 leader_election.cc:341] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:03:21.530035 13961 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: No bootstrap required, opened a new log
I20260811 16:03:21.530745 13961 ts_tablet_manager.cc:1397] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent bootstrapping tablet: real 0.395s	user 0.011s	sys 0.015s
I20260811 16:03:21.538166 14455 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.541000 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:21.541687 13825 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:21.542970 13961 raft_consensus.cc:348] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.543740 13961 raft_consensus.cc:374] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:03:21.544605 13961 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Initialized, Role: FOLLOWER
I20260811 16:03:21.547832 13961 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.549341 13825 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:21.550356 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:21.551011 13902 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:03:21.551219 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:21.553030 14382 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:03:21.553670 14382 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:21.554392 13961 ts_tablet_manager.cc:1428] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260811 16:03:21.554979 14382 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:21.559332 14455 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 1 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:21.561784 13902 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:03:21.589115 13630 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:21.955410 14455 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:03:21.961946 14498 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:03:22.060547 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:03:22.070531 14531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:22.073818 14534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:03:22.085493 14532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:03:22.087850 12383 server_base.cc:1034] running on GCE node
I20260811 16:03:22.091711 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:03:22.092116 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:03:22.092342 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464202092325 us; error 0 us; skew 500 ppm
I20260811 16:03:22.093140 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:03:22.097203 12383 webserver.cc:460] Webserver started at http://127.12.23.196:40223/ using document root <none> and password file <none>
I20260811 16:03:22.098011 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:03:22.098328 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:03:22.098789 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:03:22.102883 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-3-root/instance:
uuid: "8d98491a0db549d0b671b60b90c9cdea"
format_stamp: "Formatted at 2026-08-11 16:03:22 on dist-test-slave-chsk"
I20260811 16:03:22.110710 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260811 16:03:22.115886 14539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:22.116971 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260811 16:03:22.117353 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-3-root
uuid: "8d98491a0db549d0b671b60b90c9cdea"
format_stamp: "Formatted at 2026-08-11 16:03:22 on dist-test-slave-chsk"
I20260811 16:03:22.117743 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:03:22.150874 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:03:22.152346 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:03:22.154036 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:03:22.157047 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:03:22.157342 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:22.157665 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:03:22.157850 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:03:22.238314 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.196:37251
I20260811 16:03:22.238435 14610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.196:37251 every 8 connection(s)
I20260811 16:03:22.245958 12383 auto_leader_rebalancer-test.cc:413] add a tserver: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:22.262583 14611 heartbeater.cc:347] Connected to a master server at 127.12.23.254:34613
I20260811 16:03:22.263123 14611 heartbeater.cc:464] Registering TS with master...
I20260811 16:03:22.264101 14611 heartbeater.cc:511] Master 127.12.23.254:34613 requested a full tablet report, sending...
I20260811 16:03:22.266239 13628 ts_manager.cc:194] Registered new tserver with Master: 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:22.268262 13628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55174
I20260811 16:03:22.550796 13901 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:22.558552 13825 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.560609 14616 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:22.564920 13743 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.567762 14441 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:22.571692 14616 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.576167 13825 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:22.579792 13871 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8baa39d90a34a09ab0f3b46ed69e00a. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:22.583170 13743 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.595908 13628 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.633577 13743 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:22.646495 13901 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.646849 13824 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.647897 14455 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:22.649003 14498 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260811 16:03:22.668663 13706 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f5f6467bf4b427f873ea8d2990f2945. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:22.679061 13825 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.677448 14455 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.681931 13902 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.698334 13901 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:22.696386 13630 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.707676 13825 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.708978 13743 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.710361 14624 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:22.711520 14441 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260811 16:03:22.714022 13871 consensus_peers.cc:487] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00d7fc8e90884ea59b440daaba753fd7. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:22.726723 14616 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.735275 13824 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.758068 13743 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.762302 13630 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.818110 13825 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:22.824908 13902 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.826236 14644 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:22.827565 13739 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:22.830314 14644 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:22.838965 14644 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.840567 13901 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.858640 13630 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:22.860666 13787 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc7ec7085e27482fa91e60b9993522de. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:22.867739 13743 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:22.984884 14650 ts_tablet_manager.cc:927] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:22.987438 14650 tablet_copy_client.cc:316] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:23.005882 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet c8baa39d90a34a09ab0f3b46ed69e00a from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:23.006592 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet c8baa39d90a34a09ab0f3b46ed69e00a from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-c8baa39d90a34a09ab0f3b46ed69e00a
I20260811 16:03:23.015959 13923 tablet_copy_source_session.cc:205] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:23.020123 14650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8baa39d90a34a09ab0f3b46ed69e00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:23.037377 14650 tablet_copy_client.cc:791] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:23.038374 14650 tablet_copy_client.cc:655] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:23.044236 14650 tablet_copy_client.cc:531] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:23.057433 14650 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:23.093688 14650 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:23.094837 14650 tablet_bootstrap.cc:492] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:23.095566 14650 ts_tablet_manager.cc:1397] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.011s
I20260811 16:03:23.098202 14650 raft_consensus.cc:348] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.098959 14650 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:23.099681 14650 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.102950 14611 heartbeater.cc:503] Master 127.12.23.254:34613 was elected leader, sending a full tablet report...
I20260811 16:03:23.103437 14650 ts_tablet_manager.cc:1428] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260811 16:03:23.105305 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-c8baa39d90a34a09ab0f3b46ed69e00a received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:23.105711 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-c8baa39d90a34a09ab0f3b46ed69e00a on tablet c8baa39d90a34a09ab0f3b46ed69e00a with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:23.160344 14650 ts_tablet_manager.cc:927] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:23.162246 14650 tablet_copy_client.cc:316] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:23.164541 14657 ts_tablet_manager.cc:927] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:23.167230 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 00d7fc8e90884ea59b440daaba753fd7 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:23.168383 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 00d7fc8e90884ea59b440daaba753fd7 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-00d7fc8e90884ea59b440daaba753fd7
I20260811 16:03:23.168701 14657 tablet_copy_client.cc:316] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:23.190083 13923 tablet_copy_source_session.cc:205] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:23.193425 14650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d7fc8e90884ea59b440daaba753fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:23.195621 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 7f5f6467bf4b427f873ea8d2990f2945 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:23.196280 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 7f5f6467bf4b427f873ea8d2990f2945 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-7f5f6467bf4b427f873ea8d2990f2945
I20260811 16:03:23.204033 13755 tablet_copy_source_session.cc:205] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:23.209227 14657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5f6467bf4b427f873ea8d2990f2945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:23.223470 14650 tablet_copy_client.cc:791] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:23.224318 14650 tablet_copy_client.cc:655] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:23.230577 14650 tablet_copy_client.cc:531] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:23.244535 14657 tablet_copy_client.cc:791] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:23.244900 14650 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:23.245498 14657 tablet_copy_client.cc:655] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:23.251004 14657 tablet_copy_client.cc:531] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:23.261144 14657 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:23.270615 14663 ts_tablet_manager.cc:927] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:23.280272 14650 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:23.281612 14650 tablet_bootstrap.cc:492] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:23.282495 14650 ts_tablet_manager.cc:1397] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.012s
I20260811 16:03:23.285935 14650 raft_consensus.cc:348] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.287117 14650 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:23.298959 14650 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.305656 14657 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:23.306802 14657 tablet_bootstrap.cc:492] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:23.307673 14657 ts_tablet_manager.cc:1397] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.004s
I20260811 16:03:23.308426 14663 tablet_copy_client.cc:316] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:23.309383 14650 ts_tablet_manager.cc:1428] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.007s
I20260811 16:03:23.310832 14657 raft_consensus.cc:348] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.312469 14657 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:23.320753 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-00d7fc8e90884ea59b440daaba753fd7 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:23.321250 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-00d7fc8e90884ea59b440daaba753fd7 on tablet 00d7fc8e90884ea59b440daaba753fd7 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:23.325796 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet bc7ec7085e27482fa91e60b9993522de from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:23.325559 14657 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.326439 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet bc7ec7085e27482fa91e60b9993522de from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-bc7ec7085e27482fa91e60b9993522de
I20260811 16:03:23.328349 14657 ts_tablet_manager.cc:1428] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260811 16:03:23.332154 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7f5f6467bf4b427f873ea8d2990f2945 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:23.332593 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7f5f6467bf4b427f873ea8d2990f2945 on tablet 7f5f6467bf4b427f873ea8d2990f2945 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:23.344208 13839 tablet_copy_source_session.cc:205] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:23.351634 14663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7ec7085e27482fa91e60b9993522de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:23.367590 14663 tablet_copy_client.cc:791] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:23.368300 14663 tablet_copy_client.cc:655] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:23.372740 14663 tablet_copy_client.cc:531] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:23.377669 14583 raft_consensus.cc:1203] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:23.388427 14663 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:23.406376 14663 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:23.407512 14663 tablet_bootstrap.cc:492] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:23.410779 14663 ts_tablet_manager.cc:1397] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260811 16:03:23.413524 14663 raft_consensus.cc:348] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.414193 14663 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:23.414850 14663 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:23.417760 14663 ts_tablet_manager.cc:1428] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260811 16:03:23.423347 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-bc7ec7085e27482fa91e60b9993522de received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:23.425396 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-bc7ec7085e27482fa91e60b9993522de on tablet bc7ec7085e27482fa91e60b9993522de with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:23.613305 14583 raft_consensus.cc:1203] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:23.730590 14583 raft_consensus.cc:1203] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:23.786211 14616 raft_consensus.cc:1050] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:23.789235 14616 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:23.798141 14583 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:23.798357 13743 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:23.799628 13825 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:23.800882 14668 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:23.801792 14666 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:23.802521 14616 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:23.826661 13825 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.829128 13740 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.824617 14616 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.842482 14583 raft_consensus.cc:1203] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:23.869411 14583 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.881855 13626 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.914362 13902 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:23.921573 14583 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:23.924229 14616 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:23.925107 13743 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:23.930855 14616 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:23.932337 14642 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.935089 14583 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.938854 13740 raft_consensus.cc:2932] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.945254 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c8baa39d90a34a09ab0f3b46ed69e00a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:23.959024 13630 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:23.973275 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet c8baa39d90a34a09ab0f3b46ed69e00a with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:23.976994 14679 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:23.977941 14679 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:23.978583 14679 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:23.981561 14679 ts_tablet_manager.cc:1905] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:23.997985 14679 ts_tablet_manager.cc:1918] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:23.998487 14679 log.cc:1196] T c8baa39d90a34a09ab0f3b46ed69e00a P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/c8baa39d90a34a09ab0f3b46ed69e00a
I20260811 16:03:24.000583 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet c8baa39d90a34a09ab0f3b46ed69e00a (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:24.077481 14498 raft_consensus.cc:1050] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:24.081570 14498 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:24.088482 13902 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.088832 14583 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.090457 14455 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:24.091373 13824 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.092607 14682 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:24.093444 14638 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:24.115430 14638 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.120832 13902 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.124411 14583 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.127810 13825 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.141978 14642 raft_consensus.cc:1050] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:24.142235 13627 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.144817 14642 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:24.158231 14582 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.162178 14616 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:24.165364 13740 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.168191 13827 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.171919 14616 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:24.173125 13739 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:24.187924 13821 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:24.182292 14642 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:24.193251 14581 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:24.197676 14498 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:24.199407 14455 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:24.209440 14581 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.209316 14642 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.207435 14455 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.212158 13827 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.234282 13743 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.238847 14582 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.243636 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7f5f6467bf4b427f873ea8d2990f2945 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:24.253054 13821 raft_consensus.cc:2932] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.254061 13628 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:24.276072 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f5f6467bf4b427f873ea8d2990f2945 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:24.258561 13630 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:24.288513 14691 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:24.295913 14691 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:24.297350 14691 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:24.303695 14691 ts_tablet_manager.cc:1905] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:24.380967 14691 ts_tablet_manager.cc:1918] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:24.381636 14691 log.cc:1196] T 7f5f6467bf4b427f873ea8d2990f2945 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/7f5f6467bf4b427f873ea8d2990f2945
I20260811 16:03:24.388242 13901 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:24.390499 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 7f5f6467bf4b427f873ea8d2990f2945 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:24.406244 14581 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:24.408418 14668 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:24.414503 13827 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:24.420806 14668 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:24.427996 14616 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.437353 13827 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.442226 14581 raft_consensus.cc:2932] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.466620 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 00d7fc8e90884ea59b440daaba753fd7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:24.467893 13628 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:24.482967 14490 raft_consensus.cc:1050] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:24.490903 14490 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:24.498152 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d7fc8e90884ea59b440daaba753fd7 with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:24.506222 14581 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.508442 14649 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:03:24.525615 13905 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.526566 13743 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:24.532572 14649 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:24.535104 14692 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:24.538877 14695 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:24.540225 14695 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:24.541159 14695 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:24.548345 14695 ts_tablet_manager.cc:1905] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:24.572122 14692 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.581179 13743 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.581099 13905 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.592619 14581 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.598868 13627 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:24.616892 14695 ts_tablet_manager.cc:1918] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:24.617508 14695 log.cc:1196] T 00d7fc8e90884ea59b440daaba753fd7 P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/00d7fc8e90884ea59b440daaba753fd7
I20260811 16:03:24.619867 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 00d7fc8e90884ea59b440daaba753fd7 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:24.628273 13827 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:24.635600 14581 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:24.638298 14692 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:24.645095 13905 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:24.652536 14644 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:24.652580 14649 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.653707 14581 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.659360 13905 raft_consensus.cc:2932] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:24.671403 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet bc7ec7085e27482fa91e60b9993522de with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:24.677364 13627 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:24.715505 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7ec7085e27482fa91e60b9993522de with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:24.716641 14695 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:24.731403 14695 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:24.732213 14695 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:24.735695 14695 ts_tablet_manager.cc:1905] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:24.748833 14695 ts_tablet_manager.cc:1918] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:24.749177 14695 log.cc:1196] T bc7ec7085e27482fa91e60b9993522de P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/bc7ec7085e27482fa91e60b9993522de
I20260811 16:03:24.750649 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet bc7ec7085e27482fa91e60b9993522de (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:25.757083 13743 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:25.771080 13706 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93cf6e0832154e35bedbcec9d96701f2. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:25.771340 13901 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:25.771397 13821 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:25.773039 14682 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:25.775067 14638 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:25.795846 14638 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.798089 13901 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.806424 13821 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.823797 13626 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.839562 13901 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:25.849890 13821 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:25.851835 14666 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:03:25.853888 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7c952fbefaf4aa7b441b3d2c248f25c. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:25.854559 13743 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:25.869861 14713 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:25.873212 14666 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.875491 13821 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.883191 13743 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.893803 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.903896 13821 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:25.919533 13787 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: defa959376494546a5395f8a56cef106. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:25.923177 13905 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:25.920383 13743 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:25.925144 14644 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:25.926695 14704 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:25.935474 14692 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.937463 13743 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.937742 13905 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:25.948292 13901 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:25.954336 13627 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:26.033820 13744 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:26.041610 13827 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:26.049317 13871 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f42299184ed34c10bccc7de82e5dd1bd. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:26.052363 14666 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260811 16:03:26.067266 14713 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:26.145253 14724 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:26.151952 13743 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:26.189492 14727 ts_tablet_manager.cc:927] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:26.198107 14727 tablet_copy_client.cc:316] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:26.200543 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 93cf6e0832154e35bedbcec9d96701f2 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:26.201213 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 93cf6e0832154e35bedbcec9d96701f2 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-93cf6e0832154e35bedbcec9d96701f2
I20260811 16:03:26.211963 13628 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:26.234206 13755 tablet_copy_source_session.cc:205] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:26.238639 14727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cf6e0832154e35bedbcec9d96701f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:26.247792 13821 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:26.264941 14727 tablet_copy_client.cc:791] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:26.265851 14727 tablet_copy_client.cc:655] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:26.275432 14727 tablet_copy_client.cc:531] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:26.291105 14727 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:26.314596 14727 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:26.315811 14727 tablet_bootstrap.cc:492] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:26.316582 14727 ts_tablet_manager.cc:1397] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260811 16:03:26.319641 14727 raft_consensus.cc:348] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.320613 14727 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:26.321288 14727 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.329664 14727 ts_tablet_manager.cc:1428] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260811 16:03:26.331585 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-93cf6e0832154e35bedbcec9d96701f2 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:26.334082 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-93cf6e0832154e35bedbcec9d96701f2 on tablet 93cf6e0832154e35bedbcec9d96701f2 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:26.356123 14727 ts_tablet_manager.cc:927] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:26.357996 14727 tablet_copy_client.cc:316] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:26.359998 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet d7c952fbefaf4aa7b441b3d2c248f25c from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:26.360549 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet d7c952fbefaf4aa7b441b3d2c248f25c from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-d7c952fbefaf4aa7b441b3d2c248f25c
I20260811 16:03:26.368713 13923 tablet_copy_source_session.cc:205] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:26.372112 14727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c952fbefaf4aa7b441b3d2c248f25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:26.386160 14727 tablet_copy_client.cc:791] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:26.386890 14727 tablet_copy_client.cc:655] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:26.397017 14727 tablet_copy_client.cc:531] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:26.407461 14727 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:26.430725 14727 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:26.431751 14727 tablet_bootstrap.cc:492] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:26.432399 14727 ts_tablet_manager.cc:1397] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.002s
I20260811 16:03:26.434670 14727 raft_consensus.cc:348] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.435552 14727 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:26.436187 14727 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.438422 14727 ts_tablet_manager.cc:1428] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260811 16:03:26.440037 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-d7c952fbefaf4aa7b441b3d2c248f25c received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:26.440438 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-d7c952fbefaf4aa7b441b3d2c248f25c on tablet d7c952fbefaf4aa7b441b3d2c248f25c with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:26.481065 14727 ts_tablet_manager.cc:927] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:26.484100 14727 tablet_copy_client.cc:316] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:26.485709 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet f42299184ed34c10bccc7de82e5dd1bd from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:26.486272 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet f42299184ed34c10bccc7de82e5dd1bd from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-f42299184ed34c10bccc7de82e5dd1bd
I20260811 16:03:26.494570 14734 ts_tablet_manager.cc:927] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:26.495955 13923 tablet_copy_source_session.cc:205] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:26.499625 14727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f42299184ed34c10bccc7de82e5dd1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:26.499696 14734 tablet_copy_client.cc:316] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:26.505240 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet defa959376494546a5395f8a56cef106 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:26.505846 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet defa959376494546a5395f8a56cef106 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-defa959376494546a5395f8a56cef106
I20260811 16:03:26.523778 14727 tablet_copy_client.cc:791] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:26.524571 14727 tablet_copy_client.cc:655] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:26.528368 14727 tablet_copy_client.cc:531] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:26.535018 13839 tablet_copy_source_session.cc:205] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:26.540705 14734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defa959376494546a5395f8a56cef106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:26.541805 14727 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:26.560650 14734 tablet_copy_client.cc:791] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:26.561507 14734 tablet_copy_client.cc:655] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:26.567027 14734 tablet_copy_client.cc:531] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:26.570372 14727 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:26.571537 14727 tablet_bootstrap.cc:492] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:26.572221 14727 ts_tablet_manager.cc:1397] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.002s
I20260811 16:03:26.574980 14727 raft_consensus.cc:348] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.575862 14727 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:26.576469 14727 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.577718 14734 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:26.579074 14727 ts_tablet_manager.cc:1428] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260811 16:03:26.580919 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-f42299184ed34c10bccc7de82e5dd1bd received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:26.581331 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-f42299184ed34c10bccc7de82e5dd1bd on tablet f42299184ed34c10bccc7de82e5dd1bd with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:26.601568 14734 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:26.602396 14734 tablet_bootstrap.cc:492] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:26.603093 14734 ts_tablet_manager.cc:1397] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.000s
I20260811 16:03:26.605473 14734 raft_consensus.cc:348] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.606457 14734 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:26.607633 14734 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:26.609913 14734 ts_tablet_manager.cc:1428] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260811 16:03:26.611932 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-defa959376494546a5395f8a56cef106 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:26.612411 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-defa959376494546a5395f8a56cef106 on tablet defa959376494546a5395f8a56cef106 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:26.766198 14581 raft_consensus.cc:1203] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:26.803448 14581 raft_consensus.cc:1203] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:26.897244 14581 raft_consensus.cc:1203] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:26.909669 14581 raft_consensus.cc:1203] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:27.199993 14738 raft_consensus.cc:1050] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:27.204294 14738 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.218068 13827 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.220077 13743 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.220077 14581 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.221738 14738 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.222911 14724 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:27.223848 14739 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:27.240079 14724 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.244738 13827 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.243680 14581 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.256754 13743 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.282800 13628 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.297537 14703 raft_consensus.cc:1050] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:27.300889 14703 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.310390 14581 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.311955 13903 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.313700 14644 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.315265 14703 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.316447 13743 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.317931 14703 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.335533 13901 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.342329 14582 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.343854 13744 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.346136 14739 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:27.347410 14713 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:27.362947 14644 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.366122 14724 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.366968 14581 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.374289 13743 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.380534 13901 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.381927 14582 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.386488 14682 raft_consensus.cc:1050] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:27.388196 13740 raft_consensus.cc:2932] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.389794 14682 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.402747 13627 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:27.411906 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.422516 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet d7c952fbefaf4aa7b441b3d2c248f25c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:27.426127 13903 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.428010 14722 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.426152 14581 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.430042 14707 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.443269 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet d7c952fbefaf4aa7b441b3d2c248f25c with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:27.456457 13824 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.460034 14760 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:27.462865 14760 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:27.463747 14760 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:27.468195 14582 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.470342 14644 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:27.473559 14760 ts_tablet_manager.cc:1905] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:27.476163 13903 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.478890 14644 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:27.480753 14724 raft_consensus.cc:1050] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:27.494689 13901 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.496650 14582 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.493841 14644 raft_consensus.cc:2932] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.494990 14724 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.506618 13824 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.508426 14758 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.510828 14722 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.519260 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet defa959376494546a5395f8a56cef106 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:27.524343 14581 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.527472 14760 ts_tablet_manager.cc:1918] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:27.529323 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.528124 14760 log.cc:1196] T d7c952fbefaf4aa7b441b3d2c248f25c P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/d7c952fbefaf4aa7b441b3d2c248f25c
I20260811 16:03:27.531659 13904 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.534551 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet d7c952fbefaf4aa7b441b3d2c248f25c (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:27.549768 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet defa959376494546a5395f8a56cef106 with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:27.592950 13827 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.596074 14713 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.596141 13630 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.598628 13824 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.604411 13744 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.608213 14582 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:27.610595 14713 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:27.612159 14739 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:27.621277 14766 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:27.622649 14766 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:27.623495 14766 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:27.636152 13740 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.643846 14583 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.646677 14765 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:27.654726 13824 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.671423 14765 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.676618 14758 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:27.681782 14581 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.690413 14766 ts_tablet_manager.cc:1905] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:27.683892 13824 raft_consensus.cc:2932] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.705194 14724 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.713651 13744 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.719882 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 93cf6e0832154e35bedbcec9d96701f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:27.725716 13630 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.740562 14766 ts_tablet_manager.cc:1918] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:27.741237 14766 log.cc:1196] T defa959376494546a5395f8a56cef106 P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/defa959376494546a5395f8a56cef106
I20260811 16:03:27.739773 13824 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.741793 14581 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.747392 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet defa959376494546a5395f8a56cef106 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:27.752609 13626 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.761472 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 93cf6e0832154e35bedbcec9d96701f2 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:27.805310 14770 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:27.806531 14770 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:27.807493 14770 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:27.808755 13903 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:27.812413 14770 ts_tablet_manager.cc:1905] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:27.827226 14581 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.831235 14724 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:27.833938 14770 ts_tablet_manager.cc:1918] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:27.834612 14770 log.cc:1196] T 93cf6e0832154e35bedbcec9d96701f2 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/93cf6e0832154e35bedbcec9d96701f2
I20260811 16:03:27.841876 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 93cf6e0832154e35bedbcec9d96701f2 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:27.842307 13740 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:27.843869 14713 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.853952 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f42299184ed34c10bccc7de82e5dd1bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:27.857869 14724 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:27.862797 13630 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:27.863037 14581 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.868073 13740 raft_consensus.cc:2932] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:27.877694 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet f42299184ed34c10bccc7de82e5dd1bd with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:27.878701 14760 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:27.879777 14760 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:27.880385 14760 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:27.890949 14760 ts_tablet_manager.cc:1905] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:27.903090 14760 ts_tablet_manager.cc:1918] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:27.903597 14760 log.cc:1196] T f42299184ed34c10bccc7de82e5dd1bd P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/f42299184ed34c10bccc7de82e5dd1bd
I20260811 16:03:27.904959 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet f42299184ed34c10bccc7de82e5dd1bd (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:28.934230 13827 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:28.941067 13740 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:28.943966 13787 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ade10bd0a2294e86b324757afe52d216. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:28.944329 13903 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:28.945298 14771 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:28.946614 14773 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:28.960712 14771 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:28.962488 13743 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:28.965049 13903 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:28.976356 13824 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:28.983883 13627 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:03:29.002674 13787 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e699b23b5a94bf7b11086e6878e0207. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:29.003090 13743 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:29.004482 13904 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:29.006196 14773 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:29.009368 14773 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:29.030122 14773 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.035266 13743 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.043488 13905 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.051765 13740 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.055249 13630 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:03:29.076218 13706 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 111ca2b9029e420191db21651d7c7015. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:29.076562 13904 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:29.079073 14682 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:29.087196 13824 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:29.088737 14758 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:29.090587 14758 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.102768 13905 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.112048 13824 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:29.120772 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17293f4853fe4715a4622208f2fbb5a7. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:29.121258 13904 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:29.122725 14773 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:29.123684 13743 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:29.125680 14692 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:29.139819 13827 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.146953 14771 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.156661 13740 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.138036 13630 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:29.174422 13904 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:29.192128 13627 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:29.352701 14803 ts_tablet_manager.cc:927] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:29.354928 14803 tablet_copy_client.cc:316] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:29.356696 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet ade10bd0a2294e86b324757afe52d216 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:29.357160 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet ade10bd0a2294e86b324757afe52d216 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-ade10bd0a2294e86b324757afe52d216
I20260811 16:03:29.365482 13839 tablet_copy_source_session.cc:205] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:29.368750 14803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade10bd0a2294e86b324757afe52d216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:29.382615 14803 tablet_copy_client.cc:791] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:29.383389 14803 tablet_copy_client.cc:655] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:29.390431 14803 tablet_copy_client.cc:531] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:29.399336 14803 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:29.423116 14803 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:29.424199 14803 tablet_bootstrap.cc:492] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:29.424867 14803 ts_tablet_manager.cc:1397] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260811 16:03:29.427356 14803 raft_consensus.cc:348] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.428294 14803 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:29.428833 14803 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.432324 14803 ts_tablet_manager.cc:1428] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260811 16:03:29.434406 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-ade10bd0a2294e86b324757afe52d216 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:29.434821 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-ade10bd0a2294e86b324757afe52d216 on tablet ade10bd0a2294e86b324757afe52d216 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:29.594445 14803 ts_tablet_manager.cc:927] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:29.597702 14803 tablet_copy_client.cc:316] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:29.599370 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet 17293f4853fe4715a4622208f2fbb5a7 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:29.599957 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet 17293f4853fe4715a4622208f2fbb5a7 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-17293f4853fe4715a4622208f2fbb5a7
I20260811 16:03:29.607224 13839 tablet_copy_source_session.cc:205] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:29.608290 14808 ts_tablet_manager.cc:927] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:29.610199 14803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17293f4853fe4715a4622208f2fbb5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:29.610934 14808 tablet_copy_client.cc:316] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:29.612761 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet 5e699b23b5a94bf7b11086e6878e0207 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:29.613317 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet 5e699b23b5a94bf7b11086e6878e0207 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-5e699b23b5a94bf7b11086e6878e0207
I20260811 16:03:29.623432 13839 tablet_copy_source_session.cc:205] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:29.628342 14808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e699b23b5a94bf7b11086e6878e0207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:29.628506 14803 tablet_copy_client.cc:791] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:29.629197 14803 tablet_copy_client.cc:655] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:29.635108 14803 tablet_copy_client.cc:531] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:29.649390 14808 tablet_copy_client.cc:791] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:29.649891 14803 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:29.650147 14808 tablet_copy_client.cc:655] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:29.651600 14810 ts_tablet_manager.cc:927] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:29.654865 14810 tablet_copy_client.cc:316] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:29.656886 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 111ca2b9029e420191db21651d7c7015 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:29.657428 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 111ca2b9029e420191db21651d7c7015 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-111ca2b9029e420191db21651d7c7015
I20260811 16:03:29.662919 14808 tablet_copy_client.cc:531] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:29.678050 13755 tablet_copy_source_session.cc:205] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:29.684599 14810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 111ca2b9029e420191db21651d7c7015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:29.686165 14808 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:29.708711 14810 tablet_copy_client.cc:791] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:29.713366 14808 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:29.719427 14803 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:29.720269 14810 tablet_copy_client.cc:655] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:29.722978 14803 tablet_bootstrap.cc:492] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:29.723735 14803 ts_tablet_manager.cc:1397] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.074s	user 0.032s	sys 0.032s
I20260811 16:03:29.726480 14803 raft_consensus.cc:348] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.727269 14803 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:29.729055 14810 tablet_copy_client.cc:531] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:29.727875 14803 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.729389 14808 tablet_bootstrap.cc:492] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:29.734741 14808 ts_tablet_manager.cc:1397] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.000s
I20260811 16:03:29.740134 14803 ts_tablet_manager.cc:1428] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260811 16:03:29.741834 14808 raft_consensus.cc:348] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.745591 14808 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:29.746299 14808 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.749855 14808 ts_tablet_manager.cc:1428] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260811 16:03:29.752388 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-17293f4853fe4715a4622208f2fbb5a7 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:29.752812 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-17293f4853fe4715a4622208f2fbb5a7 on tablet 17293f4853fe4715a4622208f2fbb5a7 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:29.754606 14810 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:29.757138 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-5e699b23b5a94bf7b11086e6878e0207 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:29.757575 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-5e699b23b5a94bf7b11086e6878e0207 on tablet 5e699b23b5a94bf7b11086e6878e0207 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:29.764292 14581 raft_consensus.cc:1203] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:29.792223 14810 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:29.793316 14810 tablet_bootstrap.cc:492] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:29.794057 14810 ts_tablet_manager.cc:1397] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.000s
I20260811 16:03:29.796867 14810 raft_consensus.cc:348] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.797780 14810 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:29.798465 14810 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:29.800849 14810 ts_tablet_manager.cc:1428] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260811 16:03:29.808418 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-111ca2b9029e420191db21651d7c7015 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:29.808892 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-111ca2b9029e420191db21651d7c7015 on tablet 111ca2b9029e420191db21651d7c7015 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:30.106684 14581 raft_consensus.cc:1203] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:30.156942 14581 raft_consensus.cc:1203] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:30.217124 14771 raft_consensus.cc:1050] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:30.219884 14581 raft_consensus.cc:1203] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:30.234778 14771 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.245940 13904 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.246958 13744 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.247236 14815 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:30.248919 14581 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.250340 14815 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:30.251991 14771 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:30.268918 14771 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.273803 13904 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.283809 13743 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.283814 14581 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.291276 13626 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:30.358131 13827 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.366945 14581 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.377885 14815 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:30.378839 13744 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.384323 14815 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:30.386251 14771 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.388731 14581 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.397104 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet ade10bd0a2294e86b324757afe52d216 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:30.399912 13744 raft_consensus.cc:2932] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.409044 13628 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:30.423043 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet ade10bd0a2294e86b324757afe52d216 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:30.428401 14825 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:30.429500 14825 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:30.430312 14825 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:30.433818 14825 ts_tablet_manager.cc:1905] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:30.458966 14825 ts_tablet_manager.cc:1918] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:30.459575 14825 log.cc:1196] T ade10bd0a2294e86b324757afe52d216 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/ade10bd0a2294e86b324757afe52d216
I20260811 16:03:30.461724 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet ade10bd0a2294e86b324757afe52d216 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:30.571764 14815 raft_consensus.cc:1050] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:30.574210 14815 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.580605 13904 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.580610 14581 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.582093 14771 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:30.582839 13744 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.584220 14771 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:30.585139 14773 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:30.600931 13740 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.602595 14794 raft_consensus.cc:1050] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:30.603508 14581 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.605358 14794 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.607683 14771 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.615553 14692 raft_consensus.cc:1050] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:30.618206 14692 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.640708 13628 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.651278 14581 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.653373 13740 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.654752 13905 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.656011 14773 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:30.659333 14773 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:30.661429 14832 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260811 16:03:30.688519 13821 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.690104 14831 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:30.693642 14832 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.698585 13904 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.699107 13905 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.700937 14838 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:30.706149 14581 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.710124 14582 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:30.715731 14798 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:30.743319 13628 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.742988 13903 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.760769 13821 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.755685 13740 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.751188 14794 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.768746 14581 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.771109 14833 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:30.772512 13903 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.776666 13824 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.778510 13743 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.781548 14815 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.785629 14773 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:30.793521 14581 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.797279 13743 raft_consensus.cc:2932] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.802567 14582 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.825065 13630 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:30.836129 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 17293f4853fe4715a4622208f2fbb5a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:30.841598 13827 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.844377 13627 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.851293 13743 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:30.852630 13905 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.854213 14581 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.855839 14815 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:30.861207 14582 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.861558 13905 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:30.863685 14799 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:30.864786 14830 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:30.865031 14692 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.869588 14773 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:30.873822 14582 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.877105 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 17293f4853fe4715a4622208f2fbb5a7 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:30.878404 14825 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:30.879669 14825 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:30.880340 14825 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:30.883641 14799 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.890741 13905 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.895828 14825 ts_tablet_manager.cc:1905] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:30.901993 13903 raft_consensus.cc:2932] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.905894 13630 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:30.916246 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5e699b23b5a94bf7b11086e6878e0207 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:30.917815 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e699b23b5a94bf7b11086e6878e0207 with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:30.919703 14843 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:30.928226 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 111ca2b9029e420191db21651d7c7015 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:30.925915 14581 raft_consensus.cc:2932] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.930054 14843 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:30.933894 14843 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:30.935866 13630 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:30.938102 14843 ts_tablet_manager.cc:1905] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:30.968132 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 111ca2b9029e420191db21651d7c7015 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:30.977602 14843 ts_tablet_manager.cc:1918] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:30.978068 14843 log.cc:1196] T 5e699b23b5a94bf7b11086e6878e0207 P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/5e699b23b5a94bf7b11086e6878e0207
I20260811 16:03:30.980528 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 5e699b23b5a94bf7b11086e6878e0207 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:30.980650 14844 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:30.981413 14825 ts_tablet_manager.cc:1918] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:30.981781 14844 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:30.981859 14825 log.cc:1196] T 17293f4853fe4715a4622208f2fbb5a7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/17293f4853fe4715a4622208f2fbb5a7
I20260811 16:03:30.982784 14844 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:30.984645 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 17293f4853fe4715a4622208f2fbb5a7 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:30.986011 14844 ts_tablet_manager.cc:1905] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:31.001312 14844 ts_tablet_manager.cc:1918] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:31.001902 14844 log.cc:1196] T 111ca2b9029e420191db21651d7c7015 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/111ca2b9029e420191db21651d7c7015
I20260811 16:03:31.003662 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 111ca2b9029e420191db21651d7c7015 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:32.009699 13905 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:32.016800 13871 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 993fa0c090be4f83b6e0d60b3aa8dc78. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:32.017189 13824 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.018412 13743 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.018559 14845 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.020974 14845 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.026329 14776 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.031824 13824 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.043347 13743 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.049975 13630 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.052937 13825 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.076004 13905 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.077458 13740 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:32.078526 13787 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a97fbe9fd7534b9e93a8abec637a8c1e. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:32.079911 14771 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.081050 14815 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.098296 14815 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.121268 13905 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.122504 13740 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.125304 13743 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.151420 13627 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:03:32.156520 13706 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c9671b71f644eaf969b8bb56e717beb. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:32.169051 13905 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.170394 13824 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.173213 14794 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.188738 14865 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.190886 13903 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.199249 14866 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.211658 13743 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.213280 13824 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.212630 13627 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:32.222287 13706 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18e29247552943ad9bfa10e83e0dc5dd. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:32.222415 13903 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.225255 13825 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:32.226954 14866 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:32.232790 14866 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:32.242470 14867 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.250365 13904 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.257795 13824 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:32.261061 13630 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:32.536144 14873 ts_tablet_manager.cc:927] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:32.538307 14873 tablet_copy_client.cc:316] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:32.540277 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 993fa0c090be4f83b6e0d60b3aa8dc78 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:32.540858 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 993fa0c090be4f83b6e0d60b3aa8dc78 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-993fa0c090be4f83b6e0d60b3aa8dc78
I20260811 16:03:32.548647 13923 tablet_copy_source_session.cc:205] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:32.551806 14875 ts_tablet_manager.cc:927] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:32.553257 14873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 993fa0c090be4f83b6e0d60b3aa8dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:32.564747 14875 tablet_copy_client.cc:316] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:32.566457 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet a97fbe9fd7534b9e93a8abec637a8c1e from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:32.567008 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet a97fbe9fd7534b9e93a8abec637a8c1e from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-a97fbe9fd7534b9e93a8abec637a8c1e
I20260811 16:03:32.577536 14873 tablet_copy_client.cc:791] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:32.578563 14873 tablet_copy_client.cc:655] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:32.580287 13839 tablet_copy_source_session.cc:205] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:32.583246 14873 tablet_copy_client.cc:531] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:32.583483 14875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97fbe9fd7534b9e93a8abec637a8c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:32.593232 14873 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:32.601866 14875 tablet_copy_client.cc:791] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:32.602874 14875 tablet_copy_client.cc:655] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:32.616766 14875 tablet_copy_client.cc:531] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:32.626969 14875 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:32.656673 14875 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:32.657887 14875 tablet_bootstrap.cc:492] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:32.658743 14875 ts_tablet_manager.cc:1397] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.011s
I20260811 16:03:32.661777 14875 raft_consensus.cc:348] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.662902 14875 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:32.663740 14875 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.690445 14875 ts_tablet_manager.cc:1428] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260811 16:03:32.693534 14880 ts_tablet_manager.cc:927] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:32.694198 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-a97fbe9fd7534b9e93a8abec637a8c1e received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:32.694660 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-a97fbe9fd7534b9e93a8abec637a8c1e on tablet a97fbe9fd7534b9e93a8abec637a8c1e with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:32.709280 14873 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:32.710673 14873 tablet_bootstrap.cc:492] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:32.711187 14875 ts_tablet_manager.cc:927] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:32.711787 14873 ts_tablet_manager.cc:1397] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.119s	user 0.040s	sys 0.057s
I20260811 16:03:32.715628 14873 raft_consensus.cc:348] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.720125 14873 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:32.720903 14873 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.724228 14873 ts_tablet_manager.cc:1428] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260811 16:03:32.726439 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-993fa0c090be4f83b6e0d60b3aa8dc78 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:32.726779 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-993fa0c090be4f83b6e0d60b3aa8dc78 on tablet 993fa0c090be4f83b6e0d60b3aa8dc78 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:32.731629 14875 tablet_copy_client.cc:316] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:32.734033 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 18e29247552943ad9bfa10e83e0dc5dd from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:32.734615 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 18e29247552943ad9bfa10e83e0dc5dd from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-18e29247552943ad9bfa10e83e0dc5dd
I20260811 16:03:32.743609 13755 tablet_copy_source_session.cc:205] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:32.746335 14880 tablet_copy_client.cc:316] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:32.747046 14875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e29247552943ad9bfa10e83e0dc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:32.748140 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 6c9671b71f644eaf969b8bb56e717beb from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:32.748708 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 6c9671b71f644eaf969b8bb56e717beb from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-6c9671b71f644eaf969b8bb56e717beb
I20260811 16:03:32.759382 13755 tablet_copy_source_session.cc:205] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:32.762743 14880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c9671b71f644eaf969b8bb56e717beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:32.772560 14875 tablet_copy_client.cc:791] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:32.773630 14875 tablet_copy_client.cc:655] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:32.778280 14875 tablet_copy_client.cc:531] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:32.784121 14880 tablet_copy_client.cc:791] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:32.786996 14880 tablet_copy_client.cc:655] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:32.793529 14875 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:32.792171 14880 tablet_copy_client.cc:531] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:32.811300 14880 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:32.836925 14875 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:32.837795 14875 tablet_bootstrap.cc:492] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:32.838433 14875 ts_tablet_manager.cc:1397] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.018s
I20260811 16:03:32.841696 14875 raft_consensus.cc:348] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.842655 14875 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:32.843444 14875 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.846556 14875 ts_tablet_manager.cc:1428] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260811 16:03:32.848511 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-18e29247552943ad9bfa10e83e0dc5dd received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:32.849113 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-18e29247552943ad9bfa10e83e0dc5dd on tablet 18e29247552943ad9bfa10e83e0dc5dd with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:32.878566 14880 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:32.879714 14880 tablet_bootstrap.cc:492] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:32.880483 14880 ts_tablet_manager.cc:1397] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.040s
I20260811 16:03:32.883412 14880 raft_consensus.cc:348] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.884339 14880 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:32.885104 14880 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:32.888029 14880 ts_tablet_manager.cc:1428] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260811 16:03:32.889626 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-6c9671b71f644eaf969b8bb56e717beb received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:32.890057 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-6c9671b71f644eaf969b8bb56e717beb on tablet 6c9671b71f644eaf969b8bb56e717beb with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:32.977151 14582 raft_consensus.cc:1203] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:33.123037 14582 raft_consensus.cc:1203] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:33.133325 14582 raft_consensus.cc:1203] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:33.226852 14582 raft_consensus.cc:1203] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:33.489497 14886 raft_consensus.cc:1050] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:33.493108 14886 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.504817 14582 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.504839 13740 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.506296 14888 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:33.507910 13825 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.509442 14886 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:33.511950 14889 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:33.534169 14886 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.537722 13825 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.536940 14582 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.556654 13740 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.564675 14866 raft_consensus.cc:1050] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:33.564864 13630 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:33.568131 14866 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.596650 13905 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.596817 13825 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.598385 14794 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:33.605404 14866 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:33.606671 14815 raft_consensus.cc:1050] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:33.609133 14815 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.619874 14582 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.622324 14831 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:33.649322 13744 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.647328 14582 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.651332 14815 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:33.651566 13905 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.652805 14860 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:03:33.655372 14898 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:33.696154 14794 raft_consensus.cc:1050] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:33.698539 14794 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.708786 13825 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.702510 14831 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:03:33.736557 14902 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260811 16:03:33.748263 13901 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.757086 14581 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.757799 14903 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.763597 14583 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:33.771127 13740 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:33.754971 13626 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.773574 13901 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.775646 14886 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260811 16:03:33.781905 14888 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:33.798039 14888 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.803704 13740 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.828500 13630 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.832186 14581 raft_consensus.cc:2932] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.841712 14583 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.843596 14794 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:33.846414 14583 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:03:33.862746 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 107059us
I20260811 16:03:33.876345 13626 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.886852 13905 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.893697 14794 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:33.896309 13740 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.898039 13827 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:33.903759 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 993fa0c090be4f83b6e0d60b3aa8dc78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:33.917582 13827 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.918753 14913 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:33.922411 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 993fa0c090be4f83b6e0d60b3aa8dc78 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:33.928740 13905 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:33.932346 14913 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.937016 13903 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.942462 14582 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:33.953629 14581 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.957844 13905 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:33.967079 13744 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:33.965129 14903 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260811 16:03:33.974498 14815 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:33.981468 14917 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:33.982752 14917 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:33.983626 14917 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:33.989931 14917 ts_tablet_manager.cc:1905] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:33.997287 13825 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:33.997421 14903 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.020799 14582 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:34.022254 14917 ts_tablet_manager.cc:1918] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:34.022970 14917 log.cc:1196] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/993fa0c090be4f83b6e0d60b3aa8dc78
I20260811 16:03:34.032106 14915 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:34.034284 13628 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.037992 14578 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.042436 14831 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:34.042258 13901 raft_consensus.cc:2932] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.063484 14581 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.060618 14913 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.064910 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 993fa0c090be4f83b6e0d60b3aa8dc78 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:34.085155 13627 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.090284 13827 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.097492 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a97fbe9fd7534b9e93a8abec637a8c1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:34.104640 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 18e29247552943ad9bfa10e83e0dc5dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:34.123489 13743 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:34.138288 14581 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:34.140587 14913 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:34.147157 13824 raft_consensus.cc:2932] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.149923 13628 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.150978 14915 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.152971 14578 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.157352 13825 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:34.167064 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6c9671b71f644eaf969b8bb56e717beb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:34.168768 14915 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:34.169174 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet a97fbe9fd7534b9e93a8abec637a8c1e with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:34.171201 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 18e29247552943ad9bfa10e83e0dc5dd with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:34.178112 14922 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:34.179508 14922 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:34.180651 13824 raft_consensus.cc:2932] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:34.180351 14922 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:34.187053 14922 ts_tablet_manager.cc:1905] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:34.195945 13628 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:34.212872 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c9671b71f644eaf969b8bb56e717beb with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:34.214303 14920 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:34.215927 14920 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:34.216928 14920 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:34.223914 14922 ts_tablet_manager.cc:1918] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:34.224642 14922 log.cc:1196] T 18e29247552943ad9bfa10e83e0dc5dd P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/18e29247552943ad9bfa10e83e0dc5dd
I20260811 16:03:34.229625 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 18e29247552943ad9bfa10e83e0dc5dd (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:34.231011 14922 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:34.233366 14920 ts_tablet_manager.cc:1905] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:34.233537 14922 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:34.235831 14922 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:34.241217 14922 ts_tablet_manager.cc:1905] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:34.256309 14920 ts_tablet_manager.cc:1918] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:34.256903 14920 log.cc:1196] T a97fbe9fd7534b9e93a8abec637a8c1e P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/a97fbe9fd7534b9e93a8abec637a8c1e
I20260811 16:03:34.257256 14922 ts_tablet_manager.cc:1918] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:34.257748 14922 log.cc:1196] T 6c9671b71f644eaf969b8bb56e717beb P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/6c9671b71f644eaf969b8bb56e717beb
I20260811 16:03:34.259119 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet a97fbe9fd7534b9e93a8abec637a8c1e (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:34.259195 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 6c9671b71f644eaf969b8bb56e717beb (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:35.263669 13743 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:35.270355 13706 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f329d644e014d3fad21c11a415e907c. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:35.270455 13824 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.271937 13903 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.273130 14912 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:35.274048 14867 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:35.282619 14924 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.284452 13903 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.288057 13824 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.310438 13630 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.314996 13824 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:35.327894 13787 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c5b1c77a3014dd490b50a04ca62cd4c. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:35.328083 13903 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.329983 14903 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:35.330282 13743 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.332899 14923 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:35.365324 14903 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.372239 13903 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.388460 13744 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:35.393932 13628 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:35.401031 13743 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.416396 13903 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.417851 14924 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260811 16:03:35.420141 13706 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97076df0f82e4818b7f7318f8deff8d8. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:35.420436 13827 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.424389 14912 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:35.435875 13903 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.434185 14924 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.438652 13827 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.458930 13628 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.455814 13824 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:35.499083 13743 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.507196 13903 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:35.506960 14923 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260811 16:03:35.512319 13787 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b62f8d4bd2b496fbdc602cfa4bb2ccc. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:35.512657 14923 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:35.523581 14948 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.526875 13903 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.529320 13744 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.549594 13628 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:35.758347 14952 ts_tablet_manager.cc:927] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:35.766237 14952 tablet_copy_client.cc:316] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:35.769042 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 7f329d644e014d3fad21c11a415e907c from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:35.769634 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 7f329d644e014d3fad21c11a415e907c from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-7f329d644e014d3fad21c11a415e907c
I20260811 16:03:35.778308 13755 tablet_copy_source_session.cc:205] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:35.782243 14952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f329d644e014d3fad21c11a415e907c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:35.798629 14952 tablet_copy_client.cc:791] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:35.799276 14952 tablet_copy_client.cc:655] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:35.803392 14952 tablet_copy_client.cc:531] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:35.813632 14952 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:35.838769 14952 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:35.839663 14952 tablet_bootstrap.cc:492] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:35.840368 14952 ts_tablet_manager.cc:1397] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.000s
I20260811 16:03:35.842674 14952 raft_consensus.cc:348] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:35.843439 14952 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:35.844075 14952 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:35.847636 14952 ts_tablet_manager.cc:1428] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260811 16:03:35.850746 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7f329d644e014d3fad21c11a415e907c received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:35.851217 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7f329d644e014d3fad21c11a415e907c on tablet 7f329d644e014d3fad21c11a415e907c with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:35.928027 14952 ts_tablet_manager.cc:927] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:35.930562 14952 tablet_copy_client.cc:316] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:35.932286 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:35.932852 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-5b62f8d4bd2b496fbdc602cfa4bb2ccc
I20260811 16:03:35.939916 13839 tablet_copy_source_session.cc:205] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:35.943359 14952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:35.945716 14958 ts_tablet_manager.cc:927] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:35.950695 14958 tablet_copy_client.cc:316] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:35.952562 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet 2c5b1c77a3014dd490b50a04ca62cd4c from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:35.953179 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet 2c5b1c77a3014dd490b50a04ca62cd4c from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-2c5b1c77a3014dd490b50a04ca62cd4c
I20260811 16:03:35.961645 13839 tablet_copy_source_session.cc:205] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:35.966055 14958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5b1c77a3014dd490b50a04ca62cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:35.975256 14952 tablet_copy_client.cc:791] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:35.976716 14952 tablet_copy_client.cc:655] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:35.980808 14952 tablet_copy_client.cc:531] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:35.990370 14958 tablet_copy_client.cc:791] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:35.990798 14961 ts_tablet_manager.cc:927] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:35.991107 14958 tablet_copy_client.cc:655] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:35.992527 14952 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:35.995268 14958 tablet_copy_client.cc:531] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:36.006328 14958 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:36.007558 14961 tablet_copy_client.cc:316] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:36.009307 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 97076df0f82e4818b7f7318f8deff8d8 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:36.009897 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 97076df0f82e4818b7f7318f8deff8d8 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-97076df0f82e4818b7f7318f8deff8d8
I20260811 16:03:36.026340 13755 tablet_copy_source_session.cc:205] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:36.029843 14961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97076df0f82e4818b7f7318f8deff8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:36.049062 14952 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:36.050581 14952 tablet_bootstrap.cc:492] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:36.051648 14952 ts_tablet_manager.cc:1397] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.012s
I20260811 16:03:36.054878 14952 raft_consensus.cc:348] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:36.055863 14952 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:36.056542 14952 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:36.059444 14952 ts_tablet_manager.cc:1428] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260811 16:03:36.065390 14961 tablet_copy_client.cc:791] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:36.066015 14961 tablet_copy_client.cc:655] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:36.066994 14958 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:36.068145 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-5b62f8d4bd2b496fbdc602cfa4bb2ccc received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:36.068593 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-5b62f8d4bd2b496fbdc602cfa4bb2ccc on tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:36.072955 14961 tablet_copy_client.cc:531] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:36.075464 14958 tablet_bootstrap.cc:492] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:36.076380 14958 ts_tablet_manager.cc:1397] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.007s
I20260811 16:03:36.079238 14958 raft_consensus.cc:348] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:36.080111 14958 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:36.080776 14958 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:36.085345 14961 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:36.086385 14958 ts_tablet_manager.cc:1428] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260811 16:03:36.089443 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-2c5b1c77a3014dd490b50a04ca62cd4c received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:36.089927 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-2c5b1c77a3014dd490b50a04ca62cd4c on tablet 2c5b1c77a3014dd490b50a04ca62cd4c with peer 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:03:36.186981 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47137.3us
I20260811 16:03:36.269343 14961 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:36.272007 14961 tablet_bootstrap.cc:492] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:36.273460 14961 ts_tablet_manager.cc:1397] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.188s	user 0.025s	sys 0.008s
I20260811 16:03:36.281282 14961 raft_consensus.cc:348] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:36.285656 14961 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:36.286625 14961 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:36.294869 14961 ts_tablet_manager.cc:1428] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.021s	user 0.014s	sys 0.000s
I20260811 16:03:36.298229 14578 raft_consensus.cc:1203] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:36.318089 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-97076df0f82e4818b7f7318f8deff8d8 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:36.318758 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-97076df0f82e4818b7f7318f8deff8d8 on tablet 97076df0f82e4818b7f7318f8deff8d8 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:36.426391 14578 raft_consensus.cc:1203] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:36.499626 14578 raft_consensus.cc:1203] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:36.549007 14578 raft_consensus.cc:1203] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:36.713241 14867 raft_consensus.cc:1050] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:36.715588 14867 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:36.724781 14578 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.726415 13825 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.726557 14976 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:36.727560 13902 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.729372 14912 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:36.732551 14967 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:36.753814 14912 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.762418 13902 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.767980 13827 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.777505 14578 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.790124 13628 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:36.835912 13744 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:36.846195 14578 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:36.846345 13902 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:36.848090 14947 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:36.849225 14968 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:36.857964 14912 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.861470 13901 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.868485 14579 raft_consensus.cc:2932] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.870927 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7f329d644e014d3fad21c11a415e907c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:36.887461 13627 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:36.923102 14975 raft_consensus.cc:1050] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:36.925753 14975 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:36.929502 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f329d644e014d3fad21c11a415e907c with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:36.940214 13902 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.944228 14579 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.944257 13744 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.945915 14975 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:36.947192 14815 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:36.951503 14975 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:36.966265 14912 raft_consensus.cc:1050] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:36.969676 14912 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:36.973086 14988 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:36.974341 14988 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:36.976424 14988 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:36.980472 14988 ts_tablet_manager.cc:1905] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:36.980525 14815 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.984160 14578 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.985072 13901 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.985978 14947 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:36.988211 14947 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:36.990312 13743 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.993554 13902 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:36.994832 13821 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:36.998984 14966 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:37.069175 13627 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.071503 14579 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.113197 14988 ts_tablet_manager.cc:1918] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:37.113927 14988 log.cc:1196] T 7f329d644e014d3fad21c11a415e907c P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/7f329d644e014d3fad21c11a415e907c
I20260811 16:03:37.116250 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 7f329d644e014d3fad21c11a415e907c (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:37.115362 14912 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.117069 14578 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.135044 13824 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:37.140923 13821 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.146126 13903 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.155684 13630 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:37.168135 14975 raft_consensus.cc:1050] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:37.170943 14975 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:37.181005 14578 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:37.189088 14815 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:37.190884 13740 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:37.201333 13903 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:37.201762 14815 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.202806 14579 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:37.204322 14867 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:37.207044 14994 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:37.213721 13903 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.213593 14580 raft_consensus.cc:2932] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.219224 14966 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.237824 14578 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.244112 13626 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.258169 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c5b1c77a3014dd490b50a04ca62cd4c with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:37.259291 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 97076df0f82e4818b7f7318f8deff8d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:37.262776 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 2c5b1c77a3014dd490b50a04ca62cd4c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:37.278710 14580 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:37.280858 14994 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:37.286432 13821 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:37.286891 13740 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:37.288976 14975 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:37.295044 14966 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:37.297015 13626 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:37.300879 15001 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:37.302426 13827 raft_consensus.cc:2932] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.304647 15001 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:37.307665 15001 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:37.313935 13903 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:37.316494 15001 ts_tablet_manager.cc:1905] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:37.322870 14975 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:37.332875 14994 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.334900 13741 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.340445 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 97076df0f82e4818b7f7318f8deff8d8 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:37.365257 15005 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:37.366214 15005 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:37.366886 15005 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:37.372823 15005 ts_tablet_manager.cc:1905] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:37.375015 13903 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.375255 14580 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.389289 15001 ts_tablet_manager.cc:1918] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:37.389823 15001 log.cc:1196] T 2c5b1c77a3014dd490b50a04ca62cd4c P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/2c5b1c77a3014dd490b50a04ca62cd4c
I20260811 16:03:37.391695 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 2c5b1c77a3014dd490b50a04ca62cd4c (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:37.392992 15005 ts_tablet_manager.cc:1918] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:37.393620 15005 log.cc:1196] T 97076df0f82e4818b7f7318f8deff8d8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/97076df0f82e4818b7f7318f8deff8d8
I20260811 16:03:37.395710 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 97076df0f82e4818b7f7318f8deff8d8 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:37.399183 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.424655 13821 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:37.429549 14580 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:37.430707 13903 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:37.430908 14975 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:37.433961 14975 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:37.440178 14994 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.449648 14578 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.451112 13903 raft_consensus.cc:2932] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.459344 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:37.469110 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:37.480737 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:37.481799 15001 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:37.482926 15001 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:37.483639 15001 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:37.486555 15001 ts_tablet_manager.cc:1905] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:37.507875 15001 ts_tablet_manager.cc:1918] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:37.508328 15001 log.cc:1196] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/5b62f8d4bd2b496fbdc602cfa4bb2ccc
I20260811 16:03:37.510355 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 5b62f8d4bd2b496fbdc602cfa4bb2ccc (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:38.541144 13903 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:38.549310 13821 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:38.549433 13740 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:38.549952 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7aa7e1db174a419e955a8806d40e8a14. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:38.550778 14939 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:38.551949 14998 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:38.570152 13821 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.570369 14939 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.574801 13740 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.589874 13630 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.636730 13824 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:38.651063 13903 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:38.652100 13741 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:38.654927 15010 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:03:38.655462 13787 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6b1798b103e4d138b728902afcc2b9b. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:38.656404 14815 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:38.667882 15010 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.678326 13903 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.682655 13741 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.699937 13740 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:38.702719 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:38.710523 13903 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:38.711627 13824 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:38.712289 14966 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:38.715976 14966 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:03:38.730571 13706 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 673bb1bb89d4450ba4dbcb918a9174e0. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:38.736950 13903 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.732777 15021 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.745826 13824 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.758536 13630 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:38.760491 13740 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:38.768008 13903 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:38.769249 13706 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b76fe83cb6c40d0af784af645b1e956. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:38.769464 14966 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:38.772243 13824 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:38.776471 14966 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:38.790510 15021 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.792332 13902 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.795329 13824 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.821017 13630 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:38.978272 15028 ts_tablet_manager.cc:927] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:38.981022 15028 tablet_copy_client.cc:316] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:38.982915 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 7aa7e1db174a419e955a8806d40e8a14 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:38.983587 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 7aa7e1db174a419e955a8806d40e8a14 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-7aa7e1db174a419e955a8806d40e8a14
I20260811 16:03:38.996150 13923 tablet_copy_source_session.cc:205] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:39.000104 15028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa7e1db174a419e955a8806d40e8a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:39.020012 15028 tablet_copy_client.cc:791] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:39.020833 15028 tablet_copy_client.cc:655] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:39.024875 15028 tablet_copy_client.cc:531] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:39.035202 15028 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:39.061203 15028 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:39.062095 15028 tablet_bootstrap.cc:492] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:39.062785 15028 ts_tablet_manager.cc:1397] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260811 16:03:39.065445 15028 raft_consensus.cc:348] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.066095 15028 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:39.066648 15028 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.080744 15028 ts_tablet_manager.cc:1428] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.004s
I20260811 16:03:39.082656 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7aa7e1db174a419e955a8806d40e8a14 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:39.083060 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7aa7e1db174a419e955a8806d40e8a14 on tablet 7aa7e1db174a419e955a8806d40e8a14 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:39.203239 15028 ts_tablet_manager.cc:927] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:39.214546 15028 tablet_copy_client.cc:316] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:39.216490 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 7b76fe83cb6c40d0af784af645b1e956 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:39.217064 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 7b76fe83cb6c40d0af784af645b1e956 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-7b76fe83cb6c40d0af784af645b1e956
I20260811 16:03:39.226406 13755 tablet_copy_source_session.cc:205] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:39.229708 15028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b76fe83cb6c40d0af784af645b1e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:39.249095 15028 tablet_copy_client.cc:791] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:39.249938 15028 tablet_copy_client.cc:655] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:39.261106 15028 tablet_copy_client.cc:531] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:39.263631 15036 ts_tablet_manager.cc:927] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:39.272540 15036 tablet_copy_client.cc:316] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:39.275509 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet f6b1798b103e4d138b728902afcc2b9b from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:39.276141 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet f6b1798b103e4d138b728902afcc2b9b from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-f6b1798b103e4d138b728902afcc2b9b
I20260811 16:03:39.277509 15028 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:39.285593 13839 tablet_copy_source_session.cc:205] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:39.291293 15036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b1798b103e4d138b728902afcc2b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:39.303659 15040 ts_tablet_manager.cc:927] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:39.309707 15028 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:39.310806 15028 tablet_bootstrap.cc:492] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:39.311585 15028 ts_tablet_manager.cc:1397] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.006s
I20260811 16:03:39.315197 15028 raft_consensus.cc:348] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.316046 15036 tablet_copy_client.cc:791] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:39.316016 15040 tablet_copy_client.cc:316] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:39.316386 15028 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:39.317040 15036 tablet_copy_client.cc:655] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:39.317596 15028 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.319725 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 673bb1bb89d4450ba4dbcb918a9174e0 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:39.320564 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 673bb1bb89d4450ba4dbcb918a9174e0 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-673bb1bb89d4450ba4dbcb918a9174e0
I20260811 16:03:39.322728 15028 ts_tablet_manager.cc:1428] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260811 16:03:39.327419 13754 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7b76fe83cb6c40d0af784af645b1e956 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:39.328111 13754 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7b76fe83cb6c40d0af784af645b1e956 on tablet 7b76fe83cb6c40d0af784af645b1e956 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:39.331260 15036 tablet_copy_client.cc:531] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:39.337146 13755 tablet_copy_source_session.cc:205] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:39.341805 15040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 673bb1bb89d4450ba4dbcb918a9174e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:39.361886 15036 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:39.363626 15040 tablet_copy_client.cc:791] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:39.364238 15040 tablet_copy_client.cc:655] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:39.373742 15040 tablet_copy_client.cc:531] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:39.383878 15040 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:39.409415 15040 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:39.410389 15040 tablet_bootstrap.cc:492] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:39.411093 15040 ts_tablet_manager.cc:1397] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260811 16:03:39.414088 15040 raft_consensus.cc:348] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.415027 15040 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:39.415722 15040 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.418009 15036 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:39.419114 15036 tablet_bootstrap.cc:492] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:39.420174 15036 ts_tablet_manager.cc:1397] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.012s
I20260811 16:03:39.422894 15040 ts_tablet_manager.cc:1428] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260811 16:03:39.424760 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-673bb1bb89d4450ba4dbcb918a9174e0 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:39.425176 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-673bb1bb89d4450ba4dbcb918a9174e0 on tablet 673bb1bb89d4450ba4dbcb918a9174e0 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:39.430043 15036 raft_consensus.cc:348] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.431030 15036 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:39.431756 15036 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:39.434127 15036 ts_tablet_manager.cc:1428] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.004s
I20260811 16:03:39.435673 14578 raft_consensus.cc:1203] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:39.440079 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-f6b1798b103e4d138b728902afcc2b9b received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:39.440593 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-f6b1798b103e4d138b728902afcc2b9b on tablet f6b1798b103e4d138b728902afcc2b9b with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:39.581737 14578 raft_consensus.cc:1203] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:39.735374 14580 raft_consensus.cc:1203] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:39.871392 14580 raft_consensus.cc:1203] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:39.885346 15012 raft_consensus.cc:1050] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:39.888127 15012 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:39.914139 14578 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:39.915042 13824 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:39.915824 13740 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:39.916525 15011 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:39.917560 15012 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:39.919401 15045 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260811 16:03:39.955111 15011 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:39.959986 14578 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:39.992069 13824 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:39.998901 13627 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.033881 13743 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.071826 14976 raft_consensus.cc:1050] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:40.071866 13903 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.074460 14976 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.080437 14578 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.080616 13743 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.082019 15052 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:40.087468 15049 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:40.089960 14580 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.089527 15051 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.091831 14976 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:40.093267 13903 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.095058 13821 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.095618 14976 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:40.096617 14966 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:40.098042 14578 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.119971 13627 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.121717 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7aa7e1db174a419e955a8806d40e8a14 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:40.127080 13743 raft_consensus.cc:2932] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.136596 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa7e1db174a419e955a8806d40e8a14 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:40.140820 14947 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.143388 14580 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.141721 13903 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.160581 13821 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.175879 15068 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:40.175880 13627 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.177166 15068 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:40.178303 15068 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:40.182668 15068 ts_tablet_manager.cc:1905] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:40.230546 15068 ts_tablet_manager.cc:1918] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:40.233862 15068 log.cc:1196] T 7aa7e1db174a419e955a8806d40e8a14 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/7aa7e1db174a419e955a8806d40e8a14
I20260811 16:03:40.238751 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 7aa7e1db174a419e955a8806d40e8a14 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:40.219664 13741 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.269961 14976 raft_consensus.cc:1050] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:40.277136 14976 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.279687 14578 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.281435 14966 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:40.284708 13825 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.291751 14947 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.293666 15021 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:40.306504 14578 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.310810 13825 raft_consensus.cc:2932] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.326058 13627 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.332775 14578 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.334270 13903 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.334224 14976 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:40.335872 14947 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:40.338130 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7b76fe83cb6c40d0af784af645b1e956 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:40.347182 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b76fe83cb6c40d0af784af645b1e956 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:40.346199 14947 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.348168 13903 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.358923 14578 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.370385 13827 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.376645 15073 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:40.378317 15073 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:40.379436 15073 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:40.380353 14976 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:40.370529 13626 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.383646 15073 ts_tablet_manager.cc:1905] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:40.423765 14994 raft_consensus.cc:1050] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:40.460129 14994 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.451964 13827 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:03:40.469225 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62405.6us
I20260811 16:03:40.473349 13741 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.501109 14580 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.501521 13902 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.502656 14976 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:40.503903 14947 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:40.510834 14578 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.513320 15070 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.536890 13630 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.542258 13902 raft_consensus.cc:2932] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.552472 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 673bb1bb89d4450ba4dbcb918a9174e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:40.555924 15073 ts_tablet_manager.cc:1918] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:40.571447 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 673bb1bb89d4450ba4dbcb918a9174e0 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:40.571920 15073 log.cc:1196] T 7b76fe83cb6c40d0af784af645b1e956 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/7b76fe83cb6c40d0af784af645b1e956
I20260811 16:03:40.572623 15068 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:40.573756 15068 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:40.574527 15068 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:40.575002 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 7b76fe83cb6c40d0af784af645b1e956 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:40.576571 13902 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.581835 15076 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:40.588693 13743 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.588780 15068 ts_tablet_manager.cc:1905] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:40.591173 14578 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:40.592530 15076 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:40.596161 15077 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:40.629410 15068 ts_tablet_manager.cc:1918] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:40.628580 14994 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.630069 15068 log.cc:1196] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/673bb1bb89d4450ba4dbcb918a9174e0
I20260811 16:03:40.630227 13743 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.633342 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 673bb1bb89d4450ba4dbcb918a9174e0 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:40.636723 14578 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.645453 13903 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.653563 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.675623 13821 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:40.680559 14578 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.680925 13903 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:40.682390 15078 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:40.683475 15010 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:40.691089 15077 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.692768 14578 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.692768 13903 raft_consensus.cc:2932] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.707492 13628 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:40.711977 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f6b1798b103e4d138b728902afcc2b9b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:40.722363 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet f6b1798b103e4d138b728902afcc2b9b with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:40.725389 15085 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:40.726832 15085 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:40.728855 15085 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:40.734045 15085 ts_tablet_manager.cc:1905] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:40.758747 15085 ts_tablet_manager.cc:1918] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:40.759212 15085 log.cc:1196] T f6b1798b103e4d138b728902afcc2b9b P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/f6b1798b103e4d138b728902afcc2b9b
I20260811 16:03:40.760970 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet f6b1798b103e4d138b728902afcc2b9b (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:41.797298 13903 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:41.803997 13821 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:41.804972 13743 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:41.804988 13871 consensus_peers.cc:487] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98ab517b34b7491eabb89d31d262a45e. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:41.805476 15049 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:41.806607 15088 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:41.815620 15049 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.817795 13743 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.819764 13821 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.832508 13827 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:41.839255 13626 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:41.842651 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85bed8270f474c2e80653bbdc5806659. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:41.843410 13903 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:41.845534 15081 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:41.846205 13743 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:41.847942 15077 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:41.868804 13902 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.874065 15081 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.913259 13741 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.949329 13630 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:41.954418 13741 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:41.966744 13706 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9315a4a479754517bd121148cf017615. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:41.966903 13902 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:41.968430 13827 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:41.968698 15070 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:41.970089 15086 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:41.979983 15070 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.982215 13827 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.983454 13902 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:41.999221 13821 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.013664 13903 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 16:03:42.015012 13787 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 930faff3981346c88c8864a1f3b15158. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:42.015911 15098 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:42.016283 13741 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:42.009509 13630 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:42.017627 15103 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:42.035261 13743 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:42.027812 15081 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:42.043211 13902 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:42.057307 13626 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:42.203610 15112 ts_tablet_manager.cc:927] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:42.205583 15112 tablet_copy_client.cc:316] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:42.207049 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 98ab517b34b7491eabb89d31d262a45e from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:42.207587 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 98ab517b34b7491eabb89d31d262a45e from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-98ab517b34b7491eabb89d31d262a45e
I20260811 16:03:42.215626 13923 tablet_copy_source_session.cc:205] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:42.218782 15112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98ab517b34b7491eabb89d31d262a45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:42.236753 15112 tablet_copy_client.cc:791] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:42.237409 15112 tablet_copy_client.cc:655] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:42.242188 15112 tablet_copy_client.cc:531] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:42.247298 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:42.252144 15112 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:42.272909 15112 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:42.273918 15112 tablet_bootstrap.cc:492] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:42.274626 15112 ts_tablet_manager.cc:1397] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260811 16:03:42.277477 15112 raft_consensus.cc:348] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.278169 15112 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:42.278820 15112 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.282913 15112 ts_tablet_manager.cc:1428] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260811 16:03:42.286091 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-98ab517b34b7491eabb89d31d262a45e received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:42.286530 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-98ab517b34b7491eabb89d31d262a45e on tablet 98ab517b34b7491eabb89d31d262a45e with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.314267 15112 ts_tablet_manager.cc:927] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:42.319926 15112 tablet_copy_client.cc:316] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:42.324265 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet 85bed8270f474c2e80653bbdc5806659 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:42.324901 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet 85bed8270f474c2e80653bbdc5806659 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-85bed8270f474c2e80653bbdc5806659
I20260811 16:03:42.336179 13839 tablet_copy_source_session.cc:205] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:42.340641 15112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bed8270f474c2e80653bbdc5806659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:42.343420 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:42.344237 13741 raft_consensus.cc:595] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.360518 15112 tablet_copy_client.cc:791] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:42.360502 13827 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:42.361315 13827 raft_consensus.cc:595] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.361430 15112 tablet_copy_client.cc:655] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:42.365105 13821 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:42.365625 13821 raft_consensus.cc:595] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:42.367875 13827 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:42.368381 13827 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:42.369246 15112 tablet_copy_client.cc:531] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:42.372776 13827 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:42.373495 13827 raft_consensus.cc:595] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.377233 13827 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "defa959376494546a5395f8a56cef106"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:42.377825 13827 raft_consensus.cc:595] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.381335 15112 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:42.387899 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260811 16:03:42.389798 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:42.390610 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:42.405133 15112 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:42.406023 15112 tablet_bootstrap.cc:492] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:42.406749 15112 ts_tablet_manager.cc:1397] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.000s
I20260811 16:03:42.409785 15112 raft_consensus.cc:348] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.410712 15112 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:42.411478 15112 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.414335 15112 ts_tablet_manager.cc:1428] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260811 16:03:42.417136 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-85bed8270f474c2e80653bbdc5806659 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:42.417608 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-85bed8270f474c2e80653bbdc5806659 on tablet 85bed8270f474c2e80653bbdc5806659 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.444742 15112 ts_tablet_manager.cc:927] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:42.445638 15070 raft_consensus.cc:979] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.446194 15086 raft_consensus.cc:1067] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.447858 14578 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:03:42.448451 14578 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:42.448800 14578 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.456017 15112 tablet_copy_client.cc:316] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:42.456303 14578 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.459002 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 9315a4a479754517bd121148cf017615 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:42.459621 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 9315a4a479754517bd121148cf017615 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-9315a4a479754517bd121148cf017615
I20260811 16:03:42.459498 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:42.460297 13743 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:42.460630 13743 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:42.461323 13743 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.462476 13743 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.465381 14578 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:42.467777 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:42.468345 13821 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.470862 13755 tablet_copy_source_session.cc:205] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:42.474555 13821 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.475775 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:42.476612 15115 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:42.477030 15112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9315a4a479754517bd121148cf017615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:42.479267 15115 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:42.480283 15115 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.490250 13743 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.493546 15122 ts_tablet_manager.cc:927] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:42.499403 15103 raft_consensus.cc:979] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:42.499994 15098 raft_consensus.cc:1067] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:42.503208 15112 tablet_copy_client.cc:791] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:42.503846 15112 tablet_copy_client.cc:655] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:42.507105 13903 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:42.508049 13903 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:42.508411 13903 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.508858 15112 tablet_copy_client.cc:531] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:42.509722 13630 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:42.523305 15122 tablet_copy_client.cc:316] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:42.523798 15112 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:42.530916 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet 930faff3981346c88c8864a1f3b15158 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:42.531545 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet 930faff3981346c88c8864a1f3b15158 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-930faff3981346c88c8864a1f3b15158
I20260811 16:03:42.533138 13903 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:42.538084 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:42.538707 13743 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.539242 15103 raft_consensus.cc:979] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:42.539773 15103 raft_consensus.cc:1067] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:42.543247 15112 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:42.544423 15112 tablet_bootstrap.cc:492] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:42.545049 15112 ts_tablet_manager.cc:1397] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260811 16:03:42.546008 13743 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:42.547339 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:42.547972 15112 raft_consensus.cc:348] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.548815 15112 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:42.548871 15088 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:42.549084 13902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:42.549695 13902 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:42.549401 15112 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.552160 15112 ts_tablet_manager.cc:1428] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260811 16:03:42.552728 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:42.554557 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-9315a4a479754517bd121148cf017615 received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:42.555069 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-9315a4a479754517bd121148cf017615 on tablet 9315a4a479754517bd121148cf017615 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.555102 13827 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:42.555599 13827 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:42.552816 13903 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:42.556315 13827 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:42.557263 13827 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.549482 15088 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:42.550084 13902 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.562557 15088 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:42.573463 13743 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:03:42.577765 13827 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:42.573954 13839 tablet_copy_source_session.cc:205] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:42.574735 13902 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:42.587284 13902 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:42.590360 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:42.590665 15122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930faff3981346c88c8864a1f3b15158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:42.590369 13630 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:42.592572 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:42.593370 13827 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:42.593721 13827 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:42.594734 13827 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:42.595976 13827 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.603029 13827 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:42.603735 13743 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.604406 13874 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:42.611359 15088 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:42.614421 15088 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:42.615849 15088 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:42.611090 13743 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:42.624362 14580 raft_consensus.cc:1203] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:42.631517 15081 raft_consensus.cc:979] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.632018 15081 raft_consensus.cc:1067] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.633781 14580 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43044
I20260811 16:03:42.634377 14580 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:42.634771 14580 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.641254 15122 tablet_copy_client.cc:791] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:42.641925 15122 tablet_copy_client.cc:655] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:42.641764 14580 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.642170 13630 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:42.653406 14580 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:42.658454 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:42.659118 13821 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:42.659469 13821 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:42.660195 13821 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.663195 13821 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.663051 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:42.663758 13902 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.664132 15122 tablet_copy_client.cc:531] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:42.671303 15103 raft_consensus.cc:979] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.671993 15081 raft_consensus.cc:1067] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.673112 13902 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.674063 14579 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "defa959376494546a5395f8a56cef106"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43044
I20260811 16:03:42.674289 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:42.674724 14579 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:42.675191 14579 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.675257 15115 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:42.675832 15115 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:42.676676 15115 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.684032 15122 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:42.689811 14579 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.684199 13821 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.697541 14579 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:42.698551 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:42.699241 13902 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.699445 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:42.700111 13827 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:42.700402 13827 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:42.701109 13827 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.702560 13827 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.703533 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:42.732767 13902 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.734079 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:42.735173 15115 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:42.736858 15115 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:42.738407 13827 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.738090 15115 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.757581 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:42.772413 15122 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:42.773483 15122 tablet_bootstrap.cc:492] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:42.774379 15122 ts_tablet_manager.cc:1397] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.015s
I20260811 16:03:42.777727 15122 raft_consensus.cc:348] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.778625 15122 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:42.779310 15122 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:42.781579 15122 ts_tablet_manager.cc:1428] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260811 16:03:42.783686 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-930faff3981346c88c8864a1f3b15158 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:42.784133 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-930faff3981346c88c8864a1f3b15158 on tablet 930faff3981346c88c8864a1f3b15158 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:42.829656 14580 raft_consensus.cc:1203] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:42.930190 15103 raft_consensus.cc:979] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.931349 15098 raft_consensus.cc:1067] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:42.932860 14580 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43044
I20260811 16:03:42.933390 14580 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:42.933712 14580 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.939817 14580 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.942358 14580 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:42.942478 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:42.943171 13740 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.943674 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:42.944279 13821 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:42.944514 13821 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:42.945343 13821 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.946513 13821 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:42.950205 13740 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.951519 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:42.952399 15115 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:42.952888 15115 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:42.953724 15115 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:42.959093 13821 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:42.968175 13740 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:42.969666 15115 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:42.974274 13741 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:42.974360 13626 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:42.976065 15088 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:42.989888 14581 raft_consensus.cc:1203] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:43.016682 13827 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:43.018275 15115 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:43.071905 15054 raft_consensus.cc:1050] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:43.082491 14581 raft_consensus.cc:1203] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:43.116029 13741 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:43.125850 15054 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:43.130698 13901 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:43.130551 15088 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:43.134625 13823 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:43.175693 15088 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:43.177421 15124 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:43.186658 14580 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:43.188200 13743 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:43.189803 15149 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:43.196143 13821 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:43.203783 15088 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:43.206848 13821 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:43.208549 13827 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:43.210465 15142 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:43.215534 15081 raft_consensus.cc:1050] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:43.218024 15081 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:43.223706 13901 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:43.228324 15149 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:43.228825 15156 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260811 16:03:43.232698 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57799.7us
I20260811 16:03:43.233058 15142 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260811 16:03:43.272498 13823 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:43.275956 15124 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260811 16:03:43.452943 15165 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
W20260811 16:03:43.464385 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54680.7us
I20260811 16:03:43.465400 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:43.531587 15054 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:03:43.565688 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68800us
I20260811 16:03:43.597903 13740 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260811 16:03:43.614173 15163 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260811 16:03:43.623957 15160 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:03:43.649206 13741 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:43.657676 15162 raft_consensus.cc:1050] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:43.649134 15124 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260811 16:03:43.692298 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91815.2us
I20260811 16:03:43.696972 13902 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:43.717999 13744 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:43.719430 14581 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:43.780005 15174 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260811 16:03:43.780676 14580 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:43.799090 13820 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260811 16:03:43.853786 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 91247.3us
I20260811 16:03:43.859602 15173 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260811 16:03:43.892774 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48137.8us
W20260811 16:03:43.897396 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 197308us
I20260811 16:03:43.897294 15183 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260811 16:03:43.922494 13630 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:43.926580 15185 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260811 16:03:43.939611 15184 raft_consensus.cc:1050] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:43.940296 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:43.940929 13741 raft_consensus.cc:595] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:43.944595 15184 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:43.890949 15162 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:43.981554 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:43.982564 13741 raft_consensus.cc:595] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:43.986891 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:43.987532 13740 raft_consensus.cc:595] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:43.998092 15169 raft_consensus.cc:979] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:44.001348 15169 raft_consensus.cc:1067] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:44.002616 15161 raft_consensus.cc:979] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:44.007511 15172 raft_consensus.cc:1067] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:44.014077 14579 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:03:44.014818 14579 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:44.015355 14579 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:44.019753 14580 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:03:44.020792 14580 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:44.021204 14580 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:44.028116 13827 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:44.141124 14580 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:44.161093 14580 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:44.174384 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:44.175350 13740 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:44.175707 13740 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:44.191543 13740 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:44.201020 13740 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:44.202374 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:44.203011 13825 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:03:44.267350 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62180us
I20260811 16:03:44.274230 13825 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:44.348573 13740 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
W20260811 16:03:44.346980 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 78608.5us
W20260811 16:03:44.346299 15165 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260811 16:03:44.363163 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 334829us
W20260811 16:03:44.352631 15182 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:03:44.407810 13825 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:44.408478 13825 raft_consensus.cc:595] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:44.436702 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:44.437538 13740 raft_consensus.cc:595] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:44.453106 14580 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260811 16:03:44.454507 15190 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260811 16:03:44.454675 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:03:44.456624 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:44.490121 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:03:44.496261 15188 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.087s	user 0.007s	sys 0.002s
I20260811 16:03:44.520270 14541 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:03:44.519038 14579 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.003s
W20260811 16:03:44.547021 15193 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.088s	user 0.004s	sys 0.008s
W20260811 16:03:44.556059 15192 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260811 16:03:44.557789 15187 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260811 16:03:44.565088 15176 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:44.531430 14579 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:44.601192 14580 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
W20260811 16:03:44.619992 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48209.6us
I20260811 16:03:44.593791 15176 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:44.637001 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:44.637709 13742 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:44.638029 13742 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:44.643435 14579 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:44.645648 15176 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:03:44.652508 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63346us
I20260811 16:03:44.656476 13905 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260811 16:03:44.657465 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 66892.9us
W20260811 16:03:44.657936 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70914.5us
I20260811 16:03:44.638794 13742 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:44.664959 13742 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:44.673920 13741 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:44.676520 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:44.677510 13822 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:03:44.769829 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 84481.2us
W20260811 16:03:44.771993 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 71945.3us
I20260811 16:03:44.777851 15183 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260811 16:03:44.903455 15173 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:03:44.904378 15173 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:44.906618 15173 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:44.908874 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:44.923722 13822 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:44.940881 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:44.942312 15124 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:44.942988 15124 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:03:44.943519 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 244254us
I20260811 16:03:44.944083 15124 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:44.945685 13742 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:44.973019 15223 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:44.975116 15169 raft_consensus.cc:979] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:44.975819 15169 raft_consensus.cc:1067] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:44.985926 13901 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:44.986013 13902 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.001525 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:03:45.004654 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46397.3us
I20260811 16:03:45.008306 15214 raft_consensus.cc:979] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:45.008929 15214 raft_consensus.cc:1067] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:45.021130 13901 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60522
I20260811 16:03:45.021814 13901 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:45.022248 13901 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:45.034739 13825 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:45.035398 13825 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:45.035784 13825 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:45.035588 13901 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.042153 13901 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:45.017795 15201 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.032992 13744 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.080096 13741 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:45.099704 15185 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:45.108397 15174 raft_consensus.cc:979] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:45.112809 15174 raft_consensus.cc:1067] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:45.122557 13825 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.123169 13905 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:03:45.127117 14578 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:45.129750 13825 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:45.134716 13826 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:45.136014 14578 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43044
I20260811 16:03:45.136713 14578 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:45.137143 14578 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:45.139569 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:45.140393 13742 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:45.140740 13742 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:45.143167 15178 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260811 16:03:45.145991 15199 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260811 16:03:45.134788 13789 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:45.154870 13742 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.158545 13742 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:03:45.160909 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 118407us
I20260811 16:03:45.166389 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:45.167112 13741 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:45.167476 13741 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:45.168203 13741 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.169085 13741 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:45.176108 13741 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:45.157063 15103 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:03:45.076463 14579 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.182024 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:45.183178 13741 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.210354 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:45.222172 13826 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:03:45.232914 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51007.1us
W20260811 16:03:45.244923 15228 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260811 16:03:45.246464 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 119529us
I20260811 16:03:45.256378 15204 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:45.296748 13742 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:45.297847 14578 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:03:45.306417 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52659.2us
I20260811 16:03:45.300858 14578 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:45.316867 14578 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:03:45.306113 15204 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:45.338105 15204 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.322841 13826 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:45.362080 13630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 230) took 1447 ms. Trace:
W20260811 16:03:45.380481 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 222641us
I20260811 16:03:45.384966 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 234) took 1464 ms. Trace:
I20260811 16:03:45.388448 15142 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260811 16:03:45.391652 13628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 246) took 1462 ms. Trace:
I20260811 16:03:45.392122 13628 rpcz_store.cc:276] 0811 16:03:43.929445 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:43.929600 (+   155us) service_pool.cc:227] Handling call
0811 16:03:45.391579 (+1461979us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28788,"reported_tablets":1}
I20260811 16:03:45.385478 13626 rpcz_store.cc:276] 0811 16:03:43.920165 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:43.920452 (+   287us) service_pool.cc:227] Handling call
0811 16:03:45.384885 (+1464433us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
I20260811 16:03:45.364343 13630 rpcz_store.cc:276] 0811 16:03:43.909874 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:43.910064 (+   190us) service_pool.cc:227] Handling call
0811 16:03:45.357307 (+1447243us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:03:44.406111 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:03:44.495800 (+ 89689us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:03:44.495840 (+    40us) write_op.cc:435] Acquired schema lock
0811 16:03:44.495857 (+    17us) tablet.cc:660] Decoding operations
0811 16:03:44.496222 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:03:44.496297 (+    75us) write_op.cc:641] Partition lock acquired for write op
0811 16:03:44.496330 (+    33us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:03:44.496524 (+   194us) tablet.cc:699] Row locks acquired
0811 16:03:44.496540 (+    16us) write_op.cc:260] PREPARE: finished
0811 16:03:44.496700 (+   160us) write_op.cc:270] Start()
0811 16:03:44.496818 (+   118us) write_op.cc:276] Timestamp: P: 1786464224496653 usec, L: 0
0811 16:03:44.496841 (+    23us) op_driver.cc:331] REPLICATION: starting
0811 16:03:44.497576 (+   735us) log.cc:842] Serialized 599 byte log entry
0811 16:03:44.924440 (+426864us) op_driver.cc:444] REPLICATION: finished
0811 16:03:45.022569 (+ 98129us) write_op.cc:301] APPLY: starting
0811 16:03:45.022663 (+    94us) tablet.cc:1365] starting BulkCheckPresence
0811 16:03:45.022759 (+    96us) tablet.cc:1368] finished BulkCheckPresence
0811 16:03:45.022879 (+   120us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:03:45.023089 (+   210us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:03:45.023275 (+   186us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:03:45.023318 (+    43us) write_op.cc:312] APPLY: finished
0811 16:03:45.023503 (+   185us) log.cc:842] Serialized 23 byte log entry
0811 16:03:45.023695 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:45.023785 (+    90us) write_op.cc:454] Released schema lock
0811 16:03:45.023825 (+    40us) write_op.cc:341] FINISH: Updating metrics
0811 16:03:45.106054 (+ 82229us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:45.106099 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86605,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":97808,"apply.run_cpu_time_us":2303,"apply.run_wall_time_us":86716,"num_ops":1,"prepare.queue_time_us":418213,"prepare.run_cpu_time_us":17816,"prepare.run_wall_time_us":217978,"raft.queue_time_us":277841,"raft.run_cpu_time_us":20402,"raft.run_wall_time_us":128225,"replication_time_us":420891,"thread_start_us":554338,"threads_started":4,"wal-append.queue_time_us":93472}]]}
I20260811 16:03:45.413486 13741 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:45.411381 15156 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:03:45.414565 15156 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:45.417500 13627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 142) took 1425 ms. Trace:
I20260811 16:03:45.418380 13627 rpcz_store.cc:276] 0811 16:03:43.992091 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:43.992250 (+   159us) service_pool.cc:227] Handling call
0811 16:03:45.417409 (+1425159us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
I20260811 16:03:45.413796 15187 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.429867 13824 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260811 16:03:45.433501 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 240405us
I20260811 16:03:45.428730 14581 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.457405 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:45.447079 15235 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260811 16:03:45.415939 15207 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260811 16:03:45.483593 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:45.463653 15206 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260811 16:03:45.484831 13627 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:03:45.497762 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 319719us
I20260811 16:03:45.497058 13627 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.490068 15156 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:45.506064 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:45.509235 15234 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:03:45.507923 13627 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.509774 15234 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:45.496414 15081 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:45.529237 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:03:45.561178 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:45.561830 13902 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:45.558346 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:45.567797 13904 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:45.574592 15238 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:45.596783 15238 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:45.599363 13904 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:45.608325 15234 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:45.617602 13823 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:45.608210 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:45.618191 13823 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:45.608680 15238 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.624503 13902 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:45.618752 15209 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:03:45.532927 15081 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:45.645962 15243 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260811 16:03:45.647552 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:03:45.678767 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 187384us
I20260811 16:03:45.681672 15237 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:03:45.682279 15237 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:45.684485 15237 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:45.669754 15124 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:45.693578 15124 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:45.692092 15209 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:03:45.718096 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 193116us
I20260811 16:03:45.730690 13901 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.737957 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:45.743307 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:45.723546 15179 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:03:45.743620 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:45.648427 15200 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:03:45.803537 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51584.2us
I20260811 16:03:45.811801 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:45.814731 14580 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:45.803273 15088 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:45.829140 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:03:45.813742 15124 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:45.807550 15209 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:45.862676 13827 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:45.690737 13823 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:03:45.906795 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84388us
I20260811 16:03:45.907322 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:03:45.945012 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:03:45.905833 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65387.2us
I20260811 16:03:45.819672 15179 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:03:45.912408 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67051.5us
W20260811 16:03:45.917891 15252 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260811 16:03:45.918542 15081 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:45.953296 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:45.966603 13742 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:45.975055 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:45.975975 15231 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:03:45.977243 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:45.978137 15231 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:45.988174 13902 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:45.989643 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:45.990778 15179 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:45.972975 15205 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:46.017773 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:46.028764 13823 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:46.018538 13907 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:46.036412 15237 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:46.040972 13902 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.052269 15236 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:46.050949 13789 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:46.056044 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:46.065032 15219 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:46.074487 13824 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.073477 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:46.047384 15249 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260811 16:03:46.099013 15184 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:46.135018 13823 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
W20260811 16:03:46.137427 15235 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260811 16:03:46.163561 14581 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.177814 13823 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.180994 15156 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.186636 15088 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.202432 13743 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:46.211843 15088 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:46.245500 13907 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:46.282824 15176 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260811 16:03:46.290340 15156 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.293406 13823 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.307180 13818 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:46.315183 15185 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:46.328091 14579 raft_consensus.cc:2932] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.372195 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 98ab517b34b7491eabb89d31d262a45e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:46.394519 13628 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:46.441488 13628 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.472155 13818 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:46.485975 15054 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:46.566507 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:46.590591 13626 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:46.608458 13630 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.611234 13630 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:46.617251 13630 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:03:46.729007 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63980.3us
W20260811 16:03:46.729681 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 78707.8us
I20260811 16:03:46.784849 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 143) took 1104 ms. Trace:
I20260811 16:03:46.794061 13626 rpcz_store.cc:276] 0811 16:03:45.680651 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:45.680920 (+   269us) service_pool.cc:227] Handling call
0811 16:03:46.784749 (+1103829us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:03:46.633977 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:03:46.638773 (+  4796us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:03:46.638838 (+    65us) write_op.cc:435] Acquired schema lock
0811 16:03:46.638874 (+    36us) tablet.cc:660] Decoding operations
0811 16:03:46.639480 (+   606us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:03:46.639549 (+    69us) write_op.cc:641] Partition lock acquired for write op
0811 16:03:46.639582 (+    33us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:03:46.639858 (+   276us) tablet.cc:699] Row locks acquired
0811 16:03:46.639886 (+    28us) write_op.cc:260] PREPARE: finished
0811 16:03:46.640073 (+   187us) write_op.cc:270] Start()
0811 16:03:46.640237 (+   164us) write_op.cc:276] Timestamp: P: 1786464226640013 usec, L: 0
0811 16:03:46.640263 (+    26us) op_driver.cc:331] REPLICATION: starting
0811 16:03:46.641094 (+   831us) log.cc:842] Serialized 536 byte log entry
0811 16:03:46.756851 (+115757us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18002cfaa0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5531c8a8 00007f5c5531ea78 00007f5c5531ea28 00007f5c5531e9a8 00007f5c5531e963 00007f5c5531dc4c 00007f5c57915206 00007f5c5790d808 00007f5c51918170
0811 16:03:46.756936 (+    85us) op_driver.cc:444] REPLICATION: finished
0811 16:03:46.757918 (+   982us) write_op.cc:301] APPLY: starting
0811 16:03:46.758008 (+    90us) tablet.cc:1365] starting BulkCheckPresence
0811 16:03:46.758151 (+   143us) tablet.cc:1368] finished BulkCheckPresence
0811 16:03:46.758201 (+    50us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:03:46.758433 (+   232us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:03:46.758600 (+   167us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:03:46.758648 (+    48us) write_op.cc:312] APPLY: finished
0811 16:03:46.758902 (+   254us) log.cc:842] Serialized 23 byte log entry
0811 16:03:46.759077 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:46.759187 (+   110us) write_op.cc:454] Released schema lock
0811 16:03:46.759228 (+    41us) write_op.cc:341] FINISH: Updating metrics
0811 16:03:46.759512 (+   284us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:46.759540 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43140,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":705,"apply.run_cpu_time_us":1877,"apply.run_wall_time_us":1876,"num_ops":1,"prepare.queue_time_us":2101,"prepare.run_cpu_time_us":3597,"prepare.run_wall_time_us":16575,"replication_time_us":10472,"spinlock_wait_cycles":6806784}]]}
I20260811 16:03:46.805543 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 98ab517b34b7491eabb89d31d262a45e with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
W20260811 16:03:46.823549 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61347.6us
I20260811 16:03:46.841421 15285 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:46.844300 15285 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:46.845733 15285 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:46.844239 13820 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:46.849779 15285 ts_tablet_manager.cc:1905] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:46.875746 15285 ts_tablet_manager.cc:1918] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:46.876463 15285 log.cc:1196] T 98ab517b34b7491eabb89d31d262a45e P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/98ab517b34b7491eabb89d31d262a45e
I20260811 16:03:46.883358 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 98ab517b34b7491eabb89d31d262a45e (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:46.892443 14581 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.894090 15204 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.896504 13742 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.899693 15235 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.929431 13740 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:46.932699 13824 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:46.933449 13824 raft_consensus.cc:595] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:46.936875 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20097351f7854d5487483d8e78420c49"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:46.937557 13741 raft_consensus.cc:595] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:46.940448 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:46.941120 13741 raft_consensus.cc:595] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:46.949788 13902 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.951361 14579 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.951818 15284 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.958562 15223 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.963466 13824 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:46.969314 15284 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.983057 14580 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:46.992553 15235 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:46.994954 15168 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:46.998903 14580 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.013623 13903 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:47.023860 15235 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:47.025343 15205 raft_consensus.cc:979] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:47.026059 15205 raft_consensus.cc:1067] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:47.029076 13902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:47.029665 13902 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:47.030062 13902 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.029702 14579 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.037950 13907 raft_consensus.cc:2932] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.011225 13742 raft_consensus.cc:2932] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.055742 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 9315a4a479754517bd121148cf017615 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:47.060482 13628 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.070283 13902 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.072803 13902 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:47.075376 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 85bed8270f474c2e80653bbdc5806659 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:47.076788 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:47.077617 13823 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:47.077939 13823 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:47.078634 13823 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.094575 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:47.095377 13740 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.099264 13823 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.107894 13823 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:47.109138 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 3 to 4, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:47.142827 13740 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:47.143731 15168 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.146679 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:47.146844 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 85bed8270f474c2e80653bbdc5806659 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:47.165853 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 9315a4a479754517bd121148cf017615 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:47.166375 15156 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:47.167078 15156 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:47.168138 15156 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.170701 14580 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.159789 13902 raft_consensus.cc:2932] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.231411 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 930faff3981346c88c8864a1f3b15158 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:47.232321 13628 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:47.245523 15298 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:47.246028 15299 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:47.249008 15299 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:47.254487 15298 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:47.256371 15223 raft_consensus.cc:979] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:47.257328 15223 raft_consensus.cc:1067] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:47.261567 13907 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "20097351f7854d5487483d8e78420c49"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60522
I20260811 16:03:47.262269 13907 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:47.262269 15281 raft_consensus.cc:979] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:47.262758 13907 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.263046 15281 raft_consensus.cc:1067] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:47.265684 13826 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:47.266291 13826 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:47.266839 13826 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:47.271020 13907 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.271817 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 930faff3981346c88c8864a1f3b15158 with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:47.272893 15285 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:47.272889 13627 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:47.274128 15285 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:47.275027 15285 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:47.275349 13826 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.277598 13826 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:47.278386 15285 ts_tablet_manager.cc:1905] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:47.278937 15299 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:47.280472 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:47.281149 13741 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:03:47.281469 13741 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:47.282272 13741 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.282907 15298 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:47.283489 13741 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:47.287355 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:47.288009 13740 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:47.288336 13740 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:47.288491 13907 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:47.282280 15299 ts_tablet_manager.cc:1905] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:47.290951 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:47.292940 13823 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.292325 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:47.294155 13903 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:47.300917 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:47.302682 13740 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.306560 13740 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.306645 13903 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:03:47.310810 13902 raft_consensus.cc:595] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:47.312937 13823 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:47.315641 13874 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:47.310950 15298 ts_tablet_manager.cc:1905] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:47.320776 15197 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:47.321148 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:47.321437 15197 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:47.322567 15297 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:03:47.323189 15297 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:47.323558 15197 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.324153 15297 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.329831 13741 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:03:47.341604 13740 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:47.343271 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:47.358548 13741 raft_consensus.cc:595] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:47.360044 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:03:47.361894 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:47.362473 15285 ts_tablet_manager.cc:1918] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:47.362672 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:47.372875 15285 log.cc:1196] T 930faff3981346c88c8864a1f3b15158 P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/930faff3981346c88c8864a1f3b15158
I20260811 16:03:47.374851 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 930faff3981346c88c8864a1f3b15158 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:47.381526 13627 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:47.388901 15298 ts_tablet_manager.cc:1918] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:47.389485 15298 log.cc:1196] T 85bed8270f474c2e80653bbdc5806659 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/85bed8270f474c2e80653bbdc5806659
I20260811 16:03:47.390084 13628 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 3, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:47.390940 15299 ts_tablet_manager.cc:1918] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:47.391454 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 85bed8270f474c2e80653bbdc5806659 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:47.391822 15299 log.cc:1196] T 9315a4a479754517bd121148cf017615 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/9315a4a479754517bd121148cf017615
I20260811 16:03:47.394316 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 9315a4a479754517bd121148cf017615 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:47.543340 15156 raft_consensus.cc:979] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:47.543877 15209 raft_consensus.cc:1067] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:47.545728 13823 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:03:47.546243 13823 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:47.546515 13823 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.551832 13823 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.553368 13823 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:47.554081 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:47.554303 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:47.554749 13741 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.554881 13903 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:47.555371 13903 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:47.556066 13903 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.557088 13903 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.559976 13741 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:47.561411 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:47.562449 15297 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:47.563089 15297 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:47.563141 13903 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:47.564217 15297 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.574573 13628 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:47.621351 13741 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:47.621714 13826 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:47.623234 15209 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:47.624022 15197 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:47.641470 15195 raft_consensus.cc:979] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:47.641986 15195 raft_consensus.cc:1067] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:47.648556 13826 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:47.663558 13826 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:47.667456 13826 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.679337 13826 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.683784 13826 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:47.684914 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:47.685578 13906 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.686411 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:47.687057 13741 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:47.687395 13741 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:47.688078 13741 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.688851 13741 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:47.693670 13906 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:47.696532 13789 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:47.697844 15168 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:47.696354 13741 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:47.698377 15168 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:47.699431 15168 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:47.713349 13628 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:47.739753 13826 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:47.741458 15209 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:47.756583 13742 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:47.758821 15197 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:47.853443 13906 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:03:47.854561 15297 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:47.867254 13742 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:03:47.869451 15168 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:48.108316 13903 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:48.109643 15168 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:48.120855 13742 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:48.122514 15168 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:48.133576 13903 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:48.136066 15297 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:48.156620 13742 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:48.159772 15315 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:48.328759 13742 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:48.335508 13706 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 583cc1a296dd4344b3aaf399b8d5b17f. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:48.336280 13823 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:48.336623 13903 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:48.337632 15322 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:48.338954 15284 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:48.347407 15284 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.349128 13903 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.357340 13826 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.369294 13627 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.379523 13903 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:48.389196 13871 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e71c22039484c80abd86e7fa5392e68. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:48.389652 13826 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:48.391175 13742 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:48.391264 15209 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:48.392860 15197 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:48.405611 15209 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.410751 13826 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.411171 13742 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.424389 13823 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:48.433429 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:48.442934 13628 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.469161 13903 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260811 16:03:48.470366 13787 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af4dc0ff3ced489a86fe70cfbac98798. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:48.471110 15297 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:48.475914 13742 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:48.477185 15297 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:48.479254 15168 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.481120 13903 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.483687 13742 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.501855 13906 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:48.504402 13627 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:48.534534 13871 consensus_peers.cc:487] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1185ca07eaca4954a71d11cfa2256fd3. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:48.538259 13826 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:48.540684 15209 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:48.546356 13742 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:48.549144 15209 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:48.553574 13903 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:48.554270 13903 raft_consensus.cc:595] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:48.561815 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:48.562469 13741 raft_consensus.cc:595] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:48.565428 13823 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:48.566131 13823 raft_consensus.cc:595] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:48.569401 13826 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:48.570081 13826 raft_consensus.cc:595] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:48.570883 15088 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.575785 13823 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:48.575316 13742 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.576452 13823 raft_consensus.cc:595] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:48.575881 13826 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.579342 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:48.579936 13906 raft_consensus.cc:595] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:48.581286 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260811 16:03:48.583110 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:48.583803 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:48.604636 13628 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:48.712225 15284 raft_consensus.cc:979] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:48.712813 15322 raft_consensus.cc:1067] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:48.714284 13823 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:48.714888 13823 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:48.715312 13823 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.723373 13823 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:48.725452 13823 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:48.726555 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:48.727162 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:48.727413 13742 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:48.727854 13903 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.727869 13742 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:48.729245 13742 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:48.730315 13742 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.733701 15197 raft_consensus.cc:979] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:48.734313 15209 raft_consensus.cc:1067] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:48.736667 13903 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:48.740353 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:48.741053 13742 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:48.741448 15297 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:48.741964 15297 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:48.743086 14580 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43028
I20260811 16:03:48.742816 15297 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:48.743757 14580 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:48.744113 14580 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.760113 14580 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.763942 15197 raft_consensus.cc:979] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:48.764436 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:48.766134 13823 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.764473 15088 raft_consensus.cc:1067] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:48.769169 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:48.769870 13906 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:48.771026 13627 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:48.777444 13906 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:48.778263 13906 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.779508 13906 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.774266 14579 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43028
I20260811 16:03:48.783365 14579 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:48.783747 14579 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.785535 13823 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:48.763203 14580 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:48.786579 13906 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:48.786783 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:48.787964 15176 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:48.790304 15297 raft_consensus.cc:979] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:48.790972 15297 raft_consensus.cc:1067] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:48.793808 14579 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.800493 14580 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43044
I20260811 16:03:48.802311 14580 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:48.802990 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:48.804047 13742 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.805322 14579 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:48.820770 15176 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:48.827486 15176 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.844478 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:48.845450 13900 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:48.845841 13900 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:48.850960 15343 ts_tablet_manager.cc:927] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:48.852744 14580 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.855418 13900 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.858038 13900 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.859550 15343 tablet_copy_client.cc:316] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:48.814515 13742 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:48.861003 14541 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:48.861641 15314 raft_consensus.cc:979] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:48.862176 15315 raft_consensus.cc:1067] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:48.862392 15338 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:48.862931 15338 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:48.864319 13903 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:48.865155 13903 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:48.865067 15338 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.865691 13903 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.862198 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 6e71c22039484c80abd86e7fa5392e68 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:48.867892 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 6e71c22039484c80abd86e7fa5392e68 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-6e71c22039484c80abd86e7fa5392e68
I20260811 16:03:48.881891 13923 tablet_copy_source_session.cc:205] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:48.887427 15343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e71c22039484c80abd86e7fa5392e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:48.887050 13903 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.889317 13903 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:48.890230 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:48.890899 13823 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:48.891232 13823 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:48.895186 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:48.896056 14579 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.895411 13823 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.904752 14580 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.905264 14579 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:48.914772 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:48.920943 13741 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.917183 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:48.924055 13826 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:48.924351 13826 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:48.930042 13823 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.931203 13900 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:48.932032 13826 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.934885 13741 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:48.935002 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:48.936107 15344 ts_tablet_manager.cc:927] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:48.940596 15209 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:48.936508 14580 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:48.941553 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:48.939875 13826 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:48.942757 15176 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:48.943339 15176 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:48.944576 13823 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:48.945390 15176 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.918555 15343 tablet_copy_client.cc:791] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:48.941174 15209 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:48.949213 15343 tablet_copy_client.cc:655] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:48.950127 15344 tablet_copy_client.cc:316] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:48.950028 15209 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:48.951910 13627 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:48.953454 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 583cc1a296dd4344b3aaf399b8d5b17f from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:48.954036 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 583cc1a296dd4344b3aaf399b8d5b17f from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-583cc1a296dd4344b3aaf399b8d5b17f
I20260811 16:03:48.956394 15343 tablet_copy_client.cc:531] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:48.966321 13826 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:48.954197 13627 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:48.973886 13755 tablet_copy_source_session.cc:205] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:48.979979 15343 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:48.982667 15344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 583cc1a296dd4344b3aaf399b8d5b17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:48.988726 15352 ts_tablet_manager.cc:927] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:49.001827 15352 tablet_copy_client.cc:316] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:49.004522 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 1185ca07eaca4954a71d11cfa2256fd3 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:49.005139 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 1185ca07eaca4954a71d11cfa2256fd3 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-1185ca07eaca4954a71d11cfa2256fd3
I20260811 16:03:49.023764 13923 tablet_copy_source_session.cc:205] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:49.025791 15315 raft_consensus.cc:979] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:49.026623 15315 raft_consensus.cc:1067] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:49.029238 15343 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:49.032356 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1185ca07eaca4954a71d11cfa2256fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:49.040482 15350 ts_tablet_manager.cc:927] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:49.040779 15343 tablet_bootstrap.cc:492] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:49.044154 13900 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:49.045238 13900 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:49.046535 15343 ts_tablet_manager.cc:1397] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.017s
I20260811 16:03:49.046968 13900 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:49.051360 15343 raft_consensus.cc:348] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.063287 15343 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:49.064067 15343 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.066506 15343 ts_tablet_manager.cc:1428] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260811 16:03:49.068310 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-6e71c22039484c80abd86e7fa5392e68 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:49.068849 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-6e71c22039484c80abd86e7fa5392e68 on tablet 6e71c22039484c80abd86e7fa5392e68 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:49.069643 15352 tablet_copy_client.cc:791] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:49.077484 15352 tablet_copy_client.cc:655] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:49.091574 15344 tablet_copy_client.cc:791] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:49.091761 15352 tablet_copy_client.cc:531] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:49.093804 13627 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:49.101406 15344 tablet_copy_client.cc:655] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:49.106555 13628 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:49.119011 15344 tablet_copy_client.cc:531] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:49.122927 15350 tablet_copy_client.cc:316] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:49.125125 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet af4dc0ff3ced489a86fe70cfbac98798 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:49.125770 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet af4dc0ff3ced489a86fe70cfbac98798 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-af4dc0ff3ced489a86fe70cfbac98798
I20260811 16:03:49.128643 15352 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:49.134711 13900 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:49.137338 13900 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:49.138895 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:49.139638 13740 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:49.140965 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:49.145817 13823 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:49.146212 13823 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:49.148903 13740 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:49.149382 13839 tablet_copy_source_session.cc:205] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:49.138895 15344 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:49.152091 13823 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:49.153721 13823 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:49.154794 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:49.153729 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af4dc0ff3ced489a86fe70cfbac98798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:49.159533 15209 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:49.167670 15209 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:49.169625 13823 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:49.168676 15209 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:49.188887 13740 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:49.197539 15314 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:49.205232 15350 tablet_copy_client.cc:791] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:49.202459 13628 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:49.211043 13907 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:49.211818 15344 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:49.212829 15344 tablet_bootstrap.cc:492] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:49.213577 15344 ts_tablet_manager.cc:1397] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.010s
I20260811 16:03:49.206027 15350 tablet_copy_client.cc:655] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:49.213701 15314 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:49.224392 15352 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:49.225479 15352 tablet_bootstrap.cc:492] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:49.228133 15350 tablet_copy_client.cc:531] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:49.240648 15352 ts_tablet_manager.cc:1397] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.016s
I20260811 16:03:49.256539 15344 raft_consensus.cc:348] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.258716 15352 raft_consensus.cc:348] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.266196 15352 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:49.266412 15344 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:49.266991 15352 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.270808 15352 ts_tablet_manager.cc:1428] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260811 16:03:49.267824 15344 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.276974 15344 ts_tablet_manager.cc:1428] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260811 16:03:49.282814 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-583cc1a296dd4344b3aaf399b8d5b17f received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:49.283336 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-583cc1a296dd4344b3aaf399b8d5b17f on tablet 583cc1a296dd4344b3aaf399b8d5b17f with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:49.277549 15350 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:49.279594 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-1185ca07eaca4954a71d11cfa2256fd3 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:49.287607 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-1185ca07eaca4954a71d11cfa2256fd3 on tablet 1185ca07eaca4954a71d11cfa2256fd3 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:49.321830 13823 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.336083 14580 raft_consensus.cc:1203] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260811 16:03:49.341259 15338 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:49.361301 14580 raft_consensus.cc:1203] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:49.371448 13900 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.373977 15176 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:49.386668 14579 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.399787 15197 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:49.419302 13902 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.422930 15339 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:49.424535 15350 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:49.425647 15350 tablet_bootstrap.cc:492] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:49.427019 15350 ts_tablet_manager.cc:1397] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.150s	user 0.028s	sys 0.017s
I20260811 16:03:49.435786 13826 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.436470 15350 raft_consensus.cc:348] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.437403 15350 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:49.438700 15339 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260811 16:03:49.438124 15350 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.453773 13740 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.455782 15339 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:49.511382 13741 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.511415 15350 ts_tablet_manager.cc:1428] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.023s
I20260811 16:03:49.520627 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-af4dc0ff3ced489a86fe70cfbac98798 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:49.521133 13824 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:49.521209 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-af4dc0ff3ced489a86fe70cfbac98798 on tablet af4dc0ff3ced489a86fe70cfbac98798 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:49.522948 15088 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:49.516418 15176 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260811 16:03:49.533778 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50388.5us
I20260811 16:03:49.539005 14580 raft_consensus.cc:1203] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260811 16:03:49.564460 13820 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:49.566741 15209 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:49.577476 14580 raft_consensus.cc:1203] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:49.610330 13744 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:49.612711 15382 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260811 16:03:49.649246 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:03:49.827355 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 132762us
I20260811 16:03:49.828013 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:49.832396 15385 raft_consensus.cc:1050] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:49.835563 15385 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:49.845861 13741 raft_consensus.cc:595] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:49.850131 13818 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:49.850878 13818 raft_consensus.cc:595] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:49.857060 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d00255c500904da78a120b3431f1e31d"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:49.857400 13823 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:49.857707 13906 raft_consensus.cc:595] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:49.859962 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:03:49.860751 14580 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:49.861796 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:49.862552 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:49.863674 13741 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:49.861990 15385 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260811 16:03:49.865204 15197 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:49.867342 15382 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:49.896433 15385 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:49.898106 14579 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:49.901893 13826 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:49.912425 15283 raft_consensus.cc:1050] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
W20260811 16:03:49.912982 15283 raft_consensus.cc:1054] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Service unavailable: leader transfer in progress
I20260811 16:03:49.947207 13741 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:49.948493 13627 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:49.964056 15284 raft_consensus.cc:979] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:49.964684 15283 raft_consensus.cc:1067] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:49.966351 13826 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:49.966908 13826 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:49.967285 13826 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:49.976747 13826 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.978883 13826 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:49.979751 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:49.980400 13741 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:49.980685 13741 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:49.980597 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:49.981240 13906 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:49.981503 13741 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.984455 13741 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:49.992095 13906 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:49.993387 13789 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:49.994614 15387 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:49.996340 15387 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:49.997290 15387 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:49.998492 13741 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:50.013504 13900 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:50.021855 14580 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:50.023597 13741 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:50.023439 15197 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:50.025321 13626 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:50.028105 15197 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:50.036378 15382 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.041030 14580 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.061935 13741 raft_consensus.cc:2932] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.106509 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6e71c22039484c80abd86e7fa5392e68 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:50.112932 15385 raft_consensus.cc:1050] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:50.114053 13630 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:50.116000 15385 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:50.136515 14579 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:50.139312 15392 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:50.139864 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e71c22039484c80abd86e7fa5392e68 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:50.144057 15088 raft_consensus.cc:979] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:50.145416 15088 raft_consensus.cc:1067] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:50.145429 15387 raft_consensus.cc:1050] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:50.148350 15387 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:50.149459 15398 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:50.160655 13744 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:50.162966 13823 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:50.164911 13823 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d00255c500904da78a120b3431f1e31d"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:03:50.166482 13823 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:50.166970 13823 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:50.165051 15382 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:50.174407 15382 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:03:50.188482 14579 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:50.188524 13900 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:50.190918 15315 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:50.192037 15314 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:50.199920 15398 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:50.200975 15398 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:50.201560 13823 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:50.204090 13823 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:50.204303 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:50.207640 13740 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:50.209139 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:50.210038 13900 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:50.210408 13900 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:50.222524 13900 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:50.216427 15398 ts_tablet_manager.cc:1905] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:50.227247 13744 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:50.230218 13900 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:50.237016 13740 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:50.240152 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:50.241845 15315 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:50.242503 15315 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:50.236886 15297 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260811 16:03:50.254359 13900 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:50.261209 15315 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:50.268723 15392 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.313227 13823 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.317917 15398 ts_tablet_manager.cc:1918] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260811 16:03:50.327592 15407 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.330161 14580 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.336721 15398 log.cc:1196] T 6e71c22039484c80abd86e7fa5392e68 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/6e71c22039484c80abd86e7fa5392e68
I20260811 16:03:50.332798 14579 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.347570 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 6e71c22039484c80abd86e7fa5392e68 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:50.333170 13741 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.358898 15387 raft_consensus.cc:979] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:50.360117 15387 raft_consensus.cc:1067] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:50.363312 13906 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:50.363883 13906 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:50.364198 13906 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:50.370056 13630 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.372224 13906 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:50.375108 13906 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:50.383999 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:50.384734 13824 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:50.385026 13824 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:50.385658 13824 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:50.386912 13824 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:50.384043 13630 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.385293 13627 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:50.421386 13903 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:50.426681 13824 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:50.428372 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:50.429339 15392 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:50.429883 15392 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:50.430400 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:50.431092 13741 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:50.430846 15392 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:50.442394 14580 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:50.444548 13902 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.447863 15197 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:50.447955 13741 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:50.465927 14580 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Advancing to term 2
I20260811 16:03:50.473058 15382 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.477967 14580 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:50.480439 13740 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.494766 14580 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.497486 13824 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:50.499588 15197 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260811 16:03:50.502022 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65982us
I20260811 16:03:50.509136 13824 raft_consensus.cc:2932] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.514182 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 1185ca07eaca4954a71d11cfa2256fd3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:50.517002 15297 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:50.527832 13626 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 1 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.531899 15405 raft_consensus.cc:1050] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
W20260811 16:03:50.532394 15405 raft_consensus.cc:1054] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Illegal state: Leader has not yet committed an operation in its own term
I20260811 16:03:50.539839 13902 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:50.545209 15407 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:50.546916 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 1185ca07eaca4954a71d11cfa2256fd3 with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:50.547438 13627 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:50.555826 15412 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:50.557124 15412 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:50.558135 15412 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:50.577934 15412 ts_tablet_manager.cc:1905] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:50.596864 15412 ts_tablet_manager.cc:1918] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:50.597401 15412 log.cc:1196] T 1185ca07eaca4954a71d11cfa2256fd3 P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/1185ca07eaca4954a71d11cfa2256fd3
I20260811 16:03:50.599341 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 1185ca07eaca4954a71d11cfa2256fd3 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:50.600630 13741 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:50.603034 15405 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:50.608803 13824 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:50.615228 15315 raft_consensus.cc:1050] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:50.617300 15315 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:50.619874 13741 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:50.619874 14580 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:50.623081 15407 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:50.624972 15407 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:50.635584 15314 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.639901 13741 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.643119 14579 raft_consensus.cc:2932] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.651923 13902 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:50.654110 14581 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:50.656268 15387 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:50.659593 15407 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:50.669847 13744 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:50.679608 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet af4dc0ff3ced489a86fe70cfbac98798 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:50.683121 13626 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.690392 15405 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:50.690862 13906 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.694782 15314 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.697474 13744 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.712939 14579 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.714195 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet af4dc0ff3ced489a86fe70cfbac98798 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:50.716427 13627 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 2 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:50.730683 13902 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:50.741715 15419 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:50.743130 15419 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:50.743289 15405 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:50.744367 15419 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:50.757946 15419 ts_tablet_manager.cc:1905] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:50.778071 13740 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:50.781273 15419 ts_tablet_manager.cc:1918] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260811 16:03:50.781756 15419 log.cc:1196] T af4dc0ff3ced489a86fe70cfbac98798 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/af4dc0ff3ced489a86fe70cfbac98798
I20260811 16:03:50.782660 15297 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:50.783882 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet af4dc0ff3ced489a86fe70cfbac98798 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:50.817724 13824 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:50.820327 15392 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:50.836669 13740 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:50.838409 15209 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:51.740018 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:03:51.834393 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49876.2us
W20260811 16:03:51.836622 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50562.3us
I20260811 16:03:51.853284 13822 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:51.854452 13822 raft_consensus.cc:595] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:51.902334 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:51.903018 13908 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:51.912465 13822 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:51.913066 13822 raft_consensus.cc:595] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:51.916755 15379 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:51.917436 15379 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:51.918335 13825 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:51.922564 15379 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:51.927765 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:51.928840 13908 raft_consensus.cc:595] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:51.930693 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260811 16:03:51.932557 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:51.939128 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:51.964082 15379 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:51.964936 15379 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:51.969580 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:51.972366 15379 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:03:51.983116 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 155773us
I20260811 16:03:52.002473 15382 raft_consensus.cc:979] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:52.003108 15382 raft_consensus.cc:1067] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Signalling peer cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:52.026304 15427 raft_consensus.cc:979] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:52.026895 15427 raft_consensus.cc:1067] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
W20260811 16:03:52.029206 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 187159us
I20260811 16:03:52.032437 13901 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:52.033052 13901 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:52.033381 13901 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:03:52.037187 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 157080us
I20260811 16:03:52.041134 13901 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:52.046432 15425 raft_consensus.cc:979] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: : Instructing follower cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:52.046952 15425 raft_consensus.cc:1067] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:52.056382 13901 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:52.057829 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:52.058552 13822 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:52.058884 13822 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:52.059244 13740 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:52.059664 13822 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:52.061088 13822 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.061568 13744 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:37768
I20260811 16:03:52.062173 13744 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:52.062530 13744 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.064435 15382 raft_consensus.cc:979] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:52.065523 15385 raft_consensus.cc:1067] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
W20260811 16:03:52.067559 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44185.9us
I20260811 16:03:52.069917 13744 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.072952 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:52.073228 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:52.075335 13744 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:52.077265 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:52.077662 13822 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:52.078061 14580 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.079972 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:52.081015 14581 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43028
I20260811 16:03:52.084712 14581 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:52.085088 14581 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.078629 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:52.116209 14577 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:52.116688 13825 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:52.128403 13825 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:52.118783 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:52.120846 13741 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:37780
I20260811 16:03:52.131101 13741 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:52.131583 13741 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:52.122892 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:52.124269 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:52.133519 13742 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.134491 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:52.135780 13825 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.136914 13825 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.124402 15425 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:52.139402 15444 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:52.140034 15444 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:52.140971 15424 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:52.141616 15440 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:52.138852 13741 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:52.142199 15440 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:52.143273 13742 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:52.143955 13825 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:03:52.143173 15440 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:52.148995 15443 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:03:52.149591 15443 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.152624 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:52.154166 15433 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:52.154836 15433 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:52.160421 15443 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:52.156189 15433 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.153103 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:52.162187 13820 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:52.169046 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:52.174353 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:52.175968 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:52.177213 15443 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:03:52.179368 13741 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:52.180778 13820 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:03:52.181959 14581 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.185415 14581 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:52.187634 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:52.188233 13901 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:52.188503 13901 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:52.189235 13901 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.190338 13901 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.186257 13709 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:52.193066 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:52.193753 13908 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:03:52.194047 13908 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:52.194801 13908 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:52.196441 13908 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:52.197716 15430 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:03:52.198443 15430 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:52.190562 13626 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:52.200791 15430 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:52.215229 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:52.215920 13741 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:52.221067 13908 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:03:52.226357 13741 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:52.249542 13630 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:52.257478 14541 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:52.259114 14580 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:03:52.256404 15428 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:52.259722 15443 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:52.262801 13901 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:03:52.262768 13742 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:52.260079 14583 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:03:52.270390 15443 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:52.281945 15443 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:52.307004 13627 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:52.311360 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 583cc1a296dd4344b3aaf399b8d5b17f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:52.317359 14577 raft_consensus.cc:2932] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:52.325387 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:52.330572 13626 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 4 to 5, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:52.351464 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 583cc1a296dd4344b3aaf399b8d5b17f with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:52.355770 15460 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:52.356909 15460 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:52.359293 15460 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:52.362236 15460 ts_tablet_manager.cc:1905] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:52.377281 15460 ts_tablet_manager.cc:1918] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260811 16:03:52.377661 15460 log.cc:1196] T 583cc1a296dd4344b3aaf399b8d5b17f P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/583cc1a296dd4344b3aaf399b8d5b17f
I20260811 16:03:52.379127 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 583cc1a296dd4344b3aaf399b8d5b17f (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:52.623435 13742 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:52.624761 15440 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260811 16:03:52.635018 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800114900 after lost signal to thread 12388
W20260811 16:03:52.636746 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800114280 after lost signal to thread 13668
W20260811 16:03:52.638182 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800345780 after lost signal to thread 13771
W20260811 16:03:52.639549 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7280 after lost signal to thread 13856
W20260811 16:03:52.641191 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08001671e0 after lost signal to thread 13941
I20260811 16:03:52.641933 13825 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260811 16:03:52.642849 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08002da720 after lost signal to thread 14610
I20260811 16:03:52.643402 15445 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:52.654495 13822 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:52.656461 15440 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:52.664494 14577 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:52.666242 15445 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:52.673466 13901 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:52.676141 15438 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:52.717914 13825 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:03:52.719509 15433 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:52.758581 13901 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:03:52.762169 15430 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:52.821610 13741 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:52.831854 15468 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260811 16:03:53.133997 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:53.173471 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:53.174017 13741 raft_consensus.cc:595] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:53.176963 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:53.177459 13901 raft_consensus.cc:595] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:53.180286 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:53.180845 13741 raft_consensus.cc:595] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:53.183352 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:03:53.185108 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:53.185670 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:53.216287 15430 raft_consensus.cc:979] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:53.216763 15430 raft_consensus.cc:1067] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:53.219588 13908 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60522
I20260811 16:03:53.220237 13908 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:53.220623 13908 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:53.234133 13908 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.237496 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:53.238176 13741 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:53.238528 13741 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:53.241312 13741 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.244134 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:53.244772 14577 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:53.249270 15430 raft_consensus.cc:979] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:53.249769 15474 raft_consensus.cc:1067] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:53.251303 13901 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60522
I20260811 16:03:53.251901 13901 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:53.252245 13901 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:53.252851 13741 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:53.253325 14577 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:53.254784 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:53.242852 13908 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:53.261416 15440 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:53.261920 15440 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:53.259729 13741 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:53.262856 15440 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.268512 13901 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.272082 13901 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:53.280268 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:53.280929 13741 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:53.281241 13741 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:53.281955 13741 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.283074 13741 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:53.292995 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:53.293751 14577 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:53.296801 13741 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:53.296547 13627 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:53.303884 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:53.310098 15477 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:53.310673 15477 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:53.311689 15477 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.312304 14577 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:53.346860 13627 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:53.376981 15477 raft_consensus.cc:979] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:53.377538 15440 raft_consensus.cc:1067] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:53.379254 13822 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:03:53.379904 13822 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:53.380311 13822 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:53.396114 13822 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.407614 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:53.408288 13901 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:03:53.408588 13901 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:53.409349 13901 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.410571 13901 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:53.413206 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:53.413861 14577 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:53.417567 13741 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:53.422745 13822 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:53.424399 13901 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:03:53.425539 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:53.427944 14577 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:03:53.429171 15428 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
W20260811 16:03:53.429539 13706 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d60ab9da3d047ca897a698d07779c2e. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:53.429688 15428 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:53.430892 13901 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:03:53.430529 15428 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:53.433434 13820 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:03:53.435355 15430 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:53.437397 15430 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:53.469732 15433 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.476112 13901 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.500808 13627 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:53.504945 13820 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.507206 13902 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:53.526947 13871 consensus_peers.cc:487] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41b38d6f6713439aad43a191eb42cd45. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:53.528904 13741 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:53.529784 13825 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:53.530586 15209 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:53.534890 15209 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:53.534121 13630 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 4, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:53.580225 15477 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.585711 13825 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.600876 13742 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.612181 13627 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.624675 13826 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:03:53.648794 13787 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7c98a1b986c4db5bd4c160284e54651. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:53.648808 13902 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:53.650118 14577 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:53.651028 15487 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:53.651755 15477 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:53.659235 13741 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:53.662770 15428 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260811 16:03:53.689239 15428 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.697173 13902 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.723627 13742 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.748440 13630 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.774940 13908 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:53.777590 13741 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260811 16:03:53.792182 13871 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20097351f7854d5487483d8e78420c49. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:53.792544 13820 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:53.803318 15209 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:53.800444 13742 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:53.805902 15209 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:53.807927 15209 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:53.814371 15440 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.845729 14577 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:53.847203 13826 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:53.856179 15488 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:53.879444 13742 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:53.880833 15477 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:53.897347 13908 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:53.899653 15487 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:03:53.890285 13627 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:53.910794 14577 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:53.921610 15505 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:53.995546 13743 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:54.050302 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 133179us
I20260811 16:03:54.065392 15515 ts_tablet_manager.cc:927] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
I20260811 16:03:54.080709 15516 ts_tablet_manager.cc:927] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:54.083395 15515 tablet_copy_client.cc:316] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:03:54.112370 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 7d60ab9da3d047ca897a698d07779c2e from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
I20260811 16:03:54.113029 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 7d60ab9da3d047ca897a698d07779c2e from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-7d60ab9da3d047ca897a698d07779c2e
I20260811 16:03:54.115218 15516 tablet_copy_client.cc:316] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:03:54.117785 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet e7c98a1b986c4db5bd4c160284e54651 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:03:54.118343 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet e7c98a1b986c4db5bd4c160284e54651 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-e7c98a1b986c4db5bd4c160284e54651
I20260811 16:03:54.126554 13839 tablet_copy_source_session.cc:205] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:54.131330 15516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c98a1b986c4db5bd4c160284e54651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:54.134949 13755 tablet_copy_source_session.cc:205] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:54.140208 15522 ts_tablet_manager.cc:927] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:54.141556 15515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d60ab9da3d047ca897a698d07779c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:54.160673 15515 tablet_copy_client.cc:791] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:54.161495 15516 tablet_copy_client.cc:791] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:54.161509 15515 tablet_copy_client.cc:655] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:54.162281 15516 tablet_copy_client.cc:655] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:54.167318 15515 tablet_copy_client.cc:531] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:54.169862 15516 tablet_copy_client.cc:531] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:54.179648 15515 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:54.182080 15522 tablet_copy_client.cc:316] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:54.184689 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 41b38d6f6713439aad43a191eb42cd45 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:54.185254 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 41b38d6f6713439aad43a191eb42cd45 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-41b38d6f6713439aad43a191eb42cd45
I20260811 16:03:54.192029 15516 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:54.205900 13923 tablet_copy_source_session.cc:205] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:54.212004 15522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b38d6f6713439aad43a191eb42cd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:54.236373 15516 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:54.242563 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:54.250798 15522 tablet_copy_client.cc:791] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:54.251463 15522 tablet_copy_client.cc:655] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:54.252228 15515 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:54.253165 15515 tablet_bootstrap.cc:492] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:54.253860 15515 ts_tablet_manager.cc:1397] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.019s
I20260811 16:03:54.237520 15516 tablet_bootstrap.cc:492] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:54.256713 15515 raft_consensus.cc:348] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.257854 15515 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:54.258627 15522 tablet_copy_client.cc:531] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:54.259164 15516 ts_tablet_manager.cc:1397] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.065s	user 0.029s	sys 0.004s
I20260811 16:03:54.280030 15522 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:54.325062 15516 raft_consensus.cc:348] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.330449 15516 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:54.270135 15515 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.337477 15516 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.349049 15516 ts_tablet_manager.cc:1428] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.090s	user 0.010s	sys 0.003s
I20260811 16:03:54.349682 15515 ts_tablet_manager.cc:1428] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.003s
I20260811 16:03:54.360705 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-e7c98a1b986c4db5bd4c160284e54651 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:03:54.361167 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-e7c98a1b986c4db5bd4c160284e54651 on tablet e7c98a1b986c4db5bd4c160284e54651 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:54.361145 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7d60ab9da3d047ca897a698d07779c2e received from {username='slave'} at 127.0.0.1:37376
I20260811 16:03:54.361922 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7d60ab9da3d047ca897a698d07779c2e on tablet 7d60ab9da3d047ca897a698d07779c2e with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:54.371913 15516 ts_tablet_manager.cc:927] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:54.379591 15516 tablet_copy_client.cc:316] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:03:54.385764 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 20097351f7854d5487483d8e78420c49 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:03:54.386384 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 20097351f7854d5487483d8e78420c49 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-20097351f7854d5487483d8e78420c49
I20260811 16:03:54.421162 14577 raft_consensus.cc:1203] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260811 16:03:54.430625 13923 tablet_copy_source_session.cc:205] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:03:54.436411 15516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20097351f7854d5487483d8e78420c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:03:54.463008 15516 tablet_copy_client.cc:791] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:03:54.463694 15516 tablet_copy_client.cc:655] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:03:54.467818 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:54.468526 13908 raft_consensus.cc:595] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:54.474814 15477 raft_consensus.cc:979] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:54.475612 15477 raft_consensus.cc:1067] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:54.477257 13826 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:03:54.477847 13826 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:54.478173 13826 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:54.481463 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20ad41e4f434442792e36eb47449b101"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:54.482151 13908 raft_consensus.cc:595] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:54.478924 15516 tablet_copy_client.cc:531] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:03:54.485725 13822 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:54.486420 13822 raft_consensus.cc:595] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:54.489900 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:03:54.491717 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:54.492386 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:54.497961 15516 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:03:54.503194 15522 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:54.503252 15487 raft_consensus.cc:979] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:54.504106 15487 raft_consensus.cc:1067] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:54.504761 15522 tablet_bootstrap.cc:492] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:54.505805 15522 ts_tablet_manager.cc:1397] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.226s	user 0.036s	sys 0.042s
I20260811 16:03:54.507009 13826 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:54.512034 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:54.512513 13908 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:54.512676 13901 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:54.513090 13901 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:54.513094 13908 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:54.510048 15522 raft_consensus.cc:348] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.513612 13908 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:03:54.513921 13901 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:54.519824 15522 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:54.515085 13901 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:54.522609 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:54.527418 14577 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:54.538429 15505 raft_consensus.cc:979] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:54.539031 15505 raft_consensus.cc:1067] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:54.543071 13743 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "20ad41e4f434442792e36eb47449b101"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:37780
I20260811 16:03:54.544026 13743 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:54.544624 13743 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:54.545351 14577 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:54.548112 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:54.544384 15522 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.548936 15527 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:54.549427 15527 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:54.550268 15527 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:54.557960 15522 ts_tablet_manager.cc:1428] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.004s
I20260811 16:03:54.561791 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-41b38d6f6713439aad43a191eb42cd45 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:54.563050 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-41b38d6f6713439aad43a191eb42cd45 on tablet 41b38d6f6713439aad43a191eb42cd45 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:54.544068 13826 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:54.558322 13901 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:54.561756 13908 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:54.574074 13743 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:54.584584 13908 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:54.585907 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:54.586542 13825 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:54.588161 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:54.588789 13826 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:03:54.589056 13826 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:54.590317 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:54.590929 13742 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:03:54.593883 15516 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:03:54.594838 15516 tablet_bootstrap.cc:492] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:03:54.595583 15516 ts_tablet_manager.cc:1397] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.098s	user 0.025s	sys 0.008s
I20260811 16:03:54.598387 15516 raft_consensus.cc:348] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.599262 15516 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:03:54.601126 13630 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:54.603941 14577 raft_consensus.cc:1203] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:03:54.587276 13743 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:54.608175 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:54.610468 13908 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:54.612102 13908 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:54.599893 15516 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:54.614446 15516 ts_tablet_manager.cc:1428] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260811 16:03:54.610894 13742 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:03:54.609517 13826 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:54.618650 13826 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:03:54.625808 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20097351f7854d5487483d8e78420c49 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:03:54.626312 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20097351f7854d5487483d8e78420c49 on tablet 20097351f7854d5487483d8e78420c49 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:54.611671 13825 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:03:54.636165 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:54.616073 13908 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:54.637241 15430 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:54.616683 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:54.637859 15430 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:54.638659 15477 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:03:54.639438 15477 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:54.640586 15477 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:54.641876 15430 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:54.638715 13908 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:54.654852 13826 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:03:54.695477 13626 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 4, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:54.710664 13908 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:03:54.730250 14577 raft_consensus.cc:1203] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260811 16:03:54.751488 13627 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:03:54.754037 15533 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260811 16:03:54.867326 15430 raft_consensus.cc:1050] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:54.870327 15430 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:54.892218 13826 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:03:54.892333 13908 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:03:54.893957 15433 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:54.895364 15430 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:54.900205 14577 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:03:54.902200 15430 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:55.077059 15430 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.202085 13908 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:55.211230 15547 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:55.213050 14578 raft_consensus.cc:1203] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260811 16:03:55.214771 13901 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.206615 13627 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 4 to 5, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:55.221621 13825 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:03:55.223986 15477 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:03:55.226694 14577 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:55.260296 15553 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:55.264778 15557 raft_consensus.cc:1050] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:55.271634 13742 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:55.273864 15557 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:55.276316 13901 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:55.281047 13907 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:55.290548 15474 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:55.299469 14578 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.315977 13741 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:03:55.330008 13820 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.348480 15430 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.351003 15543 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260811 16:03:55.364856 14580 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:55.368316 13902 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.375425 15428 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:55.379344 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7d60ab9da3d047ca897a698d07779c2e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:55.381222 14580 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:55.388592 15547 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:55.389274 15564 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260811 16:03:55.399665 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 60888.4us
I20260811 16:03:55.450816 13743 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:55.455420 15504 raft_consensus.cc:1050] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:55.473183 13827 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:55.474189 15488 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260811 16:03:55.511081 14580 raft_consensus.cc:2932] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.528499 15548 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260811 16:03:55.527737 13901 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:03:55.536923 15504 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:55.539038 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 5 to 6, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:55.586294 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d60ab9da3d047ca897a698d07779c2e with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:55.596124 15428 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:03:55.609658 15580 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:55.612002 15580 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:55.614189 15488 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.626766 13826 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:55.630959 14577 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:55.618078 13740 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.632462 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:55.633679 13742 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:55.635120 15504 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:55.636904 15477 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:55.638091 15512 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:55.648382 15580 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:55.671927 15580 ts_tablet_manager.cc:1905] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:55.775988 13742 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "580037905a064c08b39df9f9843b5448"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:55.776873 13742 raft_consensus.cc:595] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:55.792510 15509 raft_consensus.cc:1050] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:03:55.810971 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:55.811867 13902 raft_consensus.cc:595] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:03:55.814164 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 103586us
I20260811 16:03:55.824604 13826 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "930faff3981346c88c8864a1f3b15158"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:55.825212 13826 raft_consensus.cc:595] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:55.827066 15477 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.853250 13901 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.841023 14577 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.854735 13630 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.859185 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:03:55.854616 15509 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:55.876959 14580 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.911861 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:55.912897 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:55.924556 13824 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:55.926996 14583 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:55.929654 15580 ts_tablet_manager.cc:1918] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260811 16:03:55.930135 15504 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:55.936699 13741 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:03:55.940430 15558 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:03:55.944617 13630 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.950950 13820 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.970813 13741 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:55.930230 15580 log.cc:1196] T 7d60ab9da3d047ca897a698d07779c2e P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/7d60ab9da3d047ca897a698d07779c2e
I20260811 16:03:55.978524 15545 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:55.988647 13821 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.000176 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 7d60ab9da3d047ca897a698d07779c2e (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:56.011940 13740 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:56.014276 15487 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:56.024289 14583 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260811 16:03:56.027725 15527 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:03:56.048970 15590 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.054431 13742 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.056931 14580 raft_consensus.cc:2932] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.063270 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e7c98a1b986c4db5bd4c160284e54651 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:56.068132 13901 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.099570 14577 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:56.107883 13824 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:56.110491 15509 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:56.115370 15545 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.114526 13626 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 3 to 4, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.121474 15509 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.127664 13821 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.139412 15558 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:56.140741 15527 raft_consensus.cc:979] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:56.152971 15527 raft_consensus.cc:1067] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:56.154433 14583 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.155542 13627 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:56.158274 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 41b38d6f6713439aad43a191eb42cd45 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:56.142742 13820 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.148945 14577 raft_consensus.cc:2932] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.164494 13901 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "930faff3981346c88c8864a1f3b15158"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:56.165091 13901 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:56.165452 13901 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:56.164340 13741 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.178047 15591 raft_consensus.cc:979] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:56.178638 15591 raft_consensus.cc:1067] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:56.193069 15558 raft_consensus.cc:979] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:56.193912 15558 raft_consensus.cc:1067] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Signalling peer cec0688f86d54789b9b9ecc924ddecf3 to start an election
I20260811 16:03:56.188828 13901 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.198446 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:56.199975 13824 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:56.200332 13824 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:56.201056 13824 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.204157 13824 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:56.207624 13901 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:56.210598 13821 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "580037905a064c08b39df9f9843b5448"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:56.211249 13821 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:56.211882 13821 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:56.216046 13824 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:56.217280 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:56.219758 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet e7c98a1b986c4db5bd4c160284e54651 with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60510
I20260811 16:03:56.222944 15545 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:56.223857 15545 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:56.225080 15545 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.230388 13821 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:56.235682 13821 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:56.241533 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:56.242488 14583 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:56.243990 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:56.244593 13901 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:56.234822 13630 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 4 to 5, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.256809 13901 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:56.260522 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:56.261291 13740 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:37780
I20260811 16:03:56.261534 15487 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:56.261948 13740 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:56.262346 13740 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:56.262435 15487 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:56.263651 15487 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:56.277688 13740 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.289728 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:56.290477 13743 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:56.290788 13743 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:56.291603 13743 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:56.292992 13743 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:56.293823 15597 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:03:56.294909 15597 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:56.296015 15597 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:56.299532 15597 ts_tablet_manager.cc:1905] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:56.317301 13743 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:56.318892 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:56.319235 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:03:56.319607 13901 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:03:56.319821 14577 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:56.319936 13901 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:56.318914 15597 ts_tablet_manager.cc:1918] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260811 16:03:56.321326 15597 log.cc:1196] T e7c98a1b986c4db5bd4c160284e54651 P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/e7c98a1b986c4db5bd4c160284e54651
I20260811 16:03:56.318169 13740 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:03:56.315093 14583 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:56.320765 13901 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.325301 13901 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:56.324234 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet e7c98a1b986c4db5bd4c160284e54651 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:56.330112 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b38d6f6713439aad43a191eb42cd45 with delete_type TABLET_DATA_TOMBSTONED (TS cec0688f86d54789b9b9ecc924ddecf3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:37762
I20260811 16:03:56.341796 14577 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:03:56.343792 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:03:56.345149 15548 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:03:56.348802 13901 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:03:56.356886 15548 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:56.357899 15548 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.358361 13627 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:56.369829 13626 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:56.389380 13630 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:56.396440 15600 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:03:56.397677 15600 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:56.398474 15600 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:56.402424 13901 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:56.415227 15600 ts_tablet_manager.cc:1905] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:56.416213 13740 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:56.416664 14577 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:56.420463 15558 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:56.421468 15512 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:03:56.436156 15504 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.439913 15600 ts_tablet_manager.cc:1918] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260811 16:03:56.440505 15600 log.cc:1196] T 41b38d6f6713439aad43a191eb42cd45 P cec0688f86d54789b9b9ecc924ddecf3: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/wals/41b38d6f6713439aad43a191eb42cd45
I20260811 16:03:56.442099 13743 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.445039 14583 raft_consensus.cc:2932] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:03:56.492697 13612 catalog_manager.cc:4841] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): tablet 41b38d6f6713439aad43a191eb42cd45 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:56.494323 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 20097351f7854d5487483d8e78420c49 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260811 16:03:56.510357 13630 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 4 to 5, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:56.646234 14577 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:56.651975 15567 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:56.709844 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 20097351f7854d5487483d8e78420c49 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40882
I20260811 16:03:56.728632 15606 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:03:56.740939 15606 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:03:56.749142 15606 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:03:56.760751 13820 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:03:56.760821 15606 ts_tablet_manager.cc:1905] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260811 16:03:56.763041 15504 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:03:56.791565 15606 ts_tablet_manager.cc:1918] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260811 16:03:56.792199 15606 log.cc:1196] T 20097351f7854d5487483d8e78420c49 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/20097351f7854d5487483d8e78420c49
I20260811 16:03:56.794294 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 20097351f7854d5487483d8e78420c49 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
I20260811 16:03:56.801664 13902 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:56.803465 15487 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:03:56.825605 13740 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:56.834823 15590 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260811 16:03:56.968961 14577 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:56.970654 15430 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:56.980491 13902 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:56.982395 15549 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:57.169281 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:03:57.268972 13826 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:03:57.270397 13826 raft_consensus.cc:595] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:03:57.278699 13743 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:03:57.280485 13743 raft_consensus.cc:595] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:03:57.290515 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "930faff3981346c88c8864a1f3b15158"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:03:57.293028 13901 raft_consensus.cc:595] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:03:57.297130 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:03:57.302172 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:03:57.349268 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:03:57.398892 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61725us
W20260811 16:03:57.404992 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 67880.8us
W20260811 16:03:57.617287 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 98783.3us
W20260811 16:03:57.628368 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55777.3us
W20260811 16:03:57.674101 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 193911us
W20260811 16:03:57.863976 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 139221us
W20260811 16:03:58.069109 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 307838us
W20260811 16:03:58.079949 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 98870.7us
I20260811 16:03:58.209106 15527 raft_consensus.cc:979] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:58.210000 15527 raft_consensus.cc:1067] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:03:58.234686 15430 raft_consensus.cc:979] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:03:58.235782 15621 raft_consensus.cc:1067] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
W20260811 16:03:58.243719 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44005.1us
I20260811 16:03:58.291325 13820 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:03:58.292424 13820 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:58.293087 13820 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:03:58.322959 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 157982us
W20260811 16:03:58.329710 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 178592us
I20260811 16:03:58.374435 15624 raft_consensus.cc:979] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:58.375365 15624 raft_consensus.cc:1067] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:03:58.378171 13901 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:03:58.385421 13901 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:58.386227 13901 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:58.407891 14580 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "930faff3981346c88c8864a1f3b15158"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43028
I20260811 16:03:58.409116 14580 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:03:58.409698 14580 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:03:58.463552 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44414.2us
I20260811 16:03:58.476785 15632 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:58.477859 15632 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:58.489918 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:58.474902 13820 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.508723 15632 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:58.517253 15639 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:58.518407 15639 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.540722 15651 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:03:58.541890 15651 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.553066 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:58.577673 15639 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:58.580662 15651 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:58.585570 14580 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:58.589680 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:03:58.603608 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:58.604636 13902 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:03:58.605227 13902 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:58.608772 14574 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:03:58.606352 13902 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:58.641112 13902 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:58.611828 14580 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:58.613569 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:58.619700 13820 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:03:58.627046 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:58.647590 15632 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:58.656283 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:03:58.660068 13901 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.679383 13907 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:03:58.674540 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:58.680572 13743 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:58.682379 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:58.683526 13820 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:03:58.683907 13820 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:58.681155 13743 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:03:58.685135 13820 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.680773 13901 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:03:58.702652 13902 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:03:58.703600 13826 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:03:58.707221 13820 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:58.710111 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:03:58.711115 13823 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:03:58.717150 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:58.713465 13743 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.722478 13743 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:58.736575 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:03:58.737574 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:03:58.738082 13908 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:58.724888 15639 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:58.774710 13908 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:58.777295 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:03:58.799253 15642 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:03:58.798923 13740 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:58.822100 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:03:58.827874 13820 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:03:58.830763 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111154us
I20260811 16:03:58.831053 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:58.832644 13823 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:03:58.834339 13743 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:03:58.835525 15660 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:03:58.843324 15660 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:03:58.842293 15428 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:58.844936 15428 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:03:58.850605 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:03:58.851751 13742 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:03:58.851056 15660 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:03:58.855851 15428 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.892620 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:03:58.895042 15617 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:03:58.896673 15617 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:03:58.898906 15617 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:03:58.929039 13742 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:03:58.962635 13820 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:58.965157 13908 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:03:58.965349 15430 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:03:58.974363 15665 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:03:58.975023 13706 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f6a000330b3415da4f525eae84f33fb. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:03:58.976161 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47474.9us
W20260811 16:03:59.030004 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 81453.8us
I20260811 16:03:59.040426 15665 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:59.051281 13908 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:03:59.065341 13626 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 3 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:03:59.060873 13630 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:59.149731 13820 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:03:59.167474 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56862us
I20260811 16:03:59.181550 13627 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:03:59.189637 13628 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:03:59.273648 13908 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:03:59.283095 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:03:59.369686 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 801054abfed346a09c04b7cd13d7c62f. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:03:59.371517 13901 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:59.377034 13741 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:59.378877 13823 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:03:59.380947 15660 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:59.388443 13826 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:03:59.398833 15632 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:03:59.380806 15558 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:03:59.411478 15628 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:03:59.443552 13741 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260811 16:03:59.529551 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 83544.6us
I20260811 16:03:59.473680 15651 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260811 16:03:59.548257 13742 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:59.643865 13826 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:03:59.685561 15694 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260811 16:03:59.763662 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 119574us
W20260811 16:03:59.797371 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 149682us
W20260811 16:03:59.851573 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72618.5us
I20260811 16:03:59.852068 15558 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260811 16:04:00.006901 15710 ts_tablet_manager.cc:927] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
W20260811 16:04:00.040462 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98704.8us
W20260811 16:04:00.111477 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61398.6us
W20260811 16:04:00.124342 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 315281us
I20260811 16:04:00.127970 13630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 303) took 1095 ms. Trace:
I20260811 16:04:00.201233 15710 tablet_copy_client.cc:316] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.193:40411
I20260811 16:04:00.217737 13627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 322) took 1042 ms. Trace:
I20260811 16:04:00.270624 15702 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:00.277366 13820 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:04:00.278600 13820 raft_consensus.cc:595] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:00.299451 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:00.300781 13901 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:00.128733 13630 rpcz_store.cc:276] 0811 16:03:59.013133 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:59.013384 (+   251us) service_pool.cc:227] Handling call
0811 16:04:00.108181 (+1094797us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:03:59.225925 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:03:59.226978 (+  1053us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:03:59.227029 (+    51us) write_op.cc:435] Acquired schema lock
0811 16:03:59.227055 (+    26us) tablet.cc:660] Decoding operations
0811 16:03:59.227664 (+   609us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:03:59.227749 (+    85us) write_op.cc:641] Partition lock acquired for write op
0811 16:03:59.227788 (+    39us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:03:59.228125 (+   337us) tablet.cc:699] Row locks acquired
0811 16:03:59.228154 (+    29us) write_op.cc:260] PREPARE: finished
0811 16:03:59.228392 (+   238us) write_op.cc:270] Start()
0811 16:03:59.228583 (+   191us) write_op.cc:276] Timestamp: P: 1786464239228330 usec, L: 0
0811 16:03:59.228613 (+    30us) op_driver.cc:331] REPLICATION: starting
0811 16:03:59.229854 (+  1241us) log.cc:842] Serialized 541 byte log entry
0811 16:03:59.355052 (+125198us) op_driver.cc:444] REPLICATION: finished
0811 16:03:59.586107 (+231055us) write_op.cc:301] APPLY: starting
0811 16:03:59.586338 (+   231us) tablet.cc:1365] starting BulkCheckPresence
0811 16:03:59.586550 (+   212us) tablet.cc:1368] finished BulkCheckPresence
0811 16:03:59.586836 (+   286us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:03:59.587329 (+   493us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:03:59.587658 (+   329us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:03:59.587763 (+   105us) write_op.cc:312] APPLY: finished
0811 16:03:59.588170 (+   407us) log.cc:842] Serialized 23 byte log entry
0811 16:03:59.588550 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:59.588699 (+   149us) write_op.cc:454] Released schema lock
0811 16:03:59.588815 (+   116us) write_op.cc:341] FINISH: Updating metrics
0811 16:03:59.589272 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:59.589317 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":122617,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":193513,"apply.run_cpu_time_us":3744,"apply.run_wall_time_us":15242,"num_ops":1,"prepare.queue_time_us":135996,"prepare.run_cpu_time_us":4483,"prepare.run_wall_time_us":52095,"replication_time_us":126246,"thread_start_us":155826,"threads_started":1}]]}
W20260811 16:04:00.369565 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 244385us
I20260811 16:04:00.377068 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260811 16:04:00.227661 13627 rpcz_store.cc:276] 0811 16:03:59.175503 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:59.175827 (+   324us) service_pool.cc:227] Handling call
0811 16:04:00.217631 (+1041804us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:03:59.278736 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:03:59.279663 (+   927us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:03:59.279722 (+    59us) write_op.cc:435] Acquired schema lock
0811 16:03:59.279756 (+    34us) tablet.cc:660] Decoding operations
0811 16:03:59.280414 (+   658us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:03:59.280539 (+   125us) write_op.cc:641] Partition lock acquired for write op
0811 16:03:59.280596 (+    57us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:03:59.280893 (+   297us) tablet.cc:699] Row locks acquired
0811 16:03:59.280952 (+    59us) write_op.cc:260] PREPARE: finished
0811 16:03:59.281187 (+   235us) write_op.cc:270] Start()
0811 16:03:59.281374 (+   187us) write_op.cc:276] Timestamp: P: 1786464239281121 usec, L: 0
0811 16:03:59.281428 (+    54us) op_driver.cc:331] REPLICATION: starting
0811 16:03:59.282505 (+  1077us) log.cc:842] Serialized 541 byte log entry
0811 16:03:59.542819 (+260314us) op_driver.cc:444] REPLICATION: finished
0811 16:03:59.702944 (+160125us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003615a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:03:59.703254 (+   310us) write_op.cc:301] APPLY: starting
0811 16:03:59.703385 (+   131us) tablet.cc:1365] starting BulkCheckPresence
0811 16:03:59.703575 (+   190us) tablet.cc:1368] finished BulkCheckPresence
0811 16:03:59.703619 (+    44us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:03:59.704078 (+   459us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:03:59.704344 (+   266us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:03:59.704426 (+    82us) write_op.cc:312] APPLY: finished
0811 16:03:59.704755 (+   329us) log.cc:842] Serialized 23 byte log entry
0811 16:03:59.770243 (+ 65488us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:59.775018 (+  4775us) write_op.cc:454] Released schema lock
0811 16:03:59.776469 (+  1451us) write_op.cc:341] FINISH: Updating metrics
0811 16:03:59.793476 (+ 17007us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:59.796741 (+  3265us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":327000,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":40767,"apply.run_cpu_time_us":3423,"apply.run_wall_time_us":96710,"mutex_wait_us":5905,"num_ops":1,"prepare.queue_time_us":87984,"prepare.run_cpu_time_us":4172,"prepare.run_wall_time_us":4172,"replication_time_us":261123,"spinlock_wait_cycles":2990848,"thread_start_us":47755,"threads_started":1}]]}
I20260811 16:04:00.466583 13755 tablet_copy_service.cc:140] P cec0688f86d54789b9b9ecc924ddecf3: Received BeginTabletCopySession request for tablet 7f6a000330b3415da4f525eae84f33fb from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:37376)
W20260811 16:04:00.476217 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67049.8us
I20260811 16:04:00.474912 15702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56284 (request call id 11) took 1211 ms. Trace:
I20260811 16:04:00.490767 15702 rpcz_store.cc:276] 0811 16:03:59.263684 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:59.263951 (+   267us) service_pool.cc:227] Handling call
0811 16:03:59.306344 (+ 42393us) log.cc:842] Serialized 506 byte log entry
0811 16:03:59.411125 (+104781us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b5400204020. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189a771 00007f5c518a5220 00007f5c518a51c8 00007f5c518a5148 00007f5c518a5103 00007f5c518a438c 00007f5c57915206 00007f5c5790d808 00007f5c518e138b 00007f5c518e3e80
0811 16:03:59.699263 (+288138us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5400204020. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189b40f 00007f5c5189a78b 00007f5c518a5220 00007f5c518a51c8 00007f5c518a5148 00007f5c518a5103 00007f5c518a438c 00007f5c57915206 00007f5c5790d808 00007f5c518e138b
0811 16:04:00.474725 (+775462us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10990,"raft.queue_time_us":15604,"raft.run_cpu_time_us":3383,"raft.run_wall_time_us":3414,"spinlock_wait_cycles":99609216,"thread_start_us":9229,"threads_started":1,"wal-append.queue_time_us":55835}
W20260811 16:04:00.497851 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 51079.5us
W20260811 16:04:00.511179 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 371061us
I20260811 16:04:00.574611 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:00.576067 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:00.609812 13628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 321) took 1426 ms. Trace:
I20260811 16:04:00.504603 13755 tablet_copy_service.cc:161] P cec0688f86d54789b9b9ecc924ddecf3: Beginning new tablet copy session on tablet 7f6a000330b3415da4f525eae84f33fb from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:37376: session id = 8d98491a0db549d0b671b60b90c9cdea-7f6a000330b3415da4f525eae84f33fb
I20260811 16:04:00.759038 15714 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:00.795987 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58280us
W20260811 16:04:00.932168 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 235337us
I20260811 16:04:00.696671 15702 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:00.665617 13628 rpcz_store.cc:276] 0811 16:03:59.183482 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:59.183995 (+   513us) service_pool.cc:227] Handling call
0811 16:04:00.609652 (+1425657us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:03:59.303310 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:03:59.304253 (+   943us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:03:59.304312 (+    59us) write_op.cc:435] Acquired schema lock
0811 16:03:59.304330 (+    18us) tablet.cc:660] Decoding operations
0811 16:03:59.304931 (+   601us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:03:59.305003 (+    72us) write_op.cc:641] Partition lock acquired for write op
0811 16:03:59.305055 (+    52us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:03:59.305443 (+   388us) tablet.cc:699] Row locks acquired
0811 16:03:59.305488 (+    45us) write_op.cc:260] PREPARE: finished
0811 16:03:59.305736 (+   248us) write_op.cc:270] Start()
0811 16:03:59.305938 (+   202us) write_op.cc:276] Timestamp: P: 1786464239305668 usec, L: 0
0811 16:03:59.305989 (+    51us) op_driver.cc:331] REPLICATION: starting
0811 16:03:59.352091 (+ 46102us) log.cc:842] Serialized 599 byte log entry
0811 16:03:59.358138 (+  6047us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54000311d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51908198 00007f5c5531bade 00007f5c5531b2b8 00007f5c5531fba1 00007f5c5531fb59 00007f5c5531fae9 00007f5c5531fab1 00007f5c5531edad 00007f5c57c48204 00007f5c57c48039
0811 16:03:59.654632 (+296494us) op_driver.cc:444] REPLICATION: finished
0811 16:03:59.673410 (+ 18778us) write_op.cc:301] APPLY: starting
0811 16:03:59.677315 (+  3905us) tablet.cc:1365] starting BulkCheckPresence
0811 16:03:59.690988 (+ 13673us) tablet.cc:1368] finished BulkCheckPresence
0811 16:03:59.706428 (+ 15440us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:03:59.706888 (+   460us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:03:59.707223 (+   335us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:03:59.707337 (+   114us) write_op.cc:312] APPLY: finished
0811 16:03:59.707763 (+   426us) log.cc:842] Serialized 23 byte log entry
0811 16:03:59.708066 (+   303us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:59.708215 (+   149us) write_op.cc:454] Released schema lock
0811 16:03:59.708293 (+    78us) write_op.cc:341] FINISH: Updating metrics
0811 16:03:59.708700 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:03:59.708757 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39268,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":4947,"apply.run_cpu_time_us":3561,"apply.run_wall_time_us":39821,"num_ops":1,"prepare.queue_time_us":41580,"prepare.run_cpu_time_us":8999,"prepare.run_wall_time_us":75162,"replication_time_us":343132,"spinlock_wait_cycles":103013632}]]}
I20260811 16:04:00.961609 15702 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.060956 15702 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:01.061875 15660 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.064905 13908 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:01.065048 15754 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.068394 15707 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.069103 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:00.860741 15714 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.104043 15660 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.106633 15714 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:01.112574 15660 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.085435 15739 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.193804 15642 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.110270 15707 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:01.214722 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 281097us
W20260811 16:04:01.207746 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.015s	sys 0.040s
W20260811 16:04:01.216951 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 646526us
W20260811 16:04:01.223692 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 287272us
I20260811 16:04:01.158496 15754 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.171912 15739 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.216866 15628 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.221658 15660 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.237551 15747 ts_tablet_manager.cc:927] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.225570 15694 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.234282 15700 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.213228 15642 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.296972 15738 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.297711 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:01.297605 15738 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.298364 13755 tablet_copy_source_session.cc:205] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Tablet Copy: opened 0 blocks and 1 log segments
W20260811 16:04:01.301954 15746 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260811 16:04:01.262732 15660 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.299587 15750 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.299324 15687 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.300256 15699 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.300787 15752 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:01.245270 15628 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.352085 15744 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:01.338986 15770 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.352959 15652 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.365911 15761 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:01.339304 15617 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:01.374868 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 140287us
I20260811 16:04:01.287798 15694 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:01.382091 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 152987us
I20260811 16:04:01.383826 15694 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:01.287973 15700 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.385896 15700 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.388566 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:01.387506 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:01.397063 15642 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.397548 15696 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.397789 15706 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.340026 15687 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.366628 15761 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.366442 15652 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:01.356280 15752 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.333196 15750 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.370165 15699 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.397589 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:01.374915 15651 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.374323 15770 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.352861 15744 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.380435 15617 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:01.722693 15729 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:01.407768 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1078) took 1025 ms. Trace:
I20260811 16:04:01.568975 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:01.430184 15738 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.434760 15767 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.757366 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:01.696142 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1286) took 1173 ms. Trace:
I20260811 16:04:01.486634 15753 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:01.665864 15752 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:01.489601 15754 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:01.487866 15707 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:01.435284 15689 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.474002 15739 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:01.486217 15712 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:01.398351 15706 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.746349 13820 rpcz_store.cc:276] 0811 16:04:00.370054 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.370347 (+   293us) service_pool.cc:227] Handling call
0811 16:04:00.371000 (+   653us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:00.375433 (+  4433us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:00.375504 (+    71us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:00.399486 (+ 23982us) log.cc:842] Serialized 26 byte log entry
0811 16:04:00.761083 (+361597us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:00.761154 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:00.761337 (+   183us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:01.394667 (+633330us) raft_consensus.cc:1671] finished
0811 16:04:01.394695 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:01.394874 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3599,"raft.queue_time_us":4043,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":24008,"thread_start_us":300512,"threads_started":1,"wal-append.queue_time_us":638752}
W20260811 16:04:01.773686 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 420917us
I20260811 16:04:01.652999 15637 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.674309 15632 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:01.678717 15660 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.773083 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:01.653338 15699 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:01.398262 15696 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.756582 15651 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:02.048637 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.027s	sys 0.083s
I20260811 16:04:01.776929 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:02.150746 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.029s	sys 0.090s
I20260811 16:04:02.154002 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:02.097563 15430 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:01.956269 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:02.097725 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 141122us
W20260811 16:04:02.161423 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 776955us
I20260811 16:04:01.772230 13741 rpcz_store.cc:276] 0811 16:04:00.504669 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.505809 (+  1140us) service_pool.cc:227] Handling call
0811 16:04:00.576465 (+ 70656us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:01.047288 (+470823us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:01.047781 (+   493us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:01.052619 (+  4838us) log.cc:842] Serialized 26 byte log entry
0811 16:04:01.238766 (+186147us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:01.238803 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:01.238907 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:01.677586 (+438679us) raft_consensus.cc:1671] finished
0811 16:04:01.677615 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:01.677808 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":125829,"raft.queue_time_us":446038,"raft.run_cpu_time_us":494,"raft.run_wall_time_us":5216,"thread_start_us":470201,"threads_started":2,"wal-append.queue_time_us":290222}
I20260811 16:04:01.726226 15628 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:01.725451 15685 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:02.085484 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.065s	sys 0.099s
I20260811 16:04:02.160183 13821 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:02.220103 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.067s	sys 0.102s
W20260811 16:04:02.220518 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 836243us
I20260811 16:04:01.743971 15729 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:02.220642 15750 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:02.222656 15660 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:02.663813 15750 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:02.664090 15660 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:02.664500 15750 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:02.666769 15660 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:02.215374 15632 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:02.488369 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:02.215046 15637 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:02.668651 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:02.224236 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 206) took 1909 ms. Trace:
I20260811 16:04:02.559350 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:01.780594 15778 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:02.486625 15430 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.768009 15767 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:01.769444 15753 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:02.532316 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1672) took 1417 ms. Trace:
I20260811 16:04:02.950387 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1669) took 1894 ms. Trace:
I20260811 16:04:02.669533 13626 rpcz_store.cc:276] 0811 16:04:00.315301 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.315672 (+   371us) service_pool.cc:227] Handling call
0811 16:04:02.224147 (+1908475us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":215070,"reported_tablets":1}
W20260811 16:04:03.218652 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.005s	sys 0.022s
W20260811 16:04:03.313299 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.006s	sys 0.022s
I20260811 16:04:03.299826 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 520) took 1178 ms. Trace:
I20260811 16:04:03.315944 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 320) took 1348 ms. Trace:
I20260811 16:04:03.316965 13825 rpcz_store.cc:276] 0811 16:04:01.961012 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:02.872514 (+911502us) service_pool.cc:227] Handling call
0811 16:04:03.124313 (+251799us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.124539 (+   226us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.124575 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.309411 (+184836us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:03.309452 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:03.309507 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:03.309621 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:02.148265 15780 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.304790 15773 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:03.319443 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.010s	sys 0.032s
I20260811 16:04:03.320016 15792 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:03.320536 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.010s	sys 0.033s
I20260811 16:04:03.156785 13826 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:03.320652 15792 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.308548 13902 rpcz_store.cc:276] 0811 16:04:01.070938 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.071062 (+   124us) service_pool.cc:227] Handling call
0811 16:04:02.487254 (+1416192us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:02.487531 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:02.487756 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:02.487792 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:02.487842 (+    50us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:02.487882 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:02.487950 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:02.488142 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6876928}
I20260811 16:04:03.319355 15780 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.305540 15637 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.323655 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:03.323861 15792 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.323673 15637 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.324539 13740 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:03.308799 13909 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:01.780280 15761 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.326115 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 199) took 1272 ms. Trace:
I20260811 16:04:03.304894 15779 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.326284 15778 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.326695 13909 rpcz_store.cc:276] 0811 16:04:02.053306 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:02.199832 (+146526us) service_pool.cc:227] Handling call
0811 16:04:03.326009 (+1126177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:03.324570 15637 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.327082 15779 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:03.328631 13871 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.549s (SENT) [suppressed 3 similar messages]
I20260811 16:04:03.310298 13901 rpcz_store.cc:276] 0811 16:04:01.055540 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.056143 (+   603us) service_pool.cc:227] Handling call
0811 16:04:02.949333 (+1893190us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:02.949658 (+   325us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:02.949929 (+   271us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:02.949967 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:02.950022 (+    55us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:02.950063 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:02.950137 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:02.950299 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":37544704}
I20260811 16:04:02.351925 15742 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.330320 15742 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.322845 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:03.319598 15773 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.325480 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1301) took 1123 ms. Trace:
I20260811 16:04:02.377818 15754 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:03.332819 13740 rpcz_store.cc:276] 0811 16:04:02.201841 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:02.203487 (+  1646us) service_pool.cc:227] Handling call
0811 16:04:03.325383 (+1121896us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:03.333287 15754 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.146384 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 316) took 1373 ms. Trace:
I20260811 16:04:03.335719 13827 rpcz_store.cc:276] 0811 16:04:01.747955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.957613 (+209658us) service_pool.cc:227] Handling call
0811 16:04:02.220670 (+263057us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:02.220879 (+   209us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:02.220902 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:02.220941 (+    39us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:02.220980 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:02.221047 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:03.121513 (+900466us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b54002ab7d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:03.121666 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11551616}
I20260811 16:04:03.337633 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:02.353988 15712 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:02.874439 13873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.012s
W20260811 16:04:03.342036 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.008s	sys 0.018s
I20260811 16:04:03.343245 15791 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:03.343816 15791 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.302834 15651 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.359480 15792 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:03.361526 15754 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.361012 15792 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.363224 15778 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.364372 15712 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.359465 15780 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.365922 15792 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.359978 15742 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:03.178718 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.017s	sys 0.025s
W20260811 16:04:03.370775 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.020s	sys 0.036s
I20260811 16:04:03.370936 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:03.371079 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.21113e+06us
I20260811 16:04:02.093140 15781 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:02.115285 15692 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.313858 14580 rpcz_store.cc:276] 0811 16:04:02.099380 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:02.099572 (+   192us) service_pool.cc:227] Handling call
0811 16:04:02.116774 (+ 17202us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:02.151368 (+ 34594us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:02.151406 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:02.151468 (+    62us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:02.151516 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:03.277281 (+1125765us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:03.277345 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:03.277510 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":78980352}
I20260811 16:04:03.207082 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1676) took 1754 ms. Trace:
I20260811 16:04:03.195381 15694 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:03.371678 13741 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:02.013383 15777 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:02.036563 15759 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.435413 13906 rpcz_store.cc:276] 0811 16:04:01.226390 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.226511 (+   121us) service_pool.cc:227] Handling call
0811 16:04:01.236947 (+ 10436us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:01.239455 (+  2508us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:01.239491 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:01.239541 (+    50us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:01.239568 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:02.980361 (+1740793us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b54003b06d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:02.980421 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:02.980583 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5364992}
I20260811 16:04:02.200304 15697 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:02.653707 15747 thread.cc:636] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.082s	sys 0.166s
I20260811 16:04:02.602006 15617 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:02.600668 15713 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:02.638257 15686 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:03.276357 15691 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.051s	sys 0.110s
I20260811 16:04:02.629812 15769 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:02.627521 15755 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:02.532896 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:02.511396 15726 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:02.639997 15696 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:02.559806 15760 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:02.706267 15699 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.364531 15779 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:03.523248 15747 thread.cc:602] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 2.099s	user 0.116s	sys 0.201s
I20260811 16:04:02.602432 15744 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.523633 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:02.601714 15687 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:03.540522 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 224) took 2714 ms. Trace:
I20260811 16:04:03.365451 15791 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:02.421730 15770 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:02.593003 15652 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:02.711225 15707 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:02.428363 15775 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:02.595108 15739 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.554632 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:03.435039 15780 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.373791 15778 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:02.551082 15719 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.397380 15750 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.509184 15430 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.366670 15773 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.550050 15632 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:02.316929 15685 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:03.590633 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 262015us
W20260811 16:04:03.629675 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 194855us
I20260811 16:04:02.222457 15689 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.619030 13739 rpcz_store.cc:276] 0811 16:04:00.408989 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.409359 (+   370us) service_pool.cc:227] Handling call
0811 16:04:01.372729 (+963370us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:01.372975 (+   246us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:01.756808 (+383833us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:01.756843 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:01.756887 (+    44us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:01.756913 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:03.123439 (+1366526us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:03.123518 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:03.123717 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":888160896}
I20260811 16:04:03.640849 15698 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:03.462461 15754 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:03.429375 15753 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:03.555308 15691 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.051s	sys 0.129s
W20260811 16:04:03.650068 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.050s	sys 0.141s
I20260811 16:04:03.659441 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 512) took 1937 ms. Trace:
I20260811 16:04:03.439131 15767 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.647584 15636 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:03.480850 15651 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:03.459378 15694 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.276232 15749 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.612381 15699 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.539898 15697 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.587512 15769 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.592060 15637 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.870574 15430 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:03.859400 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.019s	sys 0.036s
W20260811 16:04:03.906319 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.585s	user 0.022s	sys 0.038s
W20260811 16:04:03.875917 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.076s	sys 0.207s
I20260811 16:04:02.510444 13738 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:03.907243 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:03.586395 15686 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.673161 15750 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.556407 15777 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.586701 15755 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.914521 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:03.875952 14581 rpcz_store.cc:276] 0811 16:04:01.342038 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.342233 (+   195us) service_pool.cc:227] Handling call
0811 16:04:01.342593 (+   360us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:01.385025 (+ 42432us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:01.385058 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:01.385111 (+    53us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:01.385151 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:03.278661 (+1893510us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54004e02d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:03.278731 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:03.278880 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":97076480}
I20260811 16:04:03.908619 15430 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.650695 15707 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.920608 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:03.558601 15726 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.832533 15773 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.511596 15692 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.876596 15729 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.479310 15789 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:03.864539 15728 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:03.934433 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 497861us
I20260811 16:04:03.823096 15652 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.660465 15780 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.869848 15792 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:03.834084 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1295) took 2045 ms (client timeout 1784 ms). Trace:
I20260811 16:04:03.953197 15710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6a000330b3415da4f525eae84f33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:04:03.954192 15430 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.915087 15735 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:03.655470 15739 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.872162 15744 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.905900 15754 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.914064 15747 tablet_copy_client.cc:316] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:04:03.948982 15753 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:03.965335 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:03.965991 15777 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:03.956840 13825 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:03.931386 15767 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:03.612196 15713 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.795908 15778 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.546603 15759 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.981937 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:03.949424 15752 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:03.958220 15684 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:04.130241 15697 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:03.795538 15775 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.932341 15749 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.132100 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 323) took 1037 ms. Trace:
I20260811 16:04:03.926497 15636 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.931674 15719 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.924021 15698 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.933531 15651 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.026882 15753 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.133371 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:03.975225 15652 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.648802 15760 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.027510 15744 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:03.985126 15793 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.060035 15686 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:03.972095 13737 rpcz_store.cc:269] 0811 16:04:01.775745 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.791838 (+ 16093us) service_pool.cc:227] Handling call
0811 16:04:03.820742 (+2028904us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:03.980024 15792 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:04.044013 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64506.5us
I20260811 16:04:03.945417 15750 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:03.524430 15781 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.033311 15735 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.062441 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:03.986478 15789 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:04.098253 13826 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
I20260811 16:04:03.950709 15773 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.132653 13820 rpcz_store.cc:276] 0811 16:04:03.094817 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.131067 (+1036250us) service_pool.cc:227] Handling call
0811 16:04:04.131501 (+   434us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:04.131701 (+   200us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:04.131734 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:04.131790 (+    56us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:04.131830 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.131900 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.132028 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:03.991744 15728 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.117162 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.116263 15699 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.115077 15777 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.146355 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.159349 15713 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.159499 15651 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.140906 15694 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.137137 15752 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.210531 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.213771 14582 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:04.214758 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.146514 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.175649 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.195338 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.229859 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.195565 15739 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.197685 15753 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.161042 15780 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.200299 13827 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:04.209350 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 541) took 1674 ms. Trace:
I20260811 16:04:04.233469 14583 rpcz_store.cc:276] 0811 16:04:02.550384 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:02.550768 (+   384us) service_pool.cc:227] Handling call
0811 16:04:03.077652 (+526884us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:04.025738 (+948086us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:04.025768 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:04.025809 (+    41us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:04.025851 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.209022 (+183171us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54006b44d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.209068 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.209188 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2177540992}
I20260811 16:04:04.209193 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.204708 15777 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.215042 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.235702 13740 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:04.191988 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.238106 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.238947 13820 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:04.239981 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.120944 15767 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.211565 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.212891 15754 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.132565 15775 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.151072 15684 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:04.277221 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.059s	sys 0.089s
I20260811 16:04:04.167184 15793 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:04.285274 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.059s	sys 0.089s
W20260811 16:04:04.285665 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 738708us
I20260811 16:04:04.248835 15767 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:04.212657 15689 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.242183 15789 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.227922 15726 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.309885 15639 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:04.207599 15769 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.214139 15698 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.260465 15651 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:04.331205 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.257061 15707 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.178417 15719 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.340942 15795 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:04.262924 14573 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:04:04.226852 15760 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.264266 13736 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:04.250353 15685 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.316305 15726 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.370172 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.356848 15781 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.357755 15692 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.314702 15639 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.363864 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.345672 15651 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.314733 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.319366 15729 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:04.354808 15759 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.371094 13901 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:04.371872 15767 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.379616 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 517) took 2987 ms. Trace:
I20260811 16:04:04.381469 15750 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.382522 15752 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:04.383644 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1095) took 2343 ms (client timeout 1848 ms). Trace:
W20260811 16:04:04.416923 13818 rpcz_store.cc:269] 0811 16:04:02.039838 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.383323 (+2343485us) service_pool.cc:214] Skipping call since client already timed out
0811 16:04:04.383447 (+   124us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260811 16:04:04.418048 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.384297 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.419461 15651 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.420986 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1296) took 2645 ms. Trace:
I20260811 16:04:04.421411 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.421373 13742 rpcz_store.cc:276] 0811 16:04:01.776058 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.776195 (+   137us) service_pool.cc:227] Handling call
0811 16:04:01.776474 (+   279us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.429794 (+1653320us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.429843 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.429902 (+    59us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:03.429943 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.420774 (+990831us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400344ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.420824 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.420934 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3801703680}
I20260811 16:04:04.321795 15694 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.423501 15694 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.424597 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.425274 14581 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:04.332108 15691 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:04.341814 15775 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.390134 15684 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.390698 15809 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.391156 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.393585 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.349864 15698 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.365630 15778 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.349079 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.396756 15795 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:04.399385 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.352087 15636 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.386119 15685 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.455842 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.469233 13906 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:04.412699 15728 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.412817 15748 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.404659 15793 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.410992 14578 rpcz_store.cc:276] 0811 16:04:01.392252 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.425575 (+ 33323us) service_pool.cc:227] Handling call
0811 16:04:01.436318 (+ 10743us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.431016 (+1994698us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.431042 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.431081 (+    39us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:03.431108 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.379091 (+947983us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54005703d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.379175 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.379383 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4586994944}
I20260811 16:04:04.413386 15749 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.410809 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.427752 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.422833 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.425694 15694 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.431639 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.469715 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.391423 15812 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:04.595474 13909 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:04:04.562362 15639 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.590256 13901 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:04.593387 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.453567 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.388623 15726 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.410771 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.605518 13905 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:04.454706 15773 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.456753 15767 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.454957 15777 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.458069 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.408663 15729 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.616667 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.591732 15744 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.620285 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.625229 15688 raft_consensus.cc:979] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:04:04.456796 15706 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.626627 13900 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:04.634001 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.634953 13907 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:04.442965 15775 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.630786 15812 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.610365 15792 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.588649 15685 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.563235 15735 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.442813 15691 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.617185 15748 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.681385 15748 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:04.683120 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.056s	sys 0.125s
W20260811 16:04:04.683521 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.056s	sys 0.125s
I20260811 16:04:04.686663 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.672607 15688 raft_consensus.cc:1067] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:04:04.690753 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.691174 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:04.688843 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.029s
W20260811 16:04:04.692888 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.018s	sys 0.029s
W20260811 16:04:04.689213 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.026s	sys 0.021s
W20260811 16:04:04.695564 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.026s	sys 0.021s
I20260811 16:04:04.697737 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.590788 15698 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:04.687991 15810 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260811 16:04:04.709998 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.031s
W20260811 16:04:04.713418 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.031s
I20260811 16:04:04.690372 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.732522 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.737169 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.737897 13901 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:04.739818 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:04.740710 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.741482 13820 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:04.710530 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.759219 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.760136 13820 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:04.756662 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1080) took 4169 ms. Trace:
I20260811 16:04:04.759392 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:04.761797 13826 rpcz_store.cc:276] 0811 16:04:00.580781 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.581229 (+   448us) service_pool.cc:227] Handling call
0811 16:04:01.426343 (+845114us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:03.156068 (+1729725us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9acb7c 00007f5c4e9ac73b 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:03.156332 (+   264us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.156623 (+   291us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:04.173488 (+1016865us) log.cc:842] Serialized 14 byte log entry
0811 16:04:04.749869 (+576381us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:04.749995 (+   126us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:04.750053 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.750140 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.750272 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":21665,"spinlock_wait_cycles":202512512,"thread_start_us":540001,"threads_started":1}
I20260811 16:04:04.621943 15809 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.731405 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:04.755738 13874 connection.cc:232] RPC call timeout handler was delayed by -1.3206389640690759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260811 16:04:04.761593 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.798360 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:04.795773 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:04.797488 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.010s	sys 0.026s
I20260811 16:04:04.796443 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.798576 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.799211 14581 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:04:04.752339 13736 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:04.764508 15729 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:04.799863 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.010s	sys 0.026s
I20260811 16:04:04.798866 14578 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:04.807862 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:04.810693 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 608713us
I20260811 16:04:04.811056 13820 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:04.801505 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:04.806782 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.761332 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 801054abfed346a09c04b7cd13d7c62f from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:04:04.798008 15726 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.794731 15807 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.815807 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.799039 15752 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:04.797616 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.820112 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:04.820568 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 534207us
I20260811 16:04:04.826912 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.805621 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.828681 13826 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:04.830014 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.816848 15792 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.831722 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.835909 13826 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:04.809360 15813 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:04.836987 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.837507 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:04.840744 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:04.821501 15744 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:04.854063 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:04.855305 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1091) took 3423 ms (client timeout 1983 ms). Trace:
W20260811 16:04:04.855787 13824 rpcz_store.cc:269] 0811 16:04:01.431800 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.432009 (+   209us) service_pool.cc:227] Handling call
0811 16:04:04.804463 (+3372454us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:04.855181 (+ 50718us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26029952}
W20260811 16:04:04.858011 13817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 322) took 1854 ms (client timeout 2062 ms). Trace:
I20260811 16:04:04.852504 15728 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:04.830924 15775 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:04.829145 15807 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:04.831205 15685 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.818495 15812 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.829368 15752 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.917148 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 315) took 3171 ms. Trace:
I20260811 16:04:04.861761 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 327) took 1350 ms. Trace:
I20260811 16:04:04.857550 13823 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:04.914109 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 488) took 2040 ms. Trace:
I20260811 16:04:04.938669 15778 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:04.919824 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1504) took 1364 ms. Trace:
I20260811 16:04:04.863209 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 540) took 2328 ms. Trace:
I20260811 16:04:04.860275 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 321) took 2153 ms. Trace:
I20260811 16:04:04.838852 15813 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.962702 15755 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.830024 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 801054abfed346a09c04b7cd13d7c62f from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-801054abfed346a09c04b7cd13d7c62f
I20260811 16:04:04.831945 15720 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:04.984894 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.986440 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.987406 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.987566 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.853590 15744 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:04.913241 15809 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:04.966331 13827 rpcz_store.cc:276] 0811 16:04:03.511183 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.511350 (+   167us) service_pool.cc:227] Handling call
0811 16:04:04.861525 (+1350175us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400380ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:04.861653 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1281056512}
I20260811 16:04:04.837733 14574 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
W20260811 16:04:04.916002 13738 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.008s	user 0.008s	sys 0.005s
I20260811 16:04:04.971940 13744 rpcz_store.cc:276] 0811 16:04:03.555421 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.555735 (+   314us) service_pool.cc:227] Handling call
0811 16:04:03.556126 (+   391us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.964368 (+408242us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.964412 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.964471 (+    59us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:03.964514 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.919587 (+955073us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.919634 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.919762 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":938247424}
I20260811 16:04:04.975313 14577 rpcz_store.cc:276] 0811 16:04:02.534560 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:02.871541 (+336981us) service_pool.cc:227] Handling call
0811 16:04:02.872021 (+   480us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.968113 (+1096092us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.968158 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.968217 (+    59us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:03.968273 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.862905 (+894632us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006d38d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.862957 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.863120 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2520200064}
I20260811 16:04:04.979914 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:04.974150 13821 rpcz_store.cc:276] 0811 16:04:02.707129 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.859313 (+2152184us) service_pool.cc:227] Handling call
0811 16:04:04.859668 (+   355us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:04.859845 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:04.859870 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:04.859915 (+    45us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:04.859962 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.860046 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.860215 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:04.858624 13817 rpcz_store.cc:269] 0811 16:04:03.003404 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.645372 (+1641968us) service_pool.cc:227] Handling call
0811 16:04:04.857912 (+212540us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:04.840557 15792 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:04.851218 15795 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.964716 13822 rpcz_store.cc:276] 0811 16:04:01.745478 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.745615 (+   137us) service_pool.cc:227] Handling call
0811 16:04:01.745993 (+   378us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.147004 (+1401011us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.147052 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.147108 (+    56us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:03.147171 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.916772 (+1769601us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000983d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.916825 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.916955 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3221515520}
I20260811 16:04:04.967880 15752 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.001536 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.915103 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.992151 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:04.994966 13826 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:04.994851 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:04.982513 15698 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.989187 15720 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.980945 15732 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:04.859588 15691 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:04.978605 15778 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:04.957391 15728 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.006793 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:04.983841 15813 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.003563 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:04.990375 15744 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.013688 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:05.006536 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.010735 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.019822 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.018944 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:05.040843 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.004326 15720 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.041038 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.002015 15809 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.016767 15698 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.012140 15778 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.051240 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.015058 15728 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.052861 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.021564 15773 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.055811 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.022312 15775 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:05.059291 15712 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.065544 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.048840 15766 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.052699 15730 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.061714 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.069166 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.070307 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:05.063393 13787 connection.cc:232] RPC call timeout handler was delayed by -1.2600106700556353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260811 16:04:05.057690 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.064311 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.010807 15732 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.053179 15718 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.077395 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.080801 14577 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:05.082216 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.070921 13742 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:05.090644 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 291920us
I20260811 16:04:05.084139 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.049010 15809 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.076169 15730 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:05.059867 15773 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:05.055627 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:05.092386 13874 connection.cc:232] RPC call timeout handler was delayed by -1.0947389639914036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260811 16:04:05.091616 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.063030 15775 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.112126 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.112282 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.111696 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.111562 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:05.111403 13874 connection.cc:232] RPC call timeout handler was delayed by -1.0740389639977366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260811 16:04:05.065855 15685 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.065457 15712 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.113631 13744 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:04.971321 14575 rpcz_store.cc:276] 0811 16:04:02.873609 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.146315 (+272706us) service_pool.cc:227] Handling call
0811 16:04:03.248018 (+101703us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.909682 (+661664us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.909732 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.913012 (+  3280us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:03.920488 (+  7476us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:04.913772 (+993284us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b540056ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:04.913841 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:04.914020 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1461617536}
I20260811 16:04:05.067387 15766 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.085325 15665 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.091745 15718 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.092727 15786 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:05.126335 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 232) took 1144 ms. Trace:
I20260811 16:04:05.150058 13740 rpcz_store.cc:276] 0811 16:04:03.985666 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.133060 (+147394us) service_pool.cc:227] Handling call
0811 16:04:05.126098 (+993038us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:05.126256 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":215001856}
I20260811 16:04:05.151489 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.151657 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.152730 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 238) took 1062 ms. Trace:
I20260811 16:04:05.152771 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.153283 13741 rpcz_store.cc:276] 0811 16:04:04.090360 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.148859 (+1058499us) service_pool.cc:227] Handling call
0811 16:04:05.152662 (+  3803us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:05.154065 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.154430 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.094869 15730 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.113025 15773 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.122846 15712 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:05.145778 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.00791e+06us
I20260811 16:04:05.094165 15699 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.060118 15698 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.128280 15766 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.125552 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.156867 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.141101 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.115885 15775 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:05.137950 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1506) took 1580 ms. Trace:
I20260811 16:04:05.171810 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.173513 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.174276 13741 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:05.115465 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.143071 15665 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:05.143288 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.175135 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.178606 13923 tablet_copy_source_session.cc:205] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:04:05.178990 15726 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.180238 15710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43030 (request call id 476) took 5390 ms. Trace:
I20260811 16:04:05.181406 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1293) took 3406 ms. Trace:
I20260811 16:04:05.186568 13741 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:05.169369 13743 rpcz_store.cc:276] 0811 16:04:03.557932 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.558052 (+   120us) service_pool.cc:227] Handling call
0811 16:04:03.558359 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:04.217288 (+658929us) raft_consensus.cc:1520] Early marking committed up to index 2
0811 16:04:04.715861 (+498573us) log.cc:842] Serialized 14 byte log entry
0811 16:04:04.799633 (+ 83772us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:04.799682 (+    49us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:04.799721 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:05.137707 (+337986us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:05.137761 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:05.137886 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14090,"prepare.queue_time_us":591190,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7091,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":9338,"spinlock_wait_cycles":1514776448,"thread_start_us":547423,"threads_started":2,"wal-append.queue_time_us":145269}
I20260811 16:04:05.185351 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.182379 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.128091 15685 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.175999 15807 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:05.259860 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.191113 13740 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:05.184821 15665 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.265775 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 492) took 1551 ms. Trace:
I20260811 16:04:05.266366 14580 rpcz_store.cc:276] 0811 16:04:03.714523 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.911675 (+197152us) service_pool.cc:227] Handling call
0811 16:04:03.938286 (+ 26611us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:03.958652 (+ 20366us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:03.958682 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:03.958723 (+    41us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:03.958752 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:05.265446 (+1306694us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5400571f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:05.265513 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:05.265706 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46331136}
I20260811 16:04:05.162642 15797 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260811 16:04:05.187338 15726 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.189235 15727 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:05.362890 13825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 324) took 2228 ms (client timeout 2175 ms). Trace:
W20260811 16:04:05.363656 13825 rpcz_store.cc:269] 0811 16:04:03.134217 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.322356 (+188139us) service_pool.cc:227] Handling call
0811 16:04:05.362133 (+2039777us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:05.362820 (+   687us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1435124480}
I20260811 16:04:05.366918 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.325803 15430 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:05.329322 15726 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.194933 15812 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:05.199680 15792 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.373050 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.378882 15430 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:05.347007 15738 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:04:05.390573 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130810us
I20260811 16:04:05.392776 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.395888 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.397326 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:05.397727 13741 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:05.407632 15718 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.411473 15732 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.368462 15727 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:05.190680 13738 rpcz_store.cc:276] 0811 16:04:01.775014 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.791678 (+ 16664us) service_pool.cc:227] Handling call
0811 16:04:02.352189 (+560511us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:02.477733 (+125544us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:05.001428 (+2523695us) log.cc:842] Serialized 14 byte log entry
0811 16:04:05.149155 (+147727us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:05.157969 (+  8814us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:05.160963 (+  2994us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:05.169917 (+  8954us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:05.181348 (+ 11431us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4153,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":106423,"threads_started":1,"wal-append.queue_time_us":104262}
I20260811 16:04:05.473065 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.394158 15809 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.357474 15752 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:05.493897 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54841.6us
I20260811 16:04:05.394555 15812 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:05.526497 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 233) took 1501 ms. Trace:
I20260811 16:04:05.532151 13740 rpcz_store.cc:276] 0811 16:04:04.025163 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.392423 (+1367260us) service_pool.cc:227] Handling call
0811 16:04:05.525838 (+133415us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:05.526074 (+   236us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:05.526111 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:05.526165 (+    54us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:05.526205 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:05.526282 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:05.526422 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:05.189527 15710 rpcz_store.cc:276] 0811 16:03:59.789677 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:03:59.789869 (+   192us) service_pool.cc:227] Handling call
0811 16:04:00.061648 (+271779us) ts_tablet_manager.cc:928] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411)
0811 16:04:03.936353 (+3874705us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:04:04.818945 (+882592us) tablet_metadata.cc:641] Metadata flushed
0811 16:04:04.838626 (+ 19681us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:04:05.179428 (+340802us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:04:05.179758 (+   330us) tablet_replica.cc:205] Creating consensus instance
0811 16:04:05.180090 (+   332us) ts_tablet_manager.cc:983] Replica registered.
0811 16:04:05.180151 (+    61us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":555,"tablet-copy.queue_time_us":48274,"thread_start_us":93878,"threads_started":2}
I20260811 16:04:05.553490 15710 tablet_copy_client.cc:791] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:04:05.554281 15710 tablet_copy_client.cc:655] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:04:05.420183 15829 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.567598 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:05.567919 15728 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.500s	user 0.023s	sys 0.037s
W20260811 16:04:05.572551 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c390fd23cec5435d81b38a50b2988a60. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:04:05.542440 15744 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.585295 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.586357 15430 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:05.594193 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.596964 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.599040 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.597878 13740 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:05.569869 15829 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:05.606062 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 233070us
I20260811 16:04:05.581583 15698 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.577099 15752 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:05.582160 15685 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.601652 15727 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:05.607242 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.579613 15728 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.606161 15829 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.627024 15728 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.628931 13738 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 2: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:05.629071 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.631644 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:05.632617 13630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 304) took 5220 ms. Trace:
I20260811 16:04:05.633011 13630 rpcz_store.cc:276] 0811 16:04:00.411845 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.454613 (+ 42768us) service_pool.cc:227] Handling call
0811 16:04:05.632500 (+5177887us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":2}
I20260811 16:04:05.631700 15812 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.634383 15812 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.634799 15812 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:03.252385 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:05.636934 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:05.638921 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:05.619745 15652 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.645386 15702 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.645862 15702 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.645740 15726 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.620396 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.648443 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:05.649163 14574 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:04:05.620354 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.651484 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.620803 14575 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:05.621613 15773 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:05.640484 15833 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.660612 15833 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.661140 15833 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.661347 15807 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:05.640609 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:05.636914 13626 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:05.631080 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 236) took 1594 ms. Trace:
I20260811 16:04:05.662992 13744 rpcz_store.cc:276] 0811 16:04:04.036754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.630232 (+1593478us) service_pool.cc:227] Handling call
0811 16:04:05.630599 (+   367us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:05.630762 (+   163us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:05.630789 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:05.630827 (+    38us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:05.630857 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:05.630914 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:05.631021 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:05.646392 15702 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.621399 15712 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.667058 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.670173 15732 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.670620 15732 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.671000 15732 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.673630 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:05.675758 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:05.681864 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:05.682091 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:05.672370 15690 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260811 16:04:05.677909 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:05.683609 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:05.683959 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:05.684376 13817 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:05.675309 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.685674 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.686826 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.690127 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1307) took 1309 ms. Trace:
I20260811 16:04:05.690699 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.690975 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.690522 13739 rpcz_store.cc:276] 0811 16:04:04.380605 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.457452 (+ 76847us) service_pool.cc:227] Handling call
0811 16:04:05.675116 (+1217664us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:05.690062 (+ 14946us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7910144}
I20260811 16:04:05.692576 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.693190 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.694339 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.694875 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:05.693202 13905 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:05.661795 15807 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:05.700273 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.702018 13742 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:05.707428 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.707746 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.667475 15652 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.699321 15706 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:05.675762 15811 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:05.710650 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.665455 15665 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:05.724768 15778 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.015s
I20260811 16:04:05.725246 15778 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.726229 15665 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:05.701902 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:05.695451 15790 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:05.728796 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.731014 15773 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:05.715691 14541 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.732571 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.695611 15714 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.726361 13741 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:05.722199 15812 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.735800 13908 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:05.733834 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:05.676194 15831 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:05.750691 15747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 801054abfed346a09c04b7cd13d7c62f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:04:05.752125 15730 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.586s	user 0.004s	sys 0.014s
I20260811 16:04:05.752910 15730 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.754446 15706 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.754892 15706 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.754992 15730 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.755345 15706 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.756587 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.731737 15712 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.746272 15807 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.748211 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:05.748735 15800 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.741292 15696 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:04:05.750237 15766 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260811 16:04:05.739720 15714 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.761365 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.756978 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.770704 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.711316 15652 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.774065 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.775561 15806 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:05.776572 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.785418 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.786171 13739 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:05.787124 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.787755 13739 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:05.788538 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.789815 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.781387 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.797650 15806 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:05.798286 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.799443 15806 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:05.799639 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:05.800024 15806 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.800578 15806 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.800828 15722 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:05.810344 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.814399 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:05.764958 15738 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.763748 15778 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.820436 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:05.869350 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55069.1us
I20260811 16:04:05.972456 15699 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.972970 15827 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.856524 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 1897) took 1048 ms. Trace:
I20260811 16:04:05.973706 15827 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.973609 13824 rpcz_store.cc:276] 0811 16:04:04.807932 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.685193 (+877261us) service_pool.cc:227] Handling call
0811 16:04:05.855867 (+170674us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b54002dbd28. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c5682e2dc 00007f5c5686237c 00007f5c5684d80b 00007f5c5684d2a2 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c
0811 16:04:05.856000 (+   133us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:05.856195 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:05.856228 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:05.856266 (+    38us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:05.856291 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:05.856347 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:05.856464 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19321728}
I20260811 16:04:05.864763 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.824504 15738 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.889365 15690 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.773608 15714 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.929145 15744 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.895483 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:05.821094 15722 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:05.821363 15807 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.772446 15767 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.810385 15652 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:05.772944 15766 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:05.810559 15685 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:05.933096 13817 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:04:05.939719 15710 tablet_copy_client.cc:531] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:04:05.889431 15698 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:05.810784 15800 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:05.927459 15730 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:05.941762 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.973052 15699 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:05.896085 15813 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.010s
I20260811 16:04:05.939792 15726 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.981776 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:05.964558 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:05.975687 15718 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:05.980120 15738 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:05.964303 15702 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:05.994822 13903 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:05.999074 13743 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 2: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:06.001729 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.010201 13907 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:05.991171 15698 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.985419 15722 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:05.990958 15812 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.017768 13901 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:05.998302 15827 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:05.988996 15806 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.025977 15732 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.028059 15732 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:06.030776 15836 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260811 16:04:06.030877 13907 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.016535 15698 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.019872 15722 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:06.034598 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 229) took 2108 ms. Trace:
I20260811 16:04:05.998999 15813 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.007656 15718 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.064147 15718 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.037320 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:06.042057 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:05.998548 15730 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.067806 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.027911 15800 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.076848 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.077487 13744 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:06.078660 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.078872 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.080566 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:06.060501 13736 rpcz_store.cc:276] 0811 16:04:03.926303 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.828221 (+901918us) service_pool.cc:227] Handling call
0811 16:04:06.033733 (+1205512us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:06.033975 (+   242us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:06.034213 (+   238us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:06.034252 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:06.034310 (+    58us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:06.034346 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:06.034413 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:06.034537 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5248384}
I20260811 16:04:06.078907 15730 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.086658 15833 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.087863 15702 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.088883 13907 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.070986 15718 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.092468 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.092907 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.096670 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:06.100394 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.101716 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.102635 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.104358 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.104986 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.106451 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.098702 15833 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.104434 15617 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.110213 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.111044 13900 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:06.111837 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.112345 13900 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:06.098764 15827 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.114595 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.115478 13905 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.122771 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.138496 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:06.089092 15809 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.145650 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.148625 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.117141 15812 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.110610 15829 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.149477 15813 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.161782 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 323) took 2722 ms. Trace:
I20260811 16:04:06.163622 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 228) took 2250 ms. Trace:
I20260811 16:04:06.164036 13737 rpcz_store.cc:276] 0811 16:04:03.913611 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:04.819561 (+905950us) service_pool.cc:227] Handling call
0811 16:04:06.095677 (+1276116us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:06.096073 (+   396us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:06.139882 (+ 43809us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:06.146831 (+  6949us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:06.153841 (+  7010us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:06.163321 (+  9480us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:06.163413 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:06.163552 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2943232}
I20260811 16:04:06.164821 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.167532 13739 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.149470 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.171754 13909 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.173149 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:06.174376 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51755us
I20260811 16:04:06.118570 15730 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.175283 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.175362 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.140499 15726 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.181195 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.132627 15732 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.183600 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.145116 15811 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.189149 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.184983 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.190261 14579 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.185024 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.151489 15809 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:06.196085 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.153512 15812 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:06.200798 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.204936 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.197989 13900 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.166685 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.209347 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.209347 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.162258 13626 rpcz_store.cc:276] 0811 16:04:03.439380 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:03.461350 (+ 21970us) service_pool.cc:227] Handling call
0811 16:04:06.161672 (+2700322us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:05.775536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:05.776192 (+   656us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:05.776231 (+    39us) write_op.cc:435] Acquired schema lock
0811 16:04:05.776250 (+    19us) tablet.cc:660] Decoding operations
0811 16:04:05.776661 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:05.776790 (+   129us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:05.776823 (+    33us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:04:05.777055 (+   232us) tablet.cc:699] Row locks acquired
0811 16:04:05.777072 (+    17us) write_op.cc:260] PREPARE: finished
0811 16:04:05.777220 (+   148us) write_op.cc:270] Start()
0811 16:04:05.777332 (+   112us) write_op.cc:276] Timestamp: P: 1786464245777176 usec, L: 0
0811 16:04:05.777353 (+    21us) op_driver.cc:331] REPLICATION: starting
0811 16:04:05.777996 (+   643us) log.cc:842] Serialized 599 byte log entry
0811 16:04:05.822964 (+ 44968us) op_driver.cc:444] REPLICATION: finished
0811 16:04:06.071871 (+248907us) write_op.cc:301] APPLY: starting
0811 16:04:06.074415 (+  2544us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:06.088427 (+ 14012us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:06.088560 (+   133us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:06.095575 (+  7015us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:06.095953 (+   378us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:04:06.096024 (+    71us) write_op.cc:312] APPLY: finished
0811 16:04:06.156117 (+ 60093us) log.cc:842] Serialized 23 byte log entry
0811 16:04:06.156312 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:06.156401 (+    89us) write_op.cc:454] Released schema lock
0811 16:04:06.156441 (+    40us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:06.156691 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:06.156717 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1709498,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":220531,"apply.run_cpu_time_us":3002,"apply.run_wall_time_us":88043,"num_ops":1,"prepare.queue_time_us":104544,"prepare.run_cpu_time_us":20823,"prepare.run_wall_time_us":21299,"raft.queue_time_us":24009,"raft.run_cpu_time_us":36002,"raft.run_wall_time_us":205885,"replication_time_us":45516,"thread_start_us":333452,"threads_started":4,"wal-append.queue_time_us":18723}]]}
I20260811 16:04:06.212791 13909 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:06.213503 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.189527 15813 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.211475 13827 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.217640 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.181046 15730 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.218930 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.189810 15766 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.222469 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.223076 13744 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:06.262398 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.224313 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.271690 15751 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.272307 15751 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.274541 15751 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.276455 15829 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.210304 15617 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.278143 15617 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.278617 15617 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.282708 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:06.283555 15843 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260811 16:04:06.286332 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:06.287266 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65078.5us
I20260811 16:04:06.287395 15829 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:06.219990 15752 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.206966 15809 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.288496 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.206403 15812 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.290230 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.297665 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.291211 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.292752 13826 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.294606 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.300242 13823 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.301731 13820 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 2: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:06.295245 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.295689 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.219587 15813 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.306365 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.220929 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.314035 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:06.265456 15720 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.202s	user 0.012s	sys 0.031s
I20260811 16:04:06.222716 15730 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.316581 13826 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.316705 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.317993 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.290259 15806 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.316434 15813 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.288036 15829 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.278788 15714 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.317646 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.301205 15689 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.318917 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:06.324254 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.302160 15718 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:06.336575 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.311245 15766 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.334321 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:06.336585 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:06.326375 15775 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.141s	user 0.010s	sys 0.013s
I20260811 16:04:06.319422 15744 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.339035 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1312) took 1360 ms. Trace:
I20260811 16:04:06.339295 13740 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.332263 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.339423 13742 rpcz_store.cc:276] 0811 16:04:04.978789 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.111991 (+133202us) service_pool.cc:227] Handling call
0811 16:04:06.338847 (+1226856us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:06.338984 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1342811392}
I20260811 16:04:06.338781 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 251) took 1146 ms. Trace:
I20260811 16:04:06.340265 13743 rpcz_store.cc:276] 0811 16:04:05.192044 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.366634 (+174590us) service_pool.cc:227] Handling call
0811 16:04:06.338588 (+971954us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:06.338723 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1447161728}
I20260811 16:04:06.340667 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.332301 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.335482 13818 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.338828 15766 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.338482 15791 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.344632 15766 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.344776 15791 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:06.345271 15791 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.345942 13902 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.328078 15829 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:06.324899 15752 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:06.338270 15840 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.349511 13823 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:06.343981 13742 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:06.351262 13744 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:06.353902 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:06.328676 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.342132 15732 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:06.328455 15800 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260811 16:04:06.355225 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.360042 13744 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:04:06.354213 13743 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.355788 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.355923 14578 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:06.357070 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.357802 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.354377 13742 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.348165 15811 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.330890 15778 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260811 16:04:06.349016 15775 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.367029 15660 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:06.343191 15744 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.322947 15720 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.351828 15773 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.369110 15806 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:06.367842 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.373523 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.377548 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.376060 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.359933 13738 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.342453 15718 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.385325 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.385973 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.386783 13906 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:06.372231 13817 raft_consensus.cc:595] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:06.390693 13817 raft_consensus.cc:603] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:04:06.390887 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46732.2us
W20260811 16:04:06.391450 13709 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.531s (SENT)
I20260811 16:04:06.392141 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:06.392882 13900 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.393908 13901 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.394984 15806 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:06.395622 13818 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:06.396204 15806 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.396744 15790 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:06.387969 15735 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.398237 15790 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:06.398393 15735 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.398715 15790 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:06.399519 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.400309 13901 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:06.400938 15710 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:04:06.396595 15699 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.402149 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.402601 14583 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:06.406235 15714 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.411129 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.398890 15735 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.378969 15744 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.414475 15689 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:06.415459 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.414664 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.383682 15773 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.424794 13818 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:06.425034 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.425704 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.359081 15732 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.417155 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.423744 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.429657 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.404011 15694 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:06.409194 15833 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.377631 15729 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260811 16:04:06.439975 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.440193 15752 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.440755 15752 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.408942 15628 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.441169 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.424801 15773 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.442318 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.443008 15732 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.438674 15718 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.439100 15699 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.416386 15778 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.435839 15845 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.443531 15732 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:06.444983 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:06.446452 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60568.5us
I20260811 16:04:06.447256 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.406271 15775 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.450198 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.454126 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.423352 15735 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.379052 15807 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260811 16:04:06.455217 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:06.456058 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.452443 15699 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.457669 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.384749 15652 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:06.459645 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68253.5us
I20260811 16:04:06.459825 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.459921 13822 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:06.464519 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:06.450186 15849 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.468427 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.452827 15732 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:06.452805 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.475306 15767 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.477504 15617 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.474059 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.455731 15694 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:06.473047 15850 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.481215 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.491881 15694 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:06.499302 15738 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.500384 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.500294 15694 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.462630 15751 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:06.501940 14577 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.485586 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.503324 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.488372 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.452169 15714 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260811 16:04:06.473464 15699 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:06.471876 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:06.474785 15775 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:06.508000 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.508414 15720 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.509058 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:06.537659 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:06.510213 15690 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:06.511880 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.458325 15790 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.513041 15617 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.512938 15732 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.514710 15692 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:06.504412 15751 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.535549 13743 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.568481 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.573300 15829 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.542162 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.542903 15690 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.519383 15775 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:06.518031 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:06.548105 15853 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260811 16:04:06.548305 15652 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.548692 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.571919 13737 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.553154 14580 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.553856 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1319) took 1572 ms. Trace:
W20260811 16:04:06.554554 15698 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260811 16:04:06.507278 15849 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.570178 15692 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:06.563977 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.541327 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.608071 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.536430 15628 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.551083 15767 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:06.579118 15738 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.552836 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:06.590129 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.591082 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.494105 15778 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.594031 13740 rpcz_store.cc:276] 0811 16:04:04.980972 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.666369 (+685397us) service_pool.cc:227] Handling call
0811 16:04:06.339087 (+672718us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:06.339749 (+   662us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:06.553662 (+213913us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400104fd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:06.553796 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1541887744}
I20260811 16:04:06.596266 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.584475 15852 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260811 16:04:06.584544 15797 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260811 16:04:06.600680 15829 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.598982 15652 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.556715 13744 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.576081 15751 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.581993 15833 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:06.609313 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 68020.7us
I20260811 16:04:06.589375 15775 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:06.578109 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.585992 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:06.645252 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54289.9us
I20260811 16:04:06.640580 15846 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.610180 15790 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.649472 15720 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.646129 15729 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260811 16:04:06.650537 15797 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:06.619812 15726 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:06.602632 15698 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.664999 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.667389 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.585613 15791 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.646687 15660 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.647969 15767 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:06.650457 15852 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Stepping down as leader of term 2
W20260811 16:04:06.672067 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.520s (SENT)
I20260811 16:04:06.678877 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.642251 15812 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.692269 13902 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:06.692113 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:06.693369 15755 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.695992 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.696666 13907 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:06.698287 15722 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.002s
I20260811 16:04:06.696238 13825 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.662189 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.666777 13736 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.782711 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.766958 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:06.784078 13821 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.784278 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.770210 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.774186 13735 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.785823 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.786125 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.787340 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.789525 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.789598 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.782763 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.791901 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.791999 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.797535 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 249) took 2118 ms. Trace:
W20260811 16:04:06.800088 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 93378.2us
I20260811 16:04:06.798223 13738 rpcz_store.cc:276] 0811 16:04:04.678957 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:05.631091 (+952134us) service_pool.cc:227] Handling call
0811 16:04:06.342994 (+711903us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:06.388797 (+ 45803us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:06.797040 (+408243us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54001040d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:06.797302 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1631449344}
W20260811 16:04:06.803651 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.652s (SENT)
I20260811 16:04:06.804490 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:06.807396 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:06.808588 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:06.683065 15628 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260811 16:04:06.819860 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:06.679260 15692 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.823741 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.824353 15692 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.825490 15699 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:06.696009 15698 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.828094 15729 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:04:06.714462 15706 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.959s	user 0.016s	sys 0.009s
I20260811 16:04:06.688741 15714 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260811 16:04:06.678390 15731 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260811 16:04:06.684669 15720 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.721076 15730 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.705585 15722 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.715673 15744 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.725076 15766 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.898185 15744 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.691243 15767 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:06.699774 15773 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.696043 15791 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.927428 15706 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.681430 15797 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:06.930440 15706 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.727520 15813 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.888121 15702 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260811 16:04:06.897951 15665 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:06.730290 15840 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.939005 14575 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:06.940768 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.941666 13820 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:06.691701 15852 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:06.810222 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:06.867380 15696 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:06.821046 15735 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:06.870332 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83570.2us
I20260811 16:04:06.867744 15775 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.883536 13901 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.884219 15755 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:06.886626 15751 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.958709 15735 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.960474 15751 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.887645 15873 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.824376 15632 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260811 16:04:06.897898 15722 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:06.961725 15775 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:06.960552 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 158890us
I20260811 16:04:06.962787 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43028 (request call id 511) took 6399 ms. Trace:
I20260811 16:04:06.963299 15747 rpcz_store.cc:276] 0811 16:04:00.533065 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:00.537897 (+  4832us) service_pool.cc:227] Handling call
0811 16:04:01.252767 (+714870us) ts_tablet_manager.cc:928] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
0811 16:04:05.701428 (+4448661us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:04:06.070456 (+369028us) tablet_metadata.cc:641] Metadata flushed
0811 16:04:06.089285 (+ 18829us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:04:06.506992 (+417707us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:04:06.574561 (+ 67569us) tablet_replica.cc:205] Creating consensus instance
0811 16:04:06.900744 (+326183us) ts_tablet_manager.cc:983] Replica registered.
0811 16:04:06.932568 (+ 31824us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":242958,"tablet-copy.queue_time_us":497651,"thread_start_us":2451338,"threads_started":2}
I20260811 16:04:06.965224 15747 tablet_copy_client.cc:791] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:04:06.966004 15747 tablet_copy_client.cc:655] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:04:06.967389 15755 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:06.967844 15755 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:06.939261 15806 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:06.969648 15806 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:06.969234 15755 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.971195 15842 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:06.971619 15842 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:06.915714 15738 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260811 16:04:06.926849 13739 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.928188 13742 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.929966 15797 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.671952 15809 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.974182 15842 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:06.723950 15812 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.961666 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:06.670123 15833 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260811 16:04:06.937238 13744 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.014989 15685 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.015511 15685 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:06.937919 15800 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.016009 15800 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:07.016650 15685 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.017200 15752 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.017282 15800 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:06.939589 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76548.5us
I20260811 16:04:07.018754 15800 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:06.867952 15860 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:06.957571 13741 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:06.859126 15699 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:06.977448 15809 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:06.974907 15730 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:06.978785 13824 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:06.955955 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.984941 15871 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260811 16:04:07.006278 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:06.959028 15766 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:07.009878 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.036278 15690 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.119863 13818 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:06.991663 13907 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.013695 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.121769 13821 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.120676 15652 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.013931 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:07.015746 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:07.017923 15752 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:06.991627 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:06.927022 15773 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:06.935113 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83483us
I20260811 16:04:06.933357 15665 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:07.106348 15767 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.066779 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.020327 13902 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:07.097141 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.099618 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1538) took 1294 ms. Trace:
I20260811 16:04:07.099913 15778 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:07.147534 14579 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.147661 13822 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:07.148362 15778 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:07.148772 15778 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:07.100745 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.056370 15706 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.104334 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:07.149950 15778 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.150585 15698 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:07.109867 13736 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:07.152613 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260811 16:04:07.152735 15714 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:07.115823 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:07.153944 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54892.6us
I20260811 16:04:07.116981 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.047034 15852 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.118808 15617 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.155550 15852 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.151603 15845 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.156225 15845 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:07.039672 15813 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:07.075642 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71719.2us
W20260811 16:04:07.133149 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141090us
I20260811 16:04:07.134065 13735 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:07.158804 15845 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.133709 15879 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:07.140298 15665 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.178434 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:07.179306 15665 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.173302 15879 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.143172 15755 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.143750 15880 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260811 16:04:07.145292 13742 rpcz_store.cc:276] 0811 16:04:05.805233 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:06.364696 (+559463us) service_pool.cc:227] Handling call
0811 16:04:06.364867 (+   171us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:06.974104 (+609237us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:07.099275 (+125171us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:07.099527 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1294349056}
I20260811 16:04:07.146914 14583 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.146672 15831 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:07.146700 14574 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:07.188237 15722 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:07.150614 15706 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:07.111214 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:07.155758 15617 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.192143 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:07.193044 13737 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 2: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:07.191524 15867 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.193365 15617 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.177649 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:04:07.057509 13709 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.678s (SENT)
I20260811 16:04:07.196700 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.197379 14574 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260811 16:04:07.197921 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 140622us
I20260811 16:04:07.198915 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:07.199739 15773 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.125898 13820 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:07.159710 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.163671 15842 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.157258 15797 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.164563 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:07.168171 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.169240 15806 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.170591 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:07.172302 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:07.175279 13825 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:07.175885 15767 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:07.177613 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:07.177990 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.178114 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:07.178287 15685 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.152089 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:07.211412 13826 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:07.183924 13822 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:07.185287 15831 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.181809 15879 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.213670 13738 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:07.186342 15812 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.215593 15812 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.216436 13741 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.216071 15879 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.187686 15846 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:07.216857 15812 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.217844 15879 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.218268 15812 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.193933 15867 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:07.088229 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:07.222793 15846 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.222651 15867 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.224306 15867 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.224992 13742 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.204419 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.204280 15628 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260811 16:04:07.205226 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.062s (SENT)
I20260811 16:04:07.203675 15833 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260811 16:04:07.205891 15773 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260811 16:04:07.231030 15860 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.231853 15860 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.230458 13737 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:07.232192 15860 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:07.232623 15845 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:07.210579 13709 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.036s (SENT)
I20260811 16:04:07.215636 13735 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.191488 15706 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.224151 13907 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.151096 15809 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:07.214097 15831 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.237905 15706 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.228099 15617 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:07.229166 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51926.5us
I20260811 16:04:07.230047 15689 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:07.209545 15690 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:07.234263 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:07.237888 13901 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:07.239785 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 82900.4us
I20260811 16:04:07.207063 15702 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260811 16:04:07.239125 15831 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.233147 15860 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.245379 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.246220 15689 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:07.248498 15747 tablet_copy_client.cc:531] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260811 16:04:07.255528 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87553.7us
I20260811 16:04:07.256603 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.256369 15689 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.257536 15846 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260811 16:04:07.249886 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45553us
I20260811 16:04:07.252223 13826 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:07.265089 15807 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.263239 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.272431 15628 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:07.278321 15860 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.250826 15752 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:07.282835 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75625.9us
W20260811 16:04:07.283779 13709 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.044s (SENT)
I20260811 16:04:07.285382 15846 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.265471 15652 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.181579 15871 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:07.290812 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.291400 15732 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.281531 15778 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:07.293699 15732 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.297091 15732 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.298851 15732 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:07.304579 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.155s (SENT)
I20260811 16:04:07.305096 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.308118 15755 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.312414 13907 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.277050 15702 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260811 16:04:07.315716 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59237us
W20260811 16:04:07.317734 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.175s (SENT)
I20260811 16:04:07.323326 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.320042 15831 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.314471 15730 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.326788 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.328084 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.332331 13817 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
W20260811 16:04:07.337522 15710 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260811 16:04:07.342731 15806 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.343683 15690 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:07.344242 15690 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:07.344648 15690 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.343676 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.334962 15692 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.356890 13741 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.358451 15807 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.358865 15807 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:07.359849 15807 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.361200 15807 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.370072 13901 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:07.371688 13709 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.632s (SENT)
I20260811 16:04:07.372133 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.373991 15710 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:04:07.375597 15873 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.375947 14580 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.375360 15698 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:07.375988 15873 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.378754 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.349047 15731 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260811 16:04:07.369451 15702 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:07.385648 15722 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.386106 15722 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:07.389200 15722 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.390463 15722 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.390756 15752 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.389657 15694 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.391300 15694 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.394214 13901 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.395517 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.396037 15652 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.395565 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.397302 13904 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.397589 15702 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:07.399343 15881 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260811 16:04:07.400378 13709 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.844s (SENT)
I20260811 16:04:07.398736 15702 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.400671 14579 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:07.385950 15857 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:07.382259 15873 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.405054 15873 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.414731 15710 tablet_bootstrap.cc:492] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:04:07.431566 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.459065 13904 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.459097 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.460132 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.447171 13902 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:07.465627 13907 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:07.467857 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.468977 15871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50500 (request call id 13) took 6120 ms. Trace:
I20260811 16:04:07.469412 15871 rpcz_store.cc:276] 0811 16:04:01.349073 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:01.349209 (+   136us) service_pool.cc:227] Handling call
0811 16:04:04.855736 (+3506527us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54000990a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a1dc0 00007f5c51912bd2 00007f5c51911890 00007f5c5684ef39 00007f5c4ff3a704 00007f5c4ff3a692 00007f5c4ff3a5c1 00007f5c4ff3a53c 00007f5c4ff397f2 00007f5c4fd3694c
0811 16:04:04.989824 (+134088us) log.cc:842] Serialized 506 byte log entry
0811 16:04:06.366120 (+1376296us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b180022af20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:07.468870 (+1102750us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24868,"raft.queue_time_us":4915,"raft.run_cpu_time_us":1905,"raft.run_wall_time_us":325284,"spinlock_wait_cycles":6329342592,"thread_start_us":146491,"threads_started":2,"wal-append.queue_time_us":377716,"wal-append.run_cpu_time_us":1916,"wal-append.run_wall_time_us":1021927}
I20260811 16:04:07.473482 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.475787 13906 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.428380 15731 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260811 16:04:07.477186 15879 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:07.477835 15879 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.478943 15879 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.432260 15694 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.480755 15694 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.431267 15628 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.495647 13907 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60520
I20260811 16:04:07.496788 13907 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:04:07.497262 13907 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.420634 15857 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260811 16:04:07.494100 13709 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.638s (SENT)
I20260811 16:04:07.500687 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.433900 15831 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260811 16:04:07.502573 15863 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.490330 15628 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:07.505365 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:07.507773 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.510156 14580 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.514321 13826 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:07.503080 15731 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:07.503015 15863 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.509702 15773 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.513537 15710 ts_tablet_manager.cc:1397] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 1.113s	user 0.020s	sys 0.026s
I20260811 16:04:07.541432 13907 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.523633 15689 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:07.518766 15731 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.547627 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.548101 13903 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.546998 13907 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:07.524632 15628 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.551622 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:07.552142 14544 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.550s (SENT)
I20260811 16:04:07.552480 13904 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.555389 13906 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:07.559746 13901 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:07.523087 15831 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260811 16:04:07.560971 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:07.560978 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.889s (SENT)
I20260811 16:04:07.566301 15747 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:04:07.556545 15689 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:07.571911 13904 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.573225 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.573658 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.576676 13905 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.576673 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.577700 13908 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.573686 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.574523 15842 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.583334 13909 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.571334 15731 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.584904 15731 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:07.587067 14577 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:07.589634 15863 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.598204 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.598798 15863 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:07.597522 13902 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.598935 13901 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.602962 15807 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:07.603576 15807 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.597167 15690 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.604935 15628 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.606226 15807 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:07.606402 15690 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:07.607720 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:07.602293 15710 raft_consensus.cc:348] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:07.612648 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:07.619735 13709 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.829s (SENT)
I20260811 16:04:07.620281 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:07.621259 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.626046 15857 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:07.626673 15857 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.624518 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.628041 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:07.610790 13901 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:07.614684 15710 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:04:07.615191 15689 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.640751 15710 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:07.642902 15710 ts_tablet_manager.cc:1428] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260811 16:04:07.645222 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.646260 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.654835 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.659919 13902 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:07.659593 15857 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.661412 13626 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 2, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:04:07.663694 13709 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.990s (SENT)
I20260811 16:04:07.664168 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.665393 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:07.666079 13822 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:07.659593 13900 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:07.663524 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.666359 13822 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:07.670156 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.667842 13909 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:07.683668 14577 raft_consensus.cc:1203] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260811 16:04:07.670889 15665 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.673411 15807 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.677708 15692 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:07.678274 15690 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:07.684036 15797 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:07.697950 13822 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.671562 15732 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260811 16:04:07.685801 15842 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260811 16:04:07.711476 15692 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:07.747187 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:07.749832 13709 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.037s (SENT)
I20260811 16:04:07.750444 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.725888 15852 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.755928 13822 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.761987 13755 tablet_copy_service.cc:342] P cec0688f86d54789b9b9ecc924ddecf3: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7f6a000330b3415da4f525eae84f33fb received from {username='slave'} at 127.0.0.1:37376
I20260811 16:04:07.762535 13755 tablet_copy_service.cc:433] P cec0688f86d54789b9b9ecc924ddecf3: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-7f6a000330b3415da4f525eae84f33fb on tablet 7f6a000330b3415da4f525eae84f33fb with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.721424 15690 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.751442 15842 consensus_queue.cc:1225] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:07.763375 15665 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:07.751889 15797 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.784644 15864 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.785097 13906 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:07.767676 15766 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260811 16:04:07.798852 14575 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:07.799306 14575 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:07.800098 14575 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:07.807603 14544 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.179s (SENT)
W20260811 16:04:07.796113 13709 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.089s (SENT)
I20260811 16:04:07.801393 14575 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:07.816354 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:07.815116 13822 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
W20260811 16:04:07.824031 14544 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.779s (SENT)
I20260811 16:04:07.824589 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:07.824849 15891 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260811 16:04:07.827437 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:07.827742 15690 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:07.829627 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:07.830737 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.832245 15702 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:07.832419 15790 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:07.832867 15702 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:07.833899 15702 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.832878 15790 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:07.836066 15790 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.837208 15790 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:07.802266 15706 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260811 16:04:07.803879 15665 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:07.841784 15665 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.842186 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:07.844585 15842 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:04:07.845503 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.656s (SENT)
W20260811 16:04:07.847625 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55928.4us
I20260811 16:04:07.846072 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:07.849143 15842 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.850732 15852 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:07.855744 13709 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.106s (SENT)
I20260811 16:04:07.857553 15767 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:07.858155 15767 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.859956 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.861405 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:07.845577 15797 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:07.809654 15692 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.861649 13741 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:07.874257 13906 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:07.887897 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:07.858839 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:07.886106 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:07.890856 13908 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260811 16:04:07.891103 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.893872 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.894537 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:07.896924 15652 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.902498 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.903358 13826 raft_consensus.cc:2354] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:07.903573 15730 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:07.903891 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.904142 15730 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.906208 15730 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:07.907809 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.908044 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:07.908855 13741 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 2: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:07.909407 13906 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.911130 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.912408 15731 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:07.913947 13822 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:07.917661 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.915541 13901 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:07.912912 15731 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.928447 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:07.929673 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.899507 15807 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:07.932947 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.936810 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.918133 15685 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.944541 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:07.945976 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:07.949383 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:07.954614 13823 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:07.955483 13820 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.950812 13903 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:07.958636 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.958891 15699 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:07.959220 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:07.959810 15898 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260811 16:04:07.959901 15685 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:07.957959 14575 raft_consensus.cc:2396] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:07.958415 13905 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
W20260811 16:04:07.977294 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62230.8us
I20260811 16:04:07.953845 15731 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:07.950351 15807 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:07.981666 13826 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.962391 15767 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:07.983815 13820 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:07.985579 15807 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:07.986312 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.988310 13822 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:07.990672 13821 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:07.978865 15689 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:07.993378 15689 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:07.993762 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:07.994330 14580 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:07.994426 13824 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:07.997678 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:07.996618 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.002749 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.003485 13742 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:08.004930 13900 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:08.006217 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.008085 15842 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:08.008576 15842 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:08.009075 15842 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.013629 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.011888 14579 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:08.022449 14580 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:08.001713 15730 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260811 16:04:08.024266 15731 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.002030 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:08.026845 13908 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:08.029107 15778 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:08.029668 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:08.032121 13902 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:08.032703 15778 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.032873 15617 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:08.001061 15689 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.039971 13817 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:08.041056 13827 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:08.043570 13825 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260811 16:04:08.045212 15899 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260811 16:04:08.047174 13907 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:08.047716 15752 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:08.048944 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.036130 15694 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:04:08.057718 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.063355 15747 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:04:08.063555 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.067713 15747 tablet_bootstrap.cc:492] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:04:08.076362 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:08.077656 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48069us
I20260811 16:04:08.070654 15747 ts_tablet_manager.cc:1397] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.511s	user 0.036s	sys 0.022s
I20260811 16:04:08.083099 15778 raft_consensus.cc:1050] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:04:08.073997 15863 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.094944 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.095932 13824 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:08.098070 13822 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:08.101027 15685 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:08.103368 13817 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:08.101902 15685 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.074313 15731 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260811 16:04:08.112036 14544 leader_election.cc:334] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.925s (SENT)
I20260811 16:04:08.109496 13822 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:04:08.109990 15863 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:08.111368 15831 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:08.114012 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.114073 15831 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.111560 15685 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.117112 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.117775 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:08.122130 15747 raft_consensus.cc:348] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:08.122820 15773 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:08.124336 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.125586 13825 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:08.134672 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.135043 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.135818 13823 raft_consensus.cc:2354] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:08.146996 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.147495 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.147740 13821 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:08.126544 15747 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:04:08.154263 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.154795 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.154279 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:08.156046 15911 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260811 16:04:08.156719 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.150143 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.157107 13630 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 2 to 3, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:08.154495 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.159948 13823 raft_consensus.cc:2354] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:08.160738 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.161407 13823 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:08.162545 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.129876 15863 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260811 16:04:08.167936 15863 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.169916 13821 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:08.169823 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.170795 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.155099 15747 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:08.172488 15831 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.172667 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.157809 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.191107 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.158764 13630 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 3 to 4, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:08.188275 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.192523 13630 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 2 to 3, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:08.197242 13824 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:08.197391 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.201509 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.185124 15863 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.198223 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:08.220604 13825 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:08.221352 15665 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.221695 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.199229 15747 ts_tablet_manager.cc:1428] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.002s
I20260811 16:04:08.223292 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.200114 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.200874 15685 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:08.201542 13821 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:08.225265 15863 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.117507 15778 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.203876 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.206584 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.209810 13826 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:08.230424 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-801054abfed346a09c04b7cd13d7c62f received from {username='slave'} at 127.0.0.1:56292
I20260811 16:04:08.230571 13824 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
W20260811 16:04:08.211314 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 100251us
I20260811 16:04:08.216672 13820 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:08.225404 13821 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:08.205281 15812 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.230995 13824 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:08.230911 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-801054abfed346a09c04b7cd13d7c62f on tablet 801054abfed346a09c04b7cd13d7c62f with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:08.234007 13821 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:08.234284 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.237061 14580 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:08.245271 13741 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.243305 15812 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.247066 15790 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:08.248220 15692 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:08.248464 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.248588 15692 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:08.248881 13737 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 16:04:08.249724 15692 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.250288 13824 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.256021 15692 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.259552 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.260243 14580 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.251513 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:08.267872 13827 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:08.268755 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.269284 13827 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.270260 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:08.263453 13821 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.260864 15617 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.273222 15617 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.274047 13907 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:08.277009 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.275717 13823 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:08.279336 15790 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:08.283190 13871 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a48002159c1643c489d152b863d3d839. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:04:08.283969 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:08.284726 15752 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:08.279928 15731 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:08.286269 15731 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.280164 15722 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.286634 15731 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.288210 15752 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:08.260932 15812 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.289484 15617 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.291736 13824 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:08.279722 15790 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:08.292869 15790 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.290691 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:08.294251 15752 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:08.294618 15752 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.295234 15752 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.285696 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:08.300383 13903 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:08.300662 13741 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:08.306885 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.309332 13820 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:08.310438 13821 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.312081 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:08.302321 15812 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260811 16:04:08.316262 15617 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.316720 15617 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.317122 15617 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.304615 15689 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.318988 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.319248 15694 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.325408 14577 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:08.333606 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82160.7us
I20260811 16:04:08.302977 15842 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.305965 15702 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260811 16:04:08.324749 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.346449 13737 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.325103 15689 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.349790 15689 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.346458 15842 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.357295 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.358023 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:08.358114 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:08.347913 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79283.5us
I20260811 16:04:08.360225 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:08.361608 14544 leader_election.cc:398] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:08.362746 15755 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.363894 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:08.366039 15767 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.366259 15747 ts_tablet_manager.cc:927] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.368443 13824 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:08.366575 15767 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.366935 14574 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260811 16:04:08.372087 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.376258 13742 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:08.379874 15731 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.380327 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:08.382164 15731 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.383884 15752 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.385402 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:08.385948 15752 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.386343 13738 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.374990 14574 pending_rounds.cc:76] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 4
I20260811 16:04:08.390224 14574 pending_rounds.cc:97] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260811 16:04:08.390547 14574 raft_consensus.cc:2866] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:08.391445 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:08.392083 13742 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.392998 15665 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.393481 15665 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.373173 15730 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.397388 15730 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.370306 15692 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.399469 15692 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.399963 15692 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.413115 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:08.416337 13821 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:08.337371 15694 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.425534 13907 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:08.429123 15694 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.430094 15747 tablet_copy_client.cc:316] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:04:08.431485 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.432135 13824 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.412113 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:08.422706 15731 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.430685 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.456478 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.422003 15755 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.432189 15807 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:08.436662 15773 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.373529 15617 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.452504 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:08.452761 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47827.5us
I20260811 16:04:08.465652 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.471774 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.464700 13739 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:08.451496 14574 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.480351 13824 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:08.475634 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.440028 15752 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260811 16:04:08.457641 15665 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.476553 15730 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.515041 13821 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
W20260811 16:04:08.510785 15914 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260811 16:04:08.465955 14575 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:08.529505 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.489331 15706 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.522847 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:08.480475 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:08.531697 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66164.3us
I20260811 16:04:08.516767 15767 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.534019 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:08.539585 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59204.3us
I20260811 16:04:08.462523 15731 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.542308 13903 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:08.538810 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.597s (SENT) [suppressed 53 similar messages]
I20260811 16:04:08.487501 15755 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.551393 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:08.532676 15807 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.529096 13736 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:08.554805 13902 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:04:08.477491 15773 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.555845 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:08.537842 15860 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:08.516943 15790 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.549775 15879 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.548983 15831 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:08.590585 14580 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:04:08.564440 15685 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:08.596282 14544 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.034s (SENT)
I20260811 16:04:08.546819 15706 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.567932 15879 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.568617 15842 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:08.572453 15694 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.579540 15731 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.600576 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.615520 13736 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.600777 15665 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260811 16:04:08.601436 15831 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:08.584082 15617 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.618194 15790 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.618147 15831 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.605587 15879 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.620329 15706 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.621636 13736 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:08.621814 15773 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.604007 15933 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.622896 15933 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.579973 15860 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.627132 14580 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:08.628481 15699 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:08.629156 15860 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.606729 15842 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.631489 15842 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.636438 15879 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.637051 15755 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.637854 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.638728 15879 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:08.639642 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.176s (SENT)
I20260811 16:04:08.640161 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.639925 15699 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:08.641326 15699 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:08.641737 15699 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:08.643738 15722 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:08.644379 15692 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:08.611655 15924 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260811 16:04:08.653172 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 322) took 1149 ms. Trace:
I20260811 16:04:08.609349 15849 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.613997 13737 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:08.615885 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.645507 15755 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.619077 13738 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:08.646471 15730 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:08.655678 15702 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.669476 15730 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.670140 15730 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.669912 15702 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.672976 15702 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.596999 13742 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:08.647125 13628 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:08.648944 15699 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.650189 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:08.626754 15694 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.667919 14574 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:08.655126 15849 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.673484 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.684027 13738 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:08.684146 13902 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:08.684828 15773 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:08.685168 15849 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.685369 15773 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.685814 13907 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
W20260811 16:04:08.668231 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52476.7us
I20260811 16:04:08.683077 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.668866 15797 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:08.674016 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 135516us
I20260811 16:04:08.675096 13739 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.676545 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.677847 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.690608 13905 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:08.689446 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.691609 14577 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:08.694967 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.695947 13905 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:08.697678 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.702437 15731 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:08.703517 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.684944 15933 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.704762 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.698515 13905 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:08.706122 15812 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:08.706528 15812 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.706983 15812 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:08.687448 15773 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.707314 15933 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.707749 15933 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.708122 15933 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.709721 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.711292 15665 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:08.711828 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.712503 13738 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:08.713230 15773 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.713546 15773 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.713913 15773 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.706763 15699 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.703045 15731 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:08.720148 15731 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.727772 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.706686 15617 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:08.729089 15694 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.729746 15694 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.730136 15694 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.731734 13742 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:04:08.739334 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51357.6us
I20260811 16:04:08.739959 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.740031 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:08.740832 13821 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.741039 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.740175 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.746004 13825 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:08.730497 15694 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.653784 13626 rpcz_store.cc:276] 0811 16:04:07.529555 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:07.529893 (+   338us) service_pool.cc:227] Handling call
0811 16:04:08.653033 (+1123140us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:07.993791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:07.994322 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:07.994373 (+    51us) write_op.cc:435] Acquired schema lock
0811 16:04:07.994404 (+    31us) tablet.cc:660] Decoding operations
0811 16:04:07.994768 (+   364us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:07.994872 (+   104us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:07.994896 (+    24us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:04:07.995173 (+   277us) tablet.cc:699] Row locks acquired
0811 16:04:07.995208 (+    35us) write_op.cc:260] PREPARE: finished
0811 16:04:07.995374 (+   166us) write_op.cc:270] Start()
0811 16:04:07.995474 (+   100us) write_op.cc:276] Timestamp: P: 1786464247995314 usec, L: 0
0811 16:04:07.995504 (+    30us) op_driver.cc:331] REPLICATION: starting
0811 16:04:07.996177 (+   673us) log.cc:842] Serialized 541 byte log entry
0811 16:04:08.210685 (+214508us) op_driver.cc:444] REPLICATION: finished
0811 16:04:08.321581 (+110896us) write_op.cc:301] APPLY: starting
0811 16:04:08.326038 (+  4457us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:08.331337 (+  5299us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b54001f1e20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189a771 00007f5c518a5220 00007f5c518a51c8 00007f5c518a5148 00007f5c518a5103 00007f5c518a438c 00007f5c57915206 00007f5c5790d808 00007f5c518e138b 00007f5c518e3e80
0811 16:04:08.370959 (+ 39622us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:08.378567 (+  7608us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:08.518175 (+139608us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:08.563905 (+ 45730us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:04:08.568499 (+  4594us) write_op.cc:312] APPLY: finished
0811 16:04:08.583588 (+ 15089us) log.cc:842] Serialized 23 byte log entry
0811 16:04:08.583841 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:08.583960 (+   119us) write_op.cc:454] Released schema lock
0811 16:04:08.584041 (+    81us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:08.584412 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:08.584442 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":94189,"apply.run_cpu_time_us":3697,"apply.run_wall_time_us":272882,"num_ops":1,"prepare.queue_time_us":290464,"prepare.run_cpu_time_us":6623,"prepare.run_wall_time_us":45232,"raft.queue_time_us":137317,"raft.run_cpu_time_us":64771,"raft.run_wall_time_us":234983,"replication_time_us":205747,"spinlock_wait_cycles":8577280,"thread_start_us":421571,"threads_started":4,"wal-append.queue_time_us":71470}]]}
I20260811 16:04:08.761541 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:08.761840 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 206534us
I20260811 16:04:08.762341 13825 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.762774 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.763284 13739 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.762457 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:08.770632 13739 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:08.772279 13821 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.775360 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.777885 13903 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:08.746157 15863 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.788720 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.793116 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:08.794339 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:08.759495 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.767925 15860 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.812253 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:08.812973 13902 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:08.779785 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.818856 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:08.821414 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:08.815498 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:08.781404 15934 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.810961 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.795913 15628 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:08.840842 13825 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.811926 15722 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:08.824966 15860 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.837451 15689 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:08.870741 15879 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.847837 15936 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:08.836848 15790 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:08.873845 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:08.844179 15628 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.839502 14574 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.851094 14575 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:08.836864 15934 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:08.808609 15863 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:08.865175 15807 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:08.797667 15937 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260811 16:04:08.889015 13739 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:08.890625 13709 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.907s (SENT)
I20260811 16:04:08.892097 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:08.892189 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:08.878628 15722 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:08.873193 15692 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.876191 15689 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:08.875892 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:08.920804 13903 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.889657 13627 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 4, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:08.937708 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:08.944774 15722 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:08.945823 15948 ts_tablet_manager.cc:927] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:08.894057 15934 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:08.949352 13627 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 3, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:08.884104 15879 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:08.951471 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 168366us
W20260811 16:04:08.952392 15944 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:04:08.952899 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:08.953418 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:08.951284 15860 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.895112 13825 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:08.954558 13627 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:08.961223 13817 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:08.964376 13627 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 3, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:08.963224 15849 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:08.914270 15863 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:08.892385 15628 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:08.953636 15689 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:08.971280 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 207892us
I20260811 16:04:08.953353 15879 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.970533 13627 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:04:08.983232 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 96170.5us
W20260811 16:04:08.984764 13709 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.050s (SENT)
I20260811 16:04:08.985206 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:08.975358 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 212664us
I20260811 16:04:08.910012 15797 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:08.990371 13821 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:08.991827 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:08.991119 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:08.954345 13739 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:08.996608 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74679.2us
W20260811 16:04:09.005270 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52451.8us
I20260811 16:04:08.969113 15722 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:08.972101 15849 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:08.960474 15831 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260811 16:04:08.976840 15860 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:09.024089 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.025110 13739 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:09.018867 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:09.013005 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:08.983872 15665 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:09.028451 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:09.033842 15960 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:08.975287 15767 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260811 16:04:09.042461 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:09.042934 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:09.052539 14583 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:08.978139 15773 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.054286 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:09.040485 15692 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.051304 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:09.024111 15755 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:09.062887 13827 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:09.063270 15755 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.066238 15755 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.067245 14580 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:09.047533 15702 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:09.068492 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55590.7us
I20260811 16:04:09.068841 15702 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.070008 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:09.070818 15685 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:09.042831 15790 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:09.025142 15954 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.038264 15722 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:09.071298 15685 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:09.085902 15790 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.049872 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.047488 15929 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:09.130201 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.071091 15702 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:09.039193 15842 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.130753 15960 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:09.143343 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 158598us
W20260811 16:04:09.143302 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73365.4us
I20260811 16:04:09.175365 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:09.132493 15692 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:09.074208 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.046394 15665 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.147806 15849 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.170035 15842 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.130462 15958 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:09.171514 15685 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:09.150074 13743 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:09.132347 15954 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:09.223845 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:09.199059 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:09.237947 13739 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:09.199116 13735 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:09.202361 15689 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.204670 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:09.205224 15730 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.004s
I20260811 16:04:09.183323 15807 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:09.212136 15773 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.206722 15812 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.213557 15692 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:09.221364 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 217612us
I20260811 16:04:09.221812 13903 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:09.139920 14573 raft_consensus.cc:1203] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260811 16:04:09.144999 14574 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:09.236317 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:09.247514 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 97263.7us
I20260811 16:04:09.220458 15797 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:04:09.234272 15699 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.006s
I20260811 16:04:09.249667 15934 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:09.257028 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52424.1us
I20260811 16:04:09.232664 15958 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:09.338639 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:09.339002 13709 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.643s (SENT)
I20260811 16:04:09.319563 15954 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:09.323352 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87138.1us
I20260811 16:04:09.327350 15842 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:09.273764 15933 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260811 16:04:09.321395 15831 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:09.368037 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:09.364161 15831 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:09.336890 13739 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:09.338874 13907 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:09.339491 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:09.271934 15960 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
W20260811 16:04:09.331236 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 87100.9us
I20260811 16:04:09.259092 15730 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.381649 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:09.343189 15958 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:09.352816 15842 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:09.402619 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63637.2us
W20260811 16:04:09.383651 15694 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.004s
I20260811 16:04:09.381219 15831 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:09.430251 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 416040us
I20260811 16:04:09.392731 15797 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
W20260811 16:04:09.433887 13709 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.106s (SENT)
I20260811 16:04:09.443578 15960 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:09.444667 15960 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.396307 15936 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.400590 15938 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:09.450649 13908 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:09.447809 15970 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:09.467317 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:09.442266 15694 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.402908 15842 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:09.371826 15933 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.381373 13736 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:09.447440 15946 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260811 16:04:09.476480 13744 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:09.488837 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83955us
W20260811 16:04:09.496393 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 91352us
I20260811 16:04:09.508283 15974 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:09.518168 15974 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.521108 15974 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.487777 15938 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:09.487104 15797 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:09.529223 13737 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:09.534842 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 166912us
I20260811 16:04:09.538666 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.539352 13739 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:09.508456 15665 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.516336 15689 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.543231 15936 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:09.544530 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57556.6us
I20260811 16:04:09.547825 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:09.528584 15617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56284 (request call id 12) took 1936 ms. Trace:
I20260811 16:04:09.549247 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:09.550081 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.555373 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.588956 13821 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260811 16:04:09.556985 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:09.534569 15968 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:09.592226 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.589000 13823 raft_consensus.cc:2362] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:09.593022 13827 raft_consensus.cc:2354] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:09.549305 13825 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:09.589291 13826 raft_consensus.cc:2362] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:09.548774 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:09.594969 15963 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:09.599298 13820 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260811 16:04:09.595300 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51328.5us
I20260811 16:04:09.541682 15812 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.596973 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.600342 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:09.600870 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:09.601553 13822 raft_consensus.cc:2362] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:09.603662 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.604359 13821 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:09.591898 15975 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260811 16:04:09.617323 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:09.596268 15628 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.589s	user 0.016s	sys 0.000s
I20260811 16:04:09.620740 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:09.619670 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.627895 13739 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:09.592423 15934 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.630352 13821 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:09.630786 13826 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:09.628253 13818 raft_consensus.cc:2362] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:09.636654 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet c390fd23cec5435d81b38a50b2988a60 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:04:09.637298 15706 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:09.596621 15983 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:09.637605 15694 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:09.642158 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.647622 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:09.653499 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:09.657588 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 185105us
I20260811 16:04:09.658421 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:09.660475 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:09.669085 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:09.669142 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:09.643536 15730 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:09.681507 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:09.682399 14580 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:09.637367 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet c390fd23cec5435d81b38a50b2988a60 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-c390fd23cec5435d81b38a50b2988a60
I20260811 16:04:09.602634 15968 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.697979 13821 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:09.661091 15773 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.636690 15755 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260811 16:04:09.676225 15929 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.699858 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.700428 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:09.713549 13743 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:09.704373 13742 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:09.671373 15694 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:09.651233 15934 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260811 16:04:09.449329 15966 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:09.711181 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:09.724076 13739 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:09.724393 13903 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:04:09.633574 15628 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.697949 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:09.685894 15879 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:09.716346 13827 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:09.719358 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:09.707109 15971 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260811 16:04:09.703816 15933 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.650089 15978 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260811 16:04:09.735746 13824 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:09.713070 15970 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:09.651363 15797 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.646889 15938 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.714507 15699 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:09.741503 15989 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.716094 15980 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:09.724632 15929 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:09.739948 15879 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:09.656329 15983 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.734438 15773 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:09.772209 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 149127us
I20260811 16:04:09.723280 15689 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260811 16:04:09.768744 15989 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.781090 15773 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.781939 15929 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.760536 15986 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.784196 15986 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.767967 15699 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:09.777616 15988 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260811 16:04:09.786686 15699 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.773756 15752 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:09.787622 15752 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.790084 15752 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:09.772130 15879 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:09.791277 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 1877) took 1115 ms. Trace:
I20260811 16:04:09.791424 15979 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:09.792398 15977 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:09.805516 13908 rpcz_store.cc:276] 0811 16:04:08.676158 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.676280 (+   122us) service_pool.cc:227] Handling call
0811 16:04:09.790978 (+1114698us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b5400142b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:09.791159 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1748348288}
I20260811 16:04:09.813499 15978 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:09.814352 15978 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.817494 15978 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.818186 15978 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:09.818727 15978 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.824256 15978 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.824465 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:09.825038 15978 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.826211 15978 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.829152 15978 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.829820 15978 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:09.830376 15978 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.831387 15995 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.836534 15995 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.838992 15995 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:09.839303 15978 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.840498 15978 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.841038 15978 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.852011 15978 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.826754 15706 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:09.830951 14580 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:09.856309 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:09.857093 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 151394us
I20260811 16:04:09.863682 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.765604 15982 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.866036 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.867847 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.717317 15936 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.869810 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:09.874316 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 205353us
I20260811 16:04:09.807915 15977 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:09.885471 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:09.887321 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 194191us
I20260811 16:04:09.889046 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:09.777959 15957 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.224s
I20260811 16:04:09.901997 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:09.909081 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:09.873667 15995 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.589401 15617 rpcz_store.cc:276] 0811 16:04:07.561191 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:07.561522 (+   331us) service_pool.cc:227] Handling call
0811 16:04:07.918921 (+357399us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b540036a720. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189a40d 00007f5c51888050 00007f5c518ebaba 00007f5c51907a7a 00007f5c51908ada 00007f5c51907c8b 00007f5c51913084 00007f5c51912743 00007f5c5684ef39 00007f5c4ff3a704
0811 16:04:07.987873 (+ 68952us) log.cc:842] Serialized 506 byte log entry
0811 16:04:09.497786 (+1509913us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5656,"raft.queue_time_us":5385,"raft.run_cpu_time_us":1939,"raft.run_wall_time_us":6270,"spinlock_wait_cycles":46582656,"thread_start_us":73128,"threads_started":1,"wal-append.queue_time_us":102559,"wal-append.run_cpu_time_us":18988,"wal-append.run_wall_time_us":1031112}
W20260811 16:04:09.898196 15948 thread.cc:636] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.016s	sys 0.013s
W20260811 16:04:09.918895 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 280629us
I20260811 16:04:09.927815 13742 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:09.886701 15977 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:09.927119 15948 thread.cc:602] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.017s	sys 0.014s
I20260811 16:04:09.935235 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:09.913529 15984 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:09.911260 15929 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.776053 15980 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.934715 15964 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:09.928306 14544 leader_election.cc:398] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:09.866477 15979 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.948813 15929 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:09.951611 16007 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:09.952519 15628 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.957423 15996 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:09.871670 15982 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.965940 14544 leader_election.cc:401] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260811 16:04:09.971261 15968 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.980420 15986 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:09.983453 15985 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260811 16:04:09.983309 15964 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:09.985785 15983 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:09.939414 15992 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:09.985679 15842 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:09.930043 15995 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:09.972847 15831 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260811 16:04:09.965124 15980 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:10.015590 15948 tablet_copy_client.cc:316] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
W20260811 16:04:09.993467 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 116904us
I20260811 16:04:10.014012 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:09.998265 15958 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.004s
I20260811 16:04:09.992763 15984 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:10.041774 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 113729us
I20260811 16:04:09.993907 13743 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:10.045490 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.056569 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:10.022065 15996 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:10.084846 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.040967 15628 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:10.107098 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49388.1us
I20260811 16:04:10.107990 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:10.085613 16002 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260811 16:04:10.037417 15992 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.119053 16015 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260811 16:04:10.037943 15706 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3.
I20260811 16:04:10.129561 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 296) took 1361 ms. Trace:
I20260811 16:04:10.130542 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.060002 16009 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:10.007452 16007 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.090461 15963 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:10.146469 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:10.124187 16001 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260811 16:04:10.103610 15722 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:10.044224 15831 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.209426 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:10.211042 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:10.139372 15966 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.133548 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:10.232472 13908 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:10.231325 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.062595 15958 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.243582 16004 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.243888 16016 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:10.110958 15628 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.204111 15986 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:10.205809 15706 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.262449 13909 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:10.254863 15722 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.275315 13821 raft_consensus.cc:2354] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:10.264638 16016 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.277683 15842 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.090785 15929 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.283316 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:10.299713 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 259) took 1512 ms. Trace:
I20260811 16:04:10.300344 13907 rpcz_store.cc:276] 0811 16:04:08.787778 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.788384 (+   606us) service_pool.cc:227] Handling call
0811 16:04:10.299435 (+1511051us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54000339d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:10.299621 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1259791232}
I20260811 16:04:10.247908 15966 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.158082 13737 rpcz_store.cc:276] 0811 16:04:08.768409 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.775075 (+  6666us) service_pool.cc:227] Handling call
0811 16:04:08.873037 (+ 97962us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:10.122774 (+1249737us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:10.129444 (+  6670us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1305046656}
I20260811 16:04:10.323982 16010 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:10.335592 16006 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260811 16:04:10.328676 16014 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:10.283123 16007 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.336694 15958 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:10.342286 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:10.324033 16005 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260811 16:04:10.344789 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:10.354019 13905 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:10.279171 15706 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.325536 13907 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:10.282310 15986 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.326414 15995 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:10.351172 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:10.362222 13741 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 4
I20260811 16:04:10.343427 15979 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:10.337212 15773 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.339789 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1194) took 1591 ms. Trace:
I20260811 16:04:10.336717 15982 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.328817 16010 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.351711 15937 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:10.278813 16004 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.339090 15964 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:10.381054 13905 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:10.380949 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.234794 15984 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.393383 15628 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:10.395042 13902 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:10.385429 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 94443.3us
I20260811 16:04:10.389674 15722 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:10.396510 16000 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260811 16:04:10.355731 16008 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.399639 16008 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:10.390122 16019 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:04:10.390286 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.370764 13817 rpcz_store.cc:276] 0811 16:04:08.734540 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.739611 (+  5071us) service_pool.cc:227] Handling call
0811 16:04:10.309233 (+1569622us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:10.325505 (+ 16272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":490692480}
I20260811 16:04:10.282500 15996 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.379123 15979 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:10.430846 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.368252 16014 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.435845 16014 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:10.440349 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.440505 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.441422 13737 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:10.441620 13738 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:10.437197 15831 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:10.415782 15722 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:10.442947 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.445824 13908 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:10.444904 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:10.445447 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.413926 15986 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.416189 16008 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.464813 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.476168 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:10.488359 16018 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260811 16:04:10.377534 15773 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:10.448115 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:10.519881 15962 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.185s	user 0.000s	sys 0.028s
I20260811 16:04:10.490198 16007 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:10.521749 16007 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.524868 13737 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:10.525305 13740 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:10.528589 16007 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:10.462990 16015 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:10.443038 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:10.517221 13736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 295) took 1751 ms (client timeout 2304 ms). Trace:
I20260811 16:04:10.443859 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:10.558446 16024 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260811 16:04:10.540547 14582 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:10.560923 15706 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.417132 15937 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.445056 15831 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260811 16:04:10.445942 15977 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.446085 15979 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.542846 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:10.447216 15722 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:10.583914 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 294) took 1818 ms (client timeout 2024 ms). Trace:
I20260811 16:04:10.635704 13741 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
W20260811 16:04:10.734092 13744 rpcz_store.cc:269] 0811 16:04:08.765065 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.765247 (+   182us) service_pool.cc:227] Handling call
0811 16:04:10.583715 (+1818468us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400278dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:10.583840 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1249912576}
I20260811 16:04:10.729375 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:10.592595 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.662658 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 372) took 1046 ms. Trace:
I20260811 16:04:10.589895 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 369) took 1039 ms. Trace:
I20260811 16:04:10.731226 13820 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:10.731665 13904 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:10.566130 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 592) took 1510 ms. Trace:
I20260811 16:04:10.735816 14579 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:10.741261 14583 rpcz_store.cc:276] 0811 16:04:09.055308 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.055467 (+   159us) service_pool.cc:227] Handling call
0811 16:04:10.565147 (+1509680us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:10.565427 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:10.565679 (+   252us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:10.565705 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:10.565766 (+    61us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:10.565813 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:10.565888 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:10.566013 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5314432}
I20260811 16:04:10.736150 13822 rpcz_store.cc:276] 0811 16:04:09.616523 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.616666 (+   143us) service_pool.cc:227] Handling call
0811 16:04:09.648110 (+ 31444us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:09.721674 (+ 73564us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:09.721711 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:09.721762 (+    51us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:09.721794 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:10.662313 (+940519us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b5400219654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:10.662377 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:10.662562 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":168698240}
I20260811 16:04:10.737314 13823 rpcz_store.cc:276] 0811 16:04:09.550894 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.593297 (+ 42403us) service_pool.cc:227] Handling call
0811 16:04:09.611280 (+ 17983us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:09.958463 (+347183us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:09.958509 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:09.958569 (+    60us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:09.958630 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:10.589642 (+631012us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400355554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:10.589681 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:10.589825 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":797822848}
I20260811 16:04:10.749336 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1212) took 1053 ms. Trace:
I20260811 16:04:10.751538 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:10.749852 13818 rpcz_store.cc:276] 0811 16:04:09.695435 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.699035 (+  3600us) service_pool.cc:227] Handling call
0811 16:04:09.754404 (+ 55369us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:09.868895 (+114491us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:09.873798 (+  4903us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:09.923056 (+ 49258us) log.cc:842] Serialized 26 byte log entry
0811 16:04:10.037299 (+114243us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:10.044775 (+  7476us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:10.054106 (+  9331us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:10.746106 (+692000us) raft_consensus.cc:1671] finished
0811 16:04:10.746142 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:10.749237 (+  3095us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33447,"raft.queue_time_us":47187,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"thread_start_us":140892,"threads_started":2,"wal-append.queue_time_us":170510}
I20260811 16:04:10.446156 15992 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.754530 13744 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260811 16:04:10.682083 15879 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.007s
I20260811 16:04:10.464283 16016 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:10.562021 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:10.475804 15966 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.761435 14581 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:10.763803 15957 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260811 16:04:10.575122 14574 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:10.589037 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:10.732728 13736 rpcz_store.cc:269] 0811 16:04:08.765901 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.768291 (+  2390us) service_pool.cc:227] Handling call
0811 16:04:10.516949 (+1748658us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400344ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:10.517123 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1225922304}
I20260811 16:04:10.774044 13709 leader_election.cc:398] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:10.774545 13709 leader_election.cc:401] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:04:10.776697 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:10.757791 15685 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:10.779851 15722 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:10.780349 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50707.6us
I20260811 16:04:10.784081 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:10.755371 13817 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 1.
I20260811 16:04:10.577459 16010 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:10.762979 15879 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:10.866247 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.867792 13903 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:10.853668 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.000s	sys 0.054s
W20260811 16:04:10.958539 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.001s	sys 0.056s
I20260811 16:04:10.797094 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:10.819518 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.020s	sys 0.031s
W20260811 16:04:10.959789 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.021s	sys 0.038s
W20260811 16:04:10.835842 13742 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.010s	sys 0.043s
W20260811 16:04:10.960364 13742 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.013s	sys 0.045s
I20260811 16:04:10.882454 14573 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:10.769788 15937 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.829373 15982 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.961699 13901 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:10.961409 15982 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:10.964244 15982 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.964392 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.866375 15949 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:10.965159 13736 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:10.966336 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:10.966804 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:10.949654 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:10.950664 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:10.957921 13744 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:10.777108 15989 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:10.912784 15970 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.157s	user 0.015s	sys 0.001s
I20260811 16:04:10.968961 13740 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260811 16:04:10.968969 13902 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:10.966682 13900 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:10.967415 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:10.999049 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:10.939438 15957 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:11.001374 13707 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.022s	sys 0.040s
W20260811 16:04:11.021624 13707 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.022s	sys 0.040s
W20260811 16:04:11.022006 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 569564us
W20260811 16:04:11.004472 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 220462us
I20260811 16:04:10.922322 15773 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:10.912151 15950 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:11.005736 14577 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:10.840788 15960 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:11.032656 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87157.5us
I20260811 16:04:10.808388 15699 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:11.046381 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:11.047132 13823 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
W20260811 16:04:11.015303 13905 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.007s	sys 0.010s
I20260811 16:04:10.941499 15778 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:11.052217 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:10.944105 15968 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:11.030359 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:10.782532 16015 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:11.040555 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:11.066535 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 309) took 1061 ms. Trace:
I20260811 16:04:11.066705 13744 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:11.025424 15970 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:11.045251 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:10.866739 15807 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:11.018240 16026 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:11.083397 13743 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:11.052913 13822 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:10.965176 15879 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:11.054621 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:11.089372 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:11.060081 15992 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:11.046761 15989 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:11.052042 15960 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:11.062088 15778 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:11.063015 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.063735 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.063989 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.064623 15977 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:11.076064 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:11.048843 13905 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.008s	sys 0.010s
I20260811 16:04:11.070513 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:11.058056 13873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.055s	sys 0.110s
W20260811 16:04:11.108089 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.055s	sys 0.111s
I20260811 16:04:11.029642 15957 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:11.070721 13904 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:11.066932 13739 rpcz_store.cc:276] 0811 16:04:10.005402 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.005639 (+   237us) service_pool.cc:227] Handling call
0811 16:04:10.006062 (+   423us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:10.012387 (+  6325us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:10.012430 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:10.019263 (+  6833us) log.cc:842] Serialized 26 byte log entry
0811 16:04:10.958945 (+939682us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:10.958984 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:10.959045 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:11.066322 (+107277us) raft_consensus.cc:1671] finished
0811 16:04:11.066342 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:11.066476 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5820,"raft.queue_time_us":6429,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":21955,"thread_start_us":910955,"threads_started":1,"wal-append.queue_time_us":1036284}
I20260811 16:04:11.079448 13908 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260811 16:04:11.081400 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:10.965243 15949 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:11.043133 16010 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:11.026440 16029 raft_consensus.cc:1050] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:04:11.093786 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:11.134899 13826 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260811 16:04:11.095088 15984 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.013s
I20260811 16:04:11.067513 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:11.075915 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:11.064739 15968 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:11.103726 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.104100 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.144358 14579 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:11.104203 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:11.104292 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet a48002159c1643c489d152b863d3d839 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:04:11.025090 15790 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:11.139707 15702 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:11.098289 15989 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:11.112843 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:11.158423 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 370741us
I20260811 16:04:11.158949 13905 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:11.133802 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:11.136556 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:11.110975 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:11.161216 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50347.3us
I20260811 16:04:11.098289 16026 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:11.102591 15722 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:11.084249 15986 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260811 16:04:11.087106 15807 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:11.147677 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.076284 15950 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:11.141273 15984 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.001s	sys 0.013s
I20260811 16:04:11.134055 15979 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:11.166751 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.151510 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet a48002159c1643c489d152b863d3d839 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-a48002159c1643c489d152b863d3d839
I20260811 16:04:11.162178 16014 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:11.140084 16010 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:11.149689 15860 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:11.163905 16031 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260811 16:04:11.157280 16035 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:11.162165 15989 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:11.185570 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:11.202386 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.180181 14581 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:11.173388 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.165057 16026 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:11.158978 15790 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:11.176875 13735 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:11.171520 14573 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:11.196369 15706 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:11.221187 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:11.173358 15977 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260811 16:04:11.190325 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.030s	sys 0.077s
I20260811 16:04:11.199226 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:11.227476 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.031s	sys 0.077s
I20260811 16:04:11.201627 13744 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:11.184262 15992 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260811 16:04:11.207824 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.004s	sys 0.023s
I20260811 16:04:11.178830 16039 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:11.151680 16015 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:11.240121 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.191471 16014 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:11.240816 14579 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:11.197165 15968 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:11.205295 16026 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:11.230195 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.004s	sys 0.023s
W20260811 16:04:11.208074 15929 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.019s
I20260811 16:04:11.239689 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.211166 15699 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:11.245850 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.256225 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:11.212432 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:11.210244 16035 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:11.233575 15938 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.022s	sys 0.055s
I20260811 16:04:11.261920 13825 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:11.281620 15938 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.023s	sys 0.056s
I20260811 16:04:11.257309 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:11.265115 15790 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:11.266106 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:11.243850 16014 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:11.268756 15699 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:11.260027 15929 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.019s
I20260811 16:04:11.258363 13824 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:04:11.272575 16037 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260811 16:04:11.273221 16040 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260811 16:04:11.273919 16044 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260811 16:04:11.280925 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:11.203686 15860 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:11.288219 13907 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.050s	sys 0.057s
W20260811 16:04:12.102097 13907 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.611s	user 0.149s	sys 0.287s
I20260811 16:04:11.661064 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 1890) took 1500 ms. Trace:
I20260811 16:04:11.544592 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1601) took 1490 ms. Trace:
I20260811 16:04:11.326193 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:11.626585 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.045s	sys 0.066s
W20260811 16:04:12.105722 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.019s
W20260811 16:04:12.105993 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.057s	sys 0.072s
W20260811 16:04:12.101526 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.004s	sys 0.017s
I20260811 16:04:11.661187 13909 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260811 16:04:12.102226 13901 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.022s	sys 0.005s
W20260811 16:04:12.108882 13901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.022s	sys 0.006s
W20260811 16:04:12.106143 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.019s
W20260811 16:04:12.107722 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.005s	sys 0.017s
W20260811 16:04:12.106513 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.08247e+06us
I20260811 16:04:12.103030 13900 rpcz_store.cc:276] 0811 16:04:10.161094 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.161253 (+   159us) service_pool.cc:227] Handling call
0811 16:04:11.660757 (+1499504us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:11.660973 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1667448576}
W20260811 16:04:11.730752 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.009s
W20260811 16:04:12.113273 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.001s	sys 0.009s
W20260811 16:04:12.113560 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 923007us
I20260811 16:04:12.105062 13906 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:11.615808 14582 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.025s	sys 0.027s
W20260811 16:04:11.731009 13904 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.010s
W20260811 16:04:12.081969 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.011s	sys 0.021s
W20260811 16:04:12.081686 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.003s	sys 0.056s
W20260811 16:04:12.125977 13904 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.000s	sys 0.019s
W20260811 16:04:12.126120 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.012s	sys 0.022s
I20260811 16:04:12.108000 13743 rpcz_store.cc:276] 0811 16:04:10.053946 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.240164 (+186218us) service_pool.cc:227] Handling call
0811 16:04:10.265844 (+ 25680us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:11.083820 (+817976us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:11.544247 (+460427us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54000a96d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:11.544493 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1879367040}
W20260811 16:04:12.126569 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 870753us
W20260811 16:04:12.126892 14582 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.040s	sys 0.031s
I20260811 16:04:12.127645 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:12.114097 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:11.552016 14574 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:04:12.125977 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.003s	sys 0.056s
W20260811 16:04:11.456305 15685 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.673s	user 0.002s	sys 0.010s
I20260811 16:04:11.283926 15778 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:11.933063 13737 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.407s	user 0.007s	sys 0.011s
W20260811 16:04:12.140341 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.05904e+06us
I20260811 16:04:11.532855 15977 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:11.345463 15936 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.147235 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1894) took 1821 ms. Trace:
I20260811 16:04:12.160202 13907 rpcz_store.cc:276] 0811 16:04:10.309750 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.310504 (+   754us) service_pool.cc:227] Handling call
0811 16:04:10.325095 (+ 14591us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:10.325390 (+   295us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:10.490439 (+165049us) log.cc:842] Serialized 14 byte log entry
0811 16:04:12.131196 (+1640757us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:12.131268 (+    72us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:12.131320 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.131383 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.131555 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9744,"raft.queue_time_us":28922,"spinlock_wait_cycles":21283712,"thread_start_us":1612050,"threads_started":1,"wal-append.queue_time_us":1655310}
I20260811 16:04:12.161581 15968 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:11.327627 13923 tablet_copy_source_session.cc:205] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
W20260811 16:04:11.644871 15982 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.004s	sys 0.046s
I20260811 16:04:11.742535 15950 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:11.529706 15790 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:11.776049 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:11.556097 15949 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:11.726347 15807 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.058322 15963 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:11.278352 15722 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:11.744401 15938 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.052419 15966 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:11.300961 15960 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:11.325891 15957 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.111174 15992 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:11.647639 15953 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:11.329638 15986 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:11.661074 15879 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:12.163120 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1411) took 1121 ms. Trace:
I20260811 16:04:12.220224 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 308) took 2289 ms. Trace:
W20260811 16:04:12.208150 16015 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.033s	sys 0.045s
I20260811 16:04:12.133394 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1404) took 1650 ms. Trace:
W20260811 16:04:12.222209 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 155121us
I20260811 16:04:12.134558 16009 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:12.133648 15929 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:12.162248 15968 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.122915 16029 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.248268 15722 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.249279 15968 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:12.242122 16015 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.040s	sys 0.055s
I20260811 16:04:12.241639 15986 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.240145 15992 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.240535 15953 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.134895 15979 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:12.135183 15984 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:12.162732 16045 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260811 16:04:11.288457 16035 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.149701 15952 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.279455 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 381) took 1055 ms. Trace:
I20260811 16:04:12.279727 15952 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.279903 13821 rpcz_store.cc:276] 0811 16:04:11.223955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.224441 (+   486us) service_pool.cc:227] Handling call
0811 16:04:12.278699 (+1054258us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:12.278923 (+   224us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:12.279118 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:12.279167 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:12.279205 (+    38us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:12.279240 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.279289 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.279397 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3442560}
I20260811 16:04:12.280730 15986 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.281805 15952 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.242168 13738 rpcz_store.cc:276] 0811 16:04:10.479340 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.750611 (+271271us) service_pool.cc:227] Handling call
0811 16:04:10.751043 (+   432us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:10.773549 (+ 22506us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:10.778138 (+  4589us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:10.945511 (+167373us) log.cc:842] Serialized 26 byte log entry
0811 16:04:11.107078 (+161567us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:11.133121 (+ 26043us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:11.133222 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:11.342811 (+209589us) raft_consensus.cc:1671] finished
0811 16:04:11.342839 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.130062 (+787223us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11854,"raft.queue_time_us":14828,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":2751,"thread_start_us":136626,"threads_started":1,"wal-append.queue_time_us":377362}
I20260811 16:04:12.146358 16053 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:12.158296 15797 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:12.151019 16060 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.153647 13737 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:12.159910 15685 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.215188 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 1976) took 2247 ms. Trace:
I20260811 16:04:12.220425 13739 rpcz_store.cc:276] 0811 16:04:11.041555 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.182652 (+141097us) service_pool.cc:227] Handling call
0811 16:04:11.182921 (+   269us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:11.198034 (+ 15113us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:11.198064 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:11.387846 (+189782us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.126131 (+738285us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:12.126195 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.126318 (+   123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:12.162900 (+ 36582us) raft_consensus.cc:1671] finished
0811 16:04:12.162924 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.163057 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7931,"raft.queue_time_us":15067,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5019,"spinlock_wait_cycles":83200,"thread_start_us":546912,"threads_started":1,"wal-append.queue_time_us":621714}
I20260811 16:04:12.165568 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:12.294513 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1401) took 1882 ms. Trace:
I20260811 16:04:12.220636 13742 rpcz_store.cc:276] 0811 16:04:09.943081 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.961258 (+ 18177us) service_pool.cc:227] Handling call
0811 16:04:09.998597 (+ 37339us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:09.998949 (+   352us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:09.998978 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:10.012188 (+ 13210us) log.cc:842] Serialized 26 byte log entry
0811 16:04:10.960700 (+948512us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:10.960750 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:10.960813 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:12.212257 (+1251444us) raft_consensus.cc:1671] finished
0811 16:04:12.212276 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.212452 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":250,"raft.queue_time_us":3778,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":15905,"thread_start_us":906779,"threads_started":1,"wal-append.queue_time_us":1082294}
I20260811 16:04:12.240670 15879 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.222810 15938 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:12.294960 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 129459us
I20260811 16:04:12.241413 15860 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.295086 13741 rpcz_store.cc:276] 0811 16:04:10.412309 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.053041 (+640732us) service_pool.cc:227] Handling call
0811 16:04:11.547619 (+494578us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:11.547888 (+   269us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:12.146053 (+598165us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:12.146098 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:12.146156 (+    58us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:12.146201 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.294251 (+148050us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400277ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:12.294319 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.294431 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1387982848}
I20260811 16:04:12.294278 13824 rpcz_store.cc:276] 0811 16:04:09.962992 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.963298 (+   306us) service_pool.cc:227] Handling call
0811 16:04:09.972714 (+  9416us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:09.993979 (+ 21265us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:09.994021 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:10.571254 (+577233us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:10.571900 (+   646us) log.cc:842] Serialized 564 byte log entry
0811 16:04:11.258240 (+686340us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:12.206429 (+948189us) log.cc:842] Serialized 14 byte log entry
0811 16:04:12.207640 (+  1211us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.207725 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:12.207775 (+    50us) raft_consensus.cc:1671] finished
0811 16:04:12.209837 (+  2062us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.209969 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2963,"raft.queue_time_us":16045,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"spinlock_wait_cycles":12447488,"thread_start_us":685958,"threads_started":1,"wal-append.queue_time_us":1087297}
W20260811 16:04:12.145294 16050 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.252s	user 0.000s	sys 0.006s
I20260811 16:04:12.207159 16004 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.242919 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.163920 15977 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.240060 14575 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:12.207444 16010 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.252839 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:12.210240 16063 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:12.244055 16056 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260811 16:04:12.212658 15950 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260811 16:04:12.273691 16067 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:12.273612 16069 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260811 16:04:12.275993 16059 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:04:12.261504 15979 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.282657 13626 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 1 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:12.288672 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 378) took 1068 ms. Trace:
I20260811 16:04:12.200656 15936 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.209666 15790 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.203459 16061 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260811 16:04:12.292884 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 240158us
I20260811 16:04:12.219847 15963 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.410447 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.298683 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:12.300873 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:12.323904 14578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 587) took 1590 ms (client timeout 2068 ms). Trace:
W20260811 16:04:12.411801 14578 rpcz_store.cc:269] 0811 16:04:10.733378 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.252549 (+1519171us) service_pool.cc:227] Handling call
0811 16:04:12.323804 (+ 71255us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:12.240479 15966 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:12.420403 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.259783 16009 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:12.277016 16042 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260811 16:04:12.301533 15685 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.334142 13823 rpcz_store.cc:276] 0811 16:04:11.219825 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.221665 (+  1840us) service_pool.cc:227] Handling call
0811 16:04:12.288135 (+1066470us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:12.288309 (+   174us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:12.288458 (+   149us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:12.288472 (+    14us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:12.288500 (+    28us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:12.288522 (+    22us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.288555 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.288627 (+    72us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2952960}
I20260811 16:04:12.335204 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1732) took 1167 ms. Trace:
W20260811 16:04:12.401382 15989 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.190s	user 0.007s	sys 0.006s
W20260811 16:04:12.299073 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 316) took 1942 ms (client timeout 2449 ms). Trace:
I20260811 16:04:12.299901 15952 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:12.455695 16061 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:12.429389 13904 rpcz_store.cc:276] 0811 16:04:11.168247 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.168452 (+   205us) service_pool.cc:227] Handling call
0811 16:04:11.168855 (+   403us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:11.169312 (+   457us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:11.169350 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:11.169899 (+   549us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.126527 (+956628us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:12.126565 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.126633 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:12.334967 (+208334us) raft_consensus.cc:1671] finished
0811 16:04:12.334991 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.335119 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":843,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6736,"thread_start_us":939318,"threads_started":1,"wal-append.queue_time_us":976511}
W20260811 16:04:12.443920 13737 rpcz_store.cc:269] 0811 16:04:10.354863 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.447745 (+ 92882us) service_pool.cc:227] Handling call
0811 16:04:12.296711 (+1848966us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:12.359980 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:12.402863 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:04:12.466367 13741 raft_consensus.cc:595] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:12.407465 16068 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:12.409714 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.413928 13906 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:12.467700 16068 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.470407 16068 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:12.332377 13923 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:56292 (request call id 271) took 1220 ms. Trace:
I20260811 16:04:12.471297 13923 rpcz_store.cc:276] 0811 16:04:11.093131 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.095470 (+  2339us) service_pool.cc:227] Handling call
0811 16:04:12.303892 (+1208422us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:12.264605 15984 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.474709 15984 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.261027 15929 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:12.421370 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 307315us
I20260811 16:04:12.421109 13903 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:12.331534 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 622) took 1151 ms. Trace:
I20260811 16:04:12.479707 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.479792 14575 rpcz_store.cc:276] 0811 16:04:11.174750 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.775641 (+600891us) service_pool.cc:227] Handling call
0811 16:04:12.325747 (+550106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:12.293792 15797 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:12.480751 15929 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.408254 15617 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:12.481428 15617 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.483640 15617 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:12.419749 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 308982us
I20260811 16:04:12.484517 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:12.485528 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:12.485925 15929 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:12.486027 15722 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:12.486377 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:12.487577 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.487723 16008 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:12.486380 15929 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.488265 16008 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:12.427457 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.024s	sys 0.055s
I20260811 16:04:12.491811 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 600) took 1400 ms. Trace:
W20260811 16:04:12.492180 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.025s	sys 0.056s
I20260811 16:04:12.495288 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 584) took 1958 ms. Trace:
I20260811 16:04:12.493337 14577 rpcz_store.cc:276] 0811 16:04:11.042404 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.044579 (+  2175us) service_pool.cc:227] Handling call
0811 16:04:12.298501 (+1253922us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:12.443007 (+144506us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13823360}
I20260811 16:04:12.499235 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.501166 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:12.292634 16053 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:12.505991 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 174440us
I20260811 16:04:12.507889 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.508643 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.294132 16060 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.495659 14582 rpcz_store.cc:276] 0811 16:04:10.536744 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:10.539613 (+  2869us) service_pool.cc:227] Handling call
0811 16:04:10.540021 (+   408us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:10.540283 (+   262us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:11.075855 (+535572us) log.cc:842] Serialized 14 byte log entry
0811 16:04:12.494812 (+1418957us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:12.494889 (+    77us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:12.494983 (+    94us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.495064 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.495230 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8680,"raft.queue_time_us":273728,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9029,"spinlock_wait_cycles":4659456,"thread_start_us":1409807,"threads_started":2,"wal-append.queue_time_us":1076885}
I20260811 16:04:12.455835 16069 raft_consensus.cc:2741] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260811 16:04:12.515811 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.491991 15952 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:12.516352 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 388749us
I20260811 16:04:12.518479 15983 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:12.486707 15722 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.421118 15992 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.488317 15929 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:12.554221 16075 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:12.554646 16075 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:12.555177 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.555509 16075 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.556895 16075 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:12.491428 15860 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:12.488675 16008 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:12.558193 15860 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.558645 15860 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:12.560618 16053 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.444705 15953 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.561305 16053 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:12.562544 15953 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.563125 16009 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.563046 15953 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:12.520539 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76980.7us
I20260811 16:04:12.331295 16063 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.457561 16061 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.544052 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.553541 16085 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260811 16:04:12.564483 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 407321us
W20260811 16:04:12.540144 16070 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260811 16:04:12.545244 15952 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:12.542358 16080 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:12.587769 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:12.402194 16067 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.493690 15989 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:12.617054 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:12.572891 16061 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:12.616170 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51350us
I20260811 16:04:12.571179 15983 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:12.607107 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 127493us
W20260811 16:04:12.620995 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 119941us
I20260811 16:04:12.623647 13742 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:12.581777 15938 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:12.614326 13787 connection.cc:232] RPC call timeout handler was delayed by -1.2419908050214872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260811 16:04:12.617764 16062 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260811 16:04:12.634073 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:12.633302 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:12.630642 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 126510us
I20260811 16:04:12.656030 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:12.656773 14541 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:12.657807 13787 connection.cc:232] RPC call timeout handler was delayed by -1.2058967129560187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260811 16:04:12.657896 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.613958 16009 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260811 16:04:12.658737 15879 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.783433 15936 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.620090 16085 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:12.788823 16085 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.790212 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:12.658946 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:12.791522 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 134824us
I20260811 16:04:12.837414 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.783252 15685 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:12.829810 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 171990us
I20260811 16:04:12.841790 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.793233 13741 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:12.830799 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.845037 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:12.838047 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44338.9us
W20260811 16:04:12.838706 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 182774us
I20260811 16:04:12.840296 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:12.847059 13744 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:12.848038 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:12.630560 16035 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.845551 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.854212 13907 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:12.856868 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.622424 16080 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:12.926420 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.925916 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:12.795797 16088 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260811 16:04:12.869212 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:12.859723 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.930876 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.728529 15938 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:12.934314 13907 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:12.934908 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:12.934916 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89959.1us
I20260811 16:04:12.658303 15977 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:12.962306 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:12.929134 15936 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:12.959407 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:12.966022 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:12.801921 16081 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260811 16:04:12.970558 16097 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:12.971864 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.935604 15979 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:12.935696 15966 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.631021 16077 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.977043 15706 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:12.859328 16004 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:04:13.082857 13626 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.023s	sys 0.023s
I20260811 16:04:12.977946 15929 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:13.083231 13626 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.023s	sys 0.023s
I20260811 16:04:12.838088 15963 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.967391 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1417) took 1004 ms. Trace:
W20260811 16:04:12.980123 16014 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.654s	user 0.011s	sys 0.001s
I20260811 16:04:12.961630 15685 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:12.982905 16026 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.700s	user 0.013s	sys 0.000s
I20260811 16:04:13.133050 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.134025 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:12.983697 15989 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.986565 16063 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:13.114811 14573 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.874s	user 0.015s	sys 0.015s
I20260811 16:04:13.143200 14573 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:13.143980 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 603) took 2051 ms. Trace:
I20260811 16:04:12.990522 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:12.991914 16071 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.992080 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 317) took 2064 ms. Trace:
W20260811 16:04:12.992134 16084 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260811 16:04:12.934069 16098 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:13.002548 13827 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:13.004527 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.006807 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:12.630707 16087 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:12.753513 16099 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:04:13.161746 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 155022us
I20260811 16:04:12.731012 16016 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:13.135174 16092 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:13.018529 15722 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.019079 16080 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.019680 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:13.020094 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 443714us
I20260811 16:04:12.877159 15879 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:12.859131 15957 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:12.801362 15790 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.978145 16085 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:13.034073 13839 tablet_copy_source_session.cc:205] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:04:12.858876 16072 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:12.700726 16029 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.348s
W20260811 16:04:13.039498 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.016s	sys 0.021s
I20260811 16:04:12.979642 16060 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:13.206779 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.016s	sys 0.023s
W20260811 16:04:13.207625 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 964700us
I20260811 16:04:13.210788 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 1990) took 2190 ms. Trace:
I20260811 16:04:13.216347 13820 rpcz_store.cc:276] 0811 16:04:11.020408 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.020526 (+   118us) service_pool.cc:227] Handling call
0811 16:04:11.020816 (+   290us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:11.033303 (+ 12487us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:11.033333 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:11.046327 (+ 12994us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.293863 (+1247536us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b180030f820. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:04:12.487583 (+193720us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:12.525636 (+ 38053us) log.cc:842] Serialized 14 byte log entry
0811 16:04:12.526942 (+  1306us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.527043 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:13.210460 (+683417us) raft_consensus.cc:1671] finished
0811 16:04:13.210579 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:13.210724 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13184,"prepare.queue_time_us":82422,"prepare.run_cpu_time_us":2449,"prepare.run_wall_time_us":25901,"raft.queue_time_us":20110,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":11319,"spinlock_wait_cycles":36993408,"thread_start_us":231129,"threads_started":2,"wal-append.queue_time_us":1488759}
I20260811 16:04:13.225942 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:13.226670 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:13.227576 14578 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:13.132741 15685 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.229347 15665 raft_consensus.cc:979] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:04:13.229970 15665 raft_consensus.cc:1067] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:04:13.230669 15685 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:12.985360 16067 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.134485 16014 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.105420 16077 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.193406 16099 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:12.989434 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.034588 16097 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:13.036324 15936 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:13.081661 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:13.147576 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.097s	sys 0.205s
I20260811 16:04:13.081849 15953 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.150341 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1735) took 1903 ms. Trace:
I20260811 16:04:13.150346 13740 rpcz_store.cc:276] 0811 16:04:10.927668 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.025806 (+ 98138us) service_pool.cc:227] Handling call
0811 16:04:11.026078 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:11.199292 (+173214us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:11.199337 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:11.199393 (+    56us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:11.199437 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.991818 (+1792381us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540020a3d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:12.991871 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.992014 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":397797248}
I20260811 16:04:13.010478 13821 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:13.264164 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 406425us
I20260811 16:04:13.265786 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:13.261943 13901 rpcz_store.cc:276] 0811 16:04:11.247362 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.247559 (+   197us) service_pool.cc:227] Handling call
0811 16:04:11.247960 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:11.248430 (+   470us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:11.248465 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:11.260508 (+ 12043us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.109245 (+848737us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:12.491593 (+382348us) log.cc:842] Serialized 14 byte log entry
0811 16:04:12.492091 (+   498us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.492189 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:13.150066 (+657877us) raft_consensus.cc:1671] finished
0811 16:04:13.150096 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:13.150272 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44054,"prepare.queue_time_us":451236,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":18223,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":29535,"thread_start_us":1195952,"threads_started":2,"wal-append.queue_time_us":889822}
I20260811 16:04:13.162823 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:13.267729 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 105015us
W20260811 16:04:13.013200 13707 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.603s (SENT)
I20260811 16:04:12.974504 16008 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:13.152966 16098 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:13.171487 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.171954 16087 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.173399 16063 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.174925 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 274) took 1987 ms. Trace:
I20260811 16:04:13.176354 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.144390 14573 rpcz_store.cc:276] 0811 16:04:11.092520 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.095955 (+  3435us) service_pool.cc:227] Handling call
0811 16:04:13.143898 (+2047943us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:13.178093 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.295027 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.292748 13909 rpcz_store.cc:276] 0811 16:04:11.187629 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.189706 (+  2077us) service_pool.cc:227] Handling call
0811 16:04:11.660922 (+471216us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:12.114331 (+453409us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:13.174710 (+1060379us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001b1050. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:13.174859 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1036837632}
I20260811 16:04:13.178548 16094 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.298131 13821 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:13.299032 13823 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260811 16:04:13.271843 16075 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.004s
W20260811 16:04:13.184190 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.017s	sys 0.038s
I20260811 16:04:13.145068 16038 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:13.182500 16104 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:13.226781 14579 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:13.301501 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.133778 16026 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.232798 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:13.212085 16072 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.206027 15957 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.216439 15790 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:13.240008 15699 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.113399 15983 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.242473 15929 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.243470 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:13.184976 16016 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.245368 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.134682 16009 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:13.251293 16095 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:13.196426 15979 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:13.313966 16106 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:13.205447 15977 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:13.256134 14582 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:13.260972 16077 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.218199 15706 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:13.242532 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.268770 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:13.269150 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60690.6us
I20260811 16:04:13.223366 13839 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50506 (request call id 370) took 3658 ms. Trace:
I20260811 16:04:13.225970 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.344362 13820 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:13.314355 16075 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:13.345263 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:12.925208 15992 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.160043 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.255820 16097 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:13.258002 15936 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:13.277699 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 264529us
W20260811 16:04:13.279239 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 317631us
I20260811 16:04:13.167583 16071 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:13.297482 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.268258 15685 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.299172 13744 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:13.179631 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:13.299635 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.017s	sys 0.038s
I20260811 16:04:13.299999 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:13.370244 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 834637us
I20260811 16:04:13.300223 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.302269 13901 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:13.185328 16092 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.302917 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.304045 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.291771 16098 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:13.304632 14583 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:13.388698 16071 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.269784 15937 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:13.268164 13817 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:13.273972 15702 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:13.391557 15937 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:13.391897 15702 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:13.392585 15937 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:13.393587 16055 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.184s	user 0.001s	sys 0.016s
W20260811 16:04:13.307070 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74371.1us
I20260811 16:04:13.395948 13907 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:13.314687 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.320091 13908 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:13.304869 16038 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.258509 16099 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.313558 15953 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:13.343020 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 74340.4us
I20260811 16:04:13.317427 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.346104 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:13.343438 13839 rpcz_store.cc:276] 0811 16:04:09.603234 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.628961 (+ 25727us) service_pool.cc:227] Handling call
0811 16:04:13.019790 (+3390829us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54002dcdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51916257 00007f5c568295e6 00007f5c56832e5e 00007f5c4e30d5db 00007f5c56832dda 00007f5c5682deec 00007f5c5682924b 00007f5c5681de45 00007f5c55926a54 00007f5c559269e2
0811 16:04:13.209750 (+189960us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5078669696}
I20260811 16:04:13.106881 13735 rpcz_store.cc:276] 0811 16:04:11.956005 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.956156 (+   151us) service_pool.cc:227] Handling call
0811 16:04:11.956614 (+   458us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:11.956872 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:11.956898 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:12.058832 (+101934us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.297360 (+238528us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:12.299798 (+  2438us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:12.303551 (+  3753us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:12.841793 (+538242us) raft_consensus.cc:1671] finished
0811 16:04:12.841836 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:12.960707 (+118871us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":227169,"threads_started":1,"wal-append.queue_time_us":234472}
I20260811 16:04:13.317926 15790 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.344901 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:13.352182 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.322678 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:13.359357 13707 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.825s (SENT)
I20260811 16:04:13.420912 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:13.421787 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62498.8us
W20260811 16:04:13.422811 13707 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.777s (SENT)
I20260811 16:04:13.331048 15979 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.377463 13744 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260811 16:04:13.380550 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 108334us
I20260811 16:04:13.386507 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.387084 16092 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.398770 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:13.401949 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.350797 16056 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:13.402983 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:13.336506 16095 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.406461 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.442301 13824 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:13.407918 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:13.408962 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 102174us
I20260811 16:04:13.410210 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:13.410341 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:13.411100 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65072.7us
W20260811 16:04:13.415117 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70287us
I20260811 16:04:13.309306 16104 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.375995 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.336782 16009 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:13.404629 16084 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260811 16:04:13.424741 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.426139 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.427559 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.341949 15977 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.409848 15953 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:13.346388 15706 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.338181 16106 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.362164 16075 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:13.452469 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53769us
I20260811 16:04:13.492589 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:13.598129 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 173526us
I20260811 16:04:13.599176 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.425998 13737 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:13.588414 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:13.551378 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
W20260811 16:04:13.600664 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 190408us
I20260811 16:04:13.426126 15665 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:13.423097 15938 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:13.447432 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.601791 13820 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:13.420265 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 376) took 2201 ms. Trace:
I20260811 16:04:13.455932 13900 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:13.428218 16110 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:13.523042 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.599946 13824 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:13.633294 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:13.634037 16075 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.634609 13824 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:13.441557 16056 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:13.635449 16056 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:13.635859 13824 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:04:13.637447 14541 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:13.637527 13820 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:13.422508 16105 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:04:13.519618 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 109472us
I20260811 16:04:13.436368 13736 raft_consensus.cc:2362] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3. Re-sending same reply.
I20260811 16:04:13.439755 16014 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.629529 15665 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:13.519024 16109 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260811 16:04:13.650952 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 203593us
I20260811 16:04:13.660780 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.652302 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.491880 16004 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:13.580631 15790 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.655725 13821 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:13.655929 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.518893 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:13.519968 15957 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.491472 16092 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.687973 13744 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:13.628440 15953 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:13.666128 14579 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:13.640620 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.529399 16063 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:13.690132 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49624.6us
I20260811 16:04:13.690886 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:13.692157 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:13.669353 13823 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:13.538792 16026 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:13.543162 16008 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.670498 16004 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:13.530761 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.626434 16010 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:13.626253 16031 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.538282 16099 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.627727 15938 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:13.630268 16111 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:13.657522 15860 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.095s	user 0.008s	sys 0.004s
W20260811 16:04:13.677268 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 274357us
I20260811 16:04:13.657812 16067 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.698998 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.529819 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:13.706771 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92327.5us
W20260811 16:04:13.798601 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 124389us
I20260811 16:04:13.807963 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:13.795332 15722 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:13.690647 16087 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:13.810714 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 111816us
I20260811 16:04:13.811414 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:13.806031 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.811501 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:13.801249 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 100734us
I20260811 16:04:13.819350 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1736) took 2541 ms. Trace:
I20260811 16:04:13.739523 15937 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:13.740355 16026 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:13.703306 16014 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:13.829157 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1619) took 1239 ms. Trace:
I20260811 16:04:13.829437 13743 rpcz_store.cc:276] 0811 16:04:12.590139 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.612943 (+ 22804us) service_pool.cc:227] Handling call
0811 16:04:13.828440 (+1215497us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:13.828674 (+   234us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.828838 (+   164us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:13.828871 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:13.828913 (+    42us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:13.828944 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:13.828995 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:13.829103 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18457984}
W20260811 16:04:13.818351 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.072s (SENT) [suppressed 16 similar messages]
I20260811 16:04:13.822240 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:13.700577 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:13.799530 16072 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.671054 16105 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260811 16:04:13.742115 16063 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:13.677119 16016 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.887106 13736 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:04:13.880044 15706 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.878897 16014 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:13.881446 15797 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.891732 16009 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.824832 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.798247 15938 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:13.819751 13905 rpcz_store.cc:276] 0811 16:04:11.270255 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.270457 (+   202us) service_pool.cc:227] Handling call
0811 16:04:12.103535 (+833078us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:12.131304 (+ 27769us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:12.131332 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:12.150005 (+ 18673us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.975043 (+825038us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b180036de40. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:04:13.269423 (+294380us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:13.269462 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:13.269636 (+   174us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:13.800479 (+530843us) raft_consensus.cc:1671] finished
0811 16:04:13.800506 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:13.811287 (+ 10781us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27359,"raft.queue_time_us":27963,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":20179,"spinlock_wait_cycles":2194688,"thread_start_us":294194,"threads_started":1,"wal-append.queue_time_us":1173690}
I20260811 16:04:13.740576 16004 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:13.871621 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67411.6us
I20260811 16:04:13.798888 16010 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:13.871241 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55045.5us
I20260811 16:04:13.830385 15722 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:13.823554 16107 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:13.877135 16072 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:13.877416 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:13.880004 16114 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:04:13.941682 13817 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
W20260811 16:04:13.879918 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 59928.1us
I20260811 16:04:13.881426 16104 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:13.884722 16097 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.885866 16095 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:13.951843 16128 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:13.952445 16128 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:13.886392 15702 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.824663 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:13.954375 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "930faff3981346c88c8864a1f3b15158"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:13.876356 15979 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:13.823757 15952 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.204s	user 0.010s	sys 0.002s
I20260811 16:04:13.934753 16010 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:13.804958 15860 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:13.811162 16111 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.827771 16123 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:13.870291 16067 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:13.891690 16014 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:13.940092 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 117963us
I20260811 16:04:13.977361 13744 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:13.978492 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:13.943372 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 340946us
I20260811 16:04:13.832005 16052 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260811 16:04:13.832149 16008 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260811 16:04:13.878509 16063 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:13.833377 16092 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:13.954547 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129976us
I20260811 16:04:13.934343 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:13.955783 13905 raft_consensus.cc:595] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:13.956609 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.936340 15977 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:13.954620 15617 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260811 16:04:13.941957 16072 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:13.823465 15937 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:14.002727 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.969275 15952 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:13.971007 15936 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.004s
I20260811 16:04:13.970801 16112 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:13.972286 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:13.974179 13903 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:13.975975 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:13.963765 16087 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:13.939102 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 115038us
I20260811 16:04:13.989936 16118 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:13.990093 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:13.990885 16119 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:04:13.975257 15747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c390fd23cec5435d81b38a50b2988a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:04:14.034094 15665 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:13.938042 16107 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:13.997951 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:14.035343 16107 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.036334 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.036667 13822 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:13.953329 16128 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:13.999573 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65317us
W20260811 16:04:13.999883 14542 connection.cc:232] RPC call timeout handler was delayed by -1.2000242079375312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260811 16:04:13.969303 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.003326 13905 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:14.005247 15929 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:14.006273 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.041087 15929 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:14.041507 15929 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.005584 15937 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.018671 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:13.995826 16063 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.020219 13825 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:14.021744 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:14.073009 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51335.9us
I20260811 16:04:14.041592 16108 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260811 16:04:14.075049 15948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a48002159c1643c489d152b863d3d839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:04:13.994853 16092 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:13.948441 15953 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:14.038666 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.019610 16106 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.083791 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:14.046002 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.076117 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.076196 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:14.083973 13901 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:14.091566 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.069749 16125 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:14.088738 16098 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.007s
I20260811 16:04:14.109707 16072 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.020253 15936 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.109437 16098 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.093930 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:14.175798 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.092270 13825 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:14.115170 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:14.071511 15963 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:14.088008 16095 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:14.072623 16112 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:14.181401 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.181401 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:14.180037 13905 raft_consensus.cc:595] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:14.203088 13907 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:13.631732 13818 rpcz_store.cc:276] 0811 16:04:11.219163 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.224963 (+  5800us) service_pool.cc:227] Handling call
0811 16:04:11.269787 (+ 44824us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:12.135261 (+865474us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:12.150101 (+ 14840us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:12.220646 (+ 70545us) log.cc:842] Serialized 26 byte log entry
0811 16:04:12.493100 (+272454us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:13.309453 (+816353us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b180007fe40. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f
0811 16:04:13.321604 (+ 12151us) log.cc:842] Serialized 14 byte log entry
0811 16:04:13.352909 (+ 31305us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:13.361221 (+  8312us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:13.368963 (+  7742us) raft_consensus.cc:1671] finished
0811 16:04:13.398745 (+ 29782us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:13.415294 (+ 16549us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":849710,"prepare.queue_time_us":131463,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":42516,"raft.queue_time_us":874389,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":12800,"spinlock_wait_cycles":180367232,"thread_start_us":343860,"threads_started":2,"wal-append.queue_time_us":250820}
I20260811 16:04:14.094681 16106 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:14.102850 15996 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:14.104310 15953 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.091454 15706 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:14.154111 16072 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:14.206794 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 188301us
I20260811 16:04:14.203418 13826 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:14.216584 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.086131 16092 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.134768 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.219517 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.220618 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:14.221197 13737 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.145763 15952 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.102627 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.224152 13817 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:14.224563 15936 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.176478 15860 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.212708 14578 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:14.108719 15685 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:14.206205 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:14.234483 16133 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260811 16:04:14.236688 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.228391 16072 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.238722 16087 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.239284 16087 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.240585 16072 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.242156 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.175972 16097 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:14.107272 16135 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.146008 16014 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.105566 16004 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:14.243768 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:14.159942 16125 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.243768 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.256031 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:14.256695 13817 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.225124 15706 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.257730 16004 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.206729 15963 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.259796 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:14.260372 13905 raft_consensus.cc:595] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:14.231097 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:14.209436 16106 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.261634 16106 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.240741 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.244585 14579 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
W20260811 16:04:14.201630 16061 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.544s	user 0.011s	sys 0.003s
I20260811 16:04:14.265162 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.265515 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.266389 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.264693 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.267043 14579 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:14.266338 14578 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:14.268504 16014 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:14.268903 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:14.269475 14578 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.071134 16118 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:14.242051 15937 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.276372 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.277037 13905 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:14.277401 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.264588 16125 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.268966 16061 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.281930 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:14.284209 13905 raft_consensus.cc:595] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:14.282644 16140 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:14.283429 16136 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260811 16:04:14.278287 16056 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.003s
I20260811 16:04:14.286837 16061 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.289016 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:14.274096 16111 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.270119 15685 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:14.295969 13905 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.267979 15929 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.298175 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.301579 14579 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:14.307497 13825 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.243570 16135 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:14.287631 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.311446 13905 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:14.278096 15938 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.311090 14575 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:14.297914 15685 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:14.325098 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.326679 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:14.333457 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.309006 15937 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:14.334163 14579 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:14.335852 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 187486us
I20260811 16:04:14.337809 13706 leader_election.cc:398] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:14.339103 13706 leader_election.cc:401] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260811 16:04:14.339600 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
W20260811 16:04:14.339957 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 158669us
I20260811 16:04:14.340207 13907 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:14.340583 13907 raft_consensus.cc:603] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:14.340369 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:14.300361 16056 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.342018 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.341403 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:14.343869 14542 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.304s (SENT)
I20260811 16:04:14.344702 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:14.346410 14542 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.276s (SENT)
I20260811 16:04:14.347525 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:14.336254 13735 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:14.314684 15685 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.348480 13827 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.350560 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260811 16:04:14.349501 14578 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:14.352928 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:14.353139 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:14.354207 15977 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:14.355608 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.357429 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.361702 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:14.337357 15706 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.280767 16112 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.347275 15937 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:14.347981 16072 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:14.368022 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.369746 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.371050 16073 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:14.355880 15963 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.347431 16004 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:14.350167 16014 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:14.372212 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.347409 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.344901 16061 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:14.364346 13825 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:14.370695 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.370945 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.379995 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.366514 16104 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:14.365293 16098 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.388301 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.420251 14579 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:14.358592 16113 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260811 16:04:14.423864 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52995.8us
I20260811 16:04:14.425794 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.375387 15937 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.426466 13909 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:14.428120 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.359613 16085 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260811 16:04:14.438030 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.434679 13827 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:14.389519 16142 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:14.440510 16142 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:14.425450 16068 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:14.422376 16104 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:14.449231 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1905) took 1566 ms. Trace:
I20260811 16:04:14.449386 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.449922 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.449644 13902 rpcz_store.cc:276] 0811 16:04:12.882415 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.883546 (+  1131us) service_pool.cc:227] Handling call
0811 16:04:12.971547 (+ 88001us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.270492 (+298945us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:13.270541 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:13.270600 (+    59us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:13.270638 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:14.448952 (+1178314us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54002acbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:14.449004 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:14.449154 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":72117,"raft.queue_time_us":72412,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":22669,"spinlock_wait_cycles":512999808}
I20260811 16:04:14.451042 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:14.452266 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:14.452301 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.453778 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:14.454850 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.427372 16097 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:14.445986 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.388924 16118 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.422288 14574 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 1.
I20260811 16:04:14.374010 16067 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260811 16:04:14.430032 15937 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.384827 16014 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.372818 16010 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:14.459484 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.482568 14578 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:14.459575 14579 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:14.429461 16098 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:14.374330 16016 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260811 16:04:14.425420 16113 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.425623 16061 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.496193 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.496943 16038 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:14.497012 13817 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:14.497220 13737 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:14.479462 16015 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:14.497938 16015 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:14.498071 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.498356 16015 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:14.456832 16104 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:14.446981 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:14.457955 15929 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:14.498241 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.500427 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.500586 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:14.457243 15977 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:14.509533 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:14.510242 14579 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:14.487968 16097 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:14.480311 16073 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:14.505854 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.486845 16014 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:14.507823 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 385) took 1320 ms. Trace:
I20260811 16:04:14.448632 16068 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.489212 16135 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.501011 15938 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.515308 13824 rpcz_store.cc:276] 0811 16:04:13.187778 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.638123 (+450345us) service_pool.cc:227] Handling call
0811 16:04:13.638376 (+   253us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.700878 (+ 62502us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:13.700917 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:13.700956 (+    39us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:13.700989 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:14.507569 (+806580us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54000983d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:14.507617 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:14.507765 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":143305088}
I20260811 16:04:14.494256 16113 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:14.511641 16073 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:14.511459 15977 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:14.512511 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.512197 16097 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:14.519312 16134 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:14.519421 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:14.544108 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:14.491394 16098 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:14.460749 16142 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:14.718667 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1240) took 1536 ms (client timeout 1580 ms). Trace:
I20260811 16:04:14.544682 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:15.123639 13821 rpcz_store.cc:269] 0811 16:04:13.182575 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.300011 (+117436us) service_pool.cc:227] Handling call
0811 16:04:14.718453 (+1418442us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540025f654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:14.718598 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":653559552}
I20260811 16:04:14.656505 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1430) took 1140 ms. Trace:
I20260811 16:04:14.641295 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1623) took 1940 ms. Trace:
I20260811 16:04:15.131487 13741 rpcz_store.cc:276] 0811 16:04:12.700464 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.843743 (+143279us) service_pool.cc:227] Handling call
0811 16:04:12.969541 (+125798us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.333135 (+363594us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:13.333180 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:13.333253 (+    73us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:13.333309 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:14.641016 (+1307707us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:14.641059 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:14.641235 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":835586816}
I20260811 16:04:15.125272 13744 rpcz_store.cc:276] 0811 16:04:13.516430 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.688884 (+172454us) service_pool.cc:227] Handling call
0811 16:04:13.690713 (+  1829us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.977766 (+287053us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:14.656240 (+678474us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54002792d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:14.656437 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":658747776}
I20260811 16:04:15.141331 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:15.142815 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:15.145030 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.149473 13744 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:14.547078 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:14.836550 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:14.517830 16056 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.157035 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:14.891258 13707 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.531s (SENT)
I20260811 16:04:15.158061 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2017) took 1226 ms. Trace:
W20260811 16:04:14.652977 16144 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260811 16:04:15.132287 13824 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:15.116900 16063 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.024s	user 0.008s	sys 0.003s
W20260811 16:04:14.641392 16123 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.003s
I20260811 16:04:15.159597 13823 rpcz_store.cc:276] 0811 16:04:13.931477 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.240578 (+309101us) service_pool.cc:227] Handling call
0811 16:04:15.156823 (+916245us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:15.157989 (+  1166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10182016}
I20260811 16:04:15.122910 16134 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:14.638746 16083 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.632s	user 0.000s	sys 0.014s
W20260811 16:04:15.160573 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 269397us
I20260811 16:04:15.162230 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:14.640327 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 610) took 1426 ms (client timeout 1801 ms). Trace:
I20260811 16:04:15.164188 14574 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
W20260811 16:04:15.164619 13739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1621) took 2539 ms (client timeout 1711 ms). Trace:
I20260811 16:04:15.165191 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.166067 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:15.185343 13739 rpcz_store.cc:269] 0811 16:04:12.625882 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.626095 (+   213us) service_pool.cc:227] Handling call
0811 16:04:14.836317 (+2210222us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:15.164499 (+328182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13227264}
I20260811 16:04:15.185990 13901 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:15.173969 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2016) took 1347 ms. Trace:
I20260811 16:04:15.089741 15992 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:14.650403 16010 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:14.740033 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:15.176623 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 391) took 1245 ms. Trace:
I20260811 16:04:15.196601 13823 rpcz_store.cc:276] 0811 16:04:13.931165 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.175813 (+1244648us) service_pool.cc:227] Handling call
0811 16:04:15.176119 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.176290 (+   171us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.176319 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.176360 (+    41us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:15.176389 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.176440 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.176558 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.198874 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 392) took 1264 ms. Trace:
I20260811 16:04:15.200513 13825 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:15.201186 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2018) took 1132 ms. Trace:
I20260811 16:04:15.201464 13825 rpcz_store.cc:276] 0811 16:04:14.069154 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.199992 (+1130838us) service_pool.cc:227] Handling call
0811 16:04:15.200319 (+   327us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.200952 (+   633us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.201133 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:14.643327 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.108636 16094 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:14.569671 16135 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:15.131485 15977 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.144546 16073 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:14.672232 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.178195 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.144110 16097 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:15.079340 15983 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.692s	user 0.000s	sys 0.054s
W20260811 16:04:15.185104 14575 rpcz_store.cc:269] 0811 16:04:13.214371 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.218377 (+  4006us) service_pool.cc:227] Handling call
0811 16:04:14.640023 (+1421646us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400490554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:14.640258 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2222869248}
I20260811 16:04:15.217900 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.179097 16063 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.188939 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.223656 13741 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:15.152094 16068 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.189073 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:15.226727 13901 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:15.185560 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 1.
I20260811 16:04:15.227430 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 616) took 1238 ms. Trace:
I20260811 16:04:15.227842 14578 rpcz_store.cc:276] 0811 16:04:13.988864 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.158960 (+1170096us) service_pool.cc:227] Handling call
0811 16:04:15.227351 (+ 68391us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:14.797681 16067 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:15.199352 13823 rpcz_store.cc:276] 0811 16:04:13.934801 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.197893 (+1263092us) service_pool.cc:227] Handling call
0811 16:04:15.198275 (+   382us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.198496 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.198533 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.198596 (+    63us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:15.198639 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.198707 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.198821 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:14.569985 16090 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.731s
W20260811 16:04:15.205360 14579 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.004s
I20260811 16:04:15.180249 16123 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:15.207950 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 394) took 1030 ms. Trace:
I20260811 16:04:15.209017 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:15.197418 16104 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260811 16:04:15.215309 13744 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:15.216863 15983 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.829s	user 0.003s	sys 0.054s
I20260811 16:04:15.187419 13824 rpcz_store.cc:276] 0811 16:04:13.826819 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.172984 (+1346165us) service_pool.cc:227] Handling call
0811 16:04:15.173383 (+   399us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.173579 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.173600 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.173645 (+    45us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:15.173689 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.173768 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.173897 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.233625 15747 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.000s
I20260811 16:04:15.236922 13823 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:15.245237 13825 rpcz_store.cc:276] 0811 16:04:14.177520 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.204900 (+1027380us) service_pool.cc:227] Handling call
0811 16:04:15.205219 (+   319us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.206460 (+  1241us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.206505 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.206565 (+    60us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:15.206620 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.206681 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.207880 (+  1199us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.235955 14579 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:15.183391 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:15.250216 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.255491 13744 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:15.251812 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:15.250290 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:15.257166 13901 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:15.257273 14578 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.203168 15992 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:15.259568 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2023) took 1081 ms. Trace:
I20260811 16:04:15.260875 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.242648 13741 raft_consensus.cc:2396] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:15.234238 16061 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:15.259967 13823 rpcz_store.cc:276] 0811 16:04:14.178021 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.232706 (+1054685us) service_pool.cc:227] Handling call
0811 16:04:15.233072 (+   366us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.259326 (+ 26254us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.259512 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.314640 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.300782 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:15.212145 16094 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:15.214848 16135 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:15.299741 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.021s	sys 0.026s
W20260811 16:04:15.340306 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.021s	sys 0.026s
W20260811 16:04:15.340651 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.03949e+06us
I20260811 16:04:15.325460 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:15.326496 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.016s	sys 0.039s
W20260811 16:04:15.314785 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 593) took 2668 ms (client timeout 1883 ms). Trace:
I20260811 16:04:15.249306 16067 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:15.315567 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 642) took 1025 ms. Trace:
W20260811 16:04:15.315527 16125 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.024s	user 0.006s	sys 0.007s
W20260811 16:04:15.365388 14582 rpcz_store.cc:269] 0811 16:04:12.634288 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.658604 (+ 24316us) service_pool.cc:227] Handling call
0811 16:04:15.260049 (+2601445us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54004c0c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.302464 (+ 42415us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":960205056}
I20260811 16:04:15.366776 14579 rpcz_store.cc:276] 0811 16:04:14.289892 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.314169 (+1024277us) service_pool.cc:227] Handling call
0811 16:04:15.315507 (+  1338us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.364521 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:15.378809 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.379112 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1927) took 1034 ms. Trace:
I20260811 16:04:15.379745 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:15.379694 13907 rpcz_store.cc:276] 0811 16:04:14.344990 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.367506 (+1022516us) service_pool.cc:227] Handling call
0811 16:04:15.378297 (+ 10791us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.378550 (+   253us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.378588 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.378640 (+    52us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:15.378681 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.378887 (+   206us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.379039 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.374401 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1921) took 1053 ms. Trace:
I20260811 16:04:15.381003 13901 rpcz_store.cc:276] 0811 16:04:14.321343 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.301158 (+979815us) service_pool.cc:227] Handling call
0811 16:04:15.373621 (+ 72463us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.373917 (+   296us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.373955 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.374015 (+    60us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:15.374071 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.374151 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.374317 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.381873 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:15.371212 14578 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:15.383679 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:15.365388 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.022s	sys 0.040s
W20260811 16:04:15.259739 16137 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.006s	sys 0.036s
W20260811 16:04:15.375627 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.004s	sys 0.028s
W20260811 16:04:15.386337 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.005s	sys 0.028s
I20260811 16:04:15.376049 13739 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:15.384737 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 930992us
I20260811 16:04:15.336318 16123 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:15.314458 16101 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:15.303925 16112 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.039s	sys 0.050s
I20260811 16:04:15.386606 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.392457 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.325803 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1629) took 1341 ms. Trace:
I20260811 16:04:15.393219 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 646) took 1063 ms. Trace:
I20260811 16:04:15.399223 14579 rpcz_store.cc:276] 0811 16:04:14.330042 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.378562 (+1048520us) service_pool.cc:227] Handling call
0811 16:04:15.393139 (+ 14577us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.400285 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.401113 14579 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:15.401470 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 605) took 1447 ms. Trace:
I20260811 16:04:15.401844 14579 rpcz_store.cc:276] 0811 16:04:13.953705 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.399968 (+1446263us) service_pool.cc:227] Handling call
0811 16:04:15.401422 (+  1454us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.249967 16104 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.329952 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.393035 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:15.394505 16106 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.132s	user 0.012s	sys 0.001s
I20260811 16:04:15.397881 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 615) took 1035 ms. Trace:
I20260811 16:04:15.438990 14578 rpcz_store.cc:276] 0811 16:04:14.362116 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.385381 (+1023265us) service_pool.cc:227] Handling call
0811 16:04:15.397819 (+ 12438us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.315629 16140 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.026s	sys 0.025s
I20260811 16:04:15.402896 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.223767 16134 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:15.386077 16137 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.006s	sys 0.036s
I20260811 16:04:15.375471 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:15.329849 16093 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.403s	user 0.011s	sys 0.022s
W20260811 16:04:15.397117 16112 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.043s	sys 0.053s
W20260811 16:04:15.420281 16087 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.180s	user 0.002s	sys 0.011s
I20260811 16:04:15.453449 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.454389 14578 raft_consensus.cc:2396] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:15.425231 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:15.415091 13739 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:15.430995 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 631) took 2127 ms. Trace:
I20260811 16:04:15.432730 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2005) took 2033 ms. Trace:
I20260811 16:04:15.433880 16108 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:15.430189 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.462631 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1637) took 1184 ms. Trace:
W20260811 16:04:15.445668 16140 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.028s	sys 0.029s
I20260811 16:04:15.386197 16010 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:15.484000 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 1998) took 2635 ms. Trace:
I20260811 16:04:15.484452 13826 rpcz_store.cc:276] 0811 16:04:12.848366 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.021099 (+172733us) service_pool.cc:227] Handling call
0811 16:04:13.021501 (+   402us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:14.216942 (+1195441us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.483741 (+1266799us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:15.483938 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2717760256}
I20260811 16:04:15.485234 16104 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.486018 13826 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:04:15.393242 16098 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:15.447556 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 597) took 1513 ms. Trace:
I20260811 16:04:15.487001 14579 rpcz_store.cc:276] 0811 16:04:13.933894 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.402610 (+1468716us) service_pool.cc:227] Handling call
0811 16:04:15.447473 (+ 44863us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.487649 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2011) took 1662 ms (client timeout 1992 ms). Trace:
I20260811 16:04:15.488030 14579 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:04:15.488772 14579 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:04:15.488903 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1917) took 2217 ms. Trace:
I20260811 16:04:15.489208 14579 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.489395 13903 rpcz_store.cc:276] 0811 16:04:13.271078 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.405288 (+134210us) service_pool.cc:227] Handling call
0811 16:04:13.405673 (+   385us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:14.021376 (+615703us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.488667 (+1467291us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:15.488846 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1303966464}
I20260811 16:04:15.448810 13744 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:15.490123 15992 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.393014 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.399008 16056 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:15.424484 16090 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260811 16:04:15.456514 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:15.425740 15989 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:15.427583 16067 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:15.458583 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 621) took 1116 ms. Trace:
I20260811 16:04:15.459070 16137 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:15.426468 16009 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:15.507339 16009 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:15.507920 16009 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.460179 13820 rpcz_store.cc:276] 0811 16:04:13.399727 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.671722 (+271995us) service_pool.cc:227] Handling call
0811 16:04:14.718603 (+1046881us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:14.718799 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:14.718822 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:14.718863 (+    41us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:14.718891 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:14.718955 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.432561 (+713606us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540025f650. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.432668 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2406793088}
I20260811 16:04:15.428730 16135 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.463105 13740 rpcz_store.cc:276] 0811 16:04:14.278335 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.284906 (+  6571us) service_pool.cc:227] Handling call
0811 16:04:15.430013 (+1145107us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:15.462556 (+ 32543us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5879552}
I20260811 16:04:15.429107 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1928) took 1081 ms. Trace:
I20260811 16:04:15.511591 13907 rpcz_store.cc:276] 0811 16:04:14.347650 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.380905 (+1033255us) service_pool.cc:227] Handling call
0811 16:04:15.423633 (+ 42728us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.423862 (+   229us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.428792 (+  4930us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.428838 (+    46us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:15.428876 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.428936 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.429048 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.452253 16092 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.220s	user 0.011s	sys 0.004s
I20260811 16:04:15.467432 16112 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:15.467656 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.469247 16069 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:15.398765 16101 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:15.517138 16112 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.462520 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43044 (request call id 586) took 7099 ms. Trace:
I20260811 16:04:15.472286 16063 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.398872 13736 rpcz_store.cc:276] 0811 16:04:13.984530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.987937 (+  3407us) service_pool.cc:227] Handling call
0811 16:04:14.038746 (+ 50809us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:14.093825 (+ 55079us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:14.115306 (+ 21481us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:14.176934 (+ 61628us) log.cc:842] Serialized 26 byte log entry
0811 16:04:14.276463 (+ 99529us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:14.280045 (+  3582us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:14.285261 (+  5216us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:15.249666 (+964405us) raft_consensus.cc:1671] finished
0811 16:04:15.254865 (+  5199us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.314713 (+ 59848us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":20608,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":37993,"thread_start_us":65105,"threads_started":1,"wal-append.queue_time_us":108705}
I20260811 16:04:15.523312 15747 rpcz_store.cc:276] 0811 16:04:08.363298 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.365497 (+  2199us) service_pool.cc:227] Handling call
0811 16:04:08.366557 (+  1060us) ts_tablet_manager.cc:928] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
0811 16:04:13.811525 (+5444968us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:04:14.364125 (+552600us) tablet_metadata.cc:641] Metadata flushed
0811 16:04:14.385944 (+ 21819us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:04:15.315778 (+929834us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:04:15.387781 (+ 72003us) tablet_replica.cc:205] Creating consensus instance
0811 16:04:15.454588 (+ 66807us) ts_tablet_manager.cc:983] Replica registered.
0811 16:04:15.460399 (+  5811us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":214,"tablet-copy.queue_time_us":182,"thread_start_us":62586,"threads_started":1}
I20260811 16:04:15.524993 15747 tablet_copy_client.cc:791] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:04:15.525120 16112 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.525796 15747 tablet_copy_client.cc:655] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:04:15.474498 16134 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:15.529186 16068 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:15.530119 16068 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.462833 16103 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:15.531368 16103 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:15.531757 16103 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:15.533685 16068 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:15.455201 16093 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.595s	user 0.011s	sys 0.022s
I20260811 16:04:15.459901 14573 rpcz_store.cc:276] 0811 16:04:13.305765 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.308963 (+  3198us) service_pool.cc:227] Handling call
0811 16:04:13.333702 (+ 24739us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.459085 (+125383us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:13.486833 (+ 27748us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:13.516090 (+ 29257us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:13.521771 (+  5681us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.430734 (+1908963us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54003dcf54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:15.430783 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.430911 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":228478720}
I20260811 16:04:15.536201 16093 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:15.536355 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.459090 16087 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.536924 16069 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.538914 16087 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.539794 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.493597 16056 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:15.396162 16125 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.549970 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 632) took 2102 ms. Trace:
W20260811 16:04:15.492549 16113 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.950s	user 0.013s	sys 0.000s
I20260811 16:04:15.492815 15702 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:15.492981 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1733) took 4312 ms. Trace:
I20260811 16:04:15.494995 13823 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:15.488068 13827 rpcz_store.cc:269] 0811 16:04:13.825691 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.114863 (+289172us) service_pool.cc:227] Handling call
0811 16:04:15.487474 (+1372611us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.487591 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":385447680}
I20260811 16:04:15.551158 13820 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:15.551783 13908 rpcz_store.cc:276] 0811 16:04:11.180691 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:11.180822 (+   131us) service_pool.cc:227] Handling call
0811 16:04:11.194391 (+ 13569us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:13.404330 (+2209939us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.492712 (+2088382us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54000c7954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:15.492895 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4888226176}
I20260811 16:04:15.559737 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1933) took 1184 ms. Trace:
I20260811 16:04:15.563395 13907 rpcz_store.cc:276] 0811 16:04:14.375739 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.512531 (+1136792us) service_pool.cc:227] Handling call
0811 16:04:15.559243 (+ 46712us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.559431 (+   188us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.559455 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.559496 (+    41us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:15.559522 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.559571 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.559670 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.501008 13905 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.017s	sys 0.041s
I20260811 16:04:15.504601 15989 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:15.504712 16137 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.502583 14575 rpcz_store.cc:276] 0811 16:04:14.341756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.243545 (+901789us) service_pool.cc:227] Handling call
0811 16:04:15.458498 (+214953us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.502712 16026 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260811 16:04:15.496006 15979 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.023s	sys 0.046s
I20260811 16:04:15.506496 15950 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:15.507990 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1433) took 1199 ms. Trace:
I20260811 16:04:15.441741 16106 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.540560 13741 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:15.486651 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1250) took 1164 ms. Trace:
I20260811 16:04:15.574406 13739 rpcz_store.cc:276] 0811 16:04:14.309071 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.208718 (+899647us) service_pool.cc:227] Handling call
0811 16:04:15.507779 (+299061us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000a8cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.507923 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":300111232}
I20260811 16:04:15.575011 13826 rpcz_store.cc:276] 0811 16:04:14.322289 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.485324 (+1163035us) service_pool.cc:227] Handling call
0811 16:04:15.485671 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.486416 (+   745us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.486599 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.546713 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1437) took 1169 ms. Trace:
I20260811 16:04:15.550531 14583 rpcz_store.cc:276] 0811 16:04:13.447683 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.491083 (+ 43400us) service_pool.cc:227] Handling call
0811 16:04:15.302468 (+1811385us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.302656 (+   188us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.302678 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.302713 (+    35us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:15.302743 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.302790 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.549764 (+246974us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54004c0c50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.549895 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3941986432}
W20260811 16:04:15.564731 13905 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.017s	sys 0.041s
I20260811 16:04:15.491576 16108 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.556363 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1252) took 1233 ms. Trace:
I20260811 16:04:15.577211 13827 rpcz_store.cc:276] 0811 16:04:14.322907 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.555487 (+1232580us) service_pool.cc:227] Handling call
0811 16:04:15.555861 (+   374us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.556037 (+   176us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.556060 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.556097 (+    37us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:15.556142 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.556205 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.556309 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.557731 15937 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.064s	user 0.008s	sys 0.002s
W20260811 16:04:15.587436 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 278) took 2681 ms (client timeout 1676 ms). Trace:
I20260811 16:04:15.571682 13908 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:15.576004 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 336) took 1464 ms. Trace:
W20260811 16:04:15.549994 16014 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.024s	user 0.008s	sys 0.002s
W20260811 16:04:15.496065 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.033s	sys 0.043s
I20260811 16:04:15.558758 16056 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.607519 13739 rpcz_store.cc:276] 0811 16:04:14.111453 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.575233 (+1463780us) service_pool.cc:227] Handling call
0811 16:04:15.575536 (+   303us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.575701 (+   165us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.575725 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.575765 (+    40us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:15.575800 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.575857 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.575954 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.607125 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.033s	sys 0.044s
I20260811 16:04:15.608270 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.588564 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1935) took 1208 ms. Trace:
I20260811 16:04:15.609287 13741 raft_consensus.cc:2396] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:15.550642 16125 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.609884 13908 rpcz_store.cc:276] 0811 16:04:14.380231 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.570987 (+1190756us) service_pool.cc:227] Handling call
0811 16:04:15.571449 (+   462us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:15.588249 (+ 16800us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.588511 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.569772 15699 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:15.573957 16026 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:15.612524 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 602) took 1659 ms (client timeout 2204 ms). Trace:
I20260811 16:04:15.577946 16095 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:15.578253 15950 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:15.578548 15979 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.023s	sys 0.046s
I20260811 16:04:15.614650 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1638) took 1332 ms. Trace:
I20260811 16:04:15.519724 16092 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.608323 14579 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.616878 13740 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:15.558099 16094 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.566866 16093 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:15.612140 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:15.717115 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 105058us
I20260811 16:04:15.688975 14573 raft_consensus.cc:2396] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:15.661356 13827 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:15.664733 13904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 1916) took 2394 ms (client timeout 1781 ms). Trace:
I20260811 16:04:15.666388 16026 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.587886 16069 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:15.587911 13900 rpcz_store.cc:269] 0811 16:04:12.892561 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.989108 (+ 96547us) service_pool.cc:227] Handling call
0811 16:04:15.573339 (+2584231us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.573459 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":464467328}
I20260811 16:04:15.668318 13744 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:15.725144 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1432) took 1421 ms. Trace:
I20260811 16:04:15.725579 13744 rpcz_store.cc:276] 0811 16:04:14.303471 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.616946 (+1313475us) service_pool.cc:227] Handling call
0811 16:04:15.626298 (+  9352us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.724848 (+ 98550us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.725077 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.662485 15699 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.671491 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 606) took 1717 ms. Trace:
I20260811 16:04:15.672015 16137 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.614740 15989 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:15.663757 16107 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.628s	user 0.013s	sys 0.002s
I20260811 16:04:15.611058 16014 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.577796 13737 rpcz_store.cc:276] 0811 16:04:14.377721 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.467353 (+1089632us) service_pool.cc:227] Handling call
0811 16:04:15.546636 (+ 79283us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.675103 13735 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:15.551537 16113 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.695170 16108 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.605585 15937 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.750090 14578 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:15.675449 16101 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:15.689095 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.751214 15937 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.752148 14582 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:15.691584 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2024) took 1465 ms. Trace:
I20260811 16:04:15.752722 13824 rpcz_store.cc:276] 0811 16:04:14.225862 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.249121 (+1023259us) service_pool.cc:227] Handling call
0811 16:04:15.249518 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.391177 (+141659us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.391224 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.391281 (+    57us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:15.391329 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.691289 (+299960us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000d5054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:15.691353 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.691513 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":325134208}
I20260811 16:04:15.700891 14583 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:15.693305 14581 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260811 16:04:15.754488 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 636) took 2222 ms. Trace:
I20260811 16:04:15.709764 14579 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.690129 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1248) took 1368 ms. Trace:
I20260811 16:04:15.755195 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:43030 (request call id 599) took 1820 ms. Trace:
I20260811 16:04:15.692301 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:15.689776 16015 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.191s	user 0.006s	sys 0.007s
W20260811 16:04:15.718884 13904 rpcz_store.cc:269] 0811 16:04:13.270783 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.292087 (+ 21304us) service_pool.cc:227] Handling call
0811 16:04:15.623547 (+2331460us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.664652 (+ 41105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":383418624}
I20260811 16:04:15.755589 14579 rpcz_store.cc:276] 0811 16:04:13.934407 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.487872 (+1553465us) service_pool.cc:227] Handling call
0811 16:04:15.755070 (+267198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.665156 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:15.687785 16106 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.754949 14581 rpcz_store.cc:276] 0811 16:04:13.531810 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.534161 (+  2351us) service_pool.cc:227] Handling call
0811 16:04:15.692573 (+2158412us) spinlock_profiling.cc:243] Waited 871 us on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:15.692835 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.754199 (+ 61364us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.754430 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2003712}
I20260811 16:04:15.721040 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:15.702872 16102 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.416s	user 0.028s	sys 0.076s
I20260811 16:04:15.729641 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.693838 16103 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:15.664145 14574 rpcz_store.cc:269] 0811 16:04:13.952858 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.493234 (+540376us) service_pool.cc:227] Handling call
0811 16:04:15.612346 (+1119112us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54006b44d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.612464 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1534347520}
I20260811 16:04:15.743878 15699 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.744913 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:15.745805 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:15.692426 16097 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.736626 14575 rpcz_store.cc:276] 0811 16:04:13.953963 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.610326 (+1656363us) service_pool.cc:227] Handling call
0811 16:04:15.670718 (+ 60392us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.671088 (+   370us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.671118 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.671198 (+    80us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:15.671241 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.671304 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.671429 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":11833,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118}
I20260811 16:04:15.748999 16014 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.722543 16094 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:15.751160 16113 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:15.751274 13743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1630) took 1766 ms (client timeout 2151 ms). Trace:
I20260811 16:04:15.698675 13739 rpcz_store.cc:276] 0811 16:04:14.282100 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.613792 (+1331692us) service_pool.cc:227] Handling call
0811 16:04:15.614147 (+   355us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.614313 (+   166us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.614338 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:15.614378 (+    40us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:15.614428 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.614480 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:15.614585 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.755342 13823 rpcz_store.cc:276] 0811 16:04:14.321570 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.313410 (+991840us) service_pool.cc:227] Handling call
0811 16:04:15.491918 (+178508us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.551983 (+ 60065us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.689859 (+137876us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540021a550. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:15.690044 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":409294080}
W20260811 16:04:15.710538 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.005s	sys 0.051s
W20260811 16:04:15.800076 13743 rpcz_store.cc:269] 0811 16:04:13.984793 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.688767 (+1703974us) service_pool.cc:227] Handling call
0811 16:04:15.751198 (+ 62431us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:15.801774 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:15.803534 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:15.760473 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 1938) took 1379 ms (client timeout 1758 ms). Trace:
I20260811 16:04:15.761962 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:15.804123 13743 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:15.804440 13743 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:15.804307 13902 rpcz_store.cc:269] 0811 16:04:14.381291 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.457192 (+ 75901us) service_pool.cc:227] Handling call
0811 16:04:15.692100 (+1234908us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:15.760401 (+ 68301us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15008128}
I20260811 16:04:15.785275 13744 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:15.805244 13743 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.806185 13743 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:15.791239 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:15.802259 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.005s	sys 0.051s
I20260811 16:04:15.807981 14579 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:15.793937 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49094.9us
I20260811 16:04:15.763947 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:15.794319 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48612.2us
W20260811 16:04:15.810616 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46762.4us
I20260811 16:04:15.812261 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:15.814760 15977 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.007s
I20260811 16:04:15.815958 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:15.753960 16056 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.693933 15950 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:15.819476 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1626) took 1835 ms (client timeout 2081 ms). Trace:
I20260811 16:04:15.821235 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:15.818704 15937 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:15.801261 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.823022 15979 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:15.740698 16107 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:15.823774 16090 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:15.824378 13906 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
W20260811 16:04:15.761560 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.020s	sys 0.018s
W20260811 16:04:15.936825 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.021s	sys 0.019s
W20260811 16:04:15.824981 13742 rpcz_store.cc:269] 0811 16:04:13.983669 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.784363 (+1800694us) service_pool.cc:227] Handling call
0811 16:04:15.819385 (+ 35022us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:15.784794 16102 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.498s	user 0.028s	sys 0.076s
I20260811 16:04:15.823688 15983 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:15.856485 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:15.784019 16108 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:15.817201 16073 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260811 16:04:15.799220 16106 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:15.920984 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.020s
I20260811 16:04:15.802217 16101 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:15.923722 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:15.802579 16094 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:15.932036 13825 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.017s
W20260811 16:04:16.030834 13825 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.004s	sys 0.017s
I20260811 16:04:15.939028 13743 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:15.942481 13744 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:16.033896 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:15.989997 16073 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:15.851481 15685 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.484s	user 0.011s	sys 0.002s
I20260811 16:04:16.035465 13903 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:16.035444 15685 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.036478 16073 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.025694 16166 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:16.037361 16166 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.037880 15685 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:15.820556 15699 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:15.738162 16093 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.039373 16093 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:16.039737 16154 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260811 16:04:16.041731 16056 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:15.919649 16009 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:15.953660 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:15.981907 14577 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.020s
I20260811 16:04:15.984848 14579 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:16.049405 14577 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.010s	sys 0.020s
W20260811 16:04:15.986814 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.000s	sys 0.020s
I20260811 16:04:16.049606 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 281) took 1731 ms. Trace:
W20260811 16:04:16.050158 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 666655us
I20260811 16:04:16.050566 14581 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:16.033035 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:15.880131 16116 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:15.931450 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.011s	sys 0.011s
I20260811 16:04:16.055215 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:16.009294 14580 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:16.057109 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 103574us
W20260811 16:04:15.990517 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 399287us
I20260811 16:04:15.881230 16104 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:15.823055 16155 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:15.784319 16015 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:15.943317 16128 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.711s	user 0.023s	sys 0.036s
I20260811 16:04:16.021929 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.034243 16094 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:15.989459 16106 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:15.824550 15977 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:15.982479 16110 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.008s	sys 0.020s
W20260811 16:04:15.932415 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.022s
W20260811 16:04:16.085285 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.000s	sys 0.022s
W20260811 16:04:16.009697 16123 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.023s	sys 0.009s
I20260811 16:04:16.043743 16009 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.044077 16092 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.044919 16103 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.045064 16026 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.023337 16101 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.008948 16090 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:16.050031 13905 rpcz_store.cc:276] 0811 16:04:14.318111 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.330787 (+ 12676us) service_pool.cc:227] Handling call
0811 16:04:14.331226 (+   439us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:14.345825 (+ 14599us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:14.345846 (+    21us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:14.346133 (+   287us) log.cc:842] Serialized 26 byte log entry
0811 16:04:15.576543 (+1230410us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:15.576597 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:15.576680 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:16.049386 (+472706us) raft_consensus.cc:1671] finished
0811 16:04:16.049407 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.049545 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9361,"raft.queue_time_us":8853,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":21562,"thread_start_us":1208541,"threads_started":1,"wal-append.queue_time_us":1570143}
I20260811 16:04:16.055024 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:16.061096 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.062481 13744 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:16.063699 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:15.940301 15937 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.095156 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1639) took 1641 ms. Trace:
I20260811 16:04:16.067323 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:16.068819 16014 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:16.029157 16108 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:16.055608 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.011s	sys 0.012s
I20260811 16:04:16.056901 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 617) took 2062 ms. Trace:
I20260811 16:04:16.105852 16026 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:16.071792 16128 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.839s	user 0.024s	sys 0.037s
I20260811 16:04:16.106256 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1251) took 1783 ms. Trace:
I20260811 16:04:16.106859 13907 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.106642 13820 rpcz_store.cc:276] 0811 16:04:14.322602 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.510338 (+1187736us) service_pool.cc:227] Handling call
0811 16:04:15.511741 (+  1403us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.571548 (+ 59807us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.106036 (+534488us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400173c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.106191 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90032000}
I20260811 16:04:16.068660 15702 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:16.108134 15702 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.108557 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1932) took 1736 ms. Trace:
I20260811 16:04:16.109041 15702 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.110534 16107 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.110621 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 619) took 2118 ms. Trace:
W20260811 16:04:16.092494 16123 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.023s	sys 0.009s
I20260811 16:04:16.066957 16124 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:04:16.068783 16004 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:16.095510 13744 rpcz_store.cc:276] 0811 16:04:14.454238 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.061760 (+1607522us) service_pool.cc:227] Handling call
0811 16:04:16.062199 (+   439us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.094900 (+ 32701us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.095085 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.079505 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 607) took 1995 ms. Trace:
I20260811 16:04:16.096576 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:15.946228 16097 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.098345 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.083607 16056 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:16.099351 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.133147 13742 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:16.099531 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 245921us
I20260811 16:04:16.082758 16106 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.087802 13818 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:16.087582 16110 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.012s	sys 0.026s
I20260811 16:04:16.071597 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.102821 13901 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.079840 15685 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:16.070051 16155 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.145427 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.103827 16014 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:16.104938 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2014) took 2278 ms. Trace:
I20260811 16:04:16.105355 14574 rpcz_store.cc:276] 0811 16:04:13.989023 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.816163 (+1827140us) service_pool.cc:227] Handling call
0811 16:04:15.936363 (+120200us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.985946 (+ 49583us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.008385 (+ 22439us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.010294 (+  1909us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:16.022116 (+ 11822us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.027608 (+  5492us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.051402 (+ 23794us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.055826 16116 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:16.111042 14581 rpcz_store.cc:276] 0811 16:04:13.992100 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.814725 (+1822625us) service_pool.cc:227] Handling call
0811 16:04:16.050407 (+235682us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.050999 (+   592us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.110451 (+ 59452us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540052b7d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:16.110566 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":541072128}
I20260811 16:04:16.119491 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.151692 14579 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:16.095361 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:16.108903 13903 rpcz_store.cc:276] 0811 16:04:14.372024 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.490497 (+1118473us) service_pool.cc:227] Handling call
0811 16:04:15.495804 (+  5307us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.035995 (+540191us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.108381 (+ 72386us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.108516 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1240688384}
I20260811 16:04:16.111411 13908 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:16.131007 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:16.069082 16104 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.136650 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:16.045285 16068 consensus_queue.cc:1159] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:04:16.154232 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.154654 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:16.154806 13744 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:16.115736 13738 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260811 16:04:16.111228 16123 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:16.158871 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63644.4us
I20260811 16:04:16.159761 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.119658 15983 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:16.101106 16160 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:16.103284 16090 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:16.137168 15948 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.005s
I20260811 16:04:16.131916 16067 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:16.149264 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.105988 15936 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.156368 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:16.138935 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.197104 16015 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.198962 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.200044 13742 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 2: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:04:16.201180 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44885.6us
W20260811 16:04:16.202113 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63354.6us
I20260811 16:04:16.202772 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2026) took 1929 ms. Trace:
I20260811 16:04:16.191797 16004 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.162305 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.147228 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1431) took 1855 ms. Trace:
I20260811 16:04:16.165108 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.148363 15685 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.155369 16116 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.161432 15790 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.198197 16067 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.170922 15977 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.170122 16101 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.164638 16075 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.138324 16056 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.145219 16124 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:16.204795 16164 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:16.176496 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.177208 16094 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.178563 16107 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:16.180351 16014 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.182425 13744 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:16.158236 16171 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:16.185571 16104 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.244591 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:16.187500 16155 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.114825 16108 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.214812 16142 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260811 16:04:16.195281 16137 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:16.216092 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.217522 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.200434 15983 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:16.204018 16160 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.129382 14575 rpcz_store.cc:276] 0811 16:04:14.083736 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.816427 (+1732691us) service_pool.cc:227] Handling call
0811 16:04:16.010775 (+194348us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.027958 (+ 17183us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.031044 (+  3086us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.051553 (+ 20509us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:16.057178 (+  5625us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.066693 (+  9515us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.072262 (+  5569us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.254719 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:16.255425 16108 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.255869 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.257649 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.203437 13825 rpcz_store.cc:276] 0811 16:04:14.273566 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.299706 (+1026140us) service_pool.cc:227] Handling call
0811 16:04:15.364529 (+ 64823us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.364832 (+   303us) raft_consensus.cc:1520] Early marking committed up to index 2
0811 16:04:16.031499 (+666667us) log.cc:842] Serialized 14 byte log entry
0811 16:04:16.202293 (+170794us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.202369 (+    76us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:16.202433 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.202525 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.202679 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":780525,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2934,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":4999,"thread_start_us":811850,"threads_started":2}
I20260811 16:04:16.170082 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:16.218884 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56667.2us
I20260811 16:04:16.206346 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1631) took 2213 ms. Trace:
I20260811 16:04:16.176108 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 333) took 2136 ms. Trace:
W20260811 16:04:16.226194 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 370007us
I20260811 16:04:16.264374 13738 rpcz_store.cc:276] 0811 16:04:13.992403 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.994580 (+  2177us) service_pool.cc:227] Handling call
0811 16:04:16.115264 (+2120684us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:16.115491 (+   227us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.163098 (+ 47607us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.204426 (+ 41328us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3495808}
I20260811 16:04:16.264621 13736 rpcz_store.cc:276] 0811 16:04:14.039398 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.524019 (+1484621us) service_pool.cc:227] Handling call
0811 16:04:15.524439 (+   420us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.524657 (+   218us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:16.024542 (+499885us) log.cc:842] Serialized 14 byte log entry
0811 16:04:16.175586 (+151044us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.175666 (+    80us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:16.175746 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.175865 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.176024 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":521975,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":138,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"thread_start_us":600545,"threads_started":2,"wal-append.queue_time_us":205030}
I20260811 16:04:16.266355 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.267369 16016 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:16.267906 16016 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.268430 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1643) took 1747 ms. Trace:
I20260811 16:04:16.269459 13738 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:16.269920 16016 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:16.270107 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 339) took 1625 ms. Trace:
I20260811 16:04:16.271348 16155 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:04:16.242383 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.272449 13744 raft_consensus.cc:2396] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:16.273236 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.212291 13741 rpcz_store.cc:276] 0811 16:04:14.292185 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.611880 (+1319695us) service_pool.cc:227] Handling call
0811 16:04:15.612237 (+   357us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.612466 (+   229us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:16.019845 (+407379us) log.cc:842] Serialized 14 byte log entry
0811 16:04:16.146890 (+127045us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.146939 (+    49us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:16.146985 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.147048 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.147132 (+    84us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7309,"prepare.queue_time_us":434469,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":10884,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5132,"thread_start_us":523399,"threads_started":2}
I20260811 16:04:16.273940 16128 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:16.274928 16128 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:16.274989 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 341) took 1620 ms. Trace:
I20260811 16:04:16.270780 16016 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260811 16:04:16.275377 16128 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.252584 16104 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:16.275592 16056 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.270577 13738 rpcz_store.cc:276] 0811 16:04:14.645079 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.268899 (+1623820us) service_pool.cc:227] Handling call
0811 16:04:16.269271 (+   372us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.269878 (+   607us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.270055 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.276127 16104 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.276337 16128 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.232005 14579 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:16.240700 14574 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:16.221191 16092 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260811 16:04:16.277138 15983 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.255597 13742 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:16.278077 16092 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:16.278551 16092 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:16.278906 13742 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:16.150363 13817 rpcz_store.cc:276] 0811 16:04:13.826452 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.141295 (+1314843us) service_pool.cc:227] Handling call
0811 16:04:15.141787 (+   492us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:15.142030 (+   243us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:15.142080 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:15.142653 (+   573us) log.cc:842] Serialized 26 byte log entry
0811 16:04:16.104534 (+961881us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:16.104578 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.104663 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:16.104716 (+    53us) raft_consensus.cc:1671] finished
0811 16:04:16.104726 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.104877 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":961447,"threads_started":1,"wal-append.queue_time_us":786879}
I20260811 16:04:16.279592 16092 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.280110 15685 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.280488 13744 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:16.277634 16128 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:16.268951 13737 rpcz_store.cc:276] 0811 16:04:14.521383 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.267636 (+1746253us) service_pool.cc:227] Handling call
0811 16:04:16.267936 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.268115 (+   179us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.268141 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.268195 (+    54us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:16.268226 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.268280 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.268377 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.266734 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.281919 15879 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.282341 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.258400 14575 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:16.283218 13737 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260811 16:04:16.278609 16104 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.284323 16094 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.275475 13741 rpcz_store.cc:276] 0811 16:04:14.664981 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.274138 (+1609157us) service_pool.cc:227] Handling call
0811 16:04:16.274503 (+   365us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.274676 (+   173us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.274700 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.274742 (+    42us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:16.274779 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.274828 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.274928 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.286085 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:16.263806 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.290733 13821 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:16.250205 16142 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:16.293339 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.286274 16004 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:16.294866 13822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1226) took 3796 ms (client timeout 2335 ms). Trace:
I20260811 16:04:16.281137 16092 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:16.300037 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:16.298674 13822 rpcz_store.cc:269] 0811 16:04:12.494028 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:12.496056 (+  2028us) service_pool.cc:227] Handling call
0811 16:04:16.290381 (+3794325us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540014dcd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:16.290520 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3425754496}
I20260811 16:04:16.295724 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.250494 15977 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:16.217849 16168 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260811 16:04:16.303635 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.305075 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1635) took 2284 ms. Trace:
I20260811 16:04:16.305516 13740 rpcz_store.cc:276] 0811 16:04:14.020466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.511053 (+1490587us) service_pool.cc:227] Handling call
0811 16:04:15.616709 (+105656us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.709308 (+ 92599us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.304880 (+595572us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002783d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:16.305016 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":242099968}
I20260811 16:04:16.308164 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.309556 14579 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:16.310678 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.312278 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:16.312640 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.314257 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.314567 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.315934 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.316417 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.317692 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:16.317893 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.324564 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.327872 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1937) took 1947 ms. Trace:
I20260811 16:04:16.328576 14579 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:16.329035 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:16.330075 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 1923) took 1995 ms (client timeout 1844 ms). Trace:
I20260811 16:04:16.330093 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.331811 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2013) took 2505 ms. Trace:
I20260811 16:04:16.332527 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 608) took 2223 ms. Trace:
I20260811 16:04:16.332986 14579 rpcz_store.cc:276] 0811 16:04:14.109418 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.331639 (+2222221us) service_pool.cc:227] Handling call
0811 16:04:16.332057 (+   418us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.332236 (+   179us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.332273 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.332313 (+    40us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:16.332342 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.332390 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.332479 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.333698 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.334533 14579 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.335121 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 609) took 2180 ms. Trace:
I20260811 16:04:16.335434 14579 rpcz_store.cc:276] 0811 16:04:14.155052 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.334054 (+2179002us) service_pool.cc:227] Handling call
0811 16:04:16.334383 (+   329us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.334924 (+   541us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.335078 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.336668 13744 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.332175 13821 rpcz_store.cc:276] 0811 16:04:13.826180 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.143859 (+1317679us) service_pool.cc:227] Handling call
0811 16:04:16.290507 (+1146648us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.291280 (+   773us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.331622 (+ 40342us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540014dcd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:16.331743 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2636320000}
W20260811 16:04:16.330677 13909 rpcz_store.cc:269] 0811 16:04:14.334590 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.458935 (+124345us) service_pool.cc:227] Handling call
0811 16:04:16.328839 (+1869904us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:16.329989 (+  1150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24896896}
I20260811 16:04:16.341959 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 635) took 2821 ms. Trace:
I20260811 16:04:16.342458 14580 rpcz_store.cc:276] 0811 16:04:13.520635 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.520824 (+   189us) service_pool.cc:227] Handling call
0811 16:04:15.493630 (+1972806us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:15.493915 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.066543 (+572628us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.341707 (+275164us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54005401d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.341885 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1187264000}
I20260811 16:04:16.344045 14580 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.236586 16123 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.293524 15948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43028 (request call id 594) took 7514 ms. Trace:
I20260811 16:04:16.245965 16107 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.344734 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 645) took 2025 ms. Trace:
I20260811 16:04:16.361359 14580 rpcz_store.cc:276] 0811 16:04:14.319813 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.343489 (+2023676us) service_pool.cc:227] Handling call
0811 16:04:16.343824 (+   335us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.344477 (+   653us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.344679 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.345019 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 641) took 2811 ms. Trace:
I20260811 16:04:16.365975 14578 rpcz_store.cc:276] 0811 16:04:13.533360 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.463439 (+1930079us) service_pool.cc:227] Handling call
0811 16:04:15.498899 (+ 35460us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.750509 (+251610us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.344792 (+594283us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.344941 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":577202048}
I20260811 16:04:16.346787 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.367998 14580 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.360105 15977 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.328369 13907 rpcz_store.cc:276] 0811 16:04:14.380858 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.572937 (+1192079us) service_pool.cc:227] Handling call
0811 16:04:15.608258 (+ 35321us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.107464 (+499206us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.327591 (+220127us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400088ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.327795 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1146220288}
I20260811 16:04:16.347625 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:16.348294 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.349123 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 603) took 2396 ms. Trace:
I20260811 16:04:16.370893 14583 rpcz_store.cc:276] 0811 16:04:13.953141 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.587985 (+1634844us) service_pool.cc:227] Handling call
0811 16:04:15.618931 (+ 30946us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.753946 (+135015us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.348917 (+594971us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54006603d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.349067 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":188078976}
W20260811 16:04:16.372011 16186 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260811 16:04:16.372466 15977 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:16.373332 16188 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260811 16:04:16.345741 16015 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election won for term 2
W20260811 16:04:16.351161 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 141710us
I20260811 16:04:16.353911 16155 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.351276 15617 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.356586 15936 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:16.356711 15984 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:16.302567 16016 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:16.357198 16103 raft_consensus.cc:979] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:16.357503 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1939) took 1975 ms. Trace:
I20260811 16:04:16.297499 16142 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:16.295307 15879 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:16.276448 16124 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.296170 15937 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:16.394829 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 185159us
I20260811 16:04:16.376622 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.377369 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 611) took 2034 ms. Trace:
I20260811 16:04:16.350517 13744 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:16.352694 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:16.395823 14580 rpcz_store.cc:276] 0811 16:04:14.342925 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.362126 (+2019201us) service_pool.cc:227] Handling call
0811 16:04:16.367826 (+  5700us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.368433 (+   607us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.377304 (+  8871us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.381863 14578 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:16.383157 14581 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:16.397037 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.011s	sys 0.037s
W20260811 16:04:16.397377 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.011s	sys 0.037s
W20260811 16:04:16.397899 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.00488e+06us
I20260811 16:04:16.398622 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:16.383657 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 614) took 2395 ms (client timeout 2449 ms). Trace:
I20260811 16:04:16.399899 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.303936 15790 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260811 16:04:16.388016 13908 rpcz_store.cc:276] 0811 16:04:14.381633 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.615698 (+1234065us) service_pool.cc:227] Handling call
0811 16:04:15.668081 (+ 52383us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.153933 (+485852us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.353128 (+199195us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.357437 (+  4309us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1018956032}
I20260811 16:04:16.385478 15936 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:16.345935 16095 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260811 16:04:16.345621 16097 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260811 16:04:16.290488 16067 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:16.399698 14582 rpcz_store.cc:269] 0811 16:04:13.988443 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.392155 (+1403712us) service_pool.cc:227] Handling call
0811 16:04:16.383455 (+991300us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:16.383588 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":815247104}
I20260811 16:04:16.403687 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.448228 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.369540 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1640) took 1861 ms. Trace:
I20260811 16:04:16.420897 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.402031 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.378973 16108 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:16.404063 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 612) took 2060 ms. Trace:
I20260811 16:04:16.357987 15979 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260811 16:04:16.387760 16187 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260811 16:04:16.380381 16073 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.421999 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:16.456103 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54167.1us
I20260811 16:04:16.466307 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.456542 14578 rpcz_store.cc:276] 0811 16:04:14.343224 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.366910 (+2023686us) service_pool.cc:227] Handling call
0811 16:04:16.381695 (+ 14785us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.403815 (+ 22120us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.404009 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.385948 16015 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.390976 15879 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:16.460760 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.385630 16090 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:16.387516 15984 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:16.670222 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.416610 16103 raft_consensus.cc:1067] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:16.671737 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:16.672684 13707 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.781s (SENT)
I20260811 16:04:16.402753 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:16.470642 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:16.677069 14578 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:16.680202 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.404529 15685 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.534639 13902 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:16.683485 13909 raft_consensus.cc:2396] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:16.492498 14580 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:16.703485 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 625) took 2041 ms. Trace:
I20260811 16:04:16.703835 14580 rpcz_store.cc:276] 0811 16:04:14.661839 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.448458 (+1786619us) service_pool.cc:227] Handling call
0811 16:04:16.492220 (+ 43762us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.703260 (+211040us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.703433 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.392367 15617 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:16.387025 16137 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260811 16:04:16.494958 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47390.8us
I20260811 16:04:16.407730 16014 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.471119 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.694641 13903 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:16.683985 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.701323 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 648) took 1310 ms. Trace:
I20260811 16:04:16.748124 14578 rpcz_store.cc:276] 0811 16:04:15.390499 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.469183 (+1078684us) service_pool.cc:227] Handling call
0811 16:04:16.676907 (+207724us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.700968 (+ 24061us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.701247 (+   279us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.749819 14578 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260811 16:04:16.706141 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 357890us
I20260811 16:04:16.750645 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.752977 14580 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:16.753793 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 650) took 1253 ms. Trace:
I20260811 16:04:16.754179 14580 rpcz_store.cc:276] 0811 16:04:15.500835 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.738931 (+1238096us) service_pool.cc:227] Handling call
0811 16:04:16.752749 (+ 13818us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.753518 (+   769us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.753728 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.672379 16097 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:16.708779 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.456791 16016 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:16.726411 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.539698 16056 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:16.683588 15984 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.690544 16067 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.778368 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:16.684742 15879 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:16.417232 16004 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.309s
I20260811 16:04:16.464987 15989 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.310s
I20260811 16:04:16.538049 15937 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.248s
I20260811 16:04:16.693766 16108 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:16.532645 15702 consensus_queue.cc:1159] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f46150fac70458986206ec7af67a403" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:04:16.828490 16056 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:16.782554 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 652) took 1240 ms. Trace:
I20260811 16:04:16.686002 16166 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.466387 16162 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.337s
I20260811 16:04:16.813681 16014 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:16.792886 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.801571 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1912) took 3915 ms. Trace:
I20260811 16:04:16.839257 13906 rpcz_store.cc:276] 0811 16:04:12.885828 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.399007 (+513179us) service_pool.cc:227] Handling call
0811 16:04:15.573563 (+2174556us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.986826 (+413263us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.346472 (+359646us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:16.801285 (+454813us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400022bd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:16.801481 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5576727040}
I20260811 16:04:16.832173 14578 rpcz_store.cc:276] 0811 16:04:15.542653 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.749134 (+1206481us) service_pool.cc:227] Handling call
0811 16:04:16.749555 (+   421us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.782234 (+ 32679us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.782483 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.773736 16155 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:16.820981 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:16.465345 16160 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.368s
I20260811 16:04:16.831483 15685 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:16.848568 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:16.849120 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.815424 16123 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:16.847420 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:16.686398 16142 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.536105 16171 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.290s
I20260811 16:04:16.819118 15617 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:16.822794 16126 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:16.792322 16097 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:16.358621 15948 rpcz_store.cc:276] 0811 16:04:08.776548 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.776722 (+   174us) service_pool.cc:227] Handling call
0811 16:04:08.946173 (+169451us) ts_tablet_manager.cc:928] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
0811 16:04:09.787212 (+841039us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e062a 00007f5c4e9e0552 00007f5c567fd691
0811 16:04:13.981175 (+4193963us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:04:15.503887 (+1522712us) tablet_metadata.cc:641] Metadata flushed
0811 16:04:15.544566 (+ 40679us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:04:16.203088 (+658522us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:04:16.224951 (+ 21863us) tablet_replica.cc:205] Creating consensus instance
0811 16:04:16.253730 (+ 28779us) ts_tablet_manager.cc:983] Replica registered.
0811 16:04:16.291205 (+ 37475us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":49482,"spinlock_wait_cycles":30454144,"tablet-copy.queue_time_us":168453,"thread_start_us":1078377,"threads_started":2}
W20260811 16:04:16.865275 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 399057us
I20260811 16:04:16.454712 13736 rpcz_store.cc:276] 0811 16:04:14.504304 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.266780 (+1762476us) service_pool.cc:227] Handling call
0811 16:04:16.267123 (+   343us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.297653 (+ 30530us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.303286 (+  5633us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.305303 (+  2017us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:16.343339 (+ 38036us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.353427 (+ 10088us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:16.365476 (+ 12049us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:16.847275 16166 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:16.809290 16080 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260811 16:04:16.850076 15989 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260811 16:04:16.870589 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 120027us
I20260811 16:04:16.745453 15936 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.849001 16201 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:16.849076 15685 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:16.852475 16123 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:16.846089 16014 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.912459 15948 tablet_copy_client.cc:791] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:04:16.934295 13904 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:16.874344 16168 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260811 16:04:16.900549 16166 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:16.912043 16107 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:16.938987 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54301.3us
I20260811 16:04:16.945712 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:16.945969 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:16.945523 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:16.929586 16123 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:16.885365 16126 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:16.998413 16126 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.924023 16164 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260811 16:04:17.000651 16004 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:17.001068 16004 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:16.971719 16205 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260811 16:04:16.940080 16097 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.002280 16097 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.002066 16004 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.003460 16004 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.005014 15950 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:17.006172 16092 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.000s
I20260811 16:04:17.006590 16111 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:16.975622 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:17.006995 16111 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:17.008049 16208 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260811 16:04:16.934052 15936 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:16.941243 16207 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260811 16:04:16.977172 16116 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.001s
I20260811 16:04:16.972373 15948 tablet_copy_client.cc:655] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:04:16.982589 16056 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:04:16.983050 16189 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260811 16:04:17.037369 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:16.983826 16192 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260811 16:04:16.984513 16195 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260811 16:04:16.985968 14575 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.703s	user 0.002s	sys 0.006s
I20260811 16:04:16.935312 16073 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:17.125545 14574 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.000s
I20260811 16:04:17.616664 14574 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
W20260811 16:04:17.617513 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 628) took 1467 ms (client timeout 1600 ms). Trace:
W20260811 16:04:17.617875 14574 rpcz_store.cc:269] 0811 16:04:16.150162 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.160940 (+ 10778us) service_pool.cc:227] Handling call
0811 16:04:17.617397 (+1456457us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:17.619798 16171 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:17.013501 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:17.094772 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.761251 13909 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:17.762688 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.038055 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:17.766625 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.133527 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 653) took 1202 ms. Trace:
I20260811 16:04:17.016602 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:16.994525 14581 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.005s
I20260811 16:04:17.777165 14581 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:17.779598 15957 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:17.780423 15957 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:17.782028 15957 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:17.787245 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:17.788271 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 630) took 1625 ms (client timeout 1698 ms). Trace:
W20260811 16:04:16.982031 16196 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260811 16:04:17.112461 16198 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260811 16:04:17.795921 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 644) took 3498 ms. Trace:
I20260811 16:04:17.796352 14579 rpcz_store.cc:276] 0811 16:04:14.296949 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.336591 (+2039642us) service_pool.cc:227] Handling call
0811 16:04:16.336889 (+   298us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.337247 (+   358us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.337271 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:16.337735 (+   464us) log.cc:842] Serialized 26 byte log entry
0811 16:04:16.455327 (+117592us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:16.455372 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.455438 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:17.795444 (+1340006us) raft_consensus.cc:1671] finished
0811 16:04:17.795481 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.795689 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":171,"thread_start_us":117235,"threads_started":1,"wal-append.queue_time_us":417869}
I20260811 16:04:17.171655 16199 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:17.799688 16199 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:17.801110 16199 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.802404 16199 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.112854 16211 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:17.040273 16213 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:17.803929 16211 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.804116 16213 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.806489 16211 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:17.806613 16213 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:17.381861 16197 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.577s	user 0.003s	sys 0.000s
I20260811 16:04:17.414975 13743 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:17.414963 13742 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:17.470544 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1645) took 2381 ms. Trace:
W20260811 16:04:17.490314 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2025) took 3227 ms (client timeout 1867 ms). Trace:
I20260811 16:04:17.500617 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:17.810652 13738 rpcz_store.cc:276] 0811 16:04:15.088638 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.276420 (+1187782us) service_pool.cc:227] Handling call
0811 16:04:16.351997 (+ 75577us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.357498 (+  5501us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.357534 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:16.357585 (+    51us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:16.357633 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.357717 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.469964 (+1112247us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540011dd50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.470269 (+   305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":158102272}
I20260811 16:04:17.812073 16213 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:17.812357 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 312170us
I20260811 16:04:17.813408 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1444) took 2246 ms. Trace:
I20260811 16:04:17.813820 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:17.504484 16218 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:17.524065 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.527076 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 622) took 1091 ms. Trace:
I20260811 16:04:17.536847 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.813834 13740 rpcz_store.cc:276] 0811 16:04:15.566703 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.306170 (+739467us) service_pool.cc:227] Handling call
0811 16:04:16.345345 (+ 39175us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.355547 (+ 10202us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.355589 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:16.356549 (+   960us) log.cc:842] Serialized 564 byte log entry
0811 16:04:16.448702 (+ 92153us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:16.448737 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.448797 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:17.380524 (+931727us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:17.808795 (+428271us) raft_consensus.cc:1671] finished
0811 16:04:17.808820 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.813187 (+  4367us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12854528,"thread_start_us":91806,"threads_started":1,"wal-append.queue_time_us":318421}
I20260811 16:04:17.505125 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.543035 13827 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260811 16:04:17.543982 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.539705 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:17.160828 15685 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.510727 16068 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:17.220104 16073 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.824294 16068 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.819415 13902 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:16.930925 15617 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260811 16:04:17.831521 15617 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:17.112881 15879 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.507004 15936 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:17.141983 15984 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.976341 15989 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:17.855685 16068 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.987882 16014 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:16.888298 16015 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.082595 16056 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:17.868942 16056 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:16.989071 16090 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:17.875015 16090 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:17.875738 15879 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:17.876827 16090 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.878187 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:16.931351 16103 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260811 16:04:17.881652 15950 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:17.882511 16103 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:17.036845 16116 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.230516 16123 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.893229 16056 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:17.878772 16090 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.894331 16116 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:17.894582 16123 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:16.999969 16137 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:17.896118 16137 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:17.427726 16158 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:17.172281 16162 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:17.227545 16174 raft_consensus.cc:2741] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
W20260811 16:04:17.102517 16106 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.952s	user 0.008s	sys 0.004s
I20260811 16:04:16.930265 16193 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:16.911500 16108 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.008129 16111 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:17.915776 16111 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:16.926466 16201 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:16.987787 16128 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.707s	user 0.005s	sys 0.005s
I20260811 16:04:17.041420 16204 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:17.935506 16193 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:17.001101 16164 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:17.097780 16166 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.103066 16172 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:17.581805 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:17.593701 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1442) took 2027 ms. Trace:
I20260811 16:04:17.598584 16160 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:17.942245 16166 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:17.942915 16160 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:17.943425 16160 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:17.621675 16171 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:04:17.622641 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.616703 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.947163 13817 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:17.947623 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.948173 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.949081 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.949652 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.950062 13825 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:17.950531 13817 raft_consensus.cc:2362] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:17.599000 13736 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:17.951305 13736 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:17.950969 16172 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.952379 13736 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.953676 13736 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:17.954174 16172 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:17.627684 15983 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
W20260811 16:04:17.669981 13789 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40896 dropped due to backpressure. The service queue is full; it has 50 items.
I20260811 16:04:17.676203 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.954878 15983 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:17.677675 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.683827 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.686611 16142 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:17.690166 14578 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:17.683017 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 335) took 3612 ms. Trace:
I20260811 16:04:17.698464 16216 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:17.732101 14544 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.512s (SENT)
W20260811 16:04:17.752753 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.024s	sys 0.036s
I20260811 16:04:17.755082 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 306) took 8904 ms. Trace:
W20260811 16:04:17.756597 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 835677us
I20260811 16:04:17.759826 13744 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:17.944509 16160 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.041435 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.759792 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:17.967114 13627 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 4, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:17.967952 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:17.080821 14575 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:17.963877 16201 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:17.941653 13737 rpcz_store.cc:276] 0811 16:04:15.566100 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.283981 (+717881us) service_pool.cc:227] Handling call
0811 16:04:16.284309 (+   328us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.292124 (+  7815us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.297857 (+  5733us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:16.383861 (+ 86004us) log.cc:842] Serialized 26 byte log entry
0811 16:04:16.822225 (+438364us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:16.834151 (+ 11926us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.838142 (+  3991us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:17.020781 (+182639us) raft_consensus.cc:1671] finished
0811 16:04:17.029581 (+  8800us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.593490 (+563909us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":180,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":129522,"threads_started":1,"wal-append.queue_time_us":448872}
W20260811 16:04:17.972005 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 658) took 1813 ms (client timeout 1749 ms). Trace:
W20260811 16:04:17.972491 14575 rpcz_store.cc:269] 0811 16:04:16.158322 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.257277 (+ 98955us) service_pool.cc:227] Handling call
0811 16:04:17.971807 (+1714530us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:17.973726 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:17.769886 16094 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:17.975591 16094 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.976297 16160 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.978071 16094 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:17.978852 16075 raft_consensus.cc:2741] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260811 16:04:17.958011 13735 rpcz_store.cc:276] 0811 16:04:14.070641 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.547758 (+1477117us) service_pool.cc:227] Handling call
0811 16:04:15.548172 (+   414us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:15.740302 (+192130us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:17.682391 (+1942089us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:17.682819 (+   428us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":137261952}
I20260811 16:04:17.980851 14574 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:17.982000 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 656) took 1896 ms. Trace:
I20260811 16:04:17.034582 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.770723 14580 rpcz_store.cc:276] 0811 16:04:15.930659 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.791166 (+860507us) service_pool.cc:227] Handling call
0811 16:04:16.791904 (+   738us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.827179 (+ 35275us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.827242 (+    63us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:16.878175 (+ 50933us) log.cc:842] Serialized 564 byte log entry
0811 16:04:16.964479 (+ 86304us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:16.964534 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.964645 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:17.133188 (+168543us) raft_consensus.cc:1671] finished
0811 16:04:17.133219 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.133436 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":85787,"threads_started":1,"wal-append.queue_time_us":228587}
I20260811 16:04:17.785351 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:17.985379 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:17.787058 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 770331us
I20260811 16:04:17.114739 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 626) took 3818 ms. Trace:
I20260811 16:04:17.789029 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.010710 13909 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:18.010967 13906 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.011315 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 626) took 1160 ms. Trace:
I20260811 16:04:17.789541 14582 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:17.790202 16004 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:17.809532 14579 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:18.011750 14575 rpcz_store.cc:276] 0811 16:04:16.850793 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:17.997825 (+1147032us) service_pool.cc:227] Handling call
0811 16:04:18.010526 (+ 12701us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.010891 (+   365us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.010919 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:18.010989 (+    70us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:18.011025 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.011079 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.011233 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:17.810252 13743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1648) took 1756 ms (client timeout 1711 ms). Trace:
W20260811 16:04:17.811257 14581 rpcz_store.cc:269] 0811 16:04:16.162761 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.217228 (+ 54467us) service_pool.cc:227] Handling call
0811 16:04:17.788018 (+1570790us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.788208 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":304524544}
I20260811 16:04:18.010373 14577 rpcz_store.cc:276] 0811 16:04:13.296360 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.296478 (+   118us) service_pool.cc:227] Handling call
0811 16:04:15.434510 (+2138032us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:15.434663 (+   153us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.049811 (+615148us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.049841 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:16.050279 (+   438us) log.cc:842] Serialized 26 byte log entry
0811 16:04:16.305996 (+255717us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:16.306020 (+    24us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:16.306069 (+    49us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:17.114240 (+808171us) raft_consensus.cc:1671] finished
0811 16:04:17.114270 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.114632 (+   362us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":45190,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":150,"spinlock_wait_cycles":4103424,"thread_start_us":838276,"threads_started":2,"wal-append.queue_time_us":326257}
I20260811 16:04:17.537477 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:18.016593 13743 rpcz_store.cc:269] 0811 16:04:16.053309 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.098078 (+ 44769us) service_pool.cc:227] Handling call
0811 16:04:17.809915 (+1711837us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.810107 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2947548544}
I20260811 16:04:18.017985 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:17.545426 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1931) took 3176 ms. Trace:
I20260811 16:04:17.816319 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.819970 16213 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:17.818954 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.819042 13908 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:18.021338 13823 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:17.818023 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:18.021442 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 647) took 2631 ms. Trace:
I20260811 16:04:17.829193 16073 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:18.023927 13826 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.816767 14573 rpcz_store.cc:276] 0811 16:04:16.054473 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.833352 (+778879us) service_pool.cc:227] Handling call
0811 16:04:16.885538 (+ 52186us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:16.923432 (+ 37894us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:16.927047 (+  3615us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:16.973343 (+ 46296us) log.cc:842] Serialized 26 byte log entry
0811 16:04:17.080113 (+106770us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:17.082765 (+  2652us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:17.099583 (+ 16818us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:17.145404 (+ 45821us) raft_consensus.cc:1671] finished
0811 16:04:17.145455 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:17.145684 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":67232,"threads_started":1,"wal-append.queue_time_us":169804}
I20260811 16:04:17.832053 15617 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:17.852556 15685 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:17.873508 13740 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260811 16:04:17.170163 16104 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:17.882488 15950 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.072985 14577 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.074929 15950 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:17.855964 15936 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:17.861531 15989 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:17.889883 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.076727 14577 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.076994 15989 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:18.077293 13738 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:17.891774 16103 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:17.892452 15957 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:17.895483 13739 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:17.899526 15879 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:17.900318 16162 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:17.899071 16158 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:18.090728 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1649) took 2037 ms. Trace:
I20260811 16:04:18.090281 16103 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.091339 16158 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.092041 16103 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.092679 16158 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:17.901384 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:17.903887 16106 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.088529 15879 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.097075 16106 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:17.908214 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:18.097606 15879 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:18.098027 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 190035us
I20260811 16:04:18.098186 16213 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:18.098816 16213 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:18.088856 15950 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.099886 16213 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.100946 14583 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:17.932255 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 295) took 1510 ms (client timeout 1676 ms). Trace:
I20260811 16:04:17.935665 13904 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:17.936474 16204 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:16.938375 16155 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260811 16:04:17.937238 16164 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:17.953709 16137 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:17.626233 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.034s	sys 0.034s
I20260811 16:04:17.957350 13820 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 2: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:17.957536 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.951036 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:17.961810 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.024s	sys 0.039s
W20260811 16:04:17.962630 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 230864us
I20260811 16:04:17.963864 16216 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:17.970602 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:17.984681 14580 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:17.982452 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 623) took 1862 ms. Trace:
I20260811 16:04:17.958565 13626 rpcz_store.cc:276] 0811 16:04:08.850469 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.867596 (+ 17127us) service_pool.cc:227] Handling call
0811 16:04:17.754800 (+8887204us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:13.319002 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:13.325161 (+  6159us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:13.325217 (+    56us) write_op.cc:435] Acquired schema lock
0811 16:04:13.325249 (+    32us) tablet.cc:660] Decoding operations
0811 16:04:13.347026 (+ 21777us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:13.355320 (+  8294us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:13.355366 (+    46us) tablet.cc:683] Acquiring locks for 2 operations
0811 16:04:13.437778 (+ 82412us) tablet.cc:699] Row locks acquired
0811 16:04:13.440387 (+  2609us) write_op.cc:260] PREPARE: finished
0811 16:04:14.285884 (+845497us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b2c001508a8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502feada 00007f5c502fe763 00007f5c502fe701 00007f5c51947b12 00007f5c519478ed 00007f5c5531b7a0 00007f5c5531b2b8 00007f5c5531fba1 00007f5c5531fb59 00007f5c5531fae9
0811 16:04:14.285950 (+    66us) write_op.cc:270] Start()
0811 16:04:14.286146 (+   196us) write_op.cc:276] Timestamp: P: 1786464253503113 usec, L: 0
0811 16:04:14.286164 (+    18us) op_driver.cc:331] REPLICATION: starting
0811 16:04:14.286855 (+   691us) log.cc:842] Serialized 987 byte log entry
0811 16:04:16.172956 (+1886101us) op_driver.cc:444] REPLICATION: finished
0811 16:04:16.365773 (+192817us) write_op.cc:301] APPLY: starting
0811 16:04:16.374127 (+  8354us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:16.374247 (+   120us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:16.374269 (+    22us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:16.406035 (+ 31766us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:16.672029 (+265994us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 16:04:16.683302 (+ 11273us) write_op.cc:312] APPLY: finished
0811 16:04:16.751362 (+ 68060us) log.cc:842] Serialized 29 byte log entry
0811 16:04:16.802411 (+ 51049us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:16.814935 (+ 12524us) write_op.cc:454] Released schema lock
0811 16:04:16.821567 (+  6632us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:16.846707 (+ 25140us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:16.848737 (+  2030us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":170470,"apply.run_cpu_time_us":3794,"apply.run_wall_time_us":512168,"num_ops":2,"prepare.queue_time_us":779282,"prepare.run_cpu_time_us":112411,"prepare.run_wall_time_us":2681347,"raft.queue_time_us":227186,"raft.run_cpu_time_us":9588,"raft.run_wall_time_us":113504,"replication_time_us":1886669,"spinlock_wait_cycles":35923200,"thread_start_us":2460433,"threads_started":4,"wal-append.queue_time_us":1638674,"wal-append.run_cpu_time_us":78238,"wal-append.run_wall_time_us":1921617}]]}
I20260811 16:04:17.982534 14578 rpcz_store.cc:276] 0811 16:04:16.085231 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.840872 (+755641us) service_pool.cc:227] Handling call
0811 16:04:17.689584 (+848712us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:17.961240 (+271656us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:17.981684 (+ 20444us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54004ce350. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.981918 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1950832896}
I20260811 16:04:17.984647 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:17.991464 16171 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260811 16:04:17.992004 13627 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 4, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:17.955322 13789 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40896 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2036)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2029)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2034)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2035)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2027)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2032)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2038)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2031)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1270)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40908 (request call id 1272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1280)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 401)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 420)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 421)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2030)
I20260811 16:04:17.956187 15983 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.012673 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 632) took 1838 ms. Trace:
I20260811 16:04:17.809654 16110 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.003288 16094 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260811 16:04:18.016180 14581 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:17.815019 16218 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.164428 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.164683 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 635) took 1292 ms. Trace:
I20260811 16:04:18.164853 16090 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:18.018684 13901 rpcz_store.cc:276] 0811 16:04:14.369058 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:15.381842 (+1012784us) service_pool.cc:227] Handling call
0811 16:04:15.416954 (+ 35112us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:16.146359 (+729405us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:17.544861 (+1398502us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54000343d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:17.545181 (+   320us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1566939904}
W20260811 16:04:17.810770 13818 rpcz_store.cc:269] 0811 16:04:14.262670 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:14.326363 (+ 63693us) service_pool.cc:227] Handling call
0811 16:04:17.489595 (+3163232us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400385c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.489936 (+   341us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3945994496}
I20260811 16:04:18.165992 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.166739 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:18.163700 16116 consensus_queue.cc:1159] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f46150fac70458986206ec7af67a403" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260811 16:04:18.155584 14574 rpcz_store.cc:276] 0811 16:04:16.120092 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:17.621474 (+1501382us) service_pool.cc:227] Handling call
0811 16:04:17.980382 (+358908us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:17.981504 (+  1122us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:17.982185 (+   681us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400437bd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.982330 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":823896832}
I20260811 16:04:18.167940 13818 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.168457 16216 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.154757 16164 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:18.030949 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 213258us
I20260811 16:04:18.170305 16110 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.160000 13627 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:04:18.172407 13627 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 1 to 3, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:18.173472 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1443) took 2607 ms. Trace:
I20260811 16:04:18.031023 13906 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.034713 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.173918 13741 rpcz_store.cc:276] 0811 16:04:15.566403 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.285777 (+719374us) service_pool.cc:227] Handling call
0811 16:04:17.810155 (+1524378us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.171904 (+361749us) raft_consensus.cc:1520] Early marking committed up to index 2
0811 16:04:18.171941 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:18.171978 (+    37us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:18.172001 (+    23us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.172539 (+   538us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:18.172579 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.173129 (+   550us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540011e250. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:18.173276 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":561,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":4336095360}
I20260811 16:04:18.174785 13827 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:18.175648 14575 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:18.165336 16090 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:18.176492 15989 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.033725 14573 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.049688 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.178769 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.048431 13907 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:18.061522 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.031807 16128 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:18.180442 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:17.859455 15984 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:18.080207 15936 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.081158 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.081333 15617 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.082685 16104 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:18.188723 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 218258us
I20260811 16:04:18.088351 15957 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.109513 16162 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.190021 16162 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:18.108872 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.191645 15957 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.191937 13738 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:18.110531 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 623) took 3764 ms. Trace:
I20260811 16:04:18.111647 15979 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.193184 15617 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.193240 15979 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:18.101464 13905 rpcz_store.cc:269] 0811 16:04:16.421361 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.421721 (+   360us) service_pool.cc:227] Handling call
0811 16:04:17.931835 (+1510114us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:17.932038 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3307524864}
I20260811 16:04:18.195745 13817 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:18.091180 13739 rpcz_store.cc:276] 0811 16:04:16.053566 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.348910 (+295344us) service_pool.cc:227] Handling call
0811 16:04:16.349176 (+   266us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.088281 (+1739105us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.090429 (+  2148us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:18.090648 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3555148544}
I20260811 16:04:18.100417 15950 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.197006 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.197841 13817 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.192950 14583 rpcz_store.cc:276] 0811 16:04:14.346328 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.371812 (+2025484us) service_pool.cc:227] Handling call
0811 16:04:16.383026 (+ 11214us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.106974 (+1723948us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.110212 (+  3238us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54006b44d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:18.110472 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3950053760}
I20260811 16:04:18.112917 16204 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.107640 15879 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.202736 15879 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.203171 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.203497 16015 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:18.205060 15879 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.205592 15879 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:18.205765 16068 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:18.114446 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:18.206255 16068 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:18.207453 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.207780 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.208367 13905 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:18.126281 13821 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:18.117154 16123 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:18.131860 13707 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.695s (SENT)
I20260811 16:04:18.209380 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 395) took 1168 ms. Trace:
I20260811 16:04:18.209476 16123 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.209904 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.209504 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:18.211776 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 80025.9us
I20260811 16:04:18.212420 13907 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:18.198882 15950 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.214125 16108 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:18.213268 13627 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 3, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 2 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:18.214354 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.209733 13821 rpcz_store.cc:276] 0811 16:04:17.041042 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:17.041168 (+   126us) service_pool.cc:227] Handling call
0811 16:04:18.209280 (+1168112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.219497 15936 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:18.145149 16233 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260811 16:04:18.228498 15936 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.125375 13826 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:18.154838 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.035s	sys 0.034s
W20260811 16:04:18.230479 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.19522e+06us
I20260811 16:04:18.153913 13825 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.233866 13827 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:18.234529 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.159631 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 660) took 1981 ms. Trace:
I20260811 16:04:18.235095 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.235334 14580 rpcz_store.cc:276] 0811 16:04:16.178209 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:17.983926 (+1805717us) service_pool.cc:227] Handling call
0811 16:04:17.984355 (+   429us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.156939 (+172584us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.159542 (+  2603us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.157403 13903 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:18.235924 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.161123 14579 rpcz_store.cc:276] 0811 16:04:16.174719 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:17.798283 (+1623564us) service_pool.cc:227] Handling call
0811 16:04:17.798810 (+   527us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.012414 (+213604us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.012600 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.236299 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.163744 16137 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:18.145794 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.711s (SENT)
I20260811 16:04:18.166195 16218 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:17.827865 15699 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:18.022140 14582 rpcz_store.cc:276] 0811 16:04:15.390116 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:16.458020 (+1067904us) service_pool.cc:227] Handling call
0811 16:04:17.789072 (+1331052us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.012179 (+223107us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.021212 (+  9033us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540065ed50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:18.021381 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3060362624}
I20260811 16:04:18.237468 15936 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.237504 15699 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.165077 14581 rpcz_store.cc:276] 0811 16:04:16.872089 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.015485 (+1143396us) service_pool.cc:227] Handling call
0811 16:04:18.015897 (+   412us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:18.164380 (+148483us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.164625 (+   245us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.166777 13820 raft_consensus.cc:2362] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:18.182018 16004 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260811 16:04:18.186465 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.240199 15699 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.244367 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.244589 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.245361 13903 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:18.181103 13823 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.246035 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.246665 13820 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.246942 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.247663 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.245585 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.247916 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.248417 13820 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:18.249112 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.249712 13822 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4. Re-sending same reply.
I20260811 16:04:18.201936 15984 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:18.250360 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.247525 15957 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:18.250989 15957 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:18.251396 13820 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 2: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:18.193478 16090 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.219424 16123 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.251534 13739 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.194787 14573 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:18.252143 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.217352 15979 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:18.189311 16110 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.218700 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.160199 16171 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:18.163640 15983 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.236805 13826 raft_consensus.cc:2396] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:18.170336 16164 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:18.247761 13823 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 2: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:18.188829 14542 connection.cc:232] RPC call timeout handler was delayed by -1.253893494955264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260811 16:04:18.264784 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.250548 13740 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.220253 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.251641 15957 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:18.272320 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.220753 14583 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:18.206192 15879 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.277047 15879 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.275034 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.252746 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:18.222193 13627 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:18.251235 13905 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:18.207330 16068 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.256752 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.257632 13825 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:18.254258 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.260427 13739 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:18.259651 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.198892 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:18.265012 14542 connection.cc:232] RPC call timeout handler was delayed by -1.1080934950150549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260811 16:04:18.249431 15699 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:18.266117 13827 raft_consensus.cc:2396] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:18.264864 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.268394 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.269946 13821 raft_consensus.cc:2396] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260811 16:04:18.270455 16237 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260811 16:04:18.271497 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:18.288358 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.290082 13741 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:18.279485 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.279103 13826 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:18.280943 13907 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.283896 13822 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.282964 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.284314 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.287511 13823 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:18.261508 16171 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:18.300863 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.296000 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:18.300372 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 158516us
I20260811 16:04:18.309207 14583 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:18.330834 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:18.299803 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.323993 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.342465 13826 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260811 16:04:18.292722 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.374584 13825 raft_consensus.cc:2396] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:18.381999 13740 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:18.302141 13822 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:18.305509 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.336917 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.296775 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:18.340040 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.755s (SENT)
I20260811 16:04:18.386344 14580 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260811 16:04:18.302412 16068 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.335412 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.390267 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.391880 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:18.392006 16110 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:18.392717 16110 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.394759 16110 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.396184 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:18.396335 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.397054 14583 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:18.397466 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:18.399466 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 146940us
I20260811 16:04:18.412645 13900 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:18.410213 13905 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:18.297315 16166 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:18.337905 16137 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.401118 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.299969 13824 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:04:18.426048 13824 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:04:18.426519 13824 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.317734 16201 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260811 16:04:18.407471 16106 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:18.407555 15989 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.408663 16128 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.436694 13737 raft_consensus.cc:2396] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:18.410760 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.411197 13820 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 1.
I20260811 16:04:18.411340 14583 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:18.410163 14577 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.438086 16106 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:18.411619 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.391721 16210 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:18.430025 16216 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.386919 14580 pending_rounds.cc:76] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 5
I20260811 16:04:18.439564 16216 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.419879 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.297006 16090 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.440671 13822 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:18.293339 15950 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:18.289589 16123 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:18.426533 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.430506 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.454566 13825 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:18.314677 14574 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:18.298166 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.455575 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.456875 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.432602 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.398670 15957 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.461642 15957 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.298058 16104 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.462808 16104 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.436980 16128 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.464129 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.464632 16128 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.437741 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:18.465220 15950 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:18.465652 15950 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:18.466017 15950 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.440122 14577 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260811 16:04:18.391765 16171 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.328672 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.469089 16171 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:18.430570 14575 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:18.452479 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:18.471352 13735 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:18.471186 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.472649 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.473242 14583 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.473366 13822 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:18.452471 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.454475 13826 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:18.475485 14582 raft_consensus.cc:2396] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:18.475358 13827 raft_consensus.cc:2362] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5. Re-sending same reply.
I20260811 16:04:18.476472 16108 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:18.412557 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.458721 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.439913 14580 pending_rounds.cc:97] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260811 16:04:18.477348 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 180736us
I20260811 16:04:18.477525 14580 raft_consensus.cc:2866] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:18.474553 13822 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.422260 16166 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:18.297621 16126 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260811 16:04:18.490327 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150347us
I20260811 16:04:18.490871 16247 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:18.491405 16247 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:18.493629 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:18.494011 16247 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.495955 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.481688 13827 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:04:18.488579 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.500342 14581 raft_consensus.cc:2396] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260811 16:04:18.505327 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 209395us
I20260811 16:04:18.451499 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.483222 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.441540 16204 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.481833 16166 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:18.515411 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69530.9us
I20260811 16:04:18.541523 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.519929 16210 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.521166 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.528506 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.529819 16201 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:18.531267 16075 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:18.532749 13736 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260811 16:04:18.546792 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 137625us
I20260811 16:04:18.535418 16204 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.487717 16108 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260811 16:04:18.537683 15936 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:18.539003 13906 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.545382 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:18.539556 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109576us
I20260811 16:04:18.435467 16137 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.543599 15957 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:18.555119 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.554234 13743 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:18.559813 13827 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.560423 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.565349 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1278) took 1001 ms. Trace:
I20260811 16:04:18.576789 13740 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:18.579694 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:18.575758 13827 rpcz_store.cc:276] 0811 16:04:17.559488 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.517849 (+958361us) service_pool.cc:227] Handling call
0811 16:04:18.559564 (+ 41715us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.560484 (+   920us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.560727 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.580444 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:18.554050 16123 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:18.587019 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:18.577379 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0060 after lost signal to thread 12388
W20260811 16:04:18.589083 13789 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.566s (SENT)
W20260811 16:04:18.564133 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70602.3us
I20260811 16:04:18.562026 16158 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260811 16:04:18.611477 16092 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260811 16:04:18.561590 15699 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260811 16:04:18.613049 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:18.613498 15699 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:18.614086 15699 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:18.614666 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:18.592749 15957 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:18.599077 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.601337 13817 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:18.601986 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 100217us
I20260811 16:04:18.602284 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1657) took 1591 ms. Trace:
I20260811 16:04:18.606660 16247 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.552529 16210 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.564098 16128 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:18.608680 13818 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:18.597164 16137 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.564498 16201 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:18.590049 16123 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:18.642035 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:18.615377 16104 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:18.614658 15747 tablet_copy_client.cc:531] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:04:18.571957 16068 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:18.629271 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.629650 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1274) took 1066 ms. Trace:
I20260811 16:04:18.633880 13825 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.589275 16103 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:18.598064 13823 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260811 16:04:18.653169 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66294us
W20260811 16:04:18.646410 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53999.3us
I20260811 16:04:18.631054 15699 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.656186 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.656855 13740 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:18.571332 15936 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.640468 16201 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:18.661883 16164 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:18.662436 16201 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.664321 16210 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:18.665839 16216 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.658161 16103 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:18.667604 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 85871.4us
I20260811 16:04:18.650596 16123 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:18.667963 13818 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:18.668535 16128 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:18.668426 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:18.658970 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0740 after lost signal to thread 13668
I20260811 16:04:18.631285 13736 rpcz_store.cc:276] 0811 16:04:16.998076 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:17.000575 (+  2499us) service_pool.cc:227] Handling call
0811 16:04:17.001070 (+   495us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:17.598656 (+597586us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000756a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190e300 00007f5c5190f371 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc
0811 16:04:18.551943 (+953287us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.583793 (+ 31850us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1084281088}
I20260811 16:04:18.669692 15936 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.671002 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1276) took 1116 ms. Trace:
I20260811 16:04:18.667884 15699 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:18.652962 13823 pending_rounds.cc:76] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 2
I20260811 16:04:18.710201 13825 rpcz_store.cc:276] 0811 16:04:17.554238 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.480481 (+926243us) service_pool.cc:227] Handling call
0811 16:04:18.630903 (+150422us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.669603 (+ 38700us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.670818 (+  1215us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002ab7d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:18.670942 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":280679680}
I20260811 16:04:18.672879 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.663494 16164 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:18.640249 16160 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:18.674335 13903 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:18.650866 13826 rpcz_store.cc:276] 0811 16:04:17.551827 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.475390 (+923563us) service_pool.cc:227] Handling call
0811 16:04:18.475728 (+   338us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:18.475960 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.475984 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:18.476498 (+   514us) log.cc:842] Serialized 26 byte log entry
0811 16:04:18.544172 (+ 67674us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:18.544209 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.544283 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:18.618177 (+ 73894us) raft_consensus.cc:1671] finished
0811 16:04:18.618212 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.618422 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":67203,"threads_started":1,"wal-append.queue_time_us":139738}
I20260811 16:04:18.678280 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1268) took 1139 ms. Trace:
I20260811 16:04:18.635557 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 408) took 1011 ms. Trace:
W20260811 16:04:18.679908 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65327.1us
I20260811 16:04:18.680518 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.679488 13824 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:18.683642 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 98096.9us
I20260811 16:04:18.686522 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.686394 15957 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.687925 13735 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:18.690733 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:18.696082 13740 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:18.697458 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.704617 13904 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:18.650812 16104 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:18.709661 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.710789 13823 pending_rounds.cc:97] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260811 16:04:18.631594 16110 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:18.678264 16103 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:18.673801 16204 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:18.658337 15950 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:18.840137 13823 raft_consensus.cc:2866] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:04:18.840345 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 124636us
I20260811 16:04:18.840948 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.842002 13906 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:18.842264 13825 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:18.842849 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 400) took 1229 ms. Trace:
I20260811 16:04:18.843047 13825 rpcz_store.cc:276] 0811 16:04:17.613756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.711339 (+1097583us) service_pool.cc:227] Handling call
0811 16:04:18.842134 (+130795us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.842640 (+   506us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.842804 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.705806 16216 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.845350 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1279) took 1283 ms. Trace:
I20260811 16:04:18.843958 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:18.848845 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 401) took 1234 ms. Trace:
I20260811 16:04:18.849254 13826 rpcz_store.cc:276] 0811 16:04:17.614055 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.722659 (+1108604us) service_pool.cc:227] Handling call
0811 16:04:18.848354 (+125695us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.848538 (+   184us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.848561 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:18.848603 (+    42us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:18.848631 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.848681 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.848789 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.851486 13739 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:18.852423 13820 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:18.846331 13821 rpcz_store.cc:276] 0811 16:04:17.538763 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.298567 (+759804us) service_pool.cc:227] Handling call
0811 16:04:18.371485 (+ 72918us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:18.375175 (+  3690us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.375210 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:18.395451 (+ 20241us) log.cc:842] Serialized 26 byte log entry
0811 16:04:18.513150 (+117699us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:18.513206 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.513309 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:18.650239 (+136930us) raft_consensus.cc:1671] finished
0811 16:04:18.650267 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.672329 (+ 22062us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b540014d7d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:18.678185 (+  5856us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":166788352,"thread_start_us":117260,"threads_started":1,"wal-append.queue_time_us":182931}
I20260811 16:04:18.848073 13823 rpcz_store.cc:276] 0811 16:04:17.561494 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.597117 (+1035623us) service_pool.cc:227] Handling call
0811 16:04:18.597574 (+   457us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.845089 (+247515us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.845291 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.792574 16126 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.854808 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.841941 16104 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:18.839952 16110 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:18.715873 16164 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:18.867575 13824 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:18.724638 13901 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:18.864665 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:18.871532 13906 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:18.869189 13825 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:18.825699 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.812s (SENT) [suppressed 39 similar messages]
I20260811 16:04:18.845170 16160 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:18.866627 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.722232 15685 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260811 16:04:18.908090 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 421) took 1269 ms. Trace:
I20260811 16:04:18.840154 15936 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260811 16:04:18.839634 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1281) took 1150 ms. Trace:
I20260811 16:04:18.889947 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 410) took 1254 ms. Trace:
W20260811 16:04:18.910956 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 266448us
I20260811 16:04:18.912215 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40908 (request call id 1272) took 1322 ms. Trace:
I20260811 16:04:18.861999 16248 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
W20260811 16:04:18.923120 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56630.4us
I20260811 16:04:18.920801 13824 rpcz_store.cc:276] 0811 16:04:17.549354 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.299821 (+750467us) service_pool.cc:227] Handling call
0811 16:04:18.871239 (+571418us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.913250 13821 rpcz_store.cc:276] 0811 16:04:17.638698 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.858616 (+1219918us) service_pool.cc:227] Handling call
0811 16:04:18.876105 (+ 17489us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.907657 (+ 31552us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.907703 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:18.907763 (+    60us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:18.907811 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.907881 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.908027 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.917140 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:18.924289 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71186.7us
I20260811 16:04:18.863081 16199 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:18.866720 16171 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:18.877362 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 420) took 1230 ms. Trace:
W20260811 16:04:18.921427 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80338us
W20260811 16:04:18.916090 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9ba0 after lost signal to thread 13771
W20260811 16:04:18.904050 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 213412us
I20260811 16:04:18.712873 16201 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:18.918602 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92943.8us
I20260811 16:04:18.875356 16110 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:18.925741 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 241013us
I20260811 16:04:18.877946 13737 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:18.920542 13825 rpcz_store.cc:276] 0811 16:04:17.635176 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.849190 (+1214014us) service_pool.cc:227] Handling call
0811 16:04:18.868948 (+ 19758us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.874832 (+  5884us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.889827 (+ 14995us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.928941 13823 rpcz_store.cc:276] 0811 16:04:17.638390 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.856721 (+1218331us) service_pool.cc:227] Handling call
0811 16:04:18.857896 (+  1175us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.868201 (+ 10305us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.868237 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:18.868317 (+    80us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:18.868556 (+   239us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.868623 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:18.868734 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.930410 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:18.852800 13817 rpcz_store.cc:276] 0811 16:04:17.624504 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.198600 (+574096us) service_pool.cc:227] Handling call
0811 16:04:18.631185 (+432585us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.936106 16155 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260811 16:04:18.937003 16090 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:04:18.921320 16075 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:18.938246 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:18.865487 16216 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:18.938740 13824 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260811 16:04:18.863265 16128 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260811 16:04:18.940140 13821 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.922523 15989 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:18.954095 13822 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:18.955966 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:18.950120 14579 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.960341 13824 pending_rounds.cc:76] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:04:18.969645 13824 pending_rounds.cc:97] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260811 16:04:18.969955 13824 raft_consensus.cc:2866] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:18.948833 13825 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:18.862893 16126 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:18.936036 16249 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260811 16:04:18.963277 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:18.971453 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2030) took 1307 ms. Trace:
I20260811 16:04:18.933282 16248 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:18.991613 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.997630 13739 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:18.995770 13821 rpcz_store.cc:276] 0811 16:04:17.664417 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.924820 (+1260403us) service_pool.cc:227] Handling call
0811 16:04:18.939906 (+ 15086us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.971234 (+ 31328us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.971399 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:19.001698 16248 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.002266 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:19.002394 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:18.949781 16201 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.005661 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:18.961351 16171 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:18.920408 13818 rpcz_store.cc:276] 0811 16:04:17.572440 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.667416 (+1094976us) service_pool.cc:227] Handling call
0811 16:04:18.667780 (+   364us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.705694 (+ 37914us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.723082 (+ 17388us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:18.943462 16199 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.007815 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:19.008306 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60500.5us
I20260811 16:04:19.009004 16108 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:19.011247 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1280) took 1449 ms. Trace:
I20260811 16:04:19.040712 13827 rpcz_store.cc:276] 0811 16:04:17.562132 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.598851 (+1036719us) service_pool.cc:227] Handling call
0811 16:04:18.599653 (+   802us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:18.600186 (+   533us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:18.600235 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:18.601626 (+  1391us) log.cc:842] Serialized 564 byte log entry
0811 16:04:18.841581 (+239955us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:18.841620 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:18.841703 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:19.010930 (+169227us) raft_consensus.cc:1671] finished
0811 16:04:19.010956 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:19.011127 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":239523,"threads_started":1,"wal-append.queue_time_us":406905}
I20260811 16:04:19.013437 16126 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:19.006953 13742 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:18.949360 16250 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:19.023841 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:19.024760 14542 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.676s (SENT)
I20260811 16:04:19.025398 16201 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:18.933122 16210 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260811 16:04:18.977689 16244 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:19.035100 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:18.956277 16204 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260811 16:04:18.949136 15685 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260811 16:04:19.067631 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1277) took 1483 ms. Trace:
I20260811 16:04:19.005906 15989 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:19.076467 13743 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:19.096829 14541 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:19.076372 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59300.1us
I20260811 16:04:19.081805 13822 rpcz_store.cc:276] 0811 16:04:17.557052 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.498097 (+941045us) service_pool.cc:227] Handling call
0811 16:04:18.953916 (+455819us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:18.968390 (+ 14474us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:19.036690 (+ 68300us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b540029fc50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:19.040307 (+  3617us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1047596416}
I20260811 16:04:18.965065 16166 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.079223 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:19.083467 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.068941 16250 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:19.032171 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08003a80c0 after lost signal to thread 13856
I20260811 16:04:19.014947 16160 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:19.093974 13901 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.045765 16108 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:19.134553 14581 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.040s	sys 0.016s
W20260811 16:04:19.135025 14581 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.040s	sys 0.016s
I20260811 16:04:19.094692 15989 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.091790 15950 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.104354 16137 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260811 16:04:19.129905 16244 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:19.146956 16247 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260811 16:04:19.132375 16108 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:19.151782 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 127056us
I20260811 16:04:19.127405 16250 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:19.141019 16201 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:19.156625 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.164467 13901 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:04:19.156936 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 163985us
I20260811 16:04:19.165190 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.160812 13823 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:19.156713 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.145100 15989 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:19.168377 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:19.149300 15950 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:19.167573 15685 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:19.153468 16244 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.148525 16216 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.175733 13906 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:19.153952 16075 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:19.181083 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.163523 16210 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
W20260811 16:04:19.168954 14607 debug-util.cc:398] Leaking SignalData structure 0x7b0800380b20 after lost signal to thread 13941
W20260811 16:04:19.186358 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 230466us
I20260811 16:04:19.184008 13906 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:19.168329 15957 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260811 16:04:19.199510 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206980us
W20260811 16:04:19.188133 14607 debug-util.cc:398] Leaking SignalData structure 0x7b0800380ce0 after lost signal to thread 13942
I20260811 16:04:19.179942 16244 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.194897 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:19.206347 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.207063 13906 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:19.210167 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:19.210791 13743 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.186112 16210 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:19.194481 16201 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:19.196856 15983 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:19.179419 15950 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.168601 16171 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:19.228215 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59950us
W20260811 16:04:19.217299 15699 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
W20260811 16:04:19.219897 14607 debug-util.cc:398] Leaking SignalData structure 0x7b080039b840 after lost signal to thread 14610
I20260811 16:04:19.212981 16199 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.259003 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.191534 15685 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:04:19.262843 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45348.2us
I20260811 16:04:19.265162 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.266299 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.247910 16166 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:19.259048 14607 debug-util.cc:398] Leaking SignalData structure 0x7b080039b860 after lost signal to thread 14611
W20260811 16:04:19.270153 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69267.5us
W20260811 16:04:19.274354 13707 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.758s (SENT)
I20260811 16:04:19.267258 16247 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:19.277354 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.278303 13740 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260811 16:04:19.275178 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 95247.4us
I20260811 16:04:19.279626 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.279915 13742 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.227859 15936 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260811 16:04:19.280907 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.268527 16199 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260811 16:04:19.281441 15936 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:19.281872 15936 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.282186 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:19.281077 16255 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260811 16:04:19.284512 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.285213 13904 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:19.286192 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.286810 13903 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:19.286861 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.270534 16204 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260811 16:04:19.288033 13900 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:19.288372 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.285231 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.289440 13907 raft_consensus.cc:2362] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4. Re-sending same reply.
I20260811 16:04:19.268776 16261 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260811 16:04:19.290397 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.290795 16261 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:19.291203 16261 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:19.292068 16261 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:19.268157 15699 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:19.293804 14607 debug-util.cc:398] Leaking SignalData structure 0x7b0800340760 after lost signal to thread 16003
I20260811 16:04:19.293632 15699 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:19.294842 14607 debug-util.cc:398] Leaking SignalData structure 0x7b080033f4a0 after lost signal to thread 16175
I20260811 16:04:19.296756 15699 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.287475 13901 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:19.312839 16068 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:19.313097 15747 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:04:19.313273 16068 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:19.314239 16068 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.275959 16247 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:19.315471 16247 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:19.315915 13902 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:19.270354 16216 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260811 16:04:19.298161 16269 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:19.299575 15950 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.320657 16103 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:19.274024 15983 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:19.282226 15936 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:19.301043 16261 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:19.302799 16123 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260811 16:04:19.272629 16210 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.303613 15989 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:19.304970 16256 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260811 16:04:19.305428 13736 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.308246 16075 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:19.288033 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.230209 16201 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.348250 13909 raft_consensus.cc:2362] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4. Re-sending same reply.
I20260811 16:04:19.309744 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:19.345453 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63382.2us
I20260811 16:04:19.349763 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:19.354319 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 307922us
I20260811 16:04:19.337832 13901 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:19.310202 16126 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:19.346947 16269 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:19.364638 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.364835 16269 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.363927 16166 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:19.365300 14579 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:19.361281 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.351425 16075 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:19.362704 15957 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:19.370437 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.359297 16068 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.374465 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.360522 13737 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260811 16:04:19.343099 16123 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.367053 16210 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.382882 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.380203 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.359022 15950 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:19.378283 13906 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:19.376003 16126 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:19.381651 16216 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260811 16:04:19.387792 16090 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:19.387879 15957 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.380399 13737 pending_rounds.cc:76] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 2
I20260811 16:04:19.391855 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.392661 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.423919 13907 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:19.392068 16110 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.390663 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.377419 16166 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:19.393393 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.394482 13903 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:19.359206 16262 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:19.395499 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.396261 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.395064 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:19.390956 16263 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260811 16:04:19.373327 15685 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.377238 16075 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.448212 16075 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.416455 16090 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:19.389032 16201 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.417201 13826 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.450186 16090 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.420894 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.451453 14580 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:19.451581 16090 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:19.421206 14583 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:19.421612 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:19.422538 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 112923us
I20260811 16:04:19.424950 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.454026 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:19.359836 16250 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.430166 13902 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:19.460486 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:19.429610 13737 pending_rounds.cc:97] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260811 16:04:19.462644 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.465070 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:19.433681 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57996.7us
I20260811 16:04:19.434244 13743 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:19.371071 16247 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.437638 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:19.441977 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86043.6us
I20260811 16:04:19.412108 15983 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:19.403707 15950 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:19.458681 13744 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:19.462193 16250 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:19.417783 16126 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.435432 16275 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260811 16:04:19.419504 16244 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.535979 14581 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:19.479689 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:19.535781 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 153943us
I20260811 16:04:19.479262 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:19.550467 13743 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:19.444026 16108 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.521960 16128 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:19.513278 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48334.9us
I20260811 16:04:19.466867 13737 raft_consensus.cc:2866] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:04:19.511374 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47421.4us
I20260811 16:04:19.552737 13823 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:19.469798 16265 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:19.558063 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:19.469573 16160 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:19.480592 15983 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.569734 16269 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.559303 16274 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.204s
I20260811 16:04:19.533617 16171 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:19.550012 15950 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:19.550040 16103 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:19.552765 15989 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.628103 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.632473 15957 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.632690 16244 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:19.633189 16123 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.605334 16166 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.605285 16158 raft_consensus.cc:465] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Not starting pre-election -- already a leader
I20260811 16:04:19.727433 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:19.636593 15936 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:19.637859 13735 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.638418 13737 pending_rounds.cc:76] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 2
I20260811 16:04:19.639932 16126 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:19.641086 16247 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:19.641963 13744 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:04:19.563351 16160 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.642818 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:19.644455 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:19.752187 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.645504 16271 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:19.646416 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 419) took 2008 ms. Trace:
I20260811 16:04:19.647760 16201 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:19.651368 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.636727 14579 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:19.652472 16110 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.654771 13822 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:19.655570 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.562036 16128 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:19.559535 16265 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:19.661147 16108 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.671134 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.560856 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.670250 13909 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:19.571256 16092 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:19.674299 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 120208us
I20260811 16:04:19.677953 13738 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260811 16:04:19.763396 16160 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:19.679390 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:19.468945 16116 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:19.683571 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.679221 13824 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:19.819871 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.701166 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.820575 13909 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:19.701839 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:19.821216 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 120144us
I20260811 16:04:19.709052 13740 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:19.708180 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.718538 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.684599 15983 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:19.720077 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:19.701788 16104 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.826s	user 0.020s	sys 0.007s
I20260811 16:04:19.772128 16201 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:19.722544 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.826005 13900 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:19.722958 13905 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:19.699903 16155 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:19.704612 16199 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:19.763489 13823 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:19.764117 13826 rpcz_store.cc:276] 0811 16:04:17.638070 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:18.850454 (+1212384us) service_pool.cc:227] Handling call
0811 16:04:18.863747 (+ 13293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:19.450986 (+587239us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:19.646173 (+195187us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400355554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:19.646355 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1272237952}
I20260811 16:04:19.700539 16276 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260811 16:04:19.789974 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.797230 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:19.814872 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 172177us
I20260811 16:04:19.785073 14583 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:19.794008 13743 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:19.765327 13737 pending_rounds.cc:97] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260811 16:04:19.678984 13821 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:19.763954 16271 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:19.821404 13906 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.708796 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:19.843747 13902 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.824064 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:19.823326 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.719540 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.765158 16273 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:19.827487 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:19.822398 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 256493us
W20260811 16:04:19.836371 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 152927us
I20260811 16:04:19.815722 16265 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:19.794082 16274 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:19.850061 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.854249 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.825201 16108 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:19.829581 15957 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:19.855708 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.856550 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.857192 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.858320 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.819161 16092 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:19.860474 13903 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260811 16:04:19.826279 13818 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260811 16:04:19.823354 16116 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:19.880456 15957 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.853202 13737 raft_consensus.cc:2866] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:19.819399 16110 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260811 16:04:19.853498 16273 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.840289 16158 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:19.851976 16199 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.842068 16155 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:19.865352 16103 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260811 16:04:19.831223 16104 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.895133 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.890148 13739 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.872294 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.861791 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.862452 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:19.819252 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:19.862872 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:19.855558 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:19.864794 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:19.865795 13827 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:19.873199 14577 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260811 16:04:19.874346 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:19.877375 16281 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260811 16:04:19.878288 14573 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260811 16:04:19.900125 13905 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:19.889559 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:19.903175 13902 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:19.893127 14583 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:19.897346 13900 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:19.931787 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:19.935921 13821 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
W20260811 16:04:19.936196 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 93966.3us
I20260811 16:04:19.896926 14580 raft_consensus.cc:2362] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3. Re-sending same reply.
I20260811 16:04:19.938325 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:19.889216 16092 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:19.869138 16108 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:19.937054 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:19.889752 16244 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:19.890638 15948 tablet_copy_client.cc:531] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:04:19.951218 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:19.890034 16068 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260811 16:04:19.873853 16137 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:19.951905 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.886266 16199 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:19.886013 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.884073 16273 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:19.954337 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:19.986991 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:19.882226 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:19.956370 14577 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:19.889021 16104 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:19.989632 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52709us
I20260811 16:04:19.915994 16158 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:19.992267 16158 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:19.992045 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:19.993635 16158 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:19.887329 16103 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
W20260811 16:04:19.975015 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 85521.8us
I20260811 16:04:19.995730 16103 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:19.996732 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:19.998447 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:19.998749 16075 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:19.922358 13817 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:20.003369 16269 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:20.003831 16269 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:20.004474 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 319261us
I20260811 16:04:20.005764 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:20.004838 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.004207 16269 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:19.932554 16276 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:19.983551 16299 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:19.988373 14575 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:20.008116 13908 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260811 16:04:19.976590 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113771us
I20260811 16:04:19.952847 16262 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:20.007300 13738 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:19.922942 16123 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260811 16:04:19.914950 16247 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260811 16:04:19.974148 16108 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:19.931533 16210 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260811 16:04:20.007416 16283 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:20.015457 13739 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:20.015717 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78687.4us
I20260811 16:04:20.070425 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.071909 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:20.005801 16251 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260811 16:04:20.018296 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:19.985333 16137 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.041711 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:19.890425 16286 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260811 16:04:19.952968 16275 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260811 16:04:19.884090 16201 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.014194 16276 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:19.954226 15685 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260811 16:04:19.886241 16271 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:19.892419 16164 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.091977 16164 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.052657 16116 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.096122 16116 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:20.097821 15957 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.013315 16261 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:20.014402 16250 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:20.018895 16068 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:20.042752 15699 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:20.016450 15936 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:20.068987 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72787.6us
I20260811 16:04:20.075753 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:19.996857 16103 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.085310 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.112859 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:20.075515 16137 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.085253 16204 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:20.083683 16299 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:20.089360 16075 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:20.159590 13827 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:20.055788 16155 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.098938 16171 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:20.169752 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:20.140655 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:20.089109 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 234586us
I20260811 16:04:20.142400 13906 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:20.076542 16128 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.049471 16262 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.090015 16104 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:20.170476 14583 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:20.166595 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:20.166993 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 81786.9us
I20260811 16:04:20.100889 16276 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.190074 13824 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:20.196444 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 95664.5us
I20260811 16:04:20.139449 16068 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.138432 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:20.204080 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.205034 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.188702 16264 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:20.166847 16301 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:20.205389 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.172066 16216 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.169922 16171 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:20.213476 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:20.189002 13900 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:20.223687 13900 raft_consensus.cc:595] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.223554 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.224162 13900 raft_consensus.cc:603] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:20.212818 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:20.219256 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:20.224854 13740 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.193617 16275 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:20.220149 13907 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:20.220453 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 79890.7us
I20260811 16:04:20.221016 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:20.217399 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:20.189729 16305 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:20.192512 16155 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:20.226588 13906 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:20.189808 16300 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:20.206985 16068 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.210949 16103 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.219116 16264 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.237507 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:20.239380 16313 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:20.240743 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:20.241470 16316 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.241971 16316 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.245059 15957 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:20.244951 16319 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:20.247576 16319 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.248541 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.249220 13908 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:20.227635 15936 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:20.262423 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:20.228231 16155 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:20.247952 16319 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.230788 16300 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:20.236907 16264 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:20.283612 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46207.8us
I20260811 16:04:20.246682 16126 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260811 16:04:20.228010 16216 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.231110 16275 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.300963 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.287518 16300 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.291865 15936 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:20.306051 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79883.2us
I20260811 16:04:20.286904 16301 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:20.278463 16204 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260811 16:04:20.245185 16316 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:20.192121 16164 consensus_queue.cc:1159] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:04:20.304230 16123 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:20.293591 16250 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:20.297637 16299 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:20.304953 16304 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
W20260811 16:04:20.319577 16289 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260811 16:04:20.320169 16262 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.321761 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:20.325578 16314 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:20.344404 13740 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:20.367796 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:20.309113 16075 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:20.356109 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:20.371644 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:20.351285 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 279424us
I20260811 16:04:20.311419 15936 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:20.353269 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 310271us
I20260811 16:04:20.311439 16199 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:20.314944 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:20.363436 13900 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:20.311033 16307 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:20.377504 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.293913 16171 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.354339 16316 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:20.345151 16299 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:20.392805 13900 raft_consensus.cc:595] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:20.397225 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 179889us
I20260811 16:04:20.383538 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:20.375679 16293 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260811 16:04:20.370986 16075 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.366266 16314 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:20.366428 16262 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.419303 16306 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
W20260811 16:04:20.419837 16292 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260811 16:04:20.419543 16250 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.311694 16155 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.375725 15936 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.412360 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.454373 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.396909 13735 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:20.399931 16304 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
W20260811 16:04:20.459854 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 81738.5us
I20260811 16:04:20.398362 16199 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:20.467375 16199 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:20.467439 16216 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.467811 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.468475 16323 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.468314 16299 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.468998 16323 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.469692 16299 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:20.454536 16331 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:20.471719 16331 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:20.472074 13817 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:20.473497 15699 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:20.474016 15699 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:20.475525 13706 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:04:20.456398 16262 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.456238 16320 raft_consensus.cc:2741] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260811 16:04:20.459996 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53208.2us
I20260811 16:04:20.480913 16262 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.481448 16262 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.481900 16262 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.396670 16316 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:20.483325 16155 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:20.484033 16316 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.397584 16283 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:20.484823 16108 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.485795 16283 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:20.487166 16265 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.000s
I20260811 16:04:20.487572 16265 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:20.488670 16298 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260811 16:04:20.421074 16290 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260811 16:04:20.416365 16075 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.466034 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.486884 16108 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:20.519748 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 312829us
I20260811 16:04:20.453444 16307 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:20.490442 16160 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.625s	user 0.005s	sys 0.005s
I20260811 16:04:20.456094 16306 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:20.547751 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:20.544437 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:20.549774 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82038.6us
I20260811 16:04:20.489284 16204 raft_consensus.cc:2741] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260811 16:04:20.553506 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:20.498648 16304 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:20.520879 16171 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:20.472095 16331 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.563812 13740 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:20.520860 16104 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:20.538496 13736 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:20.567018 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 110655us
I20260811 16:04:20.539480 16320 raft_consensus.cc:2741] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260811 16:04:20.574826 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 121381us
I20260811 16:04:20.538204 15989 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.538995 16313 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.520413 16323 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:20.571272 16269 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260811 16:04:20.554780 16108 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.623674 16108 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.582472 16314 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.625734 16317 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:20.626376 16317 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:20.626504 16326 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:20.626852 16317 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.627249 16326 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:20.627970 16325 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260811 16:04:20.627700 16304 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.629070 16265 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:20.629591 16326 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.629969 16333 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:20.630255 16326 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260811 16:04:20.631621 16324 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260811 16:04:20.631525 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:20.564282 16216 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:20.580384 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.644519 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1684) took 1296 ms. Trace:
I20260811 16:04:20.514389 16264 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.556192 16160 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.659374 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:20.649266 13741 rpcz_store.cc:276] 0811 16:04:19.347639 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:19.348905 (+  1266us) service_pool.cc:227] Handling call
0811 16:04:19.358787 (+  9882us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:19.371428 (+ 12641us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:19.371475 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:19.403586 (+ 32111us) log.cc:842] Serialized 26 byte log entry
0811 16:04:19.756820 (+353234us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:19.756858 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:19.756921 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:20.644281 (+887360us) raft_consensus.cc:1671] finished
0811 16:04:20.644301 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:20.644458 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":13257,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4061,"thread_start_us":292299,"threads_started":1,"wal-append.queue_time_us":568866}
I20260811 16:04:20.649798 16269 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.662828 16318 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:20.663548 16318 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.664626 16269 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:20.665262 16269 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.666011 16318 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:20.665791 16269 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.667508 16303 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:20.667841 14577 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:20.668401 16332 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260811 16:04:20.669085 16309 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260811 16:04:20.670274 16309 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:04:20.670632 16309 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:20.671375 16269 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.671561 16309 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.660535 14580 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:20.421561 16301 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.632524 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:20.638815 16108 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.583899 15989 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.555227 16307 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.583319 16313 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.649897 16201 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.667518 16334 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:20.654289 14573 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:20.757634 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 209951us
W20260811 16:04:20.741575 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 161236us
W20260811 16:04:20.733350 15950 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.023s	user 0.006s	sys 0.007s
W20260811 16:04:20.718179 16273 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.000s
I20260811 16:04:20.780529 16273 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:20.699857 15983 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.000s
I20260811 16:04:20.774634 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:20.782965 13906 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.785130 16317 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:20.772445 16103 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.005s
I20260811 16:04:20.787647 13742 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:20.788760 13905 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:20.774794 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.776553 13903 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260811 16:04:20.729296 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 188880us
I20260811 16:04:20.718070 16306 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.842919 13904 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:04:20.844645 16320 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:20.845229 13902 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:20.779791 16160 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:20.779585 15950 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:20.830295 16137 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.004s
I20260811 16:04:20.847958 16137 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.848655 15950 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.849656 13743 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:20.658587 16275 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:20.813977 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.715116 16336 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.816531 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:20.817031 16340 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260811 16:04:20.817557 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.820792 15948 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:04:20.821012 16273 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.822324 14579 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260811 16:04:20.821805 15936 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.823056 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:20.872213 13742 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:20.823539 15983 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.893889 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:20.894925 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:20.824273 16158 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:20.826251 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:20.769510 16330 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:20.827188 14575 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:20.827533 16271 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:20.827896 16281 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260811 16:04:20.832094 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:20.835824 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:20.837848 13706 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:04:20.909785 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72099.7us
I20260811 16:04:20.909818 13909 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:20.745797 16326 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:20.914996 16244 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.004s
I20260811 16:04:20.915477 16244 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:20.915241 16326 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.916283 14583 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:20.916510 15989 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.901329 16320 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:20.917234 16320 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.918443 16326 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.918936 15983 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.840348 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:20.920214 16320 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:20.920521 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 80255.8us
I20260811 16:04:20.921023 15950 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:20.921660 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:20.921626 15950 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.923761 16356 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:20.924187 16356 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.924710 16356 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:20.673242 16309 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:04:20.840673 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65958.8us
I20260811 16:04:20.898957 16158 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:20.844817 15699 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.656665 16216 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.732928 13737 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:20.770886 16262 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.787290 16339 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260811 16:04:20.867990 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:20.947777 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 79922.1us
I20260811 16:04:20.949368 16301 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:20.903769 16330 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:20.864635 16347 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:20.785142 16302 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:20.899495 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:20.866778 16068 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.003s
I20260811 16:04:20.852479 16137 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:20.852952 16334 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:20.908771 13744 raft_consensus.cc:2354] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:20.908934 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:20.882028 16317 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:20.959904 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:20.960574 13904 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:20.951589 16335 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260811 16:04:20.934303 13735 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:20.964300 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:20.938928 16273 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:20.965623 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:20.957435 16330 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:20.952016 16068 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.953475 15950 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.955804 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:20.938997 16199 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:20.972805 16316 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.973268 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:20.912410 16319 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260811 16:04:20.914482 15936 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.928922 13909 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:20.779260 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:20.933439 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.939935 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:20.940686 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:20.942196 13906 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:20.908722 16264 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:20.945503 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:20.911432 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:20.976924 13901 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:20.879429 16336 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:20.987957 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:20.986451 16092 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.980s	user 0.012s	sys 0.000s
I20260811 16:04:20.990929 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:21.046813 13907 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.941730 16261 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
W20260811 16:04:21.038242 16354 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260811 16:04:21.056401 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 373) took 1362 ms. Trace:
I20260811 16:04:21.058198 13743 rpcz_store.cc:276] 0811 16:04:19.695331 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.015078 (+319747us) service_pool.cc:227] Handling call
0811 16:04:20.045509 (+ 30431us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:20.850091 (+804582us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:21.056155 (+206064us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400346cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:21.056336 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1848992000}
I20260811 16:04:21.038384 16313 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.039002 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.039193 15983 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:21.037052 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:21.060918 14578 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:21.043105 13900 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:20.949848 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:21.044317 13902 raft_consensus.cc:595] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:20.982239 13742 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:21.059854 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:21.048785 14579 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.051432 13904 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:21.053956 15699 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.054571 16092 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.067418 16068 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:21.068140 14573 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:21.068310 16116 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.972s	user 0.012s	sys 0.004s
I20260811 16:04:21.069157 16092 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.070575 13735 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:21.078303 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.078961 13826 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:21.055685 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:20.953615 16347 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:21.081203 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:21.082383 13906 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:21.056730 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:20.949885 16301 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:21.047899 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:21.062181 13902 raft_consensus.cc:603] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:21.088282 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.063056 13909 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.088878 13825 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:21.088879 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.953557 16302 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:21.097024 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:21.063850 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:21.037415 16348 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:21.101483 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.055693 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.071421 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:21.047231 16290 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260811 16:04:20.984488 16244 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.071694 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:21.041983 16346 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:21.076614 13907 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:20.978003 16250 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:21.067040 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 121589us
I20260811 16:04:21.080144 13827 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.080601 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:20.991609 16199 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:21.095350 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:20.991436 13737 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:21.019737 16319 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.127817 13823 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.071496 16137 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260811 16:04:21.065680 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 132289us
I20260811 16:04:21.073683 13817 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:21.079433 15936 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:21.136171 13909 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:21.169283 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 97675.6us
I20260811 16:04:21.030974 16123 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260811 16:04:21.112123 16216 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.066370 16336 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.094476 16301 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:21.160544 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:21.198678 14578 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:21.087762 16273 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260811 16:04:21.162895 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0613509709946811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260811 16:04:21.177909 16276 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.971s	user 0.014s	sys 0.000s
I20260811 16:04:21.160393 16318 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.101823 16286 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:20.956085 16158 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.170379 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:21.129392 16348 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:21.176232 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1468) took 1772 ms. Trace:
I20260811 16:04:21.127966 16283 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:21.082113 16160 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
I20260811 16:04:21.190500 13909 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:21.138564 16244 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.196802 13742 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:21.168002 16264 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:21.146595 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:21.243518 14574 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:21.146018 13818 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
W20260811 16:04:21.244743 16331 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.666s	user 0.004s	sys 0.010s
I20260811 16:04:21.245136 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.176625 16314 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:20.953135 16334 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:21.202714 16075 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.652s	user 0.015s	sys 0.000s
I20260811 16:04:21.207003 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.163590 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:21.186547 16199 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.213222 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:21.215052 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44761.6us
I20260811 16:04:21.216478 13826 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:21.177551 16307 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:21.222163 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 372) took 1532 ms (client timeout 1765 ms). Trace:
I20260811 16:04:21.222651 13825 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:21.192379 15936 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:21.226516 13909 raft_consensus.cc:595] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:21.158463 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77948.2us
I20260811 16:04:21.215780 16269 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260811 16:04:21.225549 16116 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:21.220017 16348 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.243078 16347 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:21.208632 16336 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.160614 16250 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:21.257055 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 161778us
I20260811 16:04:21.398372 13827 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:21.406472 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.245364 16331 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.217923 16318 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.211493 16276 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:21.417404 16317 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:21.428164 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.430266 13827 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.415292 16075 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.422389 13909 raft_consensus.cc:603] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:21.423705 13824 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:21.426887 13821 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
W20260811 16:04:21.418045 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 254521us
I20260811 16:04:21.349285 16123 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:21.451920 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:21.464263 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 296843us
I20260811 16:04:21.243197 16264 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:21.227133 16273 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.391083 16090 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:21.239770 16359 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260811 16:04:21.469055 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 300121us
I20260811 16:04:21.477721 13907 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:21.258435 13818 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:21.469323 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 481270us
I20260811 16:04:21.435344 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.431995 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.465018 13826 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:21.472309 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.487731 13820 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.466204 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.473183 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:21.476912 13903 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:21.429078 16339 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.489491 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:21.489708 16339 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.490657 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:21.491411 13742 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:21.492036 16339 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.428194 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:21.492892 16327 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
W20260811 16:04:21.473963 16300 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.147s	user 0.010s	sys 0.004s
I20260811 16:04:21.481619 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:21.481915 14579 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:21.453292 16299 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.452411 15699 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.497900 13822 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:21.498587 13825 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:21.498659 13827 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:21.499655 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71545.3us
I20260811 16:04:21.500537 14581 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260811 16:04:21.431603 13744 rpcz_store.cc:269] 0811 16:04:19.691407 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:19.751081 (+ 59674us) service_pool.cc:227] Handling call
0811 16:04:21.216843 (+1465762us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:21.222101 (+  5258us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2450277760}
I20260811 16:04:21.471906 16264 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.429809 16116 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:21.505605 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:21.507244 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:21.506346 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:21.509019 13827 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:21.507057 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.478058 16068 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.375777 16315 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.422s
I20260811 16:04:21.513443 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.513443 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:21.427608 16199 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.472927 16123 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:21.453182 15983 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260811 16:04:21.424492 16336 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:21.220067 13736 rpcz_store.cc:276] 0811 16:04:19.403907 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:19.407282 (+  3375us) service_pool.cc:227] Handling call
0811 16:04:19.631598 (+224316us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:20.577625 (+946027us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:21.175805 (+598180us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400209ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:21.176133 (+   328us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1972133248}
I20260811 16:04:21.550292 14577 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260811 16:04:21.627242 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.612401 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:21.505126 13738 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:21.700932 13908 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:21.701325 13908 raft_consensus.cc:603] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:21.480557 16273 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:21.554080 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48540.6us
I20260811 16:04:21.555009 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:21.702483 13821 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:21.703613 13822 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:21.554620 13741 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260811 16:04:21.505878 16313 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:21.510399 16319 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.565694 13825 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:21.714440 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.514642 16339 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.515913 16171 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:21.550957 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:21.722581 13823 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.005s
I20260811 16:04:21.513679 16327 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:21.725230 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:21.551548 16244 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.552513 16318 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.595077 16276 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.586709 16320 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:21.720177 13822 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:21.733980 13826 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
W20260811 16:04:21.705785 16271 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.009s
I20260811 16:04:21.488056 16090 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:21.741406 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.514281 16299 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.788100 13823 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
W20260811 16:04:21.714010 15747 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260811 16:04:21.510105 16126 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260811 16:04:21.771723 16319 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:21.504951 16300 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.794898 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.798281 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.536847 15699 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:21.804304 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.815311 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:21.791744 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 321175us
I20260811 16:04:21.827848 13827 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:21.792050 16250 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.801515 16331 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.828917 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:21.740721 16171 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:21.816030 16271 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:21.551311 15936 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.805269 16274 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.713837 16068 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.803977 16276 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.835930 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:21.843655 16356 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.918s	user 0.014s	sys 0.000s
I20260811 16:04:21.844787 16199 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.740376 16116 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:21.845968 16330 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.001s
I20260811 16:04:21.827031 15983 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:21.826582 16075 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.849061 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:21.849687 16327 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:21.854522 14573 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.001s
W20260811 16:04:21.859851 16367 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260811 16:04:21.768599 16339 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.915244 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:04:21.809903 16320 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:21.829959 16210 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.007s	sys 0.031s
I20260811 16:04:21.877388 13739 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:21.880115 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:21.867975 13789 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.812s (SENT)
I20260811 16:04:21.837733 13821 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:21.801142 16323 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260811 16:04:21.878269 16271 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:21.897017 16123 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.897519 16090 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:21.937146 16210 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.007s	sys 0.031s
I20260811 16:04:21.877285 15699 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:21.864686 16299 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.894888 13740 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:22.001844 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1691) took 1424 ms (client timeout 1886 ms). Trace:
W20260811 16:04:21.903965 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 422382us
I20260811 16:04:21.906366 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1304) took 1130 ms. Trace:
I20260811 16:04:21.868300 16171 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:21.913231 16318 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.914510 16199 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:21.827786 16319 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.917127 13818 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
W20260811 16:04:21.930241 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101475us
I20260811 16:04:22.012253 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.906661 16330 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.936000 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:22.019690 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:04:22.021152 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 85276.2us
I20260811 16:04:22.006556 16210 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:21.896111 16274 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:21.988547 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 271024us
I20260811 16:04:21.920957 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:21.992676 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:22.010494 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:21.929333 16286 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.000s
I20260811 16:04:21.923291 16300 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:21.898350 16336 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:21.927520 15983 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:21.902825 16276 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.002617 13824 rpcz_store.cc:276] 0811 16:04:20.775561 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.775905 (+   344us) service_pool.cc:227] Handling call
0811 16:04:21.906200 (+1130295us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:21.906310 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":862347648}
I20260811 16:04:21.912753 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:22.004011 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:22.002398 13740 rpcz_store.cc:269] 0811 16:04:20.577426 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.577593 (+   167us) service_pool.cc:227] Handling call
0811 16:04:21.835654 (+1258061us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:22.001761 (+166107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28718848}
I20260811 16:04:22.004772 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:21.906025 16356 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:21.996470 16271 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:22.005379 16316 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.032s	user 0.011s	sys 0.005s
I20260811 16:04:22.022608 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:22.001400 16313 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:22.003739 16372 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260811 16:04:22.013199 16364 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.295s	user 0.001s	sys 0.001s
W20260811 16:04:21.937021 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 382070us
I20260811 16:04:22.008174 16090 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:22.029589 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:22.072711 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:22.073007 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 43551.9us
I20260811 16:04:22.073741 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:22.018584 16348 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
I20260811 16:04:22.021031 13822 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:21.993723 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:22.036844 13820 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
I20260811 16:04:22.009845 15699 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.010308 16273 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:22.022326 16314 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.760s	user 0.005s	sys 0.005s
I20260811 16:04:22.046530 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:22.028695 16299 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260811 16:04:22.039995 16201 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.271s	user 0.007s	sys 0.021s
W20260811 16:04:22.051716 16369 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260811 16:04:22.052019 15983 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.058560 15936 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:22.061331 16376 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260811 16:04:22.055081 13823 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:22.077559 16373 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260811 16:04:22.070912 16300 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:22.073101 16372 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:22.037185 16210 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.120508 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1697) took 1160 ms. Trace:
I20260811 16:04:22.095901 16375 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260811 16:04:22.121078 13735 rpcz_store.cc:276] 0811 16:04:20.959683 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.963890 (+  4207us) service_pool.cc:227] Handling call
0811 16:04:22.120323 (+1156433us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:22.120439 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":242084096}
I20260811 16:04:22.122222 16375 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:22.122473 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.122738 16375 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:22.064527 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:22.019505 16318 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.041102 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 664) took 1091 ms. Trace:
I20260811 16:04:22.006122 16320 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.047322 16286 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:22.058697 16347 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:22.076043 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:22.076948 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 209001us
W20260811 16:04:22.155887 13789 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.821s (SENT)
I20260811 16:04:22.078531 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:22.068006 13736 raft_consensus.cc:2354] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
W20260811 16:04:22.141943 13737 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.965s	user 0.008s	sys 0.004s
I20260811 16:04:22.050081 16370 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:22.087363 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:22.090178 16264 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
W20260811 16:04:22.075562 13817 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.883s	user 0.006s	sys 0.006s
I20260811 16:04:22.091334 16068 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:22.092563 16317 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.003s
I20260811 16:04:22.077906 13820 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:22.076702 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:22.123813 15699 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:22.054896 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50969.9us
I20260811 16:04:22.125581 13822 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 1. Current term is 2. Ops: []
I20260811 16:04:22.094507 16123 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:22.099965 16158 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:22.129202 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 383) took 1571 ms. Trace:
I20260811 16:04:22.101580 13818 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:04:22.130843 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.0278e+06us
W20260811 16:04:22.103909 16368 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.391s	user 0.003s	sys 0.000s
I20260811 16:04:22.104539 16319 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.245434 16248 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:22.246053 16248 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.106945 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 390) took 1013 ms. Trace:
I20260811 16:04:22.107007 16304 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:22.110948 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 325) took 1338 ms. Trace:
I20260811 16:04:22.162883 13737 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:22.251354 13900 rpcz_store.cc:276] 0811 16:04:20.772778 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.783216 (+ 10438us) service_pool.cc:227] Handling call
0811 16:04:20.783613 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:21.061640 (+278027us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.110707 (+1049067us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54000c6f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:22.110862 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":596009856}
I20260811 16:04:22.111613 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 659) took 1713 ms. Trace:
I20260811 16:04:22.237164 16365 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:22.253065 16365 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:22.247565 13743 rpcz_store.cc:276] 0811 16:04:21.093530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.094219 (+   689us) service_pool.cc:227] Handling call
0811 16:04:21.094589 (+   370us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:21.146207 (+ 51618us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:21.146255 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:21.166740 (+ 20485us) log.cc:842] Serialized 26 byte log entry
0811 16:04:21.628641 (+461901us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:21.628700 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:21.628795 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:22.106724 (+477929us) raft_consensus.cc:1671] finished
0811 16:04:22.106745 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:22.106878 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44739,"raft.queue_time_us":52588,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9257,"thread_start_us":426430,"threads_started":1,"wal-append.queue_time_us":720104}
I20260811 16:04:22.254503 16319 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.115582 16371 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:22.115653 16348 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.255539 16371 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.256961 16348 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.252619 14581 rpcz_store.cc:276] 0811 16:04:20.398579 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.398698 (+   119us) service_pool.cc:227] Handling call
0811 16:04:20.420896 (+ 22198us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:21.511022 (+1090126us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.111350 (+600328us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:22.111545 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2482215680}
I20260811 16:04:22.257658 16327 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.113888 16330 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.117297 16372 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:22.258194 16327 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.119113 16210 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.116839 16356 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.252184 16265 raft_consensus.cc:2741] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260811 16:04:22.119732 16339 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.119961 16305 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260811 16:04:22.120046 16307 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260811 16:04:22.132862 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68440.8us
W20260811 16:04:22.115857 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54583.1us
I20260811 16:04:22.262439 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:22.263214 16302 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.263870 16356 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:22.116348 13823 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:04:22.265198 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2064) took 1062 ms. Trace:
I20260811 16:04:22.254449 16365 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.265532 13823 rpcz_store.cc:276] 0811 16:04:21.202390 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.110542 (+908152us) service_pool.cc:227] Handling call
0811 16:04:22.110886 (+   344us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:22.264926 (+154040us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.265142 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:22.266345 16365 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:22.119068 16160 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:22.267228 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:22.267410 16160 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:22.268046 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:22.268292 16160 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.269359 16160 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:22.107657 15936 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:22.270612 15936 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.141697 14573 rpcz_store.cc:276] 0811 16:04:20.949273 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.949498 (+   225us) service_pool.cc:227] Handling call
0811 16:04:22.039293 (+1089795us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:22.152789 16274 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.154191 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 650) took 2032 ms. Trace:
I20260811 16:04:22.272758 14575 rpcz_store.cc:276] 0811 16:04:20.121946 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.139684 (+ 17738us) service_pool.cc:227] Handling call
0811 16:04:20.222341 (+ 82657us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:20.920749 (+698408us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.153913 (+1233164us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54005c6cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:22.154122 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1247590272}
I20260811 16:04:22.103194 16276 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.112731 15747 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:04:22.280525 15747 tablet_bootstrap.cc:492] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:04:22.281561 15747 ts_tablet_manager.cc:1397] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 2.969s	user 0.048s	sys 0.030s
I20260811 16:04:22.156596 13824 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
W20260811 16:04:22.063082 16301 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.855s	user 0.007s	sys 0.004s
I20260811 16:04:22.157570 13740 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:22.100477 16075 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.142617 16299 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:22.131320 16373 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:22.334395 16373 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:22.334030 15747 raft_consensus.cc:348] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:22.335444 16373 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.337051 16373 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:22.147859 13735 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:22.104324 16171 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.200611 13822 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:22.200773 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:22.201524 16261 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.240423 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.241987 15699 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.242233 16318 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:22.242882 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87027.1us
I20260811 16:04:22.369163 13744 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:22.369450 13789 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.006s (SENT)
I20260811 16:04:22.369585 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2067) took 1157 ms. Trace:
I20260811 16:04:22.369908 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:22.101751 16313 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.243510 14541 leader_election.cc:398] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:22.247972 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 331) took 1199 ms. Trace:
I20260811 16:04:22.113672 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1690) took 1822 ms. Trace:
I20260811 16:04:22.136246 14582 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:22.266917 13823 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:22.202867 13827 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:22.289103 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:22.377288 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2066) took 1174 ms. Trace:
I20260811 16:04:22.165074 16347 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:22.163455 16380 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:22.165741 16286 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.174571 16370 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:22.176054 16264 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.329150 16276 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:22.332800 15936 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.333856 16327 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.252192 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1696) took 1292 ms. Trace:
I20260811 16:04:22.321730 13824 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:22.366763 13741 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:22.367966 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.370185 13822 rpcz_store.cc:276] 0811 16:04:21.212677 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.200109 (+987432us) service_pool.cc:227] Handling call
0811 16:04:22.200408 (+   299us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:22.369268 (+168860us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.369516 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:22.174793 13817 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:04:22.436895 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 648) took 2602 ms (client timeout 1564 ms). Trace:
I20260811 16:04:22.428655 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.366263 13739 rpcz_store.cc:276] 0811 16:04:20.557931 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.558266 (+   335us) service_pool.cc:227] Handling call
0811 16:04:20.570433 (+ 12167us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:21.986353 (+1415920us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.128925 (+142572us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002099d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:22.129119 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3005158784}
I20260811 16:04:22.370587 14541 leader_election.cc:401] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:04:22.371497 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 170803us
I20260811 16:04:22.319077 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:22.376261 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:22.377815 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 88822us
I20260811 16:04:22.377689 13827 rpcz_store.cc:276] 0811 16:04:21.202983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.164610 (+961627us) service_pool.cc:227] Handling call
0811 16:04:22.202555 (+ 37945us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:22.376982 (+174427us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.377227 (+   245us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:22.370669 13905 rpcz_store.cc:276] 0811 16:04:21.049063 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.049232 (+   169us) service_pool.cc:227] Handling call
0811 16:04:21.055600 (+  6368us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:21.070039 (+ 14439us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:21.070074 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:21.070553 (+   479us) log.cc:842] Serialized 26 byte log entry
0811 16:04:21.381446 (+310893us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:21.381504 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:21.381605 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:22.103229 (+721624us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:22.247619 (+144390us) raft_consensus.cc:1671] finished
0811 16:04:22.247642 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:22.247908 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9410,"raft.queue_time_us":16616,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":18568,"spinlock_wait_cycles":14339840,"thread_start_us":310356,"threads_started":1,"wal-append.queue_time_us":442171}
I20260811 16:04:22.386683 13823 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:22.174752 16247 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:22.398141 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.399340 13742 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:22.335048 15747 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:04:22.298524 16302 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:22.404044 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:22.364892 16248 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.351723 16356 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.128s
I20260811 16:04:22.319459 16075 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.365869 16331 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260811 16:04:22.297371 16319 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.326303 16271 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.203071 16375 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.298374 16301 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.438166 13907 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:22.657917 14581 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:22.437471 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:22.658700 13822 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260811 16:04:22.615747 13818 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:22.439045 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:22.659701 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:22.438565 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:22.481174 13902 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260811 16:04:22.548499 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.661450 13902 pending_rounds.cc:76] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 2
I20260811 16:04:22.662019 13902 pending_rounds.cc:97] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260811 16:04:22.437069 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:22.662146 13903 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:22.661437 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:22.662696 13906 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:22.662904 14579 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:22.663854 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.664574 13741 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:22.662410 13902 raft_consensus.cc:2866] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:22.405699 13627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 325) took 9226 ms. Trace:
I20260811 16:04:22.380277 16362 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.674736 13743 raft_consensus.cc:2354] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4.
W20260811 16:04:22.662256 14582 rpcz_store.cc:269] 0811 16:04:19.834951 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:19.835071 (+   120us) service_pool.cc:227] Handling call
0811 16:04:22.436670 (+2601599us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:22.436795 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5138993920}
I20260811 16:04:22.675823 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.670994 13908 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260811 16:04:22.671159 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:22.377487 16317 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:04:22.681311 13743 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:22.681864 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1702) took 1184 ms. Trace:
I20260811 16:04:22.663429 14578 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:22.380900 16210 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:22.388175 16299 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:22.656733 14580 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:22.683544 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:22.689406 13907 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:22.682439 13742 rpcz_store.cc:276] 0811 16:04:21.498337 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.498520 (+   183us) service_pool.cc:227] Handling call
0811 16:04:21.512966 (+ 14446us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:22.658864 (+1145898us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.681572 (+ 22708us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54000a96d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:22.681787 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2023125888}
I20260811 16:04:22.392781 16305 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.693048 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.695068 13739 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:22.695392 13821 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:22.682793 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.396497 16123 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:22.428006 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.445580 16339 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.436650 16199 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:22.436467 16068 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.403676 15699 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:22.436298 16376 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.533522 15950 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.428337 16116 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.427816 13628 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 2, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 2 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:22.703267 13818 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:22.654480 16092 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:22.580543 13817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1305) took 1542 ms (client timeout 1803 ms). Trace:
I20260811 16:04:22.435525 16264 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.435998 16380 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:22.666481 13627 rpcz_store.cc:276] 0811 16:04:13.178788 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:13.179040 (+   252us) service_pool.cc:227] Handling call
0811 16:04:22.405551 (+9226511us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:18.616876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:18.617616 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:18.617676 (+    60us) write_op.cc:435] Acquired schema lock
0811 16:04:18.617693 (+    17us) tablet.cc:660] Decoding operations
0811 16:04:18.837961 (+220268us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:18.838119 (+   158us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:18.838152 (+    33us) tablet.cc:683] Acquiring locks for 7 operations
0811 16:04:18.838856 (+   704us) tablet.cc:699] Row locks acquired
0811 16:04:18.838878 (+    22us) write_op.cc:260] PREPARE: finished
0811 16:04:18.839077 (+   199us) write_op.cc:270] Start()
0811 16:04:18.839265 (+   188us) write_op.cc:276] Timestamp: P: 1786464258838999 usec, L: 0
0811 16:04:18.839303 (+    38us) op_driver.cc:331] REPLICATION: starting
0811 16:04:18.932268 (+ 92965us) log.cc:842] Serialized 2913 byte log entry
0811 16:04:20.010564 (+1078296us) op_driver.cc:444] REPLICATION: finished
0811 16:04:20.483587 (+473023us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5531c410
0811 16:04:20.711438 (+227851us) write_op.cc:301] APPLY: starting
0811 16:04:20.714146 (+  2708us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:20.770207 (+ 56061us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:20.773406 (+  3199us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:20.830451 (+ 57045us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:20.830715 (+   264us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0811 16:04:20.830763 (+    48us) write_op.cc:312] APPLY: finished
0811 16:04:20.831181 (+   418us) log.cc:842] Serialized 59 byte log entry
0811 16:04:20.831390 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:20.831542 (+   152us) write_op.cc:454] Released schema lock
0811 16:04:20.831625 (+    83us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:20.831951 (+   326us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:20.831982 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31748,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":590293,"apply.run_cpu_time_us":4146,"apply.run_wall_time_us":172136,"num_ops":7,"prepare.queue_time_us":252822,"prepare.run_cpu_time_us":61402,"prepare.run_wall_time_us":544125,"raft.queue_time_us":502959,"raft.run_cpu_time_us":20848,"raft.run_wall_time_us":575997,"replication_time_us":1166087,"spinlock_wait_cycles":3392768,"thread_start_us":998049,"threads_started":4,"wal-append.queue_time_us":272507,"wal-append.run_cpu_time_us":106537,"wal-append.run_wall_time_us":2632383}]]}
I20260811 16:04:22.379103 16261 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.547391 16171 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.447831 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.435345 16371 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.570824 16090 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:22.703262 16305 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:22.715605 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 515383us
I20260811 16:04:22.722062 16331 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:22.722512 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:22.790625 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 68230.6us
I20260811 16:04:22.726483 13907 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:22.719956 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:22.666224 13737 rpcz_store.cc:276] 0811 16:04:20.959392 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.972741 (+ 13349us) service_pool.cc:227] Handling call
0811 16:04:22.252121 (+1279380us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:22.376384 13738 rpcz_store.cc:276] 0811 16:04:20.291069 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.292143 (+  1074us) service_pool.cc:227] Handling call
0811 16:04:20.309659 (+ 17516us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:21.713041 (+1403382us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.113407 (+400366us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002814d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:22.113604 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2657774976}
I20260811 16:04:22.680799 16247 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.759083 16092 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.434484 16372 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.403957 16286 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.435747 16276 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.705250 16210 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:22.708447 15936 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:22.711288 16248 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:22.839385 16248 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.841969 16248 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.729781 16323 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
W20260811 16:04:22.842541 13735 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.000s
I20260811 16:04:22.836066 15936 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:22.843962 13735 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:22.844735 15936 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.845445 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.846177 15936 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:22.846487 13735 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:22.721004 14573 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:22.847756 16092 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.848042 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.848114 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.848789 14573 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:22.849638 16304 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.004s
I20260811 16:04:22.850103 16390 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.850239 16304 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:22.428082 16347 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.850734 16304 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:22.851351 16304 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:22.851694 16319 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.712592 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.854827 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.855608 13743 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:22.855712 16271 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.755033 16334 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:22.856459 13743 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:22.857029 13743 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:22.856637 16334 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.431852 16370 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.689277 16362 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.860121 14578 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260811 16:04:22.686003 15983 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:22.722555 16339 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.780272 16264 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
W20260811 16:04:22.784929 16250 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.026s
I20260811 16:04:22.798149 14582 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260811 16:04:22.730715 16068 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:22.753328 13817 rpcz_store.cc:269] 0811 16:04:21.038050 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.038604 (+   554us) service_pool.cc:227] Handling call
0811 16:04:22.553705 (+1515101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:22.787777 16090 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.753429 15950 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.916301 16339 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.916796 15950 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.917625 13742 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:22.918517 16394 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260811 16:04:22.738281 16376 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.898895 16380 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.812928 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.731030 16199 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.753593 16116 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.833616 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.932894 14579 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:22.752945 15699 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.834623 13903 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:22.784633 16171 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260811 16:04:22.842504 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:04:22.765393 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 369106us
I20260811 16:04:22.712380 14574 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:22.850682 16390 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:22.940637 16365 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.001s
I20260811 16:04:22.855873 13736 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260811 16:04:22.942616 13736 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260811 16:04:22.737718 16123 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260811 16:04:22.679955 16326 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:22.862001 13909 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:22.857786 13743 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.888025 16276 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.888592 16305 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.856530 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:22.889569 16372 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.891047 16286 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.838510 16210 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:22.891749 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:22.924767 16090 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.820798 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:22.718796 15747 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:22.901135 14581 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:22.850473 14573 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:04:22.908599 16389 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260811 16:04:22.909130 16075 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.910240 16247 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:22.913324 16334 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:22.882072 16250 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.017s	sys 0.026s
I20260811 16:04:22.928481 14580 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:22.798820 16331 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:22.930634 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:22.943877 13825 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:22.884831 15983 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:22.983064 13743 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:22.906105 16264 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:22.927780 16301 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.897214 16068 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.884713 16271 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
W20260811 16:04:23.099588 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 307948us
I20260811 16:04:22.923450 16376 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:22.926344 16261 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:22.981932 16373 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.271875 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.272583 14581 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:23.033998 13741 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:23.279284 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:23.274358 14583 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3.
I20260811 16:04:23.280079 13741 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:23.281679 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:23.173812 16394 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260811 16:04:23.081775 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 410703us
W20260811 16:04:23.096606 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 298281us
I20260811 16:04:23.287640 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:23.235195 13736 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:22.962913 13739 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:23.250504 16375 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:23.242691 15983 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.244326 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:23.244578 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.301064 14579 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260811 16:04:23.301378 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.302320 14581 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:23.303552 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.304263 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:23.305505 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:22.923414 16362 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:23.247952 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2068) took 2035 ms. Trace:
I20260811 16:04:23.253218 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:23.270444 13789 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.146s (SENT)
I20260811 16:04:23.317008 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:23.320202 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.320675 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.044951 16326 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:23.294158 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:23.322190 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:23.283504 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.244729 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.242691 16264 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:23.273113 16116 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:23.310604 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57524.2us
I20260811 16:04:23.309032 13820 rpcz_store.cc:276] 0811 16:04:21.212994 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.202015 (+989021us) service_pool.cc:227] Handling call
0811 16:04:22.202376 (+   361us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:22.202734 (+   358us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:22.202763 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:22.203271 (+   508us) log.cc:842] Serialized 26 byte log entry
0811 16:04:22.662961 (+459690us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:23.036118 (+373157us) log.cc:842] Serialized 14 byte log entry
0811 16:04:23.247512 (+211394us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:23.247620 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:23.247682 (+    62us) raft_consensus.cc:1671] finished
0811 16:04:23.247699 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:23.247875 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7465,"prepare.queue_time_us":632603,"raft.queue_time_us":233234,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":9347,"thread_start_us":769785,"threads_started":2,"wal-append.queue_time_us":479555}
W20260811 16:04:23.070367 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 398008us
W20260811 16:04:23.337663 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43601.3us
I20260811 16:04:23.338323 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:23.318740 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:23.319381 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.321333 14581 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:23.043484 16299 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:23.322326 14583 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:23.335779 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52372.7us
I20260811 16:04:23.358729 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:23.361249 14578 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:23.347698 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:23.295513 16271 consensus_queue.cc:1225] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260811 16:04:23.362133 14579 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:23.363270 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:23.308470 16123 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.340716 14577 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:23.359833 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.369660 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:23.365120 13743 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:23.316066 16376 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:23.315725 14575 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:23.374045 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:23.460604 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 79449.9us
I20260811 16:04:23.461217 14580 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:23.374830 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.462177 13818 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:23.375236 16402 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:23.375521 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.280975 16373 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:23.378146 14581 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:23.357026 13741 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:23.481671 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:23.482076 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 116344us
I20260811 16:04:23.378679 14577 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:23.379482 13742 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:23.327126 16286 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:23.377780 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.433337 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:23.433526 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 163095us
W20260811 16:04:23.492656 13789 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.195s (SENT)
I20260811 16:04:23.493188 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:23.435381 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.436091 16412 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:23.436628 16116 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:23.439323 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:23.323629 16304 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:23.440619 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.440990 16299 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:23.442533 16331 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:23.316346 16068 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260811 16:04:23.445876 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.446503 13908 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:23.446954 16347 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.547801 16068 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:23.548203 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1487) took 1106 ms. Trace:
I20260811 16:04:23.547909 16347 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:23.548650 13742 rpcz_store.cc:276] 0811 16:04:22.441327 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.703903 (+262576us) service_pool.cc:227] Handling call
0811 16:04:23.548007 (+844104us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:23.548133 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":287755136}
I20260811 16:04:23.549530 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.549826 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.550384 16347 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:23.550690 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.551399 13902 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:23.552255 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.553257 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.554440 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.555003 13908 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:23.447412 16370 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:23.448020 16390 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:23.381917 16362 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:23.448511 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.382161 16123 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:23.449782 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83140.3us
I20260811 16:04:23.450332 16250 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:23.447126 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.452886 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.571537 13822 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:23.326174 16305 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:23.336762 16265 raft_consensus.cc:2741] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260811 16:04:23.534087 16116 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:23.321775 16261 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:23.438903 16302 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.000s
I20260811 16:04:23.465090 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:23.583528 15948 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:04:23.579070 16371 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260811 16:04:23.584766 15948 tablet_bootstrap.cc:492] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:04:23.469309 14579 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
W20260811 16:04:23.619779 13825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2076) took 2104 ms (client timeout 1955 ms). Trace:
I20260811 16:04:23.469309 13820 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:23.620271 13825 rpcz_store.cc:269] 0811 16:04:21.515119 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.740873 (+225754us) service_pool.cc:227] Handling call
0811 16:04:23.619487 (+1878614us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:23.619670 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2571716352}
I20260811 16:04:23.484144 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.376592 16274 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:23.597034 16123 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:23.367883 16365 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:23.503575 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.658146 13905 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:23.455938 16396 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.505s	user 0.000s	sys 0.001s
I20260811 16:04:23.377755 16376 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:23.664619 16376 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:23.667599 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1708) took 1378 ms. Trace:
I20260811 16:04:23.668190 13740 rpcz_store.cc:276] 0811 16:04:22.289240 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.289458 (+   218us) service_pool.cc:227] Handling call
0811 16:04:22.322181 (+ 32723us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:22.335133 (+ 12952us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:22.335209 (+    76us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:22.335878 (+   669us) log.cc:842] Serialized 26 byte log entry
0811 16:04:22.684590 (+348712us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:22.684637 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:22.684735 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:23.667258 (+982523us) raft_consensus.cc:1671] finished
0811 16:04:23.667290 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:23.667509 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12484,"raft.queue_time_us":14070,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"thread_start_us":348271,"threads_started":1,"wal-append.queue_time_us":531423}
I20260811 16:04:23.507283 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.511773 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.671762 13901 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:23.673084 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.507917 13871 leader_election.cc:398] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4.
I20260811 16:04:23.674001 13871 leader_election.cc:401] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:04:23.674968 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173063us
I20260811 16:04:23.520033 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:23.532006 13827 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:04:23.381204 16271 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260811 16:04:23.678584 16271 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:23.679042 16271 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:23.680140 16271 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:23.538931 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46286.8us
W20260811 16:04:23.682312 13789 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.209s (SENT)
I20260811 16:04:23.682874 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:23.546178 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:23.683925 16390 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:23.447858 16356 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.551005 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.684408 13823 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:23.506880 16372 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.685058 16372 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.684687 16356 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.503753 16199 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:23.558940 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.684769 13742 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:23.510294 16402 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:23.509742 16412 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:23.519537 16301 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:23.568902 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.459368 13743 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:23.527966 13817 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:23.579643 13741 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:23.570885 13906 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:23.580314 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:23.522892 16075 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260811 16:04:23.583611 13826 raft_consensus.cc:2396] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:23.467803 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:23.359733 15699 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:23.588653 16410 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:23.591387 16305 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:23.511018 16411 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260811 16:04:23.595341 16304 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:23.453581 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.327333 16318 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.135s
W20260811 16:04:23.656586 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 172516us
I20260811 16:04:23.548401 16068 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:23.559689 13902 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:23.566998 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.687582 16356 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:23.687614 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.844331 16410 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.846127 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.849516 16271 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:23.806494 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:04:23.849826 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173933us
I20260811 16:04:23.686906 16199 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 4
W20260811 16:04:23.850363 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 168113us
W20260811 16:04:23.885107 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.647s (SENT) [suppressed 23 similar messages]
W20260811 16:04:23.851697 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 337800us
I20260811 16:04:23.851845 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.858040 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.573076 16370 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.862160 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1492) took 1419 ms. Trace:
I20260811 16:04:23.850149 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.883198 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:23.892849 13739 rpcz_store.cc:276] 0811 16:04:22.442567 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.962009 (+519442us) service_pool.cc:227] Handling call
0811 16:04:22.962488 (+   479us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:22.962764 (+   276us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:23.367870 (+405106us) log.cc:842] Serialized 14 byte log entry
0811 16:04:23.861648 (+493778us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:23.861736 (+    88us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:23.861799 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:23.861888 (+    89us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:23.862064 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":237170,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":4867,"thread_start_us":188758,"threads_started":1}
I20260811 16:04:23.894577 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.849252 15948 ts_tablet_manager.cc:1397] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 3.013s	user 0.019s	sys 0.078s
W20260811 16:04:23.865526 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 412011us
I20260811 16:04:23.897513 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.776293 15747 ts_tablet_manager.cc:1428] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 1.417s	user 0.015s	sys 0.013s
I20260811 16:04:23.868376 13908 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:23.698709 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.867515 13823 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:23.850299 16330 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:23.561178 16326 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:23.848011 13822 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:23.851643 16307 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.883759 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.884182 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1812) took 1453 ms. Trace:
I20260811 16:04:23.894852 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.876952 13906 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:23.898252 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:23.898887 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.851935 16286 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:23.878175 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 668) took 2377 ms (client timeout 1866 ms). Trace:
W20260811 16:04:23.904423 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 328556us
I20260811 16:04:23.897909 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:23.874982 16313 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:23.908047 13907 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:04:23.922739 13901 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:23.914453 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 446735us
W20260811 16:04:23.903748 15747 ts_tablet_manager.cc:1460] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Tablet startup took 1621ms
W20260811 16:04:23.869849 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 406999us
I20260811 16:04:23.953591 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.849452 16412 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:23.619244 16261 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.954589 13905 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:23.929812 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:23.846872 16305 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.898001 16103 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260811 16:04:23.898674 16318 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:24.221308 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:23.873631 16429 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.246s
I20260811 16:04:24.088527 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.922463 13738 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:23.927596 13909 rpcz_store.cc:276] 0811 16:04:22.430772 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.438750 (+  7978us) service_pool.cc:227] Handling call
0811 16:04:23.883943 (+1445193us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:23.884107 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":464102272}
I20260811 16:04:24.224447 13908 raft_consensus.cc:2354] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3.
W20260811 16:04:23.982720 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87840.9us
W20260811 16:04:24.107605 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 120654us
W20260811 16:04:24.068228 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 170393us
I20260811 16:04:23.907194 16123 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:24.223876 16302 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:24.230139 14578 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.000s
I20260811 16:04:23.954962 16276 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:23.911197 16390 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:24.231376 15699 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:24.237401 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.907788 16301 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:23.953939 16075 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:24.224958 13739 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:24.066588 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:24.282207 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:24.245790 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:24.282945 14579 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:23.924075 16373 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:23.924414 16330 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:24.256697 14577 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:23.903797 16274 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:24.243783 13906 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:24.237142 16434 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:24.233222 16421 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.672s	user 0.001s	sys 0.000s
I20260811 16:04:23.930464 16356 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:24.271777 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:23.960652 16435 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:24.266096 14578 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:24.088654 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:24.091316 13737 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:24.274828 13902 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:23.904500 16347 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.350s
I20260811 16:04:24.277762 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:23.907794 16116 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:23.907470 16371 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.353s
I20260811 16:04:24.275080 16437 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:24.329574 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.068894 16372 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:24.274681 16123 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.282563 13742 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:24.091300 16210 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:24.109288 16319 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:24.407534 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.510643 13908 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:24.511416 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1824) took 1016 ms. Trace:
I20260811 16:04:24.512009 13908 rpcz_store.cc:276] 0811 16:04:23.494907 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.280084 (+785177us) service_pool.cc:227] Handling call
0811 16:04:24.511342 (+231258us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:24.277621 16103 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:04:24.408396 13707 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.026s	sys 0.064s
W20260811 16:04:24.518625 13707 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.026s	sys 0.064s
W20260811 16:04:24.519109 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 633997us
I20260811 16:04:24.408506 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:24.265630 16318 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:24.281358 16075 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:23.960178 16068 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:24.285859 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1482) took 1886 ms (client timeout 2201 ms). Trace:
I20260811 16:04:24.472259 16370 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:24.278972 16302 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:24.432993 16436 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260811 16:04:24.434485 15950 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:24.435917 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.546396 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.547821 13907 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
W20260811 16:04:24.426016 16418 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.654s	user 0.001s	sys 0.001s
W20260811 16:04:24.399243 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.008s	sys 0.008s
W20260811 16:04:24.548801 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.008s	sys 0.008s
I20260811 16:04:24.526768 16210 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:24.457527 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 229205us
I20260811 16:04:24.324860 16301 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.560662 16301 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:24.561308 16301 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:24.091912 16286 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:24.564203 14575 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.056s	user 0.011s	sys 0.002s
I20260811 16:04:23.959074 16402 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:24.564980 14575 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:04:24.565773 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 689) took 1449 ms (client timeout 1549 ms). Trace:
W20260811 16:04:24.566255 14575 rpcz_store.cc:269] 0811 16:04:23.116111 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.244050 (+127939us) service_pool.cc:227] Handling call
0811 16:04:24.565692 (+1321642us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:24.465065 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.336668 16274 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:24.567618 13902 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:24.567919 16426 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260811 16:04:24.568608 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.569270 13902 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:24.570077 16274 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:24.283293 16390 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.556656 15699 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:24.513552 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.514406 13906 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:24.513901 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1714) took 1233 ms. Trace:
I20260811 16:04:24.520643 13739 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:24.523132 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:24.528573 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:24.532166 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:24.535281 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:24.578110 13824 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:23.982091 16307 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.576467 13742 rpcz_store.cc:276] 0811 16:04:23.280532 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.959619 (+679087us) service_pool.cc:227] Handling call
0811 16:04:24.513825 (+554206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:24.576751 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 403) took 1305 ms. Trace:
I20260811 16:04:24.581990 13739 rpcz_store.cc:276] 0811 16:04:23.271215 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.329871 (+1058656us) service_pool.cc:227] Handling call
0811 16:04:24.576689 (+246818us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:24.570113 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.584667 13902 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 2.
I20260811 16:04:24.537029 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:24.359995 16434 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.509579 16437 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:24.577708 13823 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:24.538550 13820 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:04:24.539707 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.597326 13908 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:24.597941 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1825) took 1102 ms. Trace:
I20260811 16:04:24.598311 13908 rpcz_store.cc:276] 0811 16:04:23.501125 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.526129 (+1025004us) service_pool.cc:227] Handling call
0811 16:04:24.597872 (+ 71743us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:24.510402 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1499) took 1176 ms. Trace:
I20260811 16:04:24.540082 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:24.509716 16313 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:24.533636 16425 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.604s	user 0.000s	sys 0.002s
I20260811 16:04:24.513430 16319 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:24.436343 13826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 430) took 2828 ms (client timeout 1946 ms). Trace:
W20260811 16:04:23.980551 14574 rpcz_store.cc:269] 0811 16:04:21.501200 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.504127 (+  2927us) service_pool.cc:227] Handling call
0811 16:04:23.877956 (+2373829us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400571054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:23.878090 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2082215808}
I20260811 16:04:24.518038 16103 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:24.549217 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 656846us
I20260811 16:04:24.456602 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 675) took 1165 ms. Trace:
I20260811 16:04:24.551186 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:24.550971 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:24.456378 16431 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260811 16:04:24.527655 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1715) took 1244 ms. Trace:
I20260811 16:04:24.557363 16075 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.558506 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 679) took 1265 ms. Trace:
W20260811 16:04:24.455983 16427 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.532s	user 0.001s	sys 0.000s
I20260811 16:04:24.533337 16410 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:24.561936 16301 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:24.629252 13826 rpcz_store.cc:269] 0811 16:04:21.607666 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:21.797930 (+190264us) service_pool.cc:227] Handling call
0811 16:04:24.436142 (+2638212us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400125054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:24.436271 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4041345792}
I20260811 16:04:24.632860 13908 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:04:24.642362 16339 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:24.466117 16435 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.532935 16330 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.545760 15948 raft_consensus.cc:348] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:04:24.643527 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 403822us
W20260811 16:04:24.641702 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 397181us
I20260811 16:04:24.970497 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:24.861260 13739 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260811 16:04:25.016184 13739 pending_rounds.cc:76] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 5
W20260811 16:04:25.016359 13743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1498) took 1717 ms (client timeout 2192 ms). Trace:
I20260811 16:04:25.016595 13739 pending_rounds.cc:97] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260811 16:04:25.016896 13739 raft_consensus.cc:2866] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:04:25.017166 14542 connection.cc:232] RPC call timeout handler was delayed by -1.1084408230381086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2372s for a response
W20260811 16:04:24.872825 13741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 398) took 1605 ms (client timeout 1931 ms). Trace:
I20260811 16:04:24.628412 16347 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:24.541436 16276 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:24.667742 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 769504us
W20260811 16:04:25.599807 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.04888e+06us
W20260811 16:04:25.017833 13741 rpcz_store.cc:269] 0811 16:04:23.267042 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.481395 (+214353us) service_pool.cc:227] Handling call
0811 16:04:24.872476 (+1391081us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:24.872696 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":223368960}
I20260811 16:04:24.862946 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1998) took 1418 ms. Trace:
I20260811 16:04:24.644156 13909 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
W20260811 16:04:25.602784 14544 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.526s (SENT)
I20260811 16:04:25.017638 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 404) took 1746 ms. Trace:
W20260811 16:04:25.097252 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 81519.8us
W20260811 16:04:25.017680 14542 connection.cc:232] RPC call timeout handler was delayed by -1.0617256650002673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260811 16:04:25.605875 14542 connection.cc:232] RPC call timeout handler was delayed by -1.0343104600906372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260811 16:04:24.571067 16428 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260811 16:04:25.606714 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2012) took 2036 ms. Trace:
W20260811 16:04:24.250370 15747 ts_tablet_manager.cc:1462] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Trace:
0811 16:04:08.363298 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.365497 (+  2199us) service_pool.cc:227] Handling call
0811 16:04:08.366557 (+  1060us) ts_tablet_manager.cc:928] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
0811 16:04:13.811525 (+5444968us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:04:14.364125 (+552600us) tablet_metadata.cc:641] Metadata flushed
0811 16:04:14.385944 (+ 21819us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:04:15.315778 (+929834us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:04:15.387781 (+ 72003us) tablet_replica.cc:205] Creating consensus instance
0811 16:04:15.454588 (+ 66807us) ts_tablet_manager.cc:983] Replica registered.
0811 16:04:15.460399 (+  5811us) inbound_call.cc:173] Queueing success response
0811 16:04:19.312563 (+3852164us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0811 16:04:22.282004 (+2969441us) ts_tablet_manager.cc:1429] Starting tablet replica
0811 16:04:22.331648 (+ 49644us) tablet_replica.cc:259] Starting instrumentation
0811 16:04:22.332296 (+   648us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":214,"mutex_wait_us":20299,"raft.queue_time_us":26941,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":32175,"tablet-copy.queue_time_us":182,"tablet-download-pool.queue_time_us":19043,"tablet-download-pool.run_cpu_time_us":4542,"tablet-download-pool.run_wall_time_us":3061866,"thread_start_us":62586,"threads_started":1}
W20260811 16:04:24.534386 13738 rpcz_store.cc:269] 0811 16:04:22.393146 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.533940 (+1140794us) service_pool.cc:227] Handling call
0811 16:04:24.279846 (+745906us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:25.016788 13743 rpcz_store.cc:269] 0811 16:04:23.299193 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.848110 (+548917us) service_pool.cc:227] Handling call
0811 16:04:24.970236 (+1122126us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:25.016292 (+ 46056us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4214016}
I20260811 16:04:25.604025 14578 rpcz_store.cc:276] 0811 16:04:23.291047 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.307896 (+ 16849us) service_pool.cc:227] Handling call
0811 16:04:24.456521 (+1148625us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.608628 13907 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:25.617334 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 344) took 1693 ms. Trace:
W20260811 16:04:24.793267 15936 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.911s	user 0.023s	sys 0.003s
W20260811 16:04:24.862630 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 306968us
W20260811 16:04:25.484786 16375 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 2.176s	user 0.017s	sys 0.000s
I20260811 16:04:25.624372 13818 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:24.574100 16390 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:24.668056 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 431515us
W20260811 16:04:25.340975 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.007s	sys 0.026s
W20260811 16:04:25.630512 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.009s	sys 0.037s
I20260811 16:04:25.631255 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:24.713510 16454 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:24.650345 16264 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.011s	sys 0.063s
W20260811 16:04:25.633742 16264 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.037s	user 0.026s	sys 0.102s
W20260811 16:04:25.633842 16412 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.357s	user 0.012s	sys 0.000s
I20260811 16:04:25.635342 16264 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.598117 16435 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:25.635679 16412 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.637537 13821 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:25.619304 16460 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.638007 16334 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:25.638563 16334 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:25.638264 16460 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.639649 16334 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:25.641103 16334 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:25.607179 13908 rpcz_store.cc:276] 0811 16:04:23.570293 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.599086 (+1028793us) service_pool.cc:227] Handling call
0811 16:04:24.602516 (+  3430us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.606401 (+1003885us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.606643 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.609835 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:24.740183 16261 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.018672 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:25.603062 13909 raft_consensus.cc:595] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:25.618454 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:04:25.594724 16271 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.691s	user 0.011s	sys 0.004s
I20260811 16:04:24.881712 16451 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:25.561534 16434 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:25.617684 13907 rpcz_store.cc:276] 0811 16:04:23.923847 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.550862 (+627015us) service_pool.cc:227] Handling call
0811 16:04:25.617274 (+1066412us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:25.518440 16376 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.853s	user 0.016s	sys 0.000s
I20260811 16:04:25.659492 16376 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.661144 16302 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:25.661913 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1328) took 1139 ms. Trace:
I20260811 16:04:25.662503 13818 rpcz_store.cc:276] 0811 16:04:24.522438 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.523367 (+   929us) service_pool.cc:227] Handling call
0811 16:04:25.661573 (+1138206us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400173c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:25.661723 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2355537664}
W20260811 16:04:25.019562 16439 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.609s	user 0.000s	sys 0.001s
I20260811 16:04:24.644487 13906 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:25.665843 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2007) took 2208 ms. Trace:
I20260811 16:04:24.742035 13817 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:25.621649 14541 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.008s	sys 0.006s
W20260811 16:04:25.091113 16116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.013s	sys 0.044s
W20260811 16:04:25.609902 14544 connection.cc:232] RPC call timeout handler was delayed by -1.4140817349543795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260811 16:04:24.644236 16319 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:25.627514 16411 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:24.791285 16318 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.860075 16313 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.683736 13907 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:25.684092 13908 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:24.630911 16437 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:24.628463 13737 rpcz_store.cc:276] 0811 16:04:23.299821 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.579652 (+279831us) service_pool.cc:227] Handling call
0811 16:04:24.476432 (+896780us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.640165 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1316) took 2272 ms. Trace:
I20260811 16:04:25.019250 13735 rpcz_store.cc:276] 0811 16:04:23.280873 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.088328 (+807455us) service_pool.cc:227] Handling call
0811 16:04:24.524778 (+436450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.641188 16460 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:25.685509 13821 rpcz_store.cc:276] 0811 16:04:23.368167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.368315 (+   148us) service_pool.cc:227] Handling call
0811 16:04:23.442246 (+ 73931us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.638039 (+2195793us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.639783 (+  1744us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:25.640046 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5048289024}
W20260811 16:04:25.669957 16116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.015s	sys 0.048s
I20260811 16:04:25.046633 16305 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.643213 16276 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.090195 16339 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.603399 16075 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:25.616508 16274 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.607752 16372 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:25.646507 13741 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:04:24.628499 16373 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.616291 16347 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.618700 15699 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:25.632750 16454 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:24.811249 16442 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.703337 16465 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:25.703645 16442 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.705982 16412 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.017813 14582 rpcz_store.cc:276] 0811 16:04:23.292724 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.456420 (+163696us) service_pool.cc:227] Handling call
0811 16:04:23.506176 (+ 49756us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:23.895515 (+389339us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:23.895556 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:23.899081 (+  3525us) log.cc:842] Serialized 26 byte log entry
0811 16:04:24.256571 (+357490us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:24.256606 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:24.256693 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:24.558270 (+301577us) raft_consensus.cc:1671] finished
0811 16:04:24.558295 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:24.558441 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9436,"raft.queue_time_us":81630,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":652916,"threads_started":2,"wal-append.queue_time_us":555210,"wal-append.run_cpu_time_us":2156,"wal-append.run_wall_time_us":1049957}
I20260811 16:04:24.791035 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 680) took 1944 ms. Trace:
I20260811 16:04:25.603605 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 1999) took 2159 ms. Trace:
I20260811 16:04:25.707337 14573 rpcz_store.cc:276] 0811 16:04:22.816068 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.849751 (+ 33683us) service_pool.cc:227] Handling call
0811 16:04:22.850097 (+   346us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:22.850310 (+   213us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:23.893208 (+1042898us) log.cc:842] Serialized 14 byte log entry
0811 16:04:24.586629 (+693421us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:24.633119 (+ 46490us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:24.647401 (+ 14282us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:24.712997 (+ 65596us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:24.760068 (+ 47071us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15598,"raft.queue_time_us":19277,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"thread_start_us":458225,"threads_started":1,"wal-append.queue_time_us":829374}
I20260811 16:04:25.707826 13904 rpcz_store.cc:276] 0811 16:04:23.444553 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.446629 (+  2076us) service_pool.cc:227] Handling call
0811 16:04:23.446943 (+   314us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:23.447358 (+   415us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:23.447386 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:23.447837 (+   451us) log.cc:842] Serialized 26 byte log entry
0811 16:04:23.561769 (+113932us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:23.561828 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:23.561923 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:25.603293 (+2041370us) raft_consensus.cc:1671] finished
0811 16:04:25.603325 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:25.603526 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1101,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":113517,"threads_started":1,"wal-append.queue_time_us":416375}
I20260811 16:04:25.605337 13739 rpcz_store.cc:276] 0811 16:04:23.271512 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.629069 (+1357557us) service_pool.cc:227] Handling call
0811 16:04:24.860836 (+231767us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.017397 (+156561us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.017588 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.652868 13909 raft_consensus.cc:603] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:25.716140 16454 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.716468 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36246 (request call id 23) took 1161 ms. Trace:
I20260811 16:04:25.717010 16469 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.652907 13740 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
W20260811 16:04:25.618207 16402 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.009s	sys 0.003s
I20260811 16:04:25.658447 16435 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:25.398118 16199 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.493s	user 0.012s	sys 0.002s
W20260811 16:04:25.667748 14541 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.008s	sys 0.006s
W20260811 16:04:25.668032 14544 connection.cc:232] RPC call timeout handler was delayed by -1.396981735015288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260811 16:04:25.668298 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58566.9us
W20260811 16:04:25.749852 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.0312e+06us
I20260811 16:04:25.751425 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:25.666993 13906 rpcz_store.cc:276] 0811 16:04:23.457954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.628257 (+1170303us) service_pool.cc:227] Handling call
0811 16:04:24.644266 (+ 16009us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.665302 (+1021036us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.665762 (+   460us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.673655 16471 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
W20260811 16:04:25.750561 14544 connection.cc:232] RPC call timeout handler was delayed by -1.3166483410168439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260811 16:04:25.674547 16317 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:25.673846 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1324) took 1152 ms. Trace:
I20260811 16:04:25.674649 16123 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.621899 16330 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:25.634850 16380 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260811 16:04:25.684859 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2016) took 2099 ms. Trace:
I20260811 16:04:25.140091 16410 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:25.717671 16469 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.687882 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 339) took 2101 ms. Trace:
I20260811 16:04:25.803922 13907 rpcz_store.cc:276] 0811 16:04:23.586672 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.669529 (+2082857us) service_pool.cc:227] Handling call
0811 16:04:25.683480 (+ 13951us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.687559 (+  4079us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.687817 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.666249 15936 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.611001 16301 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:25.636283 16264 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.682415 16376 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.149441 16103 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.700177 16372 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:24.865374 16210 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.696609 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1713) took 2416 ms. Trace:
I20260811 16:04:25.823298 13741 rpcz_store.cc:276] 0811 16:04:23.280273 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.611890 (+2331617us) service_pool.cc:227] Handling call
0811 16:04:25.646090 (+ 34200us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.696104 (+ 50014us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.696550 (+   446us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.679414 16261 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260811 16:04:25.706481 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1717) took 2242 ms. Trace:
I20260811 16:04:25.621428 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 405) took 2294 ms. Trace:
I20260811 16:04:25.828881 13743 rpcz_store.cc:276] 0811 16:04:23.326690 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.620543 (+2293853us) service_pool.cc:227] Handling call
0811 16:04:25.620876 (+   333us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.621081 (+   205us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:25.621108 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:25.621151 (+    43us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:25.621178 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.621238 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:25.621367 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.650493 13744 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:25.711320 16460 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.679670 16451 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.015280 15948 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
W20260811 16:04:25.718106 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1718) took 2234 ms (client timeout 1854 ms). Trace:
I20260811 16:04:25.602553 13900 rpcz_store.cc:276] 0811 16:04:23.444205 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.451940 (+  7735us) service_pool.cc:227] Handling call
0811 16:04:23.510744 (+ 58804us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:23.535786 (+ 25042us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:23.535834 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:23.551061 (+ 15227us) log.cc:842] Serialized 26 byte log entry
0811 16:04:23.851700 (+300639us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:23.851749 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:23.851810 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:24.576285 (+724475us) raft_consensus.cc:1671] finished
0811 16:04:24.576302 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:24.862874 (+286572us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2815,"raft.queue_time_us":198,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":24950,"thread_start_us":300177,"threads_started":1,"wal-append.queue_time_us":556740}
I20260811 16:04:25.719007 13904 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260811 16:04:25.717190 13909 rpcz_store.cc:276] 0811 16:04:24.555048 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.575837 (+ 20789us) service_pool.cc:227] Handling call
0811 16:04:25.716342 (+1140505us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:25.745138 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 115143us
I20260811 16:04:25.745404 16488 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:25.673661 16411 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.755834 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:25.758467 14544 connection.cc:232] RPC call timeout handler was delayed by -1.1662799270125106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260811 16:04:25.755980 13739 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260811 16:04:25.723591 16402 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.009s	sys 0.003s
W20260811 16:04:25.768582 13742 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.010s	sys 0.001s
W20260811 16:04:25.869731 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 114019us
W20260811 16:04:25.870113 13742 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.010s	sys 0.001s
I20260811 16:04:25.693186 16305 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.779006 13908 rpcz_store.cc:276] 0811 16:04:23.585158 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.665958 (+2080800us) service_pool.cc:227] Handling call
0811 16:04:25.683714 (+ 17756us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.684578 (+   864us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.684797 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.882730 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:25.883560 14578 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:25.796587 13906 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260811 16:04:25.884353 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 261568us
I20260811 16:04:25.884708 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 348) took 1551 ms. Trace:
I20260811 16:04:25.885129 13906 rpcz_store.cc:276] 0811 16:04:24.333387 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.765824 (+1432437us) service_pool.cc:227] Handling call
0811 16:04:25.796124 (+ 30300us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.884453 (+ 88329us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.884653 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.749276 16435 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:25.697494 16274 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:25.766585 16199 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4.
I20260811 16:04:25.765159 16412 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:04:25.940922 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:25.942068 14577 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 2: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:25.843924 16407 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.805168 15936 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:25.699960 16373 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:25.816100 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 201769us
I20260811 16:04:25.766294 16317 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:25.767495 16434 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:25.831898 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:25.805191 16469 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.794490 16471 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:25.768730 16250 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
W20260811 16:04:25.864774 13740 rpcz_store.cc:269] 0811 16:04:23.483376 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.670268 (+186892us) service_pool.cc:227] Handling call
0811 16:04:25.018496 (+1348228us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:25.717989 (+699493us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":108161408}
I20260811 16:04:25.866146 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 342) took 2008 ms. Trace:
W20260811 16:04:25.871385 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 240265us
I20260811 16:04:25.870975 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 399) took 2601 ms. Trace:
I20260811 16:04:25.893086 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:25.767969 13817 rpcz_store.cc:276] 0811 16:04:24.521145 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.526366 (+  5221us) service_pool.cc:227] Handling call
0811 16:04:24.629468 (+103102us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.672881 (+1043413us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.673706 (+   825us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.911520 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:25.948732 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:25.949162 14611 heartbeater.cc:644] Failed to heartbeat to 127.12.23.254:34613 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.23.254:34613 timed out after 15.000s (SENT)
I20260811 16:04:25.949360 16431 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:25.950153 16491 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260811 16:04:25.950438 16458 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.490s	user 0.004s	sys 0.008s
I20260811 16:04:25.950785 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:25.951977 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:26.060597 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:25.952983 16451 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.954835 16305 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.955363 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:26.069574 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:25.957543 16274 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:26.033926 16494 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.718467 16442 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:25.869244 16488 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:25.913295 16435 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:25.994120 13743 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:25.894979 16482 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:25.995883 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:26.012200 13903 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:26.024058 13904 rpcz_store.cc:276] 0811 16:04:23.857905 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.714799 (+1856894us) service_pool.cc:227] Handling call
0811 16:04:25.718578 (+  3779us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.865863 (+147285us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.866087 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:25.895849 16480 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:26.028523 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:26.029309 14578 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:26.030985 13739 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:26.026036 13742 rpcz_store.cc:276] 0811 16:04:23.269827 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.631961 (+1362134us) service_pool.cc:227] Handling call
0811 16:04:24.632393 (+   432us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:24.632660 (+   267us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:25.119441 (+486781us) log.cc:842] Serialized 14 byte log entry
0811 16:04:25.870637 (+751196us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:25.870688 (+    51us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:25.870747 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.870808 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:25.870924 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1024213,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":20851,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":457,"thread_start_us":1153338,"threads_started":2,"wal-append.queue_time_us":656095}
I20260811 16:04:26.053258 14579 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:26.034161 13902 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260811 16:04:26.034838 14582 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:25.865046 16460 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.941048 16412 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:25.893918 16318 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260811 16:04:26.061434 13740 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:25.914196 16261 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.116s
I20260811 16:04:26.054737 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:26.023368 16434 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.996579 16407 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:26.071785 16494 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:25.997069 15948 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:26.070781 14573 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:26.763181 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.003s	sys 0.011s
W20260811 16:04:26.471781 13901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2013) took 2887 ms (client timeout 1688 ms). Trace:
W20260811 16:04:26.871918 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.006s	sys 0.011s
I20260811 16:04:26.475004 16307 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:26.476297 16365 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:26.376901 16301 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:26.844295 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:26.479053 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.94439e+06us
I20260811 16:04:26.078045 16488 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:26.845080 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 416) took 1087 ms. Trace:
I20260811 16:04:26.484028 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1330) took 1959 ms. Trace:
W20260811 16:04:26.846011 14544 connection.cc:232] RPC call timeout handler was delayed by -1.8147786050103605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260811 16:04:26.474412 16334 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.808s	user 0.008s	sys 0.004s
I20260811 16:04:25.845495 13737 rpcz_store.cc:276] 0811 16:04:23.464050 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.690025 (+2225975us) service_pool.cc:227] Handling call
0811 16:04:25.698879 (+  8854us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.701936 (+  3057us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:25.706060 (+  4124us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:25.706146 (+    86us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:25.706201 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:25.706277 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:25.706411 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:26.847123 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:26.892203 16411 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:26.892797 14579 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:26.533912 16356 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:26.889307 13825 rpcz_store.cc:276] 0811 16:04:24.524334 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.524480 (+   146us) service_pool.cc:227] Handling call
0811 16:04:24.534883 (+ 10403us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:24.571671 (+ 36788us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:24.571718 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:24.571780 (+    62us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:24.571824 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:26.483648 (+1911824us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b5400219b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:26.483714 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:26.483931 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3137,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"spinlock_wait_cycles":83047296}
W20260811 16:04:26.430958 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 345) took 2334 ms (client timeout 1931 ms). Trace:
W20260811 16:04:26.841696 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 854583us
I20260811 16:04:26.848078 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:26.895686 13906 raft_consensus.cc:595] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:26.896119 13906 raft_consensus.cc:603] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:04:26.895371 13905 rpcz_store.cc:269] 0811 16:04:24.096873 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.271386 (+174513us) service_pool.cc:227] Handling call
0811 16:04:26.430580 (+2159194us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400300a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:26.430786 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3870338944}
I20260811 16:04:26.065754 16431 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:26.841104 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:26.825950 16319 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.139s	user 0.010s	sys 0.001s
I20260811 16:04:26.851651 16434 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:26.132931 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 411) took 2661 ms. Trace:
I20260811 16:04:26.132567 16347 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:26.858709 16480 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:26.182950 16492 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260811 16:04:26.054116 16339 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:26.210712 16317 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:26.179450 16490 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260811 16:04:26.848682 16482 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:26.974531 14575 raft_consensus.cc:2396] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:26.862497 16103 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:26.863723 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:26.864230 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:26.531916 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.020s	sys 0.046s
I20260811 16:04:26.979189 14580 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:26.390110 16372 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:26.865908 13902 pending_rounds.cc:76] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 4
W20260811 16:04:26.866389 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 837901us
I20260811 16:04:26.866683 16442 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:26.867452 14582 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:04:26.269392 16471 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:26.990183 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2011) took 3432 ms (client timeout 1633 ms). Trace:
I20260811 16:04:26.870117 16264 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:26.870143 16373 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:26.870703 16412 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:04:26.028086 16469 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:26.842751 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 414) took 1085 ms. Trace:
I20260811 16:04:26.909221 16411 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260811 16:04:26.872566 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:26.872084 13901 rpcz_store.cc:269] 0811 16:04:23.584165 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.672731 (+ 88566us) service_pool.cc:227] Handling call
0811 16:04:26.471501 (+2798770us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:26.471670 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":572339456}
I20260811 16:04:26.876824 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:26.871043 16473 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.007s	sys 0.027s
W20260811 16:04:26.180886 16483 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260811 16:04:26.882545 13740 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
W20260811 16:04:26.889161 14544 connection.cc:232] RPC call timeout handler was delayed by -1.737174903973937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30810000000000004s for a response
I20260811 16:04:26.883471 14583 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:26.889250 13739 rpcz_store.cc:276] 0811 16:04:25.757802 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.892801 (+134999us) service_pool.cc:227] Handling call
0811 16:04:26.845019 (+952218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:26.890848 13706 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:26.848647 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1481) took 4468 ms (client timeout 1757 ms). Trace:
I20260811 16:04:26.896958 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 415) took 1139 ms. Trace:
W20260811 16:04:26.901629 13707 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.013s	sys 0.005s
I20260811 16:04:26.878875 16375 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:26.904882 14579 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:26.879033 16304 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:26.902971 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:26.880578 16261 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:26.881697 16365 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:26.910156 14581 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.007s	sys 0.017s
I20260811 16:04:26.880872 16362 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:26.889998 16307 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:26.901219 16356 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:26.861719 15948 ts_tablet_manager.cc:1428] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 2.957s	user 0.014s	sys 0.031s
I20260811 16:04:26.985944 13902 pending_rounds.cc:97] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260811 16:04:26.986575 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:26.901746 16486 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:26.969164 16496 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260811 16:04:26.869410 16247 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.010s	sys 0.002s
W20260811 16:04:26.872334 13709 connection.cc:232] RPC call timeout handler was delayed by -3.168777639977634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260811 16:04:26.904668 16319 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:26.979087 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:27.459991 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 557110us
I20260811 16:04:27.462196 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 686) took 1436 ms. Trace:
I20260811 16:04:27.463348 16460 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:27.463636 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1502) took 1588 ms (client timeout 1964 ms). Trace:
W20260811 16:04:27.464213 13737 rpcz_store.cc:269] 0811 16:04:25.874804 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:26.908650 (+1033846us) service_pool.cc:227] Handling call
0811 16:04:27.463562 (+554912us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:27.464721 14544 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.927s (SENT)
I20260811 16:04:27.465394 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:27.465857 15948 ts_tablet_manager.cc:1460] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Tablet startup took 3568ms
I20260811 16:04:27.465947 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:27.466707 14544 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.946s (SENT)
I20260811 16:04:27.462234 13902 raft_consensus.cc:2866] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:27.462812 16261 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:27.469774 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 483285us
I20260811 16:04:27.470582 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:27.445245 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.001s	sys 0.026s
W20260811 16:04:27.471343 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.002s	sys 0.027s
W20260811 16:04:27.471678 13787 connection.cc:232] RPC call timeout handler was delayed by -1.2186893299221992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260811 16:04:27.468842 13709 connection.cc:232] RPC call timeout handler was delayed by -2.3865496261278167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260811 16:04:27.473110 16373 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:27.473644 14581 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.463s	user 0.008s	sys 0.025s
I20260811 16:04:27.466929 16469 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:27.468288 16481 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:27.411324 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.019s
W20260811 16:04:27.475450 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.016s	sys 0.024s
I20260811 16:04:27.474923 16481 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:26.989986 16442 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:27.477240 16481 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:27.023211 14542 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.504s (SENT)
I20260811 16:04:27.478050 16486 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:26.920754 16480 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:27.469884 16372 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:27.479254 13742 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:27.479539 16372 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:27.479915 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1505) took 1602 ms (client timeout 1712 ms). Trace:
I20260811 16:04:27.480089 16372 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:26.989494 16464 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.480429 16486 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.480903 16464 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:27.481279 16375 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:27.483296 16375 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.483355 16304 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:27.485060 13744 rpcz_store.cc:269] 0811 16:04:22.380162 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:22.433526 (+ 53364us) service_pool.cc:227] Handling call
0811 16:04:22.548325 (+114799us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:26.848371 (+4300046us) spinlock_profiling.cc:243] Waited 2.99 s on lock 0x7b54000a91d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:26.848505 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6947958784}
I20260811 16:04:27.486685 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:27.486971 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.487393 13744 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:27.487825 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1504) took 1611 ms (client timeout 1876 ms). Trace:
W20260811 16:04:27.488271 13740 rpcz_store.cc:269] 0811 16:04:25.876253 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:26.843993 (+967740us) service_pool.cc:227] Handling call
0811 16:04:27.487762 (+643769us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:27.471618 16460 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:04:27.477316 13743 rpcz_store.cc:276] 0811 16:04:25.757182 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.831489 (+ 74307us) service_pool.cc:227] Handling call
0811 16:04:26.842672 (+1011183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:27.489429 16372 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:27.480461 13742 rpcz_store.cc:269] 0811 16:04:25.877102 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:26.871639 (+994537us) service_pool.cc:227] Handling call
0811 16:04:27.479855 (+608216us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:26.988090 16317 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:27.490664 16370 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:27.491745 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.492362 13742 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
W20260811 16:04:27.492949 13736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1712) took 4212 ms (client timeout 1721 ms). Trace:
W20260811 16:04:27.493444 13736 rpcz_store.cc:269] 0811 16:04:23.280001 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.376338 (+ 96337us) service_pool.cc:227] Handling call
0811 16:04:27.492699 (+4116361us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:27.492844 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4994394368}
I20260811 16:04:27.494863 16469 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:27.472520 16411 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:27.494704 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:27.496219 13707 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.844s	user 0.022s	sys 0.007s
I20260811 16:04:27.496083 16411 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:27.496446 13736 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:27.496658 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.87065e+06us
I20260811 16:04:27.497470 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.497249 16411 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.498175 16494 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.498330 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1720) took 1625 ms. Trace:
W20260811 16:04:27.499073 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0818893299438059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260811 16:04:27.499524 16481 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.490666 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.500463 16261 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.498756 13736 rpcz_store.cc:276] 0811 16:04:25.872765 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.497201 (+1624436us) service_pool.cc:227] Handling call
0811 16:04:27.498271 (+  1070us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:26.994797 13903 rpcz_store.cc:269] 0811 16:04:23.557421 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:23.568516 (+ 11095us) service_pool.cc:227] Handling call
0811 16:04:26.989992 (+3421476us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:26.990111 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4862679808}
I20260811 16:04:27.500178 16481 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.501596 13743 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:27.169322 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:27.502863 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.225970 16334 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.464943 16356 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.468153 13741 rpcz_store.cc:276] 0811 16:04:25.757502 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.843742 (+ 86240us) service_pool.cc:227] Handling call
0811 16:04:26.896899 (+1053157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:27.502913 13906 raft_consensus.cc:595] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:27.513200 13906 raft_consensus.cc:603] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:27.478402 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:27.514786 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 491662us
W20260811 16:04:27.412230 16493 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.362s	user 0.000s	sys 0.000s
I20260811 16:04:27.462736 14578 rpcz_store.cc:276] 0811 16:04:26.025556 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:26.876476 (+850920us) service_pool.cc:227] Handling call
0811 16:04:27.462127 (+585651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:26.908816 13738 rpcz_store.cc:276] 0811 16:04:23.453990 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.631067 (+2177077us) service_pool.cc:227] Handling call
0811 16:04:25.631574 (+   507us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:25.631856 (+   282us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:25.783778 (+151922us) log.cc:842] Serialized 14 byte log entry
0811 16:04:26.029155 (+245377us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:26.035115 (+  5960us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:26.061867 (+ 26752us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:26.072693 (+ 10826us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:26.115626 (+ 42933us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25110,"prepare.queue_time_us":58362,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":25686,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":23418,"thread_start_us":277413,"threads_started":2,"wal-append.queue_time_us":1179827}
I20260811 16:04:27.489627 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.527109 13739 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:27.001021 16075 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.304s	user 0.009s	sys 0.006s
W20260811 16:04:27.499603 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0719893298810348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260811 16:04:27.555675 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0719893298810348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260811 16:04:27.518241 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:27.467777 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.059s (SENT)
I20260811 16:04:27.558687 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:27.560636 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:27.485638 16304 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:27.504046 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 613269us
W20260811 16:04:27.387899 16437 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.696s	user 0.010s	sys 0.007s
I20260811 16:04:27.522228 16460 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:27.544970 16375 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:27.477553 16442 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:27.555207 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.662s	user 0.019s	sys 0.035s
W20260811 16:04:27.583676 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.690s	user 0.019s	sys 0.035s
W20260811 16:04:27.518394 16330 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.726s	user 0.012s	sys 0.003s
I20260811 16:04:27.466737 13737 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:27.520298 15699 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.004s	sys 0.007s
I20260811 16:04:26.994024 14574 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:27.505267 16464 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:27.502027 16473 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 1.659s	user 0.014s	sys 0.032s
W20260811 16:04:27.570827 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 103069us
W20260811 16:04:27.591223 14544 connection.cc:232] RPC call timeout handler was delayed by -1.5681786050554365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260811 16:04:27.506951 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 161806us
I20260811 16:04:27.526268 16431 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.472959 16362 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.563889 16356 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:27.599822 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:27.565156 16250 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:27.596380 13871 connection.cc:232] RPC call timeout handler was delayed by -2.1804883769946173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260811 16:04:27.588572 15699 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.004s	sys 0.007s
W20260811 16:04:27.605928 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 144354us
I20260811 16:04:27.601997 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:27.603533 13871 connection.cc:232] RPC call timeout handler was delayed by -2.1219883770681918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260811 16:04:27.607069 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:27.512130 16307 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.522006 16334 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.604689 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:27.577095 16500 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:27.585148 16375 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:27.607573 13871 connection.cc:232] RPC call timeout handler was delayed by -2.1147883770754561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260811 16:04:27.601303 16075 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:27.613940 16247 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.542s	user 0.010s	sys 0.012s
I20260811 16:04:27.604921 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:27.612844 14579 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:27.613615 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:27.625185 14578 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:27.570072 16261 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260811 16:04:27.619271 16375 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:27.589351 16505 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:27.580120 16437 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.568143 16482 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:27.622821 16362 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:27.623212 16334 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.626184 16380 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:27.636099 16471 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:27.612780 16372 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.630600 16431 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:27.637333 16431 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:27.612100 16250 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.613641 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:27.638682 16431 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:27.466255 15948 ts_tablet_manager.cc:1462] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Trace:
0811 16:04:08.776548 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:08.776722 (+   174us) service_pool.cc:227] Handling call
0811 16:04:08.946173 (+169451us) ts_tablet_manager.cc:928] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
0811 16:04:09.787212 (+841039us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e062a 00007f5c4e9e0552 00007f5c567fd691
0811 16:04:13.981175 (+4193963us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:04:15.503887 (+1522712us) tablet_metadata.cc:641] Metadata flushed
0811 16:04:15.544566 (+ 40679us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:04:16.203088 (+658522us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:04:16.224951 (+ 21863us) tablet_replica.cc:205] Creating consensus instance
0811 16:04:16.253730 (+ 28779us) ts_tablet_manager.cc:983] Replica registered.
0811 16:04:16.291205 (+ 37475us) inbound_call.cc:173] Queueing success response
0811 16:04:20.819913 (+4528708us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0811 16:04:23.904709 (+3084796us) ts_tablet_manager.cc:1429] Starting tablet replica
0811 16:04:23.925778 (+ 21069us) tablet_replica.cc:259] Starting instrumentation
0811 16:04:23.926324 (+   546us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":49482,"mutex_wait_us":33652,"raft.queue_time_us":7862,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":30454144,"tablet-copy.queue_time_us":168453,"tablet-download-pool.queue_time_us":5015,"tablet-download-pool.run_cpu_time_us":1611,"tablet-download-pool.run_wall_time_us":2849635,"thread_start_us":1078377,"threads_started":2}
I20260811 16:04:27.640641 16319 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.638799 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 682) took 1698 ms. Trace:
I20260811 16:04:27.643839 16481 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.637348 16307 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.644466 16347 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:27.644694 16488 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.008s
I20260811 16:04:27.645035 16347 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:27.645166 16488 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:27.653119 16375 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.660732 16437 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:27.653311 16431 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.667776 16373 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:27.669255 16431 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.654975 16488 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:27.639460 16505 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:27.657235 16103 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.682s	user 0.014s	sys 0.000s
I20260811 16:04:27.661267 16375 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.670647 16468 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.671114 16468 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.670980 16505 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.671949 16412 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.674024 16412 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.664991 16365 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.627957 16075 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.670535 16480 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:27.676200 16435 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.795s	user 0.001s	sys 0.012s
I20260811 16:04:27.676334 16365 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.676646 16075 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.676934 16480 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.676723 16435 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.682237 16442 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:27.583158 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.796783 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.797811 13736 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:27.620396 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:27.608269 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 135921us
I20260811 16:04:27.800421 16250 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.800760 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:27.801282 16486 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.803755 16103 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:27.804380 16103 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:27.804875 16103 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:27.809340 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 188916us
I20260811 16:04:27.811457 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:27.619952 13871 connection.cc:232] RPC call timeout handler was delayed by -2.0616883770562708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260811 16:04:27.812906 13871 connection.cc:232] RPC call timeout handler was delayed by -2.0409883770626038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260811 16:04:27.813488 13871 connection.cc:232] RPC call timeout handler was delayed by -2.0058883770834655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260811 16:04:27.813952 13871 connection.cc:232] RPC call timeout handler was delayed by -2.00048837705981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260811 16:04:27.814393 13871 connection.cc:232] RPC call timeout handler was delayed by -1.9932883770670742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260811 16:04:27.814851 13871 connection.cc:232] RPC call timeout handler was delayed by -1.9725883770734072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260811 16:04:27.815949 13871 connection.cc:232] RPC call timeout handler was delayed by -1.8060883770231158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260811 16:04:27.816474 13871 connection.cc:232] RPC call timeout handler was delayed by -1.6844767889706418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260811 16:04:27.816941 13871 connection.cc:232] RPC call timeout handler was delayed by -1.6521883769892156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260811 16:04:27.817343 13871 connection.cc:232] RPC call timeout handler was delayed by -1.164370110956952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260811 16:04:27.817704 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1544701110105962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260811 16:04:27.758119 13742 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:27.761013 14542 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.554s (SENT)
I20260811 16:04:27.764410 14577 raft_consensus.cc:2354] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4.
I20260811 16:04:27.765419 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.767485 14574 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:27.734925 13738 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:27.770737 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.770972 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 699) took 1889 ms. Trace:
I20260811 16:04:27.773034 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1821) took 4279 ms. Trace:
I20260811 16:04:27.774601 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.641356 14581 rpcz_store.cc:276] 0811 16:04:25.940345 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.942619 (+  2274us) service_pool.cc:227] Handling call
0811 16:04:25.943044 (+   425us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:25.943521 (+   477us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:25.943560 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:25.944102 (+   542us) log.cc:842] Serialized 26 byte log entry
0811 16:04:26.438803 (+494701us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b18002c6440. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:27.474437 (+1035634us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:27.474482 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.474558 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:27.638370 (+163812us) raft_consensus.cc:1671] finished
0811 16:04:27.638394 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:27.638724 (+   330us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":17597,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":20092,"spinlock_wait_cycles":34344320,"thread_start_us":1463160,"threads_started":1,"wal-append.queue_time_us":1581609}
W20260811 16:04:27.782541 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 700) took 1900 ms (client timeout 1566 ms). Trace:
I20260811 16:04:27.783798 16435 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.791014 15936 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.732769 13906 raft_consensus.cc:595] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:04:27.836406 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0446701110340655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260811 16:04:27.806918 16347 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:27.846573 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86277.6us
I20260811 16:04:27.850286 13906 raft_consensus.cc:603] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:27.837105 14575 rpcz_store.cc:276] 0811 16:04:25.881750 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.892790 (+ 11040us) service_pool.cc:227] Handling call
0811 16:04:27.770207 (+1877417us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:27.770645 (+   438us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2099495808}
I20260811 16:04:27.864089 13744 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:27.864387 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.867918 13741 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:27.844393 14583 rpcz_store.cc:269] 0811 16:04:25.882118 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.911163 (+ 29045us) service_pool.cc:227] Handling call
0811 16:04:27.781939 (+1870776us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54004c0c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:27.782307 (+   368us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1952827264}
I20260811 16:04:27.837322 13902 rpcz_store.cc:276] 0811 16:04:23.493420 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:24.630545 (+1137125us) service_pool.cc:227] Handling call
0811 16:04:24.863438 (+232893us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.470529 (+2607091us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.772254 (+301725us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003b01d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:27.772714 (+   460us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2691510016}
I20260811 16:04:27.870067 16411 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:27.870683 16411 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:27.871096 16411 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:27.873332 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.334s (SENT)
I20260811 16:04:27.874099 16468 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.802564 16486 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:27.875615 16407 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.866089 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1506) took 1954 ms. Trace:
I20260811 16:04:27.874004 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:27.880267 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:27.882613 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.489s (SENT)
I20260811 16:04:27.883409 16435 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:27.885155 13739 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:27.891099 13737 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:27.892302 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.862828 16068 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:27.892333 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1503) took 2016 ms. Trace:
I20260811 16:04:27.893509 13742 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:27.892530 13743 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:27.897130 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1501) took 2022 ms. Trace:
I20260811 16:04:27.897562 16486 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:27.897665 13743 rpcz_store.cc:276] 0811 16:04:25.874474 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.519311 (+1644837us) service_pool.cc:227] Handling call
0811 16:04:27.892126 (+372815us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.895246 (+  3120us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.896815 (+  1569us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540011dd50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:27.897035 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":856441088}
I20260811 16:04:27.876616 13738 rpcz_store.cc:276] 0811 16:04:25.896688 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.560475 (+1663787us) service_pool.cc:227] Handling call
0811 16:04:27.733613 (+173138us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:27.734338 (+   725us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.842925 (+108587us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.850368 (+  7443us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7345024}
I20260811 16:04:27.900506 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:27.901345 13738 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:27.902015 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:27.903074 14577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 684) took 1908 ms (client timeout 1866 ms). Trace:
I20260811 16:04:27.894632 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:27.903604 14577 rpcz_store.cc:269] 0811 16:04:25.994975 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:25.995621 (+   646us) service_pool.cc:227] Handling call
0811 16:04:27.902815 (+1907194us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400571054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:27.902997 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2096274176}
W20260811 16:04:27.903573 14542 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.923s (SENT)
I20260811 16:04:27.904865 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:27.885579 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.903364 16505 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:27.906642 16435 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:27.907878 13735 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:27.908591 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 413) took 2152 ms (client timeout 2019 ms). Trace:
W20260811 16:04:27.908975 13735 rpcz_store.cc:269] 0811 16:04:25.756686 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.773822 (+2017136us) service_pool.cc:227] Handling call
0811 16:04:27.908469 (+134647us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:27.910131 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.910797 13735 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:27.910898 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.904036 13742 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:27.911810 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:27.914137 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63875.8us
I20260811 16:04:27.906709 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:27.937048 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54573us
I20260811 16:04:27.923264 16347 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.940147 16380 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.923553 16468 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:27.964176 16468 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:27.964062 16380 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:27.965595 16468 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:27.922611 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1719) took 2050 ms (client timeout 2127 ms). Trace:
W20260811 16:04:27.955668 14542 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.931s (SENT)
I20260811 16:04:27.927608 15950 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.937821 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:27.967221 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:27.945513 13626 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to <none>, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:27.975422 16435 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:27.963008 16347 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:27.945132 13628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 210) took 18928 ms (client timeout 15000 ms). Trace:
I20260811 16:04:27.903121 13741 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:27.927987 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:27.973270 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:27.913652 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 102511us
I20260811 16:04:27.976205 13906 raft_consensus.cc:595] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:27.975541 13743 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
W20260811 16:04:27.942827 13707 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.618s (SENT)
I20260811 16:04:27.977936 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1729) took 1122 ms. Trace:
I20260811 16:04:27.981009 13744 rpcz_store.cc:276] 0811 16:04:26.855817 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.486223 (+630406us) service_pool.cc:227] Handling call
0811 16:04:27.961353 (+475130us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:27.966903 13737 rpcz_store.cc:269] 0811 16:04:25.872441 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.465625 (+1593184us) service_pool.cc:227] Handling call
0811 16:04:27.922481 (+456856us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:27.984550 13906 raft_consensus.cc:603] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:27.893414 13740 rpcz_store.cc:276] 0811 16:04:25.875955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.523995 (+1648040us) service_pool.cc:227] Handling call
0811 16:04:27.524438 (+   443us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.847405 (+322967us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:27.851935 (+  4530us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:27.867615 (+ 15680us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:27.867647 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.885050 (+ 17403us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:27.892130 (+  7080us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":99451,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":316607,"threads_started":1}
W20260811 16:04:27.988185 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 413667us
I20260811 16:04:27.988529 13741 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:04:27.989557 13744 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:04:27.988816 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1728) took 1133 ms. Trace:
I20260811 16:04:27.990206 13743 rpcz_store.cc:276] 0811 16:04:26.855551 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.985578 (+1130027us) service_pool.cc:227] Handling call
0811 16:04:27.988141 (+  2563us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.988469 (+   328us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:27.988491 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:27.988532 (+    41us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:27.988561 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.988613 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:27.988733 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":127232}
I20260811 16:04:27.990949 16486 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.991561 16400 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:27.992309 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1725) took 1137 ms. Trace:
I20260811 16:04:27.992776 13741 rpcz_store.cc:276] 0811 16:04:26.854760 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.987395 (+1132635us) service_pool.cc:227] Handling call
0811 16:04:27.988024 (+   629us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.989252 (+  1228us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.992248 (+  2996us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51840}
I20260811 16:04:27.992138 16400 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:27.927868 16517 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.994777 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.957324 16103 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:27.992568 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:27.997745 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:27.921219 16442 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:27.998678 16400 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.000586 13742 raft_consensus.cc:2396] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:27.997006 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1508) took 1136 ms. Trace:
I20260811 16:04:28.001299 13744 rpcz_store.cc:276] 0811 16:04:26.856396 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.987443 (+1131047us) service_pool.cc:227] Handling call
0811 16:04:27.989252 (+  1809us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:27.992372 (+  3120us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:27.992556 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17280}
I20260811 16:04:28.006438 16103 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:28.012122 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 127684us
I20260811 16:04:28.006201 16411 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.013958 16469 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:28.014424 16469 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.014747 16469 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.015084 16411 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.016144 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:28.017799 16494 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:28.018299 16494 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.018735 16494 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:27.928283 16521 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:27.991952 16486 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.022949 13739 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:27.975641 15950 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.043556 13735 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260811 16:04:28.042340 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:04:28.045745 15950 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.049994 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:28.044669 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:28.050665 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 406835us
I20260811 16:04:28.051090 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.043025 16347 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:28.052100 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48802.7us
I20260811 16:04:28.052351 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:28.053066 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.042060 16522 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:28.056013 16505 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:28.058816 16505 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:28.056545 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53037.5us
I20260811 16:04:28.058007 16261 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:28.059908 16261 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.060353 16488 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:28.060890 16488 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.055756 16380 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:28.056592 14577 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:28.060952 16505 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:28.060370 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:28.060631 16261 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.063445 16347 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:28.065979 15936 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:28.057502 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1510) took 1200 ms. Trace:
I20260811 16:04:28.061376 16488 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.068410 13737 rpcz_store.cc:276] 0811 16:04:26.856942 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.002979 (+1146037us) service_pool.cc:227] Handling call
0811 16:04:28.055632 (+ 52653us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:28.056884 (+  1252us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:28.056935 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:28.057009 (+    74us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:28.057090 (+    81us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:28.057192 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:28.057391 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":786,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":124}
I20260811 16:04:28.071942 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.073211 16435 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:27.978092 13628 rpcz_store.cc:269] 0811 16:04:09.016199 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:09.028768 (+ 12569us) service_pool.cc:227] Handling call
0811 16:04:27.944815 (+18916047us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:23.375637 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:23.376144 (+   507us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:23.376210 (+    66us) write_op.cc:435] Acquired schema lock
0811 16:04:23.376235 (+    25us) tablet.cc:660] Decoding operations
0811 16:04:23.436625 (+ 60390us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:23.436703 (+    78us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:23.436734 (+    31us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:04:23.436939 (+   205us) tablet.cc:699] Row locks acquired
0811 16:04:23.436955 (+    16us) write_op.cc:260] PREPARE: finished
0811 16:04:23.437118 (+   163us) write_op.cc:270] Start()
0811 16:04:23.437253 (+   135us) write_op.cc:276] Timestamp: P: 1786464263437064 usec, L: 0
0811 16:04:23.437273 (+    20us) op_driver.cc:331] REPLICATION: starting
0811 16:04:23.438076 (+   803us) log.cc:842] Serialized 536 byte log entry
0811 16:04:25.797678 (+2359602us) op_driver.cc:444] REPLICATION: finished
0811 16:04:26.911225 (+1113547us) write_op.cc:301] APPLY: starting
0811 16:04:26.911375 (+   150us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:26.911526 (+   151us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:26.989402 (+ 77876us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:27.045714 (+ 56312us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:27.045956 (+   242us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 16:04:27.046011 (+    55us) write_op.cc:312] APPLY: finished
0811 16:04:27.046242 (+   231us) log.cc:842] Serialized 23 byte log entry
0811 16:04:27.510285 (+464043us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:27.510399 (+   114us) write_op.cc:454] Released schema lock
0811 16:04:27.510445 (+    46us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:27.511063 (+   618us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:27.511110 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":540398,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1091289,"apply.run_cpu_time_us":14805,"apply.run_wall_time_us":600276,"num_ops":1,"prepare.queue_time_us":574700,"prepare.run_cpu_time_us":57353,"prepare.run_wall_time_us":194803,"raft.queue_time_us":617805,"raft.run_cpu_time_us":48338,"raft.run_wall_time_us":1851618,"replication_time_us":2341847,"thread_start_us":3039338,"threads_started":5,"wal-append.queue_time_us":902125,"wal-append.run_cpu_time_us":18832,"wal-append.run_wall_time_us":2772972}]]}
I20260811 16:04:28.073741 16435 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.074501 16435 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.074498 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.075791 16250 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:28.076185 16250 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.076524 16250 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.073252 16400 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.085934 16486 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:28.050843 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1507) took 1194 ms. Trace:
W20260811 16:04:28.094154 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 81041.2us
I20260811 16:04:28.086912 13626 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 4, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 4 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:28.111783 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:28.113581 13743 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:28.095786 16521 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.118547 16521 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.125751 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:28.124485 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:28.123952 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.126528 16068 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:28.122797 14583 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:28.122562 14575 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Advancing to term 3
I20260811 16:04:28.124598 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.123601 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.121071 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.087941 16400 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:28.141639 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 186120us
I20260811 16:04:28.056718 13738 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:28.144783 14582 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:28.145823 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:28.148211 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45465.1us
I20260811 16:04:28.150728 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:28.156601 14578 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:28.161689 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 93880.3us
W20260811 16:04:28.162204 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 219732us
I20260811 16:04:28.095757 13735 rpcz_store.cc:276] 0811 16:04:26.856132 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:27.994352 (+1138220us) service_pool.cc:227] Handling call
0811 16:04:28.043014 (+ 48662us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:28.050495 (+  7481us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:28.050778 (+   283us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:28.163335 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68170.1us
I20260811 16:04:28.131052 16517 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:28.166925 14542 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.951s (SENT)
I20260811 16:04:28.172711 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:28.149237 13626 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:28.175310 14574 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:28.184808 13707 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.647s (SENT)
I20260811 16:04:28.183190 16103 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:28.176149 16456 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:28.199240 16488 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.203313 13789 leader_election.cc:398] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3.
I20260811 16:04:28.203846 13789 leader_election.cc:401] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260811 16:04:28.204396 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:28.206102 13707 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.655s (SENT)
I20260811 16:04:28.190299 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:28.192267 14580 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEARNER]: Advancing to term 3
I20260811 16:04:28.195897 13825 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:28.196331 16494 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.197635 16372 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:28.199860 16365 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:28.199417 16103 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.216162 16456 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:28.186568 16435 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:28.218329 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77609.1us
I20260811 16:04:28.224680 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 420) took 1168 ms. Trace:
I20260811 16:04:28.225517 16471 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:28.225423 16431 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260811 16:04:28.227082 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52229.3us
I20260811 16:04:28.227730 16486 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3.
I20260811 16:04:28.229110 16522 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:28.219910 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1509) took 1357 ms. Trace:
I20260811 16:04:28.227157 16521 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:28.237075 16103 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:28.220635 13626 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 4, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:04:28.240339 14582 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:28.242844 13825 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:28.245265 13871 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 2 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 2. Current term is 3.
I20260811 16:04:28.245036 13817 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260811 16:04:28.247967 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44270.9us
I20260811 16:04:28.207618 16488 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:28.249039 13707 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.686s (SENT)
I20260811 16:04:28.221037 16372 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:28.269109 14581 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:28.178025 16250 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.238724 13742 rpcz_store.cc:276] 0811 16:04:27.056018 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.004536 (+948518us) service_pool.cc:227] Handling call
0811 16:04:28.005127 (+   591us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:28.005745 (+   618us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:28.005771 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:28.006408 (+   637us) log.cc:842] Serialized 26 byte log entry
0811 16:04:28.040510 (+ 34102us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:28.040545 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:28.040610 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:28.224411 (+183801us) raft_consensus.cc:1671] finished
0811 16:04:28.224439 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:28.224599 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1532,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":233,"thread_start_us":33692,"threads_started":1,"wal-append.queue_time_us":141120}
I20260811 16:04:28.248327 16471 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.255095 16468 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:28.255990 13741 rpcz_store.cc:276] 0811 16:04:26.856674 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.004267 (+1147593us) service_pool.cc:227] Handling call
0811 16:04:28.059530 (+ 55263us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:28.059798 (+   268us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:28.059827 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:28.060565 (+   738us) log.cc:842] Serialized 26 byte log entry
0811 16:04:28.159018 (+ 98453us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:28.159052 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:28.159124 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:28.213860 (+ 54736us) raft_consensus.cc:1671] finished
0811 16:04:28.213891 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:28.214268 (+   377us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":98078,"threads_started":1,"wal-append.queue_time_us":128419}
I20260811 16:04:28.291512 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:28.277539 16468 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:28.292857 13707 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.773s (SENT)
W20260811 16:04:28.320174 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 43711.3us
I20260811 16:04:28.277751 16471 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:28.339268 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.340440 14581 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:28.332075 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.282521 13626 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:28.347747 14578 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:28.279500 16521 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:28.355229 16528 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260811 16:04:28.355544 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.329221 16468 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.315434 16517 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.362270 14582 raft_consensus.cc:2396] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:28.337234 15936 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:28.373622 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88139.6us
W20260811 16:04:28.416327 16527 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260811 16:04:28.346596 16261 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.375500 15936 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.382782 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.418478 13626 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 4, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:04:28.471391 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 226300us
I20260811 16:04:28.421310 16469 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.373663 16372 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.481374 14582 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260811 16:04:28.482331 16494 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:28.483261 16530 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
I20260811 16:04:28.483278 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:28.495685 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:28.365170 13707 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.891s (SENT)
I20260811 16:04:28.488641 16435 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:28.356496 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.399464 16505 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.516878 13817 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:28.517928 16372 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:28.518591 16505 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:28.511730 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 236359us
I20260811 16:04:28.514158 14581 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260811 16:04:28.530586 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.531415 13827 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.532799 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.533692 13820 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:28.535867 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.536479 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.537231 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.537824 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.515873 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:28.538630 13826 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:28.538671 13906 raft_consensus.cc:2362] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5. Re-sending same reply.
I20260811 16:04:28.495195 16103 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:28.519712 16365 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:28.540099 13826 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:04:28.540216 16365 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:28.540114 16103 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.541092 16477 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:28.541579 16477 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.541936 16477 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.541745 16365 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.543510 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:28.520218 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 209051us
I20260811 16:04:28.520641 16261 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.495923 15936 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:28.546561 16250 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:28.547415 13827 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:04:28.548579 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.548964 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.549943 13901 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:28.550314 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.534693 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.551097 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:28.551579 13820 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:28.552027 13626 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:28.552629 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.552688 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.553522 13905 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:28.553552 13820 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:28.554605 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.553993 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:28.554766 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.543037 16103 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:28.514896 13902 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260811 16:04:28.505335 16456 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:28.536562 13823 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.527976 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.556540 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.557210 13900 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:28.550969 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.558097 13901 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:28.558293 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.559217 13907 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:28.549233 13827 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:28.556002 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.552065 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.562852 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:28.563483 13741 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.565308 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.565745 13820 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.566036 13818 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.567548 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.568267 13818 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.569269 13825 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:28.528237 16469 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.514190 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.544725 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.555994 16456 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:28.573644 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:28.575675 13741 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:28.584551 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:28.581048 13823 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:28.585424 13741 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.586927 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.591267 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.592372 13823 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.593294 13826 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:28.596410 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:28.598294 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 121869us
I20260811 16:04:28.600015 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.600826 13907 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:04:28.601824 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89000.9us
I20260811 16:04:28.602936 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.603020 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:28.604219 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.605566 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.606371 16486 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:28.606853 16486 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.583521 16380 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260811 16:04:28.607223 16411 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:28.608096 16261 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:04:28.608539 16103 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:28.578981 16521 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.607247 16486 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.611953 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.612605 13821 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.614176 13817 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:28.614375 13818 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:28.590261 16517 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:28.615393 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.616281 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 419) took 1580 ms. Trace:
I20260811 16:04:28.639299 13744 rpcz_store.cc:276] 0811 16:04:27.036124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.020232 (+984108us) service_pool.cc:227] Handling call
0811 16:04:28.051617 (+ 31385us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:28.227391 (+175774us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:28.227785 (+   394us) log.cc:842] Serialized 14 byte log entry
0811 16:04:28.491687 (+263902us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:28.495464 (+  3777us) log.cc:842] Serialized 26 byte log entry
0811 16:04:28.495587 (+   123us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:28.495620 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:28.599112 (+103492us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:28.599211 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:28.615935 (+ 16724us) raft_consensus.cc:1671] finished
0811 16:04:28.616061 (+   126us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:28.616202 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39624,"prepare.queue_time_us":890,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":40814,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":10177,"spinlock_wait_cycles":296361728,"thread_start_us":263436,"threads_started":1,"wal-append.queue_time_us":267494}
I20260811 16:04:28.617475 13706 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.619590 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.642380 13825 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:28.621248 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:28.639424 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.628602 15936 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:28.629853 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 276236us
I20260811 16:04:28.630874 16456 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.633066 13908 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:28.634896 13820 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:28.637630 16477 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.642545 13823 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
W20260811 16:04:28.680190 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59089.8us
I20260811 16:04:28.681519 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.682318 13820 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:28.683509 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.678139 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:28.630318 16486 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.661296 13817 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.661605 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.662606 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.660344 13826 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:28.662178 16435 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:28.696393 16068 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:28.699965 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.709486 13823 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:28.704139 13907 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260811 16:04:28.705664 13822 raft_consensus.cc:2354] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5.
I20260811 16:04:28.683079 16522 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:28.708958 13909 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:28.708835 16068 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:28.713400 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.713475 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.727460 13818 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.714123 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.675663 16517 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260811 16:04:28.728658 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.711412 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:28.698406 13626 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:04:28.709331 16380 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:28.705430 16456 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.741798 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.757041 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:28.757067 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 150952us
I20260811 16:04:28.719487 16435 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:28.765033 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.728893 16505 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:28.763300 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.763653 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.764323 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.765107 16471 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:28.741160 16250 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260811 16:04:28.766256 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.766829 16486 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:28.776962 13823 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:28.766974 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.767223 13824 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:28.782068 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:28.768873 16477 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:28.769681 16517 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:28.729018 16068 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.760074 13826 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.773564 13741 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:28.740459 16380 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:28.789521 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.772540 16522 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:28.777464 13821 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:28.771716 16468 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.783610 13818 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.788988 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:28.759457 15936 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:28.784366 13822 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:28.784613 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.814972 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:28.785909 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 95632.9us
W20260811 16:04:28.815733 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 228876us
W20260811 16:04:28.786909 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 180121us
I20260811 16:04:28.780712 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.794422 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.801772 13823 raft_consensus.cc:2354] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:28.783198 13817 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:28.855440 13908 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:29.001318 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.820366 13901 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260811 16:04:29.002974 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.844130 13904 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:28.845783 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.028513 13905 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:29.030644 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.031517 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:28.835734 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:29.002506 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:28.840870 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.032186 13906 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:28.953469 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:28.829357 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.821723 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.865360 13820 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
W20260811 16:04:28.991767 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 232473us
I20260811 16:04:29.025377 13818 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:28.785722 16517 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:28.947158 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 240334us
I20260811 16:04:28.817421 13826 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:28.838246 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.878954 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:29.001968 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:28.792133 16380 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:29.030037 13901 pending_rounds.cc:76] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 5
I20260811 16:04:29.038050 13900 raft_consensus.cc:2354] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
W20260811 16:04:29.038851 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 203194us
I20260811 16:04:29.039805 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:29.040186 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.041419 13907 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:28.829803 16535 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260811 16:04:29.039348 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.043406 13905 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260811 16:04:29.064670 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.045163 16546 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:28.958006 16505 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:29.047286 13900 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:04:28.854528 16435 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:29.067605 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.068279 13900 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:29.038025 13901 pending_rounds.cc:97] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260811 16:04:29.047876 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.048388 16471 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:28.846283 16068 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:28.926960 16411 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:29.053064 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.053653 13821 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:29.053782 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.054574 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.826607 15983 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:29.042923 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.055500 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:29.056341 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.057313 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:28.929999 14542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.057s (SENT) [suppressed 44 similar messages]
I20260811 16:04:29.005204 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-c390fd23cec5435d81b38a50b2988a60 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:04:29.040448 13825 raft_consensus.cc:2362] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5. Re-sending same reply.
I20260811 16:04:29.062820 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:29.062995 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:28.826586 16532 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.369s
I20260811 16:04:28.843779 16468 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:29.037955 16469 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:29.066434 16505 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:28.950559 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-a48002159c1643c489d152b863d3d839 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:04:28.845093 16481 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.217s
I20260811 16:04:28.842355 16522 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:29.068380 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.345177 13907 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:29.345927 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.346181 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:29.346787 13904 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:29.347472 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:29.083159 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 209427us
I20260811 16:04:29.349478 13827 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:29.350129 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:29.350391 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.351054 16544 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:29.351527 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 293928us
W20260811 16:04:29.178618 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45779.7us
I20260811 16:04:29.353297 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:29.158949 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 97980.3us
W20260811 16:04:29.296439 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 254005us
I20260811 16:04:29.355845 13908 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:29.081087 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:29.368734 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 438731us
I20260811 16:04:29.352124 13901 raft_consensus.cc:2866] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:29.357179 13903 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:29.382953 13822 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:29.372747 13909 raft_consensus.cc:2362] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4. Re-sending same reply.
I20260811 16:04:29.384297 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.385063 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:29.360363 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.385857 13826 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:29.387063 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:29.298059 16526 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260811 16:04:29.388059 13826 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:29.391265 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.395450 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.396394 13827 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:29.398742 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.400832 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.385120 13907 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:29.330847 16521 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:29.403944 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:29.404850 13900 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:29.404224 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:29.400045 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.408974 13909 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:29.410666 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.411835 14578 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260811 16:04:29.386969 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-c390fd23cec5435d81b38a50b2988a60 on tablet c390fd23cec5435d81b38a50b2988a60 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:29.413425 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.415393 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.416539 13908 raft_consensus.cc:2396] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:29.421293 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.251037 16546 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:29.421353 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.426297 13818 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:29.369081 16544 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:29.413868 13825 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:29.427129 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:29.424620 13820 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:29.429224 13825 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:29.420210 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.431252 14580 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:29.431471 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:29.433677 13826 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260811 16:04:29.438259 14542 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.076s (SENT)
W20260811 16:04:29.414937 16456 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.001s
I20260811 16:04:29.441380 13907 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:29.398833 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-a48002159c1643c489d152b863d3d839 on tablet a48002159c1643c489d152b863d3d839 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:29.445011 13905 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260811 16:04:29.463742 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:29.449236 13905 pending_rounds.cc:76] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 4
I20260811 16:04:29.484930 13905 pending_rounds.cc:97] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260811 16:04:29.489063 13908 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260811 16:04:29.485296 13905 raft_consensus.cc:2866] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:29.081279 16517 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:29.495569 16517 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:29.495668 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 268163us
W20260811 16:04:29.497130 16556 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260811 16:04:29.501834 16469 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:29.081602 16553 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.381s
I20260811 16:04:29.502568 16469 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:29.503945 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 688) took 1382 ms. Trace:
I20260811 16:04:29.505040 16469 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:29.505800 16469 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:04:29.434372 16544 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:29.437605 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 694) took 1202 ms. Trace:
I20260811 16:04:29.559522 13827 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260811 16:04:29.561658 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 156983us
I20260811 16:04:29.443378 16521 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:29.565574 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52206.1us
W20260811 16:04:29.570345 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 159788us
W20260811 16:04:29.572314 14544 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.554s (SENT)
I20260811 16:04:29.573037 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:29.513892 16372 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260811 16:04:29.579041 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.566406 15983 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:29.573814 16541 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.351s	user 0.004s	sys 0.001s
W20260811 16:04:29.592417 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90348.3us
I20260811 16:04:29.597788 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:29.598644 13827 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:29.599614 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 221084us
I20260811 16:04:29.620982 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:29.626536 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:29.618459 16551 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260811 16:04:29.564225 16411 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:29.593103 16563 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:29.562930 16560 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:29.567809 16546 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:29.625103 16068 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:29.625842 16481 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:29.638674 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.596s (SENT)
I20260811 16:04:29.655392 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:29.643954 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:29.645211 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:29.645870 16372 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260811 16:04:29.646808 13744 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:29.548000 14574 rpcz_store.cc:276] 0811 16:04:28.232140 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.239738 (+  7598us) service_pool.cc:227] Handling call
0811 16:04:28.240152 (+   414us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:28.240653 (+   501us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:28.240695 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:28.241252 (+   557us) log.cc:842] Serialized 26 byte log entry
0811 16:04:28.590042 (+348790us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:28.595660 (+  5618us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:28.603685 (+  8025us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:29.389872 (+786187us) raft_consensus.cc:1671] finished
0811 16:04:29.389900 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:29.422871 (+ 32971us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":14912,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6083,"thread_start_us":336969,"threads_started":1,"wal-append.queue_time_us":463611}
I20260811 16:04:29.668473 13823 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260811 16:04:29.669299 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2093) took 1068 ms. Trace:
I20260811 16:04:29.669628 13823 rpcz_store.cc:276] 0811 16:04:28.600401 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.420955 (+820554us) service_pool.cc:227] Handling call
0811 16:04:29.667912 (+246957us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:29.668164 (+   252us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:29.669006 (+   842us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:29.669236 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54217600}
W20260811 16:04:29.673934 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53097.7us
I20260811 16:04:29.676433 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:29.675966 16564 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:29.679531 16068 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:29.679971 16068 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:29.680488 16068 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:29.682283 16469 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:29.682704 16469 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:29.683252 16560 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:29.683801 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:29.685168 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:29.655176 16572 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:29.694522 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:29.695655 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:29.698839 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72360.9us
I20260811 16:04:29.700311 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:29.694420 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:29.701112 13709 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.773s (SENT)
I20260811 16:04:29.701746 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:29.704926 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70798.5us
I20260811 16:04:29.706920 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:29.708410 13823 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:29.670259 16365 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260811 16:04:29.694299 16468 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:29.702657 16562 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260811 16:04:29.719322 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44240.1us
I20260811 16:04:29.695502 16372 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:29.720887 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 142355us
I20260811 16:04:29.725997 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:29.726473 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.601s (SENT)
I20260811 16:04:29.669783 16481 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:29.745844 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:29.720305 16563 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:29.720124 16572 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:29.748973 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:29.760607 13823 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:29.764752 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:29.751387 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:29.768136 13742 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:29.717132 16468 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:29.504498 14575 rpcz_store.cc:276] 0811 16:04:28.121702 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.121838 (+   136us) service_pool.cc:227] Handling call
0811 16:04:28.122341 (+   503us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:28.262337 (+139996us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:28.263969 (+  1632us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:28.327260 (+ 63291us) log.cc:842] Serialized 26 byte log entry
0811 16:04:28.811529 (+484269us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:29.061795 (+250266us) log.cc:842] Serialized 14 byte log entry
0811 16:04:29.437782 (+375987us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:29.461695 (+ 23913us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:29.487559 (+ 25864us) raft_consensus.cc:1671] finished
0811 16:04:29.487586 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:29.503853 (+ 16267us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":69418,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":288510,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":5623,"spinlock_wait_cycles":10141952,"thread_start_us":793311,"threads_started":3,"wal-append.queue_time_us":641014}
I20260811 16:04:29.780210 13826 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260811 16:04:29.677901 16570 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260811 16:04:29.724762 16372 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:29.775488 13825 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:29.781687 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60930.6us
W20260811 16:04:29.781903 13906 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.001s
I20260811 16:04:29.743815 16521 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:29.781484 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:29.788723 13906 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:29.799630 13826 raft_consensus.cc:2354] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:29.802965 13826 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260811 16:04:29.807045 13826 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:29.754657 16365 consensus_queue.cc:1225] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:29.804994 13825 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:29.780301 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:29.782943 16564 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:29.781061 16468 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:29.805025 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:29.705166 15983 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:29.783402 16431 raft_consensus.cc:2741] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260811 16:04:29.872426 16561 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260811 16:04:29.873641 16561 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:29.874022 16561 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:29.875890 16581 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260811 16:04:29.817945 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:29.861799 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 172732us
I20260811 16:04:29.844759 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:29.867728 13823 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:29.871907 16576 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260811 16:04:29.857366 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 130922us
I20260811 16:04:29.793388 16372 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:29.798578 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:29.879771 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:29.879813 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:29.888759 13740 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 5
I20260811 16:04:29.754495 16469 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:29.873651 16571 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260811 16:04:29.912809 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:29.905009 16576 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:29.922034 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.858s (SENT)
I20260811 16:04:29.919240 16584 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:29.928400 13707 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.633s (SENT)
I20260811 16:04:29.924764 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:29.887166 16505 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:29.912497 16572 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:29.875007 16561 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:29.912163 16580 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260811 16:04:30.080197 16579 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:29.992336 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 291247us
I20260811 16:04:30.026036 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.082192 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2096) took 1480 ms. Trace:
I20260811 16:04:30.082994 13742 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:30.082794 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.633s (SENT)
I20260811 16:04:30.092742 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:29.941157 13707 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.688s (SENT)
I20260811 16:04:30.087742 13821 rpcz_store.cc:276] 0811 16:04:28.601365 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.423075 (+821710us) service_pool.cc:227] Handling call
0811 16:04:29.437448 (+ 14373us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:29.629883 (+192435us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:29.629909 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:29.639528 (+  9619us) log.cc:842] Serialized 26 byte log entry
0811 16:04:29.793843 (+154315us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:29.920448 (+126605us) log.cc:842] Serialized 14 byte log entry
0811 16:04:29.925302 (+  4854us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:29.925384 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:29.925423 (+    39us) raft_consensus.cc:1671] finished
0811 16:04:29.925439 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:30.082131 (+156692us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":46865,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":105396,"thread_start_us":287321,"threads_started":3,"wal-append.queue_time_us":160967}
I20260811 16:04:30.096217 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:30.097301 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 297965us
I20260811 16:04:29.924211 13737 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
W20260811 16:04:30.102135 16544 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
W20260811 16:04:30.057598 16582 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260811 16:04:30.142627 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:30.144932 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 261626us
I20260811 16:04:29.924583 16576 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.144280 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 464) took 1290 ms. Trace:
W20260811 16:04:30.146732 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 227158us
I20260811 16:04:30.081584 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 465) took 1228 ms. Trace:
W20260811 16:04:30.102628 16587 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260811 16:04:29.975481 16584 raft_consensus.cc:2741] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260811 16:04:30.150631 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.176317 13744 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:30.096215 16469 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.197216 16468 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.102393 16597 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:30.199529 16597 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:30.200598 16468 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:30.201129 16597 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.097841 13736 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:30.160229 16572 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.099733 16505 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:30.138329 16570 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:30.099438 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.160972 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.163201 16567 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260811 16:04:30.168701 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.866s (SENT)
I20260811 16:04:30.214998 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:30.216593 13739 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.031s	sys 0.052s
W20260811 16:04:30.217083 13739 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.031s	sys 0.052s
W20260811 16:04:30.217818 13827 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.006s
I20260811 16:04:30.156936 13824 rpcz_store.cc:276] 0811 16:04:28.852893 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.381875 (+528982us) service_pool.cc:227] Handling call
0811 16:04:29.509044 (+127169us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:30.096022 (+586978us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9acb7c 00007f5c4e9ac73b 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:30.143656 (+ 47634us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17070592}
I20260811 16:04:30.174814 15983 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:30.185061 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.185653 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.185837 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.159791 16561 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.228307 13825 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:30.186811 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.149494 16544 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.149664 16481 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:30.196198 16380 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.135s	user 0.014s	sys 0.000s
I20260811 16:04:30.240170 13822 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260811 16:04:30.239852 16380 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.241325 16564 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:30.241827 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 477196us
W20260811 16:04:30.175086 14544 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.923s (SENT)
W20260811 16:04:30.242959 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 313734us
I20260811 16:04:29.975841 16365 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:30.249296 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 369635us
I20260811 16:04:30.250415 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:30.219264 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.044s
I20260811 16:04:30.224014 13821 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.230171 13823 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:30.254632 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.011s	sys 0.044s
I20260811 16:04:30.249648 13740 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:30.236639 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:30.237052 16068 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.001s
W20260811 16:04:30.247395 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 164671us
I20260811 16:04:30.248553 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.252295 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.252468 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.225101 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:30.256711 16380 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:30.257179 13823 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:30.259106 14574 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:04:30.259923 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:30.260922 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 85870.1us
I20260811 16:04:30.261441 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.262776 13818 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260811 16:04:30.310412 14544 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.935s (SENT)
I20260811 16:04:30.311107 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2108) took 1689 ms. Trace:
I20260811 16:04:30.311123 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:30.223467 13735 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.313385 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.308080 16505 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:30.314285 14578 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:30.218796 16570 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.270056 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.270320 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.270905 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1351) took 1013 ms. Trace:
I20260811 16:04:30.271396 16469 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:30.271842 16544 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:30.265519 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:30.276641 13821 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:30.266880 16365 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:30.284677 16517 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.007s
W20260811 16:04:30.285591 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 135972us
I20260811 16:04:30.323617 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:30.269385 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 555783us
I20260811 16:04:30.234952 13742 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:30.301208 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.299892 13824 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:30.311568 13818 rpcz_store.cc:276] 0811 16:04:28.621899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.433707 (+811808us) service_pool.cc:227] Handling call
0811 16:04:30.262183 (+828476us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:30.262395 (+   212us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:30.310861 (+ 48466us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:30.311048 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":55810944}
I20260811 16:04:30.294287 16068 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:30.313591 13709 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.686s (SENT)
I20260811 16:04:30.325915 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:30.326040 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77700.6us
I20260811 16:04:30.326658 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:30.267032 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:30.314736 14575 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:30.318255 13826 rpcz_store.cc:276] 0811 16:04:29.257824 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.855692 (+597868us) service_pool.cc:227] Handling call
0811 16:04:29.856044 (+   352us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:29.856309 (+   265us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:29.856333 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:29.856945 (+   612us) log.cc:842] Serialized 26 byte log entry
0811 16:04:30.067458 (+210513us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:30.067524 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:30.067634 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:30.270691 (+203057us) raft_consensus.cc:1671] finished
0811 16:04:30.270712 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:30.270843 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":151187,"threads_started":1,"wal-append.queue_time_us":296035}
I20260811 16:04:30.320334 14580 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:30.325207 13740 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260811 16:04:30.328332 13824 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:30.324087 13787 connection.cc:232] RPC call timeout handler was delayed by -1.6336822010343894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260811 16:04:30.319180 16411 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:30.320358 16563 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.005s
W20260811 16:04:30.330293 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63393.9us
I20260811 16:04:30.329685 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.332681 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.332984 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:30.329622 16435 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:30.342506 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.342880 16435 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:30.343376 16435 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:30.343580 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.344326 16576 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.345387 16372 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:04:30.346127 16591 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.548s	user 0.006s	sys 0.004s
I20260811 16:04:30.346575 16576 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:30.321862 16546 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:30.173745 13817 rpcz_store.cc:276] 0811 16:04:28.853300 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.447553 (+594253us) service_pool.cc:227] Handling call
0811 16:04:29.562860 (+115307us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:29.583834 (+ 20974us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:29.589583 (+  5749us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:29.638998 (+ 49415us) log.cc:842] Serialized 26 byte log entry
0811 16:04:29.877689 (+238691us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:29.883987 (+  6298us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:29.904959 (+ 20972us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:30.081288 (+176329us) raft_consensus.cc:1671] finished
0811 16:04:30.081318 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:30.081482 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":155819,"threads_started":1,"wal-append.queue_time_us":274221}
I20260811 16:04:30.347338 13738 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:30.347832 16563 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:30.332276 16560 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:30.348584 16469 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:30.349453 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.334532 13824 raft_consensus.cc:2362] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3. Re-sending same reply.
I20260811 16:04:30.349747 16469 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:30.335317 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:04:30.351827 13709 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.955s (SENT)
I20260811 16:04:30.352310 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:30.354746 16561 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:30.337101 16411 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.339231 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.339934 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.340894 14579 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:30.336470 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.341287 16570 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:30.341519 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.341645 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.341938 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.342340 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.333936 13743 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 2.
I20260811 16:04:30.348693 14578 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260811 16:04:30.370257 16574 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.517s	user 0.004s	sys 0.004s
I20260811 16:04:30.371447 13826 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:30.371730 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.372502 16411 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:30.372649 13737 raft_consensus.cc:2396] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260811 16:04:30.372916 16517 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:30.365790 16372 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:30.358479 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.355219 16561 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:30.374323 16561 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.374775 14583 raft_consensus.cc:2396] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:30.335753 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.355015 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:30.376617 14577 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.377770 13820 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:30.378528 13744 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:30.373374 14582 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.372943 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.350324 13741 raft_consensus.cc:2396] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:30.355971 16544 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260811 16:04:30.341014 13736 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:30.381477 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1350) took 1781 ms. Trace:
I20260811 16:04:30.376582 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:30.355880 14542 leader_election.cc:398] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:30.388877 14542 leader_election.cc:401] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260811 16:04:30.383280 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:30.386659 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.390638 16570 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:30.391278 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.392599 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.393303 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.365644 16250 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:30.395395 13744 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260811 16:04:30.395503 16250 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:30.395812 13744 pending_rounds.cc:76] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 5
I20260811 16:04:30.396083 13744 pending_rounds.cc:97] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260811 16:04:30.396319 13744 raft_consensus.cc:2866] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:30.396502 16250 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.373561 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.412088 13744 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:30.336840 16572 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:30.387991 13822 rpcz_store.cc:276] 0811 16:04:28.600070 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.409601 (+809531us) service_pool.cc:227] Handling call
0811 16:04:29.441095 (+ 31494us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:30.240640 (+799545us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:30.363101 (+122461us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400385c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:30.381422 (+ 18321us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1837043072}
I20260811 16:04:30.415305 14577 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
W20260811 16:04:30.417958 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62235.9us
I20260811 16:04:30.419757 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.397882 16250 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.422703 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:30.418952 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83893.6us
I20260811 16:04:30.424770 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:30.427803 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.428922 13741 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:30.362073 16068 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:30.430481 13743 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:30.433660 14582 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:30.420861 16261 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:30.419054 16372 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:30.414644 16572 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:30.369858 13735 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:30.437366 14577 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260811 16:04:30.397954 16505 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:30.419787 16517 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:30.465008 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.468171 13740 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:30.470650 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.440590 16261 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:30.470929 14583 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:30.438860 16559 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:30.470985 14579 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:30.474366 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.475340 14580 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:30.430321 13737 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:30.475786 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:30.473528 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.471397 16431 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:30.476477 14578 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:30.471597 14581 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.478701 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:30.421985 16380 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260811 16:04:30.447268 16572 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.479990 14577 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:30.456142 16505 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:30.481946 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:30.462766 16620 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260811 16:04:30.482725 16607 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260811 16:04:30.449358 16560 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260811 16:04:30.483991 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.484247 16604 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:30.476940 16570 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:30.485388 16610 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260811 16:04:30.485759 16575 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:30.485967 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:30.487094 16567 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:30.448318 16372 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:30.473423 16261 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:30.493328 14579 raft_consensus.cc:2354] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3.
I20260811 16:04:30.475438 16521 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:30.484493 16597 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:30.442399 16546 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260811 16:04:30.470666 16517 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.480350 15983 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260811 16:04:30.491457 16505 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.519788 16595 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:30.508291 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.499935 16584 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:30.522367 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:30.526424 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:30.533828 13741 raft_consensus.cc:1203] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[5.6-5.6]   Dedup: 5.6->[]
I20260811 16:04:30.534904 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.540063 13741 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260811 16:04:30.491580 16431 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.542513 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:30.541158 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:30.548065 13740 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:30.548234 14578 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:30.506245 16468 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260811 16:04:30.553524 13900 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:30.532703 16569 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.013s	sys 0.026s
I20260811 16:04:30.560879 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:30.564266 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 108535us
I20260811 16:04:30.564502 13900 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:30.565024 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.565635 13824 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
W20260811 16:04:30.566540 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44274.4us
I20260811 16:04:30.567348 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:30.527649 16584 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:30.568454 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:30.569110 13907 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:30.576316 14577 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:30.564366 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:30.532907 16567 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:30.593739 14578 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:30.577699 13822 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:30.577061 13826 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:30.576465 13820 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:30.578465 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:30.579967 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:30.592139 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.519778 16521 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.599314 13900 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:30.605182 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:30.563938 16569 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.014s	sys 0.027s
I20260811 16:04:30.609450 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:30.612401 13823 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:30.563649 16560 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:30.563840 15983 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:30.624636 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:30.517369 16575 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.619923 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:30.606998 13909 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:30.635090 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:30.630945 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63670.1us
I20260811 16:04:30.636626 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:30.625543 13902 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:30.635341 13909 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:30.634305 13905 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:30.571209 16584 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.628070 16595 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:30.608067 16604 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:30.695324 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58783.6us
I20260811 16:04:30.575573 16380 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260811 16:04:30.595338 16607 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260811 16:04:30.719789 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.633378 16560 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:30.696900 13742 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:30.722957 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 79307.3us
I20260811 16:04:30.616482 16372 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:30.790761 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134601us
I20260811 16:04:30.651681 16570 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:30.726468 16552 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:30.696215 13909 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.620566 16563 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260811 16:04:30.641975 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:30.817775 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.628060 16600 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.329s
W20260811 16:04:30.729924 16611 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260811 16:04:30.781186 16560 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.698478 16365 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:30.729218 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:30.889891 13905 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:30.843410 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.640884 16617 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.191s
I20260811 16:04:30.867763 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:30.894852 14578 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3. Re-sending same reply.
W20260811 16:04:30.895267 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 243345us
I20260811 16:04:30.898324 14582 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.896687 16431 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:30.917717 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.918166 16600 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:30.918787 14578 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:30.841102 16552 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:30.842574 16597 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:30.907220 15983 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:30.944330 16620 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:30.944244 15983 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.889405 13817 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:30.943470 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47423.8us
I20260811 16:04:30.947100 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:30.945019 16620 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.947734 15983 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:30.948244 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:30.949549 16620 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:30.892216 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:30.953507 13909 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.953601 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.956202 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:30.952523 16604 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:30.965559 16627 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260811 16:04:30.967545 16625 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260811 16:04:30.968933 16630 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:30.969519 16630 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:30.959739 16599 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:04:30.969712 13824 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:30.971768 16575 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:30.976228 16633 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:30.976740 16633 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:30.977535 16633 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.978792 16633 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:30.942175 16576 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
W20260811 16:04:30.983903 16561 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.004s
I20260811 16:04:30.984196 16576 consensus_queue.cc:1225] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260811 16:04:30.984372 16561 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:30.985095 16597 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.957146 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:30.934877 16552 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:30.843990 16570 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:30.951187 16620 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:31.017846 13742 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:30.951483 14581 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:31.019042 14579 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:31.058912 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:31.059224 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:31.060385 13823 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:04:31.061928 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 219616us
I20260811 16:04:31.063130 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:31.066318 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:31.068069 13823 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:30.991233 13738 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:31.011196 14573 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.003s
I20260811 16:04:30.960446 16517 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:31.080123 13739 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:31.079389 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:31.083241 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:30.954250 16553 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.118s
I20260811 16:04:31.011008 16561 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:31.009430 16579 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
W20260811 16:04:31.089733 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 258209us
I20260811 16:04:31.014818 16521 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:31.067955 16620 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:31.085881 13871 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.014s
W20260811 16:04:31.091303 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 299336us
W20260811 16:04:31.151702 13871 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.018s	sys 0.016s
W20260811 16:04:31.084676 16435 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.007s
I20260811 16:04:30.999574 16068 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.086s
I20260811 16:04:31.122649 16561 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:31.078747 16563 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:31.128898 14582 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:31.081697 14573 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:31.091778 16579 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:30.970532 16630 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:31.152045 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 764430us
I20260811 16:04:31.122148 16620 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:31.098544 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1741) took 1376 ms. Trace:
I20260811 16:04:31.154700 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:31.084517 16600 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
W20260811 16:04:31.172519 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104103us
I20260811 16:04:31.149474 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:04:31.164983 13871 connection.cc:232] RPC call timeout handler was delayed by -2.8836693899938837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260811 16:04:31.173403 13871 connection.cc:232] RPC call timeout handler was delayed by -2.8548693900229409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260811 16:04:31.173746 13871 connection.cc:232] RPC call timeout handler was delayed by -2.7522693900391459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260811 16:04:31.174098 13871 connection.cc:232] RPC call timeout handler was delayed by -2.6046693900134414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260811 16:04:31.174510 13871 connection.cc:232] RPC call timeout handler was delayed by -2.5254693899769336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260811 16:04:31.174875 13871 connection.cc:232] RPC call timeout handler was delayed by -1.6974693899974227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2884s for a response
W20260811 16:04:31.144539 16468 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.013s
I20260811 16:04:31.123848 16639 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election won for term 3
W20260811 16:04:31.153892 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 205691us
W20260811 16:04:31.167002 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.002s	sys 0.007s
W20260811 16:04:31.176487 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.002s	sys 0.007s
I20260811 16:04:31.176714 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:31.148598 16481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.013s	sys 0.009s
W20260811 16:04:31.205137 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50593.4us
I20260811 16:04:31.158545 16561 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:31.206619 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:31.213068 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.209s (SENT)
I20260811 16:04:31.214677 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:31.200151 16468 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.009s	sys 0.013s
I20260811 16:04:31.213376 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:31.220748 16617 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:31.170130 13736 rpcz_store.cc:276] 0811 16:04:29.713593 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.717275 (+  3682us) service_pool.cc:227] Handling call
0811 16:04:31.081435 (+1364160us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:31.090345 (+  8910us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":544248064}
I20260811 16:04:31.166388 16595 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:31.212553 16621 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
W20260811 16:04:31.277851 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 155283us
I20260811 16:04:31.164270 16563 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.281404 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:31.285849 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72581.6us
I20260811 16:04:31.295619 14580 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:31.281563 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:31.213521 16561 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:31.216492 16481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.013s	sys 0.011s
I20260811 16:04:31.228257 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:31.288435 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81893.9us
I20260811 16:04:31.157923 16435 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.306485 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:31.300794 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:31.301753 16634 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:31.216147 16648 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:31.275792 16639 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:31.312994 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.314033 13902 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:31.284366 16658 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:31.225488 16553 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
W20260811 16:04:31.367113 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 148364us
I20260811 16:04:31.371167 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.375376 13900 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:31.373351 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:04:31.377699 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63346.9us
I20260811 16:04:31.387944 13900 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:31.309994 16435 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:31.392813 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 219156us
W20260811 16:04:31.389398 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88770.7us
I20260811 16:04:31.315286 16595 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:31.398137 16595 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:31.398797 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.398973 16595 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:31.399552 13908 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:31.400707 13907 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260811 16:04:31.400480 13820 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260811 16:04:31.402210 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.402784 13907 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:31.307560 16570 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:31.374104 14575 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:31.375861 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:31.406124 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.376120 16658 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:31.318162 16575 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260811 16:04:31.314973 16617 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260811 16:04:31.405081 16521 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:31.473768 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.477768 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.319419 16634 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.502285 13900 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:31.470299 16658 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:31.503683 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.477065 16521 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:31.477422 16468 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:31.533066 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.480515 16570 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:31.539565 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.452751 16469 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260811 16:04:31.479888 16651 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:31.541847 13908 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:31.501355 16657 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:31.545562 16250 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.124s	user 0.009s	sys 0.005s
I20260811 16:04:31.505383 16640 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:31.580564 16640 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:31.580958 16640 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:31.581153 16517 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:31.581795 16517 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:31.583334 16657 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.299855 16579 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:31.584344 16544 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:31.584985 16481 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:31.555576 13905 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:31.586877 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.587710 13905 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:31.556339 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:31.550432 13909 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.001s
I20260811 16:04:31.556696 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:31.602767 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46173.3us
I20260811 16:04:31.558151 16660 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:31.602789 13909 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:31.604588 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 382) took 1026 ms. Trace:
W20260811 16:04:31.558632 16649 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260811 16:04:31.558764 16650 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
W20260811 16:04:31.620049 16584 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.002s
I20260811 16:04:31.620558 16584 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.543391 16468 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:31.561108 16662 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260811 16:04:31.562232 16652 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260811 16:04:31.565546 16655 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260811 16:04:31.554131 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 168736us
W20260811 16:04:31.572645 16572 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.005s
I20260811 16:04:31.573949 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.576037 16654 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:31.532305 16521 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:31.603811 13905 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:31.605120 13909 rpcz_store.cc:276] 0811 16:04:30.578337 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.578985 (+   648us) service_pool.cc:227] Handling call
0811 16:04:30.606859 (+ 27874us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:31.604237 (+997378us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:31.604515 (+   278us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:31.624365 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:31.633349 13821 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:31.551060 13736 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260811 16:04:31.611955 16660 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.669219 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.583002 16517 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.613986 16657 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:31.614612 16677 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:31.627543 13903 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260811 16:04:31.604408 16570 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:31.668452 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.700173 13908 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260811 16:04:31.628743 16469 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:31.626607 16468 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:31.627367 16670 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:31.638164 13907 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:04:31.669632 13817 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.723s	user 0.004s	sys 0.008s
I20260811 16:04:31.630430 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 451) took 1098 ms. Trace:
I20260811 16:04:31.682336 13821 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:31.625028 16250 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:31.699745 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 489228us
I20260811 16:04:31.632117 16651 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:31.622731 16584 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:31.721259 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.711166 13909 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:31.751456 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.700073 16621 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:31.754568 16621 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:31.755802 16552 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260811 16:04:31.756268 16552 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.738468 16517 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:31.715327 16261 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.195s	user 0.014s	sys 0.000s
I20260811 16:04:31.699936 16657 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:31.758538 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.706979 16677 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:31.492939 16639 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.668133 16572 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.699668 16654 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260811 16:04:31.733743 13817 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:31.753038 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.819723 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:31.891084 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72354.8us
W20260811 16:04:31.816886 14582 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.009s
W20260811 16:04:31.892402 14582 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.011s	sys 0.012s
W20260811 16:04:31.892832 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 132586us
I20260811 16:04:31.810635 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.816917 13900 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:31.806177 16570 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.894794 13821 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260811 16:04:31.895259 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.896288 13900 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
W20260811 16:04:31.890576 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70964.8us
I20260811 16:04:31.816919 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:31.852458 13908 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:31.898032 13909 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:31.907101 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.806833 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2045) took 1244 ms. Trace:
I20260811 16:04:31.892128 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:31.714064 16670 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:31.891774 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.027s
W20260811 16:04:31.922956 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.027s
I20260811 16:04:31.740337 16563 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:31.908778 13904 rpcz_store.cc:276] 0811 16:04:30.561965 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.562132 (+   167us) service_pool.cc:227] Handling call
0811 16:04:30.562499 (+   367us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:30.795254 (+232755us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:30.795302 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:30.889460 (+ 94158us) log.cc:842] Serialized 52 byte log entry
0811 16:04:31.082543 (+193083us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:31.082577 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:31.082640 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:31.630761 (+548121us) raft_consensus.cc:1671] finished
0811 16:04:31.630779 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:31.806733 (+175954us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15014,"raft.queue_time_us":224465,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":46997,"thread_start_us":338766,"threads_started":2,"wal-append.queue_time_us":485401}
I20260811 16:04:31.919574 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:31.808802 16505 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.268s	user 0.015s	sys 0.000s
W20260811 16:04:31.923563 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 613737us
W20260811 16:04:31.915648 16620 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.707s	user 0.017s	sys 0.014s
I20260811 16:04:31.831460 16559 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:31.816138 16552 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:31.928542 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111724us
I20260811 16:04:31.915788 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.734647 16469 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:31.942376 13905 raft_consensus.cc:2354] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
W20260811 16:04:31.944300 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.027s
W20260811 16:04:31.929872 16595 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260811 16:04:31.925360 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:31.931802 16567 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.013s	sys 0.016s
I20260811 16:04:31.949385 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.963897 13908 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
W20260811 16:04:31.952122 14581 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.009s
I20260811 16:04:31.956619 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.956844 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.923820 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:31.960752 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.000s	sys 0.027s
I20260811 16:04:31.933442 16544 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:31.930862 16650 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:31.931214 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1364) took 1367 ms. Trace:
I20260811 16:04:31.922432 16584 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260811 16:04:31.967989 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 577245us
I20260811 16:04:31.982303 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:31.969471 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:31.970501 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46752.1us
I20260811 16:04:31.975342 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:31.970130 16567 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.013s	sys 0.016s
I20260811 16:04:31.984179 13900 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:31.985096 13908 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260811 16:04:31.915288 16657 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:31.967835 14581 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.009s
I20260811 16:04:31.758682 16250 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.987749 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:31.976475 13789 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.157s (SENT)
I20260811 16:04:31.921288 16261 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.955495 16620 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:31.947111 16505 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.001353 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:32.010892 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:32.007457 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:32.007838 13822 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:32.022151 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:31.977960 16634 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:32.033964 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:32.025678 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:32.038291 13821 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:32.044091 13824 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:32.052618 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47458.2us
I20260811 16:04:32.054106 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:31.984671 16621 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:32.000494 16563 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:31.961625 16559 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:32.071431 16561 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.761s	user 0.012s	sys 0.000s
I20260811 16:04:32.071561 16656 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:32.072106 16682 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:31.965575 16595 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:32.097311 16691 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260811 16:04:32.098671 16665 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260811 16:04:31.991923 16692 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:32.006318 16648 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260811 16:04:32.097354 16633 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.097s	user 0.013s	sys 0.000s
I20260811 16:04:32.100584 13907 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:32.098711 16631 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:32.073789 16685 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:32.072587 16676 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260811 16:04:32.014021 16365 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:04:32.043358 16560 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.122s	user 0.006s	sys 0.008s
I20260811 16:04:31.978135 13817 rpcz_store.cc:276] 0811 16:04:30.548580 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.552514 (+  3934us) service_pool.cc:227] Handling call
0811 16:04:31.915904 (+1363390us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:31.947224 16668 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260811 16:04:32.092686 13908 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:32.095044 16505 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:32.095402 16608 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:31.806424 16651 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:32.095623 16656 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:32.095914 16559 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:32.096374 16567 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:32.098595 16595 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:32.074723 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98276.1us
I20260811 16:04:31.980940 16650 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.116369 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:32.081568 16563 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:32.120406 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1759) took 1517 ms (client timeout 1551 ms). Trace:
I20260811 16:04:32.122947 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 384) took 1505 ms. Trace:
I20260811 16:04:32.124886 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:31.977638 16544 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:32.094041 16640 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.513s	user 0.001s	sys 0.010s
W20260811 16:04:32.091007 13738 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.004s	user 0.013s	sys 0.000s
W20260811 16:04:32.129959 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75983.6us
I20260811 16:04:32.075116 16673 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:32.132117 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 129914us
I20260811 16:04:32.294610 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:31.734040 13735 rpcz_store.cc:276] 0811 16:04:30.532361 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.533980 (+  1619us) service_pool.cc:227] Handling call
0811 16:04:30.591638 (+ 57658us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:30.847652 (+256014us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:30.958219 (+110567us) log.cc:842] Serialized 14 byte log entry
0811 16:04:31.289617 (+331398us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:31.407449 (+117832us) log.cc:842] Serialized 26 byte log entry
0811 16:04:31.468262 (+ 60813us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:31.470567 (+  2305us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:31.473619 (+  3052us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:31.630163 (+156544us) raft_consensus.cc:1671] finished
0811 16:04:31.630191 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:31.630341 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":199990,"prepare.queue_time_us":51627,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3639,"raft.queue_time_us":246133,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":19220,"thread_start_us":127437,"threads_started":1,"wal-append.queue_time_us":288940}
I20260811 16:04:32.295885 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:32.296622 16567 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:32.297809 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:32.167994 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:32.343575 13821 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:32.297077 16567 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:32.302980 16261 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:32.300398 16250 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:32.205826 16654 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:32.304322 16521 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.000s
I20260811 16:04:32.304220 16656 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:32.373461 16521 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:32.375625 16521 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:32.375777 14577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 700) took 1878 ms (client timeout 1854 ms). Trace:
W20260811 16:04:32.376142 14577 rpcz_store.cc:269] 0811 16:04:30.497398 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.497805 (+   407us) service_pool.cc:227] Handling call
0811 16:04:32.375586 (+1877781us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54003d13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:32.375703 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":117067520}
I20260811 16:04:32.377528 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1760) took 1774 ms. Trace:
I20260811 16:04:32.377897 13739 rpcz_store.cc:276] 0811 16:04:30.603463 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.956264 (+352801us) service_pool.cc:227] Handling call
0811 16:04:30.963327 (+  7063us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:31.082394 (+119067us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.377291 (+1294897us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:32.377467 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":261879168}
I20260811 16:04:32.304816 16469 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:32.093552 16561 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.379215 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1758) took 1776 ms. Trace:
I20260811 16:04:32.379570 13740 rpcz_store.cc:276] 0811 16:04:30.602784 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.618163 (+ 15379us) service_pool.cc:227] Handling call
0811 16:04:30.618551 (+   388us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:30.630676 (+ 12125us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:30.630724 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:30.630785 (+    61us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:30.630830 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.378972 (+1748142us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54000a8cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:32.379017 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:32.379129 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27309952}
I20260811 16:04:32.381019 16561 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:32.132206 16572 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:32.306568 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:32.381949 16456 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:32.307229 16579 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:32.382216 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 702) took 1849 ms. Trace:
I20260811 16:04:32.382375 16456 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:32.307884 16620 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:32.308600 13736 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:32.309162 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:04:32.301892 13742 rpcz_store.cc:269] 0811 16:04:30.603121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.603304 (+   183us) service_pool.cc:227] Handling call
0811 16:04:32.120164 (+1516860us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:32.120329 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140132608}
I20260811 16:04:32.316743 13822 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260811 16:04:32.382580 14579 rpcz_store.cc:276] 0811 16:04:30.533079 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.533233 (+   154us) service_pool.cc:227] Handling call
0811 16:04:31.018798 (+485565us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:31.019556 (+   758us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.382000 (+1362444us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54006b44d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:32.382156 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1071729536}
I20260811 16:04:32.044617 16677 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.300487 13901 rpcz_store.cc:276] 0811 16:04:30.617381 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.621620 (+  4239us) service_pool.cc:227] Handling call
0811 16:04:30.638189 (+ 16569us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:30.781904 (+143715us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:31.066617 (+284713us) log.cc:842] Serialized 14 byte log entry
0811 16:04:31.314258 (+247641us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:32.103792 (+789534us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:32.104293 (+   501us) log.cc:842] Serialized 26 byte log entry
0811 16:04:32.104479 (+   186us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:32.104509 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.104586 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:32.113284 (+  8698us) raft_consensus.cc:1671] finished
0811 16:04:32.122679 (+  9395us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:32.122869 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":83927,"prepare.queue_time_us":58364,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":314038,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":42542,"spinlock_wait_cycles":92636672,"thread_start_us":452177,"threads_started":3,"wal-append.queue_time_us":523869}
I20260811 16:04:32.152168 16648 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:04:32.217461 16693 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260811 16:04:32.217900 16642 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.804s	user 0.003s	sys 0.000s
I20260811 16:04:32.328563 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:32.324554 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 432518us
I20260811 16:04:32.309387 16532 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:04:32.217715 16678 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260811 16:04:32.298425 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:32.300671 13900 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:32.343462 13908 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:32.132617 16685 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:32.336410 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 293483us
I20260811 16:04:32.314450 16640 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.296984 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 455) took 1135 ms. Trace:
I20260811 16:04:32.113554 16553 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.203s
I20260811 16:04:32.257464 16657 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:32.297586 16608 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:32.151582 16682 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:32.297712 16673 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:32.311724 16563 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:32.362321 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:32.402225 16469 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:32.128648 16621 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.352610 16650 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:32.369252 16624 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.575s	user 0.000s	sys 0.007s
I20260811 16:04:32.221738 16670 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:32.372563 13789 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.183s (SENT)
I20260811 16:04:32.374854 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 449) took 1856 ms. Trace:
I20260811 16:04:32.525741 16673 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:32.360553 16505 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:32.392210 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:32.393764 13821 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
W20260811 16:04:32.396620 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75510.1us
I20260811 16:04:32.400494 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:32.564829 13901 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
W20260811 16:04:32.401170 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 92133.7us
I20260811 16:04:32.403178 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:32.349782 16700 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260811 16:04:32.152599 16560 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.406414 13787 leader_election.cc:398] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3.
I20260811 16:04:32.571468 13787 leader_election.cc:401] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260811 16:04:32.406817 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.013s	sys 0.029s
W20260811 16:04:32.571867 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 168820us
I20260811 16:04:32.404908 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:32.391865 16654 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:32.514878 16553 consensus_queue.cc:1225] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260811 16:04:32.521549 16685 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.522377 16544 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:32.093837 16660 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:32.399045 16532 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:32.406098 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 454) took 1307 ms. Trace:
I20260811 16:04:32.299953 13738 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:32.449482 16648 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:32.531898 16657 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:32.551431 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:32.507293 16608 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:32.419652 16620 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.130s
W20260811 16:04:32.572217 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.013s	sys 0.030s
I20260811 16:04:32.397485 16572 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:04:32.554454 16469 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:32.608568 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.024s
W20260811 16:04:32.385136 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 380131us
W20260811 16:04:32.555542 16616 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 2.091s	user 0.010s	sys 0.021s
I20260811 16:04:32.573367 16670 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:32.628794 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 226384us
W20260811 16:04:33.215926 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.003s	sys 0.030s
I20260811 16:04:32.757707 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1361) took 2086 ms. Trace:
I20260811 16:04:32.732179 13908 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:32.409297 13735 rpcz_store.cc:276] 0811 16:04:31.161973 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:32.296162 (+1134189us) service_pool.cc:227] Handling call
0811 16:04:32.296469 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:32.296661 (+   192us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:32.296690 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:32.296730 (+    40us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:32.296768 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.296822 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:32.296921 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:32.562433 16505 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:33.211167 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 912720us
I20260811 16:04:33.244030 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1855) took 1117 ms. Trace:
I20260811 16:04:33.243178 13818 rpcz_store.cc:276] 0811 16:04:30.539871 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.540036 (+   165us) service_pool.cc:227] Handling call
0811 16:04:30.570227 (+ 30191us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:30.694772 (+124545us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:30.694810 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:30.780379 (+ 85569us) log.cc:842] Serialized 26 byte log entry
0811 16:04:31.162370 (+381991us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:31.162484 (+   114us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:31.162616 (+   132us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:32.106378 (+943762us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:32.599769 (+493391us) raft_consensus.cc:1671] finished
0811 16:04:32.599811 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:32.625703 (+ 25892us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26842,"raft.queue_time_us":249046,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":32248,"spinlock_wait_cycles":3209472,"thread_start_us":387943,"threads_started":2,"wal-append.queue_time_us":470818}
W20260811 16:04:33.218083 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 651947us
I20260811 16:04:33.248257 13900 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260811 16:04:32.681529 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.016s	sys 0.062s
W20260811 16:04:33.261423 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.031s	sys 0.069s
I20260811 16:04:33.253355 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:33.262719 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1858) took 1067 ms. Trace:
W20260811 16:04:32.608829 16570 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.016s
W20260811 16:04:33.045318 16658 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.492s	user 0.013s	sys 0.000s
I20260811 16:04:33.264088 13908 rpcz_store.cc:276] 0811 16:04:32.126666 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:32.296736 (+170070us) service_pool.cc:227] Handling call
0811 16:04:33.243958 (+947222us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:33.205242 16567 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.002s
W20260811 16:04:33.194169 16656 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.037s	sys 0.087s
I20260811 16:04:32.575523 16707 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:33.270023 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2046) took 2707 ms. Trace:
I20260811 16:04:33.263280 13900 rpcz_store.cc:276] 0811 16:04:32.204854 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:33.247614 (+1042760us) service_pool.cc:227] Handling call
0811 16:04:33.247931 (+   317us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:33.262311 (+ 14380us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.262635 (+   324us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:33.215781 16616 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 2.752s	user 0.011s	sys 0.025s
I20260811 16:04:33.274705 13900 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260811 16:04:33.274996 16628 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.321s	user 0.002s	sys 0.020s
I20260811 16:04:33.271013 13903 rpcz_store.cc:276] 0811 16:04:30.562305 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.562972 (+   667us) service_pool.cc:227] Handling call
0811 16:04:30.563391 (+   419us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:31.708762 (+1145371us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.269758 (+1560996us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400034dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:33.269957 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2446790912}
I20260811 16:04:33.277595 13900 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260811 16:04:33.250754 16579 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.003s
I20260811 16:04:32.977687 16621 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.256295 16657 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:33.277310 16656 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.037s	sys 0.094s
I20260811 16:04:33.268586 16620 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:33.289173 16469 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:33.291714 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.25942e+06us
I20260811 16:04:32.981791 16640 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.215444 16572 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:33.292629 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:33.272835 16716 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:33.287915 16629 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:32.754062 16682 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:33.289633 16673 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.002s
I20260811 16:04:33.267654 16604 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.277976 13900 pending_rounds.cc:76] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 2
I20260811 16:04:33.376588 13900 pending_rounds.cc:97] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260811 16:04:33.317028 13908 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:33.317907 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1517) took 3039 ms. Trace:
I20260811 16:04:32.553997 13737 rpcz_store.cc:276] 0811 16:04:30.518608 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.520106 (+  1498us) service_pool.cc:227] Handling call
0811 16:04:32.374071 (+1853965us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:32.374306 (+   235us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:32.374499 (+   193us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:32.374529 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:32.374571 (+    42us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:32.374607 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.374667 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:32.374790 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24667008}
I20260811 16:04:33.376969 13900 raft_consensus.cc:2866] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:32.613859 16631 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3.
W20260811 16:04:33.269920 16570 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.014s	sys 0.033s
I20260811 16:04:33.380936 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1863) took 1072 ms. Trace:
I20260811 16:04:33.381312 13900 rpcz_store.cc:276] 0811 16:04:32.308804 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:33.276940 (+968136us) service_pool.cc:227] Handling call
0811 16:04:33.277241 (+   301us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:33.380665 (+103424us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.380874 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:33.271296 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1761) took 2619 ms (client timeout 2121 ms). Trace:
W20260811 16:04:33.382514 13738 rpcz_store.cc:269] 0811 16:04:30.629594 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.789321 (+159727us) service_pool.cc:227] Handling call
0811 16:04:33.248595 (+2459274us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:33.274464 16711 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:33.383986 16711 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.614075 16532 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.250898 16576 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260811 16:04:33.369897 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 495) took 2298 ms (client timeout 2735 ms). Trace:
W20260811 16:04:33.393241 13824 rpcz_store.cc:269] 0811 16:04:31.065743 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:31.065968 (+   225us) service_pool.cc:227] Handling call
0811 16:04:33.362640 (+2296672us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:33.362857 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2243980160}
I20260811 16:04:33.369870 16572 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:32.608363 16654 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:32.613114 13736 rpcz_store.cc:276] 0811 16:04:31.095044 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:32.167551 (+1072507us) service_pool.cc:227] Handling call
0811 16:04:32.300053 (+132502us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:32.390810 (+ 90757us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.402620 (+ 11810us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:33.360069 16563 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.001s
I20260811 16:04:33.377429 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:33.377341 13741 rpcz_store.cc:276] 0811 16:04:30.243539 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.432286 (+188747us) service_pool.cc:227] Handling call
0811 16:04:30.432553 (+   267us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:30.540593 (+108040us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.282773 (+2742180us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400002b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:33.283060 (+   287us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":232635264}
I20260811 16:04:33.322324 16560 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.323019 16579 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:33.397490 16711 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.375633 16629 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:33.374650 16660 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:33.401747 16532 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:33.278823 16658 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.276535 16567 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.360844 16621 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260811 16:04:33.406948 16575 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:33.387640 16673 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.363741 16505 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.419159 16560 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:33.420145 16660 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:33.442147 16629 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.443028 16647 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:33.443387 16629 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:33.443609 16647 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:33.444767 16647 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.446412 16647 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:33.451292 13902 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:33.399755 16604 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.429798 16575 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:33.492061 16575 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.493870 16575 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:33.408701 16563 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.496428 13900 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260811 16:04:33.378546 16716 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.501518 16716 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:33.463331 16709 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260811 16:04:33.467422 16505 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:33.467934 16567 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:33.472415 16710 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.865s	user 0.009s	sys 0.001s
I20260811 16:04:33.449496 16660 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:33.473359 16657 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:33.474628 16654 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.424265 16579 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.510180 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:33.477051 16637 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:33.478335 16608 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.484519 16673 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:33.504307 16697 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.416s	user 0.006s	sys 0.013s
I20260811 16:04:33.541913 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2061) took 2074 ms. Trace:
I20260811 16:04:33.530992 13900 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:33.536885 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:33.537516 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:33.544811 13909 rpcz_store.cc:276] 0811 16:04:31.467968 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:31.974665 (+506697us) service_pool.cc:227] Handling call
0811 16:04:31.975056 (+   391us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:31.981941 (+  6885us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:31.981971 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:31.982444 (+   473us) log.cc:842] Serialized 26 byte log entry
0811 16:04:32.393913 (+411469us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:32.400442 (+  6529us) log.cc:842] Serialized 14 byte log entry
0811 16:04:32.400767 (+   325us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.400859 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:33.471834 (+1070975us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:33.506946 (+ 35112us) raft_consensus.cc:1671] finished
0811 16:04:33.541679 (+ 34733us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:33.541839 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14586,"prepare.queue_time_us":8126,"raft.queue_time_us":11129,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":13570,"spinlock_wait_cycles":14123264,"thread_start_us":349165,"threads_started":1,"wal-append.queue_time_us":538977}
I20260811 16:04:33.550474 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:33.550402 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:33.557317 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:33.560174 13909 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:33.536870 16629 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.573553 16629 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.576282 16629 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.576392 16563 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.537508 16637 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:33.576574 16576 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.577934 16579 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.578434 16481 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:33.551355 16570 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.579154 16481 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.579816 16570 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.581869 16570 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.582404 16570 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:33.583132 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:33.542906 16567 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.584303 16567 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.585724 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:33.586338 13818 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:33.587658 13737 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:33.589093 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:33.592415 13740 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:33.592621 16657 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:33.596298 13908 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:33.597405 16673 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:33.553982 16380 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.592444 16698 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:33.601052 16698 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:33.601402 16698 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:33.604441 16608 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.577442 16637 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.606280 16637 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:33.609021 16572 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.607060 16673 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:33.612881 16673 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.586289 16567 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:33.600060 16380 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.622632 13908 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:33.577337 16576 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.639103 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:33.648697 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89124.2us
I20260811 16:04:33.650610 13818 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:33.650681 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:33.652326 13740 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:33.676052 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:33.677248 13905 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:33.677939 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 394) took 1379 ms. Trace:
I20260811 16:04:33.678458 13905 rpcz_store.cc:276] 0811 16:04:32.298531 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:33.675662 (+1377131us) service_pool.cc:227] Handling call
0811 16:04:33.677868 (+  2206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:33.681841 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:33.684039 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 447) took 3772 ms. Trace:
I20260811 16:04:33.582870 16570 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:33.688098 13743 rpcz_store.cc:276] 0811 16:04:29.912083 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.438997 (+526914us) service_pool.cc:227] Handling call
0811 16:04:33.283804 (+2844807us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:33.284061 (+   257us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:33.284094 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:33.284154 (+    60us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:33.284199 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.284290 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:33.683805 (+399515us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b5400002b50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:33.683961 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6503184768}
W20260811 16:04:33.685271 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1845) took 1966 ms (client timeout 1990 ms). Trace:
I20260811 16:04:33.686968 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:33.690621 13907 rpcz_store.cc:269] 0811 16:04:31.708424 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:31.801444 (+ 93020us) service_pool.cc:227] Handling call
0811 16:04:33.674536 (+1873092us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000884d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:33.674759 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":473809152}
I20260811 16:04:33.581869 16481 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.699657 13900 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:33.778331 13740 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:33.703507 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 492621us
W20260811 16:04:33.698971 16639 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.074s	sys 0.140s
W20260811 16:04:33.799531 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.038s
W20260811 16:04:33.805604 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.007s	sys 0.038s
W20260811 16:04:33.805934 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 555827us
I20260811 16:04:33.787626 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:33.802459 16639 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.074s	sys 0.140s
I20260811 16:04:33.793377 16572 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:33.828310 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:33.832120 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:33.832959 14581 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:33.834350 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:33.835080 14582 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:33.869163 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:33.871881 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 713) took 3422 ms. Trace:
I20260811 16:04:33.872354 14575 rpcz_store.cc:276] 0811 16:04:30.449692 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.464469 (+ 14777us) service_pool.cc:227] Handling call
0811 16:04:30.506657 (+ 42188us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:31.470131 (+963474us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.871569 (+2401438us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:33.871789 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1848037248}
I20260811 16:04:33.876480 16456 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:33.877672 16456 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:33.879876 16714 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260811 16:04:33.880697 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1755) took 4027 ms. Trace:
W20260811 16:04:33.881863 16717 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260811 16:04:33.882500 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:33.883199 14583 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:33.887601 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1842) took 2257 ms. Trace:
I20260811 16:04:33.881088 13744 rpcz_store.cc:276] 0811 16:04:29.853275 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.420738 (+567463us) service_pool.cc:227] Handling call
0811 16:04:30.477128 (+ 56390us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:30.481257 (+  4129us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:30.481289 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:30.490055 (+  8766us) log.cc:842] Serialized 26 byte log entry
0811 16:04:30.550132 (+ 60077us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:30.550431 (+   299us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:30.550497 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:32.368548 (+1818051us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:32.555964 (+187416us) raft_consensus.cc:1671] finished
0811 16:04:32.555985 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:33.880505 (+1324520us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b54000a9bd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:33.880634 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6072,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":129583872,"thread_start_us":41611,"threads_started":1,"wal-append.queue_time_us":133423,"wal-append.run_cpu_time_us":10357,"wal-append.run_wall_time_us":2957652}
I20260811 16:04:33.888191 13904 rpcz_store.cc:276] 0811 16:04:31.630308 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:31.970434 (+340126us) service_pool.cc:227] Handling call
0811 16:04:31.987524 (+ 17090us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:32.015275 (+ 27751us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:32.021384 (+  6109us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:32.039946 (+ 18562us) log.cc:842] Serialized 26 byte log entry
0811 16:04:32.434368 (+394422us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:32.523034 (+ 88666us) log.cc:842] Serialized 14 byte log entry
0811 16:04:32.523333 (+   299us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:32.523439 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:33.887293 (+1363854us) raft_consensus.cc:1671] finished
0811 16:04:33.887326 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:33.887516 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61059,"prepare.queue_time_us":89038,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":32224,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":19299,"thread_start_us":316716,"threads_started":1,"wal-append.queue_time_us":1601300}
I20260811 16:04:33.860023 16380 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.907771 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:33.912545 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:33.903846 16713 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260811 16:04:33.920084 14582 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:33.905115 16604 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.924901 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:33.931754 13820 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.014s	sys 0.007s
W20260811 16:04:33.944176 13820 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.014s	sys 0.007s
W20260811 16:04:33.944564 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.000s	sys 0.010s
W20260811 16:04:33.945006 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.000s	sys 0.011s
W20260811 16:04:33.945389 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 701421us
I20260811 16:04:33.943933 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:33.946352 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:33.929080 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.006s	sys 0.035s
W20260811 16:04:33.948967 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.007s	sys 0.035s
I20260811 16:04:33.913082 16576 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.909843 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:33.950002 14583 raft_consensus.cc:2396] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260811 16:04:33.977962 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.018s
W20260811 16:04:33.978437 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.006s	sys 0.018s
I20260811 16:04:33.976114 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1370) took 2544 ms. Trace:
I20260811 16:04:33.929288 16608 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:33.946997 16685 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.001s	sys 0.029s
I20260811 16:04:33.977141 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:33.977367 16630 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260811 16:04:33.987491 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 610146us
I20260811 16:04:33.979604 13820 rpcz_store.cc:276] 0811 16:04:31.402907 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:31.403058 (+   151us) service_pool.cc:227] Handling call
0811 16:04:31.403445 (+   387us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:31.534204 (+130759us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:31.534246 (+    42us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:31.605208 (+ 70962us) log.cc:842] Serialized 52 byte log entry
0811 16:04:33.215406 (+1610198us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:33.945953 (+730547us) log.cc:842] Serialized 14 byte log entry
0811 16:04:33.946427 (+   474us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:33.946520 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:33.946579 (+    59us) raft_consensus.cc:1671] finished
0811 16:04:33.946596 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:33.946892 (+   296us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47504,"raft.queue_time_us":182932,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":2344097,"threads_started":3,"wal-append.queue_time_us":1673166}
W20260811 16:04:33.991618 13903 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.016s	sys 0.035s
I20260811 16:04:33.976176 16481 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:33.947608 16570 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:33.917591 16579 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
W20260811 16:04:33.993142 13903 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.035s
I20260811 16:04:33.996351 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:33.988749 14541 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.005s
W20260811 16:04:33.997013 14541 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.005s
W20260811 16:04:33.997437 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 540058us
W20260811 16:04:33.986764 16564 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.008s
I20260811 16:04:33.985144 16608 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:33.988334 16685 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.001s	sys 0.029s
W20260811 16:04:33.991547 16677 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.008s	sys 0.043s
W20260811 16:04:34.013609 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.65348e+06us
W20260811 16:04:34.014454 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.222s (SENT) [suppressed 34 similar messages]
I20260811 16:04:33.995059 16505 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:33.993304 16576 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:33.992569 16729 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:34.016350 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:34.042963 13744 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:34.018633 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1862) took 1710 ms. Trace:
I20260811 16:04:34.044166 13902 rpcz_store.cc:276] 0811 16:04:32.308454 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:33.246507 (+938053us) service_pool.cc:227] Handling call
0811 16:04:34.018394 (+771887us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:34.018561 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":433366272}
W20260811 16:04:34.004639 16564 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.006s	sys 0.009s
W20260811 16:04:34.054952 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58691.7us
W20260811 16:04:34.065153 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.854s (SENT)
I20260811 16:04:34.007530 16608 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:34.070518 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:34.071982 13740 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
W20260811 16:04:34.072721 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66345.8us
W20260811 16:04:34.035984 16677 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.009s	sys 0.043s
W20260811 16:04:34.079859 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.030s
W20260811 16:04:34.080241 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.006s	sys 0.030s
I20260811 16:04:34.051808 16365 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.093971 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:34.015982 16718 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.007s
I20260811 16:04:34.066170 16630 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
W20260811 16:04:34.091228 13787 connection.cc:232] RPC call timeout handler was delayed by -2.0640908639179543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260811 16:04:34.076690 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.007s	sys 0.017s
I20260811 16:04:34.087198 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:34.092945 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:34.096125 13744 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260811 16:04:34.094089 16575 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.001s
I20260811 16:04:34.004521 16481 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:34.114547 14544 leader_election.cc:398] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:34.115587 13737 raft_consensus.cc:2396] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260811 16:04:34.120194 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.007s	sys 0.018s
W20260811 16:04:34.138334 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 845724us
W20260811 16:04:34.117372 13787 connection.cc:232] RPC call timeout handler was delayed by -2.0442908639088273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260811 16:04:34.112753 16718 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.008s	sys 0.008s
W20260811 16:04:34.077889 16597 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.016s	sys 0.011s
I20260811 16:04:34.079547 16576 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:34.147905 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:34.109757 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 460148us
W20260811 16:04:34.114185 16469 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.023s	sys 0.032s
W20260811 16:04:34.139487 13787 connection.cc:232] RPC call timeout handler was delayed by -1.8570908638648689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260811 16:04:34.141103 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:34.151558 13902 raft_consensus.cc:595] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.045780 16698 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:34.145012 16719 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260811 16:04:34.115015 16365 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:34.113920 16682 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.030s	sys 0.051s
I20260811 16:04:34.159389 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:34.134630 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:34.152844 13787 connection.cc:232] RPC call timeout handler was delayed by -1.687167419004254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3178s for a response
I20260811 16:04:34.068526 16729 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.133472 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:34.142642 16677 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:34.147351 16597 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.016s	sys 0.012s
I20260811 16:04:34.175096 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.162456 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:34.160923 16682 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.031s	sys 0.051s
W20260811 16:04:34.150933 16469 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.023s	sys 0.033s
I20260811 16:04:34.166126 14577 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:04:34.175331 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.176860 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:34.155644 16658 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:34.161264 16721 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260811 16:04:34.161643 13787 connection.cc:232] RPC call timeout handler was delayed by -1.551090863882564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260811 16:04:34.138906 16563 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260811 16:04:34.154660 16630 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:34.185745 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:34.192019 13906 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260811 16:04:34.193503 13900 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:34.159550 16656 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:34.195676 13907 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:34.203807 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:34.204298 13905 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260811 16:04:34.204433 13902 raft_consensus.cc:595] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.204820 13902 raft_consensus.cc:603] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:34.196286 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:34.185329 16660 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
W20260811 16:04:34.198649 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 273818us
I20260811 16:04:34.164408 16572 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:34.200652 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:34.197713 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.205627 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:34.219976 16658 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.192051 16732 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:34.231732 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:34.237465 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.241346 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.227918 16658 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.242134 13902 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:34.253684 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:34.265275 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:34.265763 13904 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:34.266477 13904 raft_consensus.cc:595] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:34.266918 13904 raft_consensus.cc:603] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:34.234266 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:34.226886 16365 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:34.244095 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 229653us
I20260811 16:04:34.178186 16677 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.201278 16431 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260811 16:04:34.230232 16732 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:34.281440 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58368.1us
W20260811 16:04:34.286706 16722 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260811 16:04:34.286859 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:34.287765 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.222150 16576 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.231762 16682 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:34.283610 14582 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:34.286484 16630 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.243093 16636 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:04:34.274192 16505 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
W20260811 16:04:34.297501 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 224936us
W20260811 16:04:34.280435 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46310.4us
I20260811 16:04:34.309090 16481 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:34.309372 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90814.6us
I20260811 16:04:34.228972 16569 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260811 16:04:34.217092 16660 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.263561 16572 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:34.281136 16637 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:34.293850 16682 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:34.284188 16365 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:34.325076 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:34.284404 16732 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:34.280913 16563 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260811 16:04:34.329869 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:34.333814 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1372) took 2741 ms. Trace:
I20260811 16:04:34.347654 13823 rpcz_store.cc:276] 0811 16:04:31.592533 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:31.592771 (+   238us) service_pool.cc:227] Handling call
0811 16:04:31.593170 (+   399us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:31.593524 (+   354us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:31.593549 (+    25us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:33.500810 (+1907261us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:33.501526 (+   716us) log.cc:842] Serialized 52 byte log entry
0811 16:04:34.080689 (+579163us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:34.080744 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:34.080840 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:34.333411 (+252571us) raft_consensus.cc:1671] finished
0811 16:04:34.333435 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:34.333731 (+   296us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":20014,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":16188672,"thread_start_us":578645,"threads_started":1,"wal-append.queue_time_us":762886}
I20260811 16:04:34.349984 14582 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:34.334825 16572 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.335995 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 393) took 2037 ms. Trace:
I20260811 16:04:34.351090 13901 rpcz_store.cc:276] 0811 16:04:32.298168 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:33.648282 (+1350114us) service_pool.cc:227] Handling call
0811 16:04:33.686144 (+ 37862us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:33.690689 (+  4545us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:33.690719 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:33.698528 (+  7809us) log.cc:842] Serialized 26 byte log entry
0811 16:04:34.138773 (+440245us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:34.153385 (+ 14612us) log.cc:842] Serialized 14 byte log entry
0811 16:04:34.160122 (+  6737us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:34.160263 (+   141us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:34.335771 (+175508us) raft_consensus.cc:1671] finished
0811 16:04:34.335790 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:34.335938 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10559,"prepare.queue_time_us":5833,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":27568,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":7762,"thread_start_us":333075,"threads_started":1,"wal-append.queue_time_us":495140}
I20260811 16:04:34.337425 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:34.336409 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61524.1us
I20260811 16:04:34.354099 13904 raft_consensus.cc:2396] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:34.324493 16505 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:34.342118 13907 raft_consensus.cc:595] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.319550 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:34.358826 13907 raft_consensus.cc:603] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:34.342905 13900 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:34.265116 16725 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260811 16:04:34.343763 13741 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:34.344362 13909 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:34.317111 16380 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:34.338428 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.330989 16564 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:34.340672 16682 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:34.351547 16698 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.366110 16725 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260811 16:04:34.386309 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58027.6us
I20260811 16:04:34.373258 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.342949 16431 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260811 16:04:34.344659 16579 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260811 16:04:34.388077 13904 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:34.398566 13900 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "defa959376494546a5395f8a56cef106"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:34.394464 13902 raft_consensus.cc:1203] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260811 16:04:34.399277 13900 raft_consensus.cc:595] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:34.371822 16380 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:34.401942 13902 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:34.403451 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260811 16:04:34.405964 13789 connection.cc:232] RPC call timeout handler was delayed by -1.9038022640161216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3171s for a response
W20260811 16:04:34.406356 13789 connection.cc:232] RPC call timeout handler was delayed by -1.897502264007926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3178s for a response
W20260811 16:04:34.407045 16736 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260811 16:04:34.407408 13789 connection.cc:232] RPC call timeout handler was delayed by -1.775102264015004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33140000000000003s for a response
W20260811 16:04:34.407758 13789 connection.cc:232] RPC call timeout handler was delayed by -1.7310022639576346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33630000000000004s for a response
I20260811 16:04:34.378419 16729 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:34.410856 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56685.6us
I20260811 16:04:34.384928 16637 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:34.416342 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:34.417335 13904 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:34.408581 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:34.408052 13789 connection.cc:232] RPC call timeout handler was delayed by -1.438045924063772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2767s for a response
W20260811 16:04:34.395756 16647 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.949s	user 0.017s	sys 0.000s
I20260811 16:04:34.418524 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:34.418529 13789 connection.cc:232] RPC call timeout handler was delayed by -1.4367022640071809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.369s for a response
I20260811 16:04:34.421335 13900 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:34.422544 13900 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:34.427286 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.428092 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:34.428295 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.432632 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.432945 16763 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:34.433332 16763 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:34.433794 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.434139 16763 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.427731 16552 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.435722 13826 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260811 16:04:34.435797 16552 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.436518 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2042) took 3894 ms. Trace:
I20260811 16:04:34.436857 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.436929 13906 rpcz_store.cc:276] 0811 16:04:30.542572 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.554814 (+ 12242us) service_pool.cc:227] Handling call
0811 16:04:30.555263 (+   449us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:34.204615 (+3649352us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:34.436323 (+231708us) spinlock_profiling.cc:243] Waited 3.64 s on lock 0x7b54000c8354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:34.436465 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8363178752}
I20260811 16:04:34.438056 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.438755 16552 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.439092 13822 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:34.440317 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.442013 16727 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.444905 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:34.420394 16733 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260811 16:04:34.381856 16564 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.447450 13826 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:34.415606 16481 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.454002 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.419341 16569 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.463850 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:34.464612 13904 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:34.425707 13900 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.424629 16725 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.415381 16636 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:34.454290 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 115919us
I20260811 16:04:34.419204 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:34.469834 13900 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:34.473477 13827 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260811 16:04:34.473477 13822 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260811 16:04:34.475304 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 66805.7us
I20260811 16:04:34.470798 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:34.477452 16677 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.477758 16365 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:34.478300 16365 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:34.458943 16532 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:34.479382 16365 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.470163 16569 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.480949 16564 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:34.463169 16753 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260811 16:04:34.481774 16569 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:34.477301 16769 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260811 16:04:34.483464 13824 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260811 16:04:34.484254 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.482553 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:34.463182 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.503455 13822 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260811 16:04:34.470245 16763 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:34.466274 16660 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:34.510524 13900 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260811 16:04:34.519155 13900 pending_rounds.cc:76] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 6
I20260811 16:04:34.519439 13900 pending_rounds.cc:97] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260811 16:04:34.519691 13900 raft_consensus.cc:2866] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:04:34.536366 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108880us
I20260811 16:04:34.475521 16658 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.552055 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:34.555872 16753 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260811 16:04:34.556460 16766 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260811 16:04:34.430583 16505 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.501508 16564 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:34.482476 16725 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.456564 16727 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.472162 16637 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.501274 16431 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:34.680742 14583 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:34.620033 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.619930 13825 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:34.620918 13826 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:34.557392 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1861) took 2249 ms. Trace:
I20260811 16:04:34.681471 13818 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:34.466527 16481 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:34.632135 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 161430us
I20260811 16:04:34.613611 16658 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
W20260811 16:04:34.608510 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54755.6us
I20260811 16:04:34.673993 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.678784 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.561203 13901 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:34.491242 16552 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260811 16:04:34.677034 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.631740 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:34.668469 16617 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.685006 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:34.619055 16774 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.691716 13827 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:34.693954 13818 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:34.694850 13822 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:34.703522 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:34.669420 16768 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.698303 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:34.671293 16567 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:34.698328 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.720387 13818 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:34.681586 13903 rpcz_store.cc:276] 0811 16:04:32.308054 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:33.276708 (+968654us) service_pool.cc:227] Handling call
0811 16:04:33.287829 (+ 11121us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:33.288308 (+   479us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:33.998082 (+709774us) log.cc:842] Serialized 14 byte log entry
0811 16:04:34.281883 (+283801us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:34.291994 (+ 10111us) log.cc:842] Serialized 26 byte log entry
0811 16:04:34.292166 (+   172us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:34.294469 (+  2303us) log.cc:842] Serialized 14 byte log entry
0811 16:04:34.312156 (+ 17687us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:34.312251 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:34.557197 (+244946us) raft_consensus.cc:1671] finished
0811 16:04:34.557217 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:34.557334 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37212,"prepare.queue_time_us":504448,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":82,"raft.queue_time_us":73709,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":58824,"spinlock_wait_cycles":7428864,"thread_start_us":897356,"threads_started":2,"wal-append.queue_time_us":329261}
I20260811 16:04:34.671025 16677 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:34.696363 13787 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.573s (SENT)
W20260811 16:04:34.609375 16608 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.006s
I20260811 16:04:34.710162 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:34.720702 13824 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260811 16:04:34.720451 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:34.489027 16380 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.732568 13823 raft_consensus.cc:2396] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:34.735411 13826 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:34.610262 16732 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.775318 14578 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:34.774544 14581 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
W20260811 16:04:34.798667 13789 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.540s (SENT)
I20260811 16:04:34.799896 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:34.768055 13787 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.781s (SENT)
W20260811 16:04:34.803812 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83427us
I20260811 16:04:34.798691 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:34.718941 16569 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:34.812062 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:34.805526 14581 raft_consensus.cc:2362] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5. Re-sending same reply.
I20260811 16:04:34.820312 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:34.821286 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:34.820441 14583 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:34.823540 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.824505 13824 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:34.825707 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.826488 13824 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:34.832132 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.833055 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:34.833873 14574 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:34.831991 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:34.673265 16682 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.728770 16775 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.840313 14582 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:34.738886 16751 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.787669 16763 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:34.856573 16763 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.788508 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:34.620126 16636 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:34.722916 16729 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.121s
I20260811 16:04:34.811208 16569 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:34.862524 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.709455 16617 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.844969 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:34.730779 16567 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:34.885866 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64694us
I20260811 16:04:34.731854 16746 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260811 16:04:34.735817 16608 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.740008 16677 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.888650 14581 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:34.841362 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:34.893610 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.866703 16648 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:34.721101 16774 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.852104 16775 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.879801 16769 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:34.919870 16732 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.920843 16783 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:34.921468 16783 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.888074 16729 consensus_queue.cc:1225] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:04:34.891520 14573 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:34.912443 13741 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:34.855824 16751 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.902853 13737 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:34.727859 16768 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.917500 13742 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:34.909811 16648 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:34.928683 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:34.946382 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 52881.3us
I20260811 16:04:34.949186 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:34.942252 13817 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:34.936486 16716 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:34.959687 16789 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:34.960124 16716 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:34.960865 16789 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:34.961407 16725 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.961138 16716 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:34.961549 16789 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:04:34.962006 16725 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:04:34.945309 16728 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:34.963841 16775 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:34.963881 16725 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:34.965109 16727 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:34.962316 16716 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:34.958636 13904 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:34.931041 16781 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:34.967837 13737 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:34.960628 16771 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:04:34.966652 16747 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:34.949162 16648 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:34.970728 13735 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:34.970440 16768 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.993278 14574 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:35.024011 13737 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:35.024595 13737 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:35.027988 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 229378us
W20260811 16:04:35.029011 13789 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.549s (SENT)
I20260811 16:04:34.990000 16481 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:34.966751 16456 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260811 16:04:34.991966 16763 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.029201 13737 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:35.033294 13789 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.569s (SENT)
I20260811 16:04:35.048380 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:35.044739 13822 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260811 16:04:35.049116 13822 pending_rounds.cc:76] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:04:35.049800 13822 pending_rounds.cc:97] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260811 16:04:35.050325 13822 raft_consensus.cc:2866] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:35.064435 13737 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:35.031617 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 146216us
I20260811 16:04:35.029489 16682 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:35.071520 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 177074us
I20260811 16:04:35.074194 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:35.077585 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:35.042106 16751 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:35.064495 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 111829us
I20260811 16:04:35.037770 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:35.043372 16774 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.088711 16567 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.674129 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:35.675585 16677 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:35.440840 16685 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:35.179812 16608 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.676740 16685 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:35.266845 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 548531us
W20260811 16:04:35.138701 16778 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260811 16:04:35.677749 16685 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:35.194149 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 833577us
I20260811 16:04:35.679801 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:35.163002 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 234402us
I20260811 16:04:35.681169 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:35.255090 13737 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260811 16:04:35.102134 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68863.1us
I20260811 16:04:35.439342 13908 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260811 16:04:35.070329 16781 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:35.074898 16607 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:35.707263 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 740) took 1233 ms. Trace:
I20260811 16:04:35.707728 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:35.076927 16788 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:35.711589 14577 rpcz_store.cc:276] 0811 16:04:34.474050 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.474435 (+   385us) service_pool.cc:227] Handling call
0811 16:04:34.474765 (+   330us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:34.475126 (+   361us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:34.475416 (+   290us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:34.492831 (+ 17415us) log.cc:842] Serialized 52 byte log entry
0811 16:04:34.816901 (+324070us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:34.816965 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:34.817078 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:35.706901 (+889823us) raft_consensus.cc:1671] finished
0811 16:04:35.706932 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:35.707163 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2398,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":138894,"threads_started":1,"wal-append.queue_time_us":464728}
I20260811 16:04:35.711833 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:35.711838 14581 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:35.136132 16786 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260811 16:04:35.631592 16431 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.951s	user 0.014s	sys 0.000s
I20260811 16:04:35.634457 16572 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:35.707530 16685 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:35.299335 16629 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:35.724694 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:35.715408 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 744) took 1087 ms. Trace:
I20260811 16:04:35.728739 14575 rpcz_store.cc:276] 0811 16:04:34.623095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.672466 (+ 49371us) service_pool.cc:227] Handling call
0811 16:04:34.718788 (+ 46322us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:34.788965 (+ 70177us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:34.805753 (+ 16788us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:34.881054 (+ 75301us) log.cc:842] Serialized 26 byte log entry
0811 16:04:35.023481 (+142427us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:35.025574 (+  2093us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:35.028807 (+  3233us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:35.138239 (+109432us) raft_consensus.cc:1671] finished
0811 16:04:35.138257 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:35.710792 (+572535us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":81731,"threads_started":1,"wal-append.queue_time_us":215155}
I20260811 16:04:35.725651 16431 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:35.731217 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1773) took 1018 ms. Trace:
I20260811 16:04:35.733479 13740 rpcz_store.cc:276] 0811 16:04:34.712390 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.712818 (+   428us) service_pool.cc:227] Handling call
0811 16:04:34.713205 (+   387us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:34.719753 (+  6548us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:34.719778 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:34.720109 (+   331us) log.cc:842] Serialized 26 byte log entry
0811 16:04:34.908040 (+187931us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:34.908093 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:34.908182 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:35.730841 (+822659us) raft_consensus.cc:1671] finished
0811 16:04:35.730859 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:35.731108 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6109,"raft.queue_time_us":12660,"spinlock_wait_cycles":6449536,"thread_start_us":70625,"threads_started":1,"wal-append.queue_time_us":169740}
I20260811 16:04:35.286258 16731 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:35.675711 16774 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:35.207311 16746 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:35.716001 13738 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
W20260811 16:04:35.717499 16570 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260811 16:04:35.725555 16805 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:35.089442 16481 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:35.726711 16572 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:35.750289 16716 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
W20260811 16:04:35.721585 16754 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.018s	sys 0.026s
I20260811 16:04:35.711133 16795 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:35.758443 14578 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:35.758263 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1770) took 1688 ms. Trace:
I20260811 16:04:35.713477 16636 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260811 16:04:35.727413 16629 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:35.769445 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:35.724735 16647 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260811 16:04:35.755925 16617 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.761685 16774 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:35.737118 16801 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:35.767843 13743 rpcz_store.cc:276] 0811 16:04:34.069388 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.070106 (+   718us) service_pool.cc:227] Handling call
0811 16:04:35.753893 (+1683787us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54003476d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:35.758197 (+  4304us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1412870912}
I20260811 16:04:35.719971 16607 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:35.770604 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:35.765475 16481 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:35.745278 16608 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260811 16:04:35.767676 16754 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.018s	sys 0.029s
I20260811 16:04:35.716574 16781 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:35.752252 16456 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260811 16:04:35.773923 16751 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:35.787070 16481 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:35.789834 16608 consensus_queue.cc:1225] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260811 16:04:35.758771 16731 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:35.775851 16636 consensus_queue.cc:1225] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:04:35.811334 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:35.766520 16746 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:35.808712 16751 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:35.810638 16795 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:04:35.843470 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 154972us
W20260811 16:04:35.843657 16802 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260811 16:04:35.856304 16572 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.856961 16572 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:35.857601 16572 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:35.858212 16572 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:04:35.859634 16629 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:35.861734 16569 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:35.863039 16569 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:35.864766 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53555.2us
I20260811 16:04:35.839709 16751 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:35.870793 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 718) took 1095 ms. Trace:
I20260811 16:04:35.871426 14578 rpcz_store.cc:276] 0811 16:04:34.775163 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.819954 (+ 44791us) service_pool.cc:227] Handling call
0811 16:04:35.870561 (+1050607us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54003d13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:35.870715 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2109341952}
I20260811 16:04:35.872604 16607 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:35.870771 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:35.867060 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 159816us
I20260811 16:04:35.840974 16795 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:35.868288 16648 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.876s	user 0.000s	sys 0.013s
I20260811 16:04:35.878113 16827 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:35.878248 16608 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:35.880201 16809 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:35.881114 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:35.881533 16731 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:35.882140 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 405) took 1413 ms. Trace:
I20260811 16:04:36.009757 13901 rpcz_store.cc:276] 0811 16:04:34.468524 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.468862 (+   338us) service_pool.cc:227] Handling call
0811 16:04:34.560731 (+ 91869us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:34.694314 (+133583us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:35.881907 (+1187593us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b54000875d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:35.882079 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":163617152}
I20260811 16:04:35.883678 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 473) took 1195 ms. Trace:
W20260811 16:04:36.011080 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 130032us
I20260811 16:04:36.011425 13739 rpcz_store.cc:276] 0811 16:04:34.688525 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.708980 (+ 20455us) service_pool.cc:227] Handling call
0811 16:04:35.882942 (+1173962us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:35.883198 (+   256us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:35.883393 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:35.883416 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:35.883451 (+    35us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:35.883477 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:35.883527 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:35.883617 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3234560}
I20260811 16:04:36.012202 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:35.891201 13821 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260811 16:04:36.013583 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2132) took 1583 ms. Trace:
I20260811 16:04:36.013983 13821 rpcz_store.cc:276] 0811 16:04:34.430511 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.456847 (+ 26336us) service_pool.cc:227] Handling call
0811 16:04:35.890697 (+1433850us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:35.890917 (+   220us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:36.013239 (+122322us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.013516 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5738752}
I20260811 16:04:35.905046 16769 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:35.898774 16781 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:35.900166 16481 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:35.901038 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 713) took 1166 ms. Trace:
I20260811 16:04:35.918087 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:36.018770 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 336493us
I20260811 16:04:36.020710 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:36.037921 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 119973us
I20260811 16:04:36.038884 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:36.041433 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 360313us
I20260811 16:04:36.042740 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:36.042774 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:36.045410 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 331653us
I20260811 16:04:36.047134 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.018497 16809 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260811 16:04:36.051928 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 340217us
I20260811 16:04:36.052413 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.052990 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.015921 16729 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260811 16:04:36.048344 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 152819us
I20260811 16:04:36.054574 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.055996 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.057623 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.059605 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.061007 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.061784 13826 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.047874 14578 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:36.053213 13818 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:36.064875 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.065613 13818 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:35.901743 16795 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:36.054085 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.067629 13825 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:36.059005 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.068495 13827 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:36.068539 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.069126 13825 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.069540 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.070576 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.071364 13827 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:36.067668 16795 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.062831 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.072638 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.054761 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:35.906554 16648 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.074438 13740 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:36.093163 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:36.095558 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.045910 16731 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.074482 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.076998 13739 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:36.085142 14578 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Advancing to term 4
I20260811 16:04:36.036201 16769 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.089588 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.044818 16781 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:36.101215 13818 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.017395 16751 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.101716 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.131716 13821 raft_consensus.cc:2396] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:36.102676 14577 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:36.105901 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.132807 13823 raft_consensus.cc:2354] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:36.072036 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.048997 16636 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:36.048838 16827 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:36.136659 13744 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:36.074173 16608 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:36.124938 14582 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260811 16:04:36.138252 14582 pending_rounds.cc:76] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 6
I20260811 16:04:36.138504 14582 pending_rounds.cc:97] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260811 16:04:36.138751 14582 raft_consensus.cc:2866] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:36.128098 14575 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:36.128006 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.133934 13827 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:36.139992 14578 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260811 16:04:36.141227 13827 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:36.135613 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:36.141508 13871 connection.cc:232] RPC call timeout handler was delayed by -4.5548491840017959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260811 16:04:36.141932 13818 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:36.142441 13818 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.141819 13826 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:36.142674 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:36.141956 13871 connection.cc:232] RPC call timeout handler was delayed by -4.5332491840235889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260811 16:04:36.149376 13871 connection.cc:232] RPC call timeout handler was delayed by -4.4963491839589551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260811 16:04:36.149712 13871 connection.cc:232] RPC call timeout handler was delayed by -4.4819491839734837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260811 16:04:36.150054 13871 connection.cc:232] RPC call timeout handler was delayed by -4.4639491839334369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260811 16:04:36.150365 13871 connection.cc:232] RPC call timeout handler was delayed by -4.4162491839379072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260811 16:04:36.150655 13871 connection.cc:232] RPC call timeout handler was delayed by -4.2974491839995608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260811 16:04:36.150941 13871 connection.cc:232] RPC call timeout handler was delayed by -3.9914491840172559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260811 16:04:36.151271 13871 connection.cc:232] RPC call timeout handler was delayed by -3.9131491839652881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260811 16:04:36.151571 13871 connection.cc:232] RPC call timeout handler was delayed by -3.4406491839326918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2745s for a response
I20260811 16:04:36.152222 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.155503 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.156216 13739 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:36.107542 16729 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:36.161237 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.158825 14580 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:36.162036 13823 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:36.143393 13818 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.162892 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.163414 13818 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:36.162104 14581 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:04:36.160802 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86439.8us
I20260811 16:04:36.171667 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.172271 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.172534 14583 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:36.195297 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.231478 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.243248 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:36.247515 14574 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:36.249509 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 73576.8us
I20260811 16:04:36.142688 16818 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:36.250581 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:36.039631 14573 rpcz_store.cc:276] 0811 16:04:34.734711 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.809475 (+ 74764us) service_pool.cc:227] Handling call
0811 16:04:34.860747 (+ 51272us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:34.937990 (+ 77243us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:35.900762 (+962772us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:35.900964 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16981376}
I20260811 16:04:36.253083 14577 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:36.137816 16809 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260811 16:04:36.155284 16629 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:36.273679 14575 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:36.230166 16827 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:36.277280 13825 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.242812 16608 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:36.276784 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:36.158586 16826 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:36.241025 16654 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:36.142913 16636 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.249312 16805 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:36.293064 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:36.261686 16604 raft_consensus.cc:2741] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260811 16:04:36.285182 16754 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:36.317963 14578 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260811 16:04:36.289609 16608 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.288528 16746 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:36.333693 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:36.339919 13743 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.003s	sys 0.001s
W20260811 16:04:36.340382 13743 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.003s	sys 0.001s
I20260811 16:04:36.344218 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.346122 13825 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:36.346930 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.348244 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.352234 13821 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:36.344691 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.358229 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.320715 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.367992 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:36.339262 16608 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.250068 16769 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.380241 16607 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:36.380678 16607 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:36.380887 16769 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:36.381551 16607 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.386953 16505 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:36.387573 16505 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.388326 16630 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:36.388973 16630 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.376784 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 469) took 1691 ms. Trace:
I20260811 16:04:36.290469 16629 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.390625 13736 rpcz_store.cc:276] 0811 16:04:34.685909 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.690428 (+  4519us) service_pool.cc:227] Handling call
0811 16:04:36.375933 (+1685505us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:36.376202 (+   269us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:36.376431 (+   229us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:36.376457 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:36.376498 (+    41us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:36.376537 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.376598 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:36.376717 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4953344}
I20260811 16:04:36.391451 16630 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.332279 16604 raft_consensus.cc:2741] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260811 16:04:36.369539 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.370078 16570 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:36.414121 13827 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:36.414289 16731 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:36.371569 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:36.415537 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44104.3us
I20260811 16:04:36.416296 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:36.389706 16505 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.301136 16826 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.432507 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:36.434521 16826 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.374652 16820 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:36.314227 16805 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:36.435763 13902 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.013s	sys 0.018s
W20260811 16:04:36.436146 13902 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.013s	sys 0.018s
I20260811 16:04:36.437319 16805 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:36.368176 13686 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet 7f6a000330b3415da4f525eae84f33fb
W20260811 16:04:36.438053 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet 7f6a000330b3415da4f525eae84f33fb
I20260811 16:04:36.438141 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 476) took 1727 ms. Trace:
I20260811 16:04:36.414705 16570 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.444649 16579 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:36.445446 16570 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.445297 16579 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:36.376749 16831 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260811 16:04:36.452040 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:36.377841 16825 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260811 16:04:36.347824 13817 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:36.393230 16629 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:36.393663 16569 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.003s
I20260811 16:04:36.396587 16751 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:36.398025 16636 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.336207 16754 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.406155 16843 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:36.342468 16481 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.349152 16746 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:36.363601 16648 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.407407 16608 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.408897 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:36.370842 13823 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:36.417179 16563 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:36.417697 16819 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:36.419222 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.373348 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.465330 16764 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:36.465808 16764 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.466310 16608 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.466888 16629 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:36.467104 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.467849 14574 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 2.
I20260811 16:04:36.468008 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1774) took 1755 ms. Trace:
I20260811 16:04:36.468601 16754 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:36.466532 16774 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
W20260811 16:04:36.425278 13820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1387) took 2262 ms (client timeout 1840 ms). Trace:
W20260811 16:04:36.424773 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 147898us
W20260811 16:04:36.470099 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51086.8us
W20260811 16:04:36.470225 13820 rpcz_store.cc:269] 0811 16:04:34.163233 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.163455 (+   222us) service_pool.cc:227] Handling call
0811 16:04:36.425030 (+2261575us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:36.425194 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4288111872}
I20260811 16:04:36.428794 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.471395 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.471848 13909 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.472929 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.429118 14573 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:36.429785 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:36.431690 13826 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:36.376890 16656 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:36.438578 13741 rpcz_store.cc:276] 0811 16:04:34.710321 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.710446 (+   125us) service_pool.cc:227] Handling call
0811 16:04:34.710758 (+   312us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:34.931465 (+220707us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.437870 (+1506405us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:36.438076 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":463262592}
I20260811 16:04:36.454945 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 478) took 1460 ms. Trace:
I20260811 16:04:36.461217 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 736) took 2122 ms. Trace:
I20260811 16:04:36.485644 13826 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.485963 13744 rpcz_store.cc:276] 0811 16:04:34.994942 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:35.039722 (+ 44780us) service_pool.cc:227] Handling call
0811 16:04:35.040141 (+   419us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:36.137072 (+1096931us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.454618 (+317546us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003471d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:36.454861 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2521370880}
W20260811 16:04:36.466217 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 92985.3us
I20260811 16:04:36.471122 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.488591 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:36.462569 13789 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.551s (SENT)
I20260811 16:04:36.475798 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:36.477568 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:36.489439 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:36.421837 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 369443us
W20260811 16:04:36.489817 13789 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.573s (SENT)
I20260811 16:04:36.486040 14579 rpcz_store.cc:276] 0811 16:04:34.339005 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.339162 (+   157us) service_pool.cc:227] Handling call
0811 16:04:34.349961 (+ 10799us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:34.463237 (+113276us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:34.463272 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:34.463314 (+    42us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:34.463348 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.460961 (+1997613us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:36.461015 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:36.461155 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":259859712}
I20260811 16:04:36.490242 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.493414 14544 leader_election.cc:398] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:36.485002 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:36.491565 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:36.500085 14544 leader_election.cc:401] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260811 16:04:36.503439 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:36.505563 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.469435 16774 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:36.465467 16563 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.508154 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.486548 13826 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.512217 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.474756 16781 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:36.466708 16764 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:36.462608 16569 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260811 16:04:36.517849 13789 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.577s (SENT)
I20260811 16:04:36.514955 13826 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:36.468451 13735 rpcz_store.cc:276] 0811 16:04:34.712774 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.859357 (+146583us) service_pool.cc:227] Handling call
0811 16:04:34.859847 (+   490us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:34.999204 (+139357us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.467730 (+1468526us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:36.467939 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":176699264}
I20260811 16:04:36.510769 16654 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:36.484117 16818 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.520607 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.522675 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.515864 16505 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:36.564560 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:36.502315 16751 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:36.501623 16636 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:36.507107 16805 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:36.531878 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.501890 16754 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260811 16:04:36.517872 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 408) took 1835 ms (client timeout 1975 ms). Trace:
W20260811 16:04:36.542201 13789 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.644s (SENT)
I20260811 16:04:36.511075 16481 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 16:04:36.578864 13909 rpcz_store.cc:269] 0811 16:04:34.682939 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.428534 (+1745595us) service_pool.cc:227] Handling call
0811 16:04:36.517804 (+ 89270us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:36.516278 16656 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:36.517540 16563 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:36.517295 16629 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election won for term 4
W20260811 16:04:36.548887 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.011s	sys 0.014s
W20260811 16:04:36.584770 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.011s	sys 0.014s
W20260811 16:04:36.585107 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 740708us
I20260811 16:04:36.553938 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:36.510896 16847 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:36.530128 16630 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260811 16:04:36.518528 16843 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:36.589493 16843 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:36.589931 16843 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.590220 16632 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260811 16:04:36.591046 16783 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.572731 16365 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:36.521644 16729 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:36.568049 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47539.6us
I20260811 16:04:36.484508 16746 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:36.593379 16801 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260811 16:04:36.566996 13744 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:36.593700 16365 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:04:36.594638 16746 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:36.506312 16770 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260811 16:04:36.573208 13737 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:36.595541 16770 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:36.595909 16770 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.596736 16770 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:36.597965 16770 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.599378 13735 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:36.574282 16835 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:36.525954 16819 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5.
I20260811 16:04:36.518594 16842 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:36.527631 16579 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:36.602130 16563 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.604625 16532 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:36.605163 16532 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:36.464263 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:36.606041 16532 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.550115 16764 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:36.516148 16660 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260811 16:04:36.604683 16563 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:36.580601 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.546674 16608 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260811 16:04:36.610034 16847 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:36.620462 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.620808 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.620616 16847 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.621147 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.621605 13901 raft_consensus.cc:2354] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4.
I20260811 16:04:36.621743 13903 raft_consensus.cc:2362] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6. Re-sending same reply.
I20260811 16:04:36.622196 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.623461 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.623740 13905 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:36.569558 16654 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:36.576318 16639 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.624714 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.624830 16654 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.583741 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.536396 16604 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260811 16:04:36.525099 16826 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260811 16:04:36.518651 16820 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.587700 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.582471 16732 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260811 16:04:36.588699 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.578383 16657 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:36.589007 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:36.576713 16805 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:36.600464 16835 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.601320 16842 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.579059 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.632282 16648 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:36.541169 16569 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.574929 16774 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:36.615566 16673 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:36.616680 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.617977 16656 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:36.670495 16656 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.671733 16770 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:36.659291 16805 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.619520 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2065) took 2444 ms. Trace:
I20260811 16:04:36.672802 13908 rpcz_store.cc:276] 0811 16:04:34.175214 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.175336 (+   122us) service_pool.cc:227] Handling call
0811 16:04:34.175636 (+   300us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:35.682744 (+1507108us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.619244 (+936500us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:36.619455 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2905459456}
I20260811 16:04:36.618510 16629 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:36.628526 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.628715 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.680739 13905 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:36.630317 14578 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:36.654472 16657 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.640848 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.687181 13740 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.652176 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.653455 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.689042 13903 raft_consensus.cc:2354] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6.
W20260811 16:04:36.654778 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65851.3us
I20260811 16:04:36.654938 16630 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:36.659410 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:36.661015 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 118845us
I20260811 16:04:36.691769 13741 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:36.581502 16481 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:36.669130 16835 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:36.661732 16842 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:36.672140 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.627221 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.673970 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:36.683318 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 95705.9us
W20260811 16:04:36.684309 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67716.9us
W20260811 16:04:36.638726 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59774us
I20260811 16:04:36.690773 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.695677 13908 raft_consensus.cc:2362] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6. Re-sending same reply.
I20260811 16:04:36.663348 16648 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.721736 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:36.676883 16673 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:36.723665 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.730552 13900 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:36.679550 16569 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:36.731892 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.733335 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.736132 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:36.725138 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 135224us
I20260811 16:04:36.720530 13906 raft_consensus.cc:2396] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260811 16:04:36.740928 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.741528 13906 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:36.618520 16740 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260811 16:04:36.727957 13901 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:36.724272 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.729378 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:36.737354 16858 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260811 16:04:36.688618 16604 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:36.721589 16481 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:36.738637 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.727353 16648 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:36.736944 13909 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:36.785229 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.785881 13909 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.742408 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.786878 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:36.691443 16630 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.747119 13905 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:36.789213 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 403) took 2345 ms. Trace:
I20260811 16:04:36.790275 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.748297 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.790760 13904 raft_consensus.cc:1203] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Deduplicated request from leader. Original: 3.3->[4.4-4.4]   Dedup: 4.4->[]
I20260811 16:04:36.791371 13904 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260811 16:04:36.693284 16788 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:36.755672 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.758144 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.805462 13903 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:36.760149 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.761597 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.761909 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:36.762653 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.763190 16860 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:36.809363 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.809894 16860 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:04:36.770581 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:36.739629 13741 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:36.776434 13740 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.765969 16768 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:36.765049 13908 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:36.783996 13821 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260811 16:04:36.818830 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48360.6us
I20260811 16:04:36.787763 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.791322 13900 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:36.819645 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.691071 16657 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.791610 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.783556 16505 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:36.829420 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.826900 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.742022 16796 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:36.802100 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.811808 13735 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:36.812671 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.813091 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.789710 13902 rpcz_store.cc:276] 0811 16:04:34.444253 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.446013 (+  1760us) service_pool.cc:227] Handling call
0811 16:04:34.446305 (+   292us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:35.227755 (+781450us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:36.436503 (+1208748us) log.cc:842] Serialized 14 byte log entry
0811 16:04:36.455546 (+ 19043us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b48000603d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:04:36.567688 (+112142us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:36.573198 (+  5510us) log.cc:842] Serialized 26 byte log entry
0811 16:04:36.573504 (+   306us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:36.573552 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.573647 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:36.763817 (+190170us) raft_consensus.cc:1671] finished
0811 16:04:36.788992 (+ 25175us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:36.789146 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":771936,"prepare.queue_time_us":584350,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":794578,"raft.run_cpu_time_us":10152,"raft.run_wall_time_us":1231018,"spinlock_wait_cycles":39488256,"thread_start_us":1328574,"threads_started":2,"wal-append.queue_time_us":225142}
I20260811 16:04:36.656232 16818 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:36.815815 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.752660 16746 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260811 16:04:36.820801 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.741781 16835 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260811 16:04:36.822190 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.850239 13903 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:36.738139 16837 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:36.853895 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.742440 16783 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260811 16:04:36.801920 16630 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:36.789897 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.835458 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.870970 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.753510 16770 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260811 16:04:36.871785 13903 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
I20260811 16:04:36.781620 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.839115 13740 raft_consensus.cc:2354] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5.
I20260811 16:04:36.751637 16769 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260811 16:04:36.843449 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.844743 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.834426 16768 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:36.812794 16838 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260811 16:04:36.850485 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.951856 13908 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:36.854898 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.953286 13741 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:36.858433 13900 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:36.831643 16836 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:36.864434 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.871577 13909 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
I20260811 16:04:36.960427 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.813025 16788 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:36.895380 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:36.861286 16837 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:36.856688 16647 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:36.816079 16673 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:36.903688 16810 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:36.930938 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.834409 16862 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260811 16:04:36.932456 14578 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:36.934440 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.935050 13744 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:36.935351 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.938251 13871 leader_election.cc:398] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5.
I20260811 16:04:36.847709 13905 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:36.989316 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:36.989719 13737 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260811 16:04:36.987980 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.962985 13741 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:36.988919 14583 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:36.991812 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.992487 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.992821 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.993103 14583 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:36.967922 16836 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:36.815676 16629 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.002367 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.970338 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:36.968935 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.973037 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:36.983686 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.846330 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:36.983915 16863 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.005s
W20260811 16:04:36.984395 16855 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260811 16:04:36.879559 16805 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.002215 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.013084 13905 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:37.003994 13900 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:36.982366 13908 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:37.013507 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:36.999503 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:36.996508 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:37.014519 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.004933 13902 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:36.975601 16837 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:37.025913 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.005501 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:37.026866 13903 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:36.984270 13736 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:37.006026 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:37.032648 13741 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260811 16:04:37.033967 13740 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:37.035228 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.035601 13740 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:04:36.997975 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:36.999811 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 214130us
I20260811 16:04:37.006587 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.000969 16836 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:37.008513 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:37.024634 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:37.025229 13905 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:04:37.003333 14580 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
W20260811 16:04:37.030646 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 92530.5us
I20260811 16:04:37.031066 13818 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260811 16:04:37.036450 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 249372us
I20260811 16:04:37.037480 13902 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:37.037775 13741 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260811 16:04:36.966753 13906 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:37.040062 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:36.848169 16796 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:36.998157 16874 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:37.044812 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.048084 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.063642 13902 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260811 16:04:37.049263 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.008476 16746 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260811 16:04:37.077131 16871 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260811 16:04:37.078967 13740 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:37.065436 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.054973 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.080782 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.081015 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:37.029970 16810 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260811 16:04:37.097040 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53641us
I20260811 16:04:37.001180 16843 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.049079 13821 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:37.051646 13905 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:37.067443 13827 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:04:37.082652 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.072408 13744 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260811 16:04:37.103897 13744 pending_rounds.cc:76] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 3
I20260811 16:04:37.104245 13744 pending_rounds.cc:97] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260811 16:04:37.104563 13744 raft_consensus.cc:2866] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:37.104916 13905 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:37.106410 13744 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260811 16:04:37.106897 13744 pending_rounds.cc:76] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 3
I20260811 16:04:37.075140 13902 pending_rounds.cc:76] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 1
I20260811 16:04:37.107326 13902 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260811 16:04:37.107728 13902 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:37.108142 13902 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260811 16:04:37.108449 13902 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:37.073827 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:37.043171 13900 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260811 16:04:37.109647 13900 pending_rounds.cc:76] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 2
I20260811 16:04:37.109896 13900 pending_rounds.cc:97] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260811 16:04:37.074970 13909 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:37.110309 13900 raft_consensus.cc:2866] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:37.110347 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.058712 13906 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:04:37.111783 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:37.116312 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:37.114758 13744 pending_rounds.cc:97] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260811 16:04:37.118340 13744 raft_consensus.cc:2866] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:04:37.121112 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 81170.2us
I20260811 16:04:37.122032 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:37.100425 13789 leader_election.cc:398] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6.
I20260811 16:04:37.126981 13789 leader_election.cc:401] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:04:37.042675 16875 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:37.135558 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:37.132495 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 97410.4us
I20260811 16:04:37.075799 16746 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:37.146832 13825 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:37.068491 16781 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:37.134653 13744 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260811 16:04:37.065737 16884 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:37.070607 16770 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:37.139492 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:37.136318 13900 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:37.073325 13736 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:37.100840 14573 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:37.070899 16796 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.138203 14582 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:37.133383 16740 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:37.115038 16838 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:37.116636 16769 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:37.123401 16456 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:37.164235 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:37.120534 16380 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:37.169516 16639 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
I20260811 16:04:37.163336 16884 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:37.170002 13903 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:37.170362 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 511) took 1113 ms. Trace:
I20260811 16:04:37.131628 16604 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260811 16:04:37.171983 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2146) took 2463 ms. Trace:
I20260811 16:04:37.195246 13822 rpcz_store.cc:276] 0811 16:04:34.708386 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.708623 (+   237us) service_pool.cc:227] Handling call
0811 16:04:35.044355 (+335732us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:35.076024 (+ 31669us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:37.169233 (+2093209us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400240c50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:37.171921 (+  2688us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":709974400}
I20260811 16:04:37.149991 16469 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260811 16:04:37.159404 16764 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260811 16:04:37.135681 16875 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:37.171480 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46405.7us
I20260811 16:04:37.168807 13735 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:37.153317 16746 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:37.035480 16768 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:37.167567 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 67295.9us
W20260811 16:04:37.200147 16751 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260811 16:04:37.166730 16862 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:37.102669 16827 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:37.137008 16656 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260811 16:04:37.159752 16657 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.203300 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.193467 13824 rpcz_store.cc:276] 0811 16:04:36.057370 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.143622 (+ 86252us) service_pool.cc:227] Handling call
0811 16:04:36.144059 (+   437us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:36.332140 (+188081us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:36.332171 (+    31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:36.343785 (+ 11614us) log.cc:842] Serialized 52 byte log entry
0811 16:04:36.574522 (+230737us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:36.662084 (+ 87562us) log.cc:842] Serialized 14 byte log entry
0811 16:04:36.682809 (+ 20725us) log.cc:842] Serialized 14 byte log entry
0811 16:04:36.682992 (+   183us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.683058 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:37.170138 (+487080us) raft_consensus.cc:1671] finished
0811 16:04:37.170157 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:37.170305 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10418,"prepare.queue_time_us":115188,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":257854,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":12531,"spinlock_wait_cycles":66838400,"thread_start_us":435195,"threads_started":3,"wal-append.queue_time_us":295443}
I20260811 16:04:37.229813 16657 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.178159 16770 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6.
I20260811 16:04:37.202543 16647 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260811 16:04:37.189471 16796 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.232645 16796 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.234800 16796 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.240932 16873 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:37.193876 16639 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:37.072890 16874 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.192346 16838 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:37.193768 16729 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:37.197158 16456 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:37.195240 16884 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:37.217025 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.239292 16849 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:37.240005 16845 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:37.240473 16882 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:04:37.239727 16878 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260811 16:04:37.154609 16781 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:37.242111 14580 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260811 16:04:37.208729 13817 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:04:37.241425 16841 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:37.215866 16746 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:37.210057 16875 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:37.193225 16380 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.317338 16873 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:37.260087 16648 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:37.263331 16870 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260811 16:04:37.263849 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:37.260725 16862 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:37.260788 16658 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.383708 16849 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:37.272759 16569 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.005s
I20260811 16:04:37.225222 16827 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:37.226699 16751 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:37.267055 16843 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:37.275261 16805 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:37.260334 16729 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:37.260459 16838 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:37.313934 16796 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:37.319478 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 116272us
I20260811 16:04:37.389707 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.225996 16788 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:37.327901 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 110909us
I20260811 16:04:37.319707 16656 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:37.392920 16827 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:37.392598 16569 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.396157 13743 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:37.334935 16845 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.363626 16380 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.364017 16532 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:37.365203 16891 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260811 16:04:37.333617 16841 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:37.402221 16842 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.005s
W20260811 16:04:37.380885 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1769) took 3311 ms (client timeout 1790 ms). Trace:
I20260811 16:04:37.329841 16781 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:37.391600 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.399763 16838 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:37.378340 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65760.7us
I20260811 16:04:37.402127 16729 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:37.416357 16862 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:37.426170 13742 rpcz_store.cc:269] 0811 16:04:34.069029 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:34.070020 (+   991us) service_pool.cc:227] Handling call
0811 16:04:37.380570 (+3310550us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400311d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:37.380791 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1837707008}
I20260811 16:04:37.317691 16770 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:37.461382 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.465694 16879 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.466361 16879 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.425545 16604 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260811 16:04:37.427968 16890 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260811 16:04:37.412864 16456 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.454030 13901 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:37.478834 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.480607 16747 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:37.482033 16770 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.484405 16764 raft_consensus.cc:2741] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260811 16:04:37.482765 16770 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.488382 16770 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:37.498438 13789 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.121s (SENT)
W20260811 16:04:37.499843 13789 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.127s (SENT)
I20260811 16:04:37.500108 16656 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:37.501876 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 520) took 1441 ms. Trace:
I20260811 16:04:37.384910 16849 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.429062 16845 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.426259 16841 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:37.504593 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:37.529358 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:37.502497 13826 rpcz_store.cc:276] 0811 16:04:36.060332 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.148543 (+ 88211us) service_pool.cc:227] Handling call
0811 16:04:36.431533 (+282990us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:36.578201 (+146668us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:36.578229 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:36.579200 (+   971us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:36.579253 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.579316 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:37.501659 (+922343us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400200b50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:37.501797 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5609,"spinlock_wait_cycles":650057088}
I20260811 16:04:37.440802 16788 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:37.403082 16796 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.461839 16569 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:37.445642 16810 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260811 16:04:37.442020 16842 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.554564 16842 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:37.539029 16579 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:37.445850 16647 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260811 16:04:37.555667 16579 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:37.534955 16747 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:37.457715 16889 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:37.558987 16648 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.559376 13736 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:37.566291 16579 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:37.538359 16879 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:37.492899 16827 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:37.547194 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47391us
I20260811 16:04:37.538717 16837 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:37.591056 13789 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.131s (SENT)
I20260811 16:04:37.592952 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:37.593318 16827 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:37.597618 16845 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.560444 16569 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260811 16:04:37.606948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:37.599486 16630 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.005s
W20260811 16:04:37.603825 16820 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.951s	user 0.006s	sys 0.008s
I20260811 16:04:37.617879 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 759) took 1189 ms. Trace:
I20260811 16:04:37.441561 16873 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.609086 16365 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260811 16:04:37.651103 16365 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:37.651630 16365 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:37.640244 16864 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.787s	user 0.003s	sys 0.000s
W20260811 16:04:37.664975 16866 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.805s	user 0.001s	sys 0.000s
I20260811 16:04:37.665513 16819 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:37.588738 16874 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.637274 13736 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:37.673377 16826 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:37.683019 16826 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:37.685153 13822 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 16:04:37.687536 16839 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:37.688078 16839 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:37.688344 16572 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:37.618594 16630 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:37.692008 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 100996us
I20260811 16:04:37.669126 16819 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:37.684311 16826 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.708585 16819 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.712073 16572 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:04:37.713039 16572 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:37.713421 16572 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:37.714481 16572 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.728121 16572 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:37.652693 16365 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.757058 16365 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:37.746034 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:37.748229 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:37.682457 14577 rpcz_store.cc:276] 0811 16:04:36.428152 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.428287 (+   135us) service_pool.cc:227] Handling call
0811 16:04:36.428662 (+   375us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:36.440538 (+ 11876us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:36.577094 (+136556us) log.cc:842] Serialized 14 byte log entry
0811 16:04:36.577341 (+   247us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:36.577385 (+    44us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:36.577425 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:37.617607 (+1040182us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54006b44d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:37.617664 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:37.617795 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":171406,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":106,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4778,"spinlock_wait_cycles":26661120,"thread_start_us":136123,"threads_started":1}
I20260811 16:04:37.760387 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:37.761651 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:37.764792 13820 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:37.695968 16820 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:37.767936 13821 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:37.780287 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 764) took 1151 ms. Trace:
I20260811 16:04:37.789191 14581 rpcz_store.cc:276] 0811 16:04:36.629330 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.629833 (+   503us) service_pool.cc:227] Handling call
0811 16:04:36.630088 (+   255us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:36.630457 (+   369us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:36.630485 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:36.630962 (+   477us) log.cc:842] Serialized 52 byte log entry
0811 16:04:36.691856 (+ 60894us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:36.691891 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:36.691951 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:37.639361 (+947410us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:37.779878 (+140517us) raft_consensus.cc:1671] finished
0811 16:04:37.779907 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:37.780187 (+   280us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2424,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":14200,"spinlock_wait_cycles":34600320,"thread_start_us":29840,"threads_started":1,"wal-append.queue_time_us":140041}
I20260811 16:04:37.723812 16819 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:37.794848 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:37.803212 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.144s	sys 0.273s
W20260811 16:04:37.804415 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.144s	sys 0.273s
I20260811 16:04:37.689267 16839 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.804469 13907 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
W20260811 16:04:37.806126 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 676037us
I20260811 16:04:37.806951 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:37.759704 16837 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:37.810637 13821 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:37.766791 16796 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.812295 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:37.816031 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2086) took 1092 ms. Trace:
I20260811 16:04:37.816430 13904 rpcz_store.cc:276] 0811 16:04:36.723540 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.723912 (+   372us) service_pool.cc:227] Handling call
0811 16:04:36.748381 (+ 24469us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:36.802621 (+ 54240us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:37.815775 (+1013154us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b5400034dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:37.815962 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":97206272}
I20260811 16:04:37.821552 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:37.823911 13903 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:04:37.825523 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.826398 13902 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
W20260811 16:04:37.832279 13827 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.023s	sys 0.032s
W20260811 16:04:37.832682 13827 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.023s	sys 0.032s
I20260811 16:04:37.837083 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1784) took 1261 ms. Trace:
I20260811 16:04:37.837661 13743 rpcz_store.cc:276] 0811 16:04:36.575968 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.576110 (+   142us) service_pool.cc:227] Handling call
0811 16:04:37.836776 (+1260666us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:37.836996 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1770668288}
W20260811 16:04:37.815807 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.041s	sys 0.065s
W20260811 16:04:37.854357 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.042s	sys 0.066s
W20260811 16:04:37.854794 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 690609us
I20260811 16:04:37.857180 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.861047 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.862922 13821 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:37.865414 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:37.865878 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.861964 13902 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:37.868103 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:37.874657 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:37.875560 13902 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:37.764981 16579 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.879187 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:37.880020 13904 raft_consensus.cc:2362] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
I20260811 16:04:37.883585 16812 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.884455 16812 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:37.891546 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.003s	sys 0.055s
W20260811 16:04:37.892026 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.003s	sys 0.055s
I20260811 16:04:37.776644 16754 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260811 16:04:37.851079 16839 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:37.782407 16729 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.915910 13903 raft_consensus.cc:1203] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
W20260811 16:04:37.863238 16481 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.059s	user 0.013s	sys 0.002s
I20260811 16:04:37.917469 13743 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:37.851671 16835 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:37.917827 13903 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260811 16:04:37.849790 16563 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:37.929611 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.863777 16882 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:37.878163 16617 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.938719 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:37.939985 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:37.913655 16874 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:37.925098 16569 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.808495 16884 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.925966 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1787) took 1338 ms. Trace:
I20260811 16:04:37.943389 16660 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:37.877069 16751 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260811 16:04:37.967906 16569 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.951721 16563 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:37.954350 16380 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:37.959802 16874 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:37.994590 16630 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:37.964253 16845 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:37.965144 16365 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:37.973780 16660 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:37.927809 16481 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.943934 16835 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.028461 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:38.033660 13789 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.121s (SENT)
W20260811 16:04:38.034893 13789 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.222s (SENT)
I20260811 16:04:38.037010 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.954396 16617 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:37.996624 16380 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:38.007670 16874 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:38.011574 16365 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:38.060468 13789 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.974s (SENT)
I20260811 16:04:38.061142 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:37.967406 16841 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:38.062584 13739 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 2. Current term is 3. Ops: []
I20260811 16:04:38.039989 16785 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:38.039217 16630 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:38.083344 16868 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.226s	user 0.003s	sys 0.000s
I20260811 16:04:37.963409 16882 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.083447 16630 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.078379 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:38.053400 16380 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:38.081573 16841 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.068435 16801 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:04:38.082679 16836 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.986s	user 0.014s	sys 0.000s
W20260811 16:04:38.066200 16875 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.679s	user 0.014s	sys 0.000s
I20260811 16:04:38.089143 16882 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:38.081439 16729 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:38.107887 16897 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260811 16:04:38.064815 16832 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:38.108810 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1407) took 1067 ms. Trace:
I20260811 16:04:38.109241 16884 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:38.021062 16845 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:38.086520 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:38.019220 16563 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.147701 16569 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.148058 16630 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:38.148658 16365 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.149714 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1788) took 1561 ms. Trace:
I20260811 16:04:38.150048 16365 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:38.150163 13739 rpcz_store.cc:276] 0811 16:04:36.588021 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.588186 (+   165us) service_pool.cc:227] Handling call
0811 16:04:36.623575 (+ 35389us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:38.064983 (+1441408us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.149434 (+ 84451us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000a82d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:38.149641 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3308915968}
I20260811 16:04:38.142887 13820 rpcz_store.cc:276] 0811 16:04:37.041500 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.041700 (+   200us) service_pool.cc:227] Handling call
0811 16:04:37.096161 (+ 54461us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:37.774155 (+677994us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.108525 (+334370us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54002db9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:38.108737 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1537088768}
I20260811 16:04:38.153767 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.110311 16836 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:38.099656 16812 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:38.134827 16629 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.012s	sys 0.033s
W20260811 16:04:38.121039 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.017s	sys 0.038s
W20260811 16:04:38.162720 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.018s	sys 0.038s
W20260811 16:04:38.169030 16838 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260811 16:04:38.169296 16836 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.175752 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:38.137665 16579 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.188025 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.188889 13824 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:38.162515 16629 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.012s	sys 0.034s
I20260811 16:04:38.197794 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:38.199051 16532 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.000s
I20260811 16:04:38.199476 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:37.974260 13738 rpcz_store.cc:276] 0811 16:04:36.585670 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.586943 (+  1273us) service_pool.cc:227] Handling call
0811 16:04:36.689190 (+102247us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:36.753400 (+ 64210us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:36.767031 (+ 13631us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:36.876282 (+109251us) log.cc:842] Serialized 52 byte log entry
0811 16:04:37.374701 (+498419us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:37.385484 (+ 10783us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:37.400645 (+ 15161us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:37.891243 (+490598us) raft_consensus.cc:1671] finished
0811 16:04:37.891277 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:37.923889 (+ 32612us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4616,"raft.queue_time_us":11413,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":33306,"thread_start_us":430342,"threads_started":1,"wal-append.queue_time_us":981214}
I20260811 16:04:38.200970 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.202490 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:38.208616 16746 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.006s
I20260811 16:04:38.209237 16746 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.212018 16660 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:38.213598 16481 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:38.216192 13736 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:38.222170 13902 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:38.169559 16838 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.135895 16875 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.235054 16617 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:38.231585 16781 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.004s
I20260811 16:04:38.239210 16673 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:38.241325 13626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 323) took 17823 ms (client timeout 15000 ms). Trace:
I20260811 16:04:38.242683 16774 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:38.170092 16845 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.256731 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1411) took 1064 ms. Trace:
I20260811 16:04:38.267179 16781 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.276890 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 412) took 1501 ms. Trace:
I20260811 16:04:38.275949 13827 rpcz_store.cc:276] 0811 16:04:37.192089 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.192611 (+   522us) service_pool.cc:227] Handling call
0811 16:04:37.192994 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:37.200367 (+  7373us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.200414 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:37.207890 (+  7476us) log.cc:842] Serialized 26 byte log entry
0811 16:04:37.833055 (+625165us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:37.833100 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:37.833177 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:38.256478 (+423301us) raft_consensus.cc:1671] finished
0811 16:04:38.256501 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:38.256647 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":401,"raft.queue_time_us":548,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5987,"thread_start_us":603952,"threads_started":1,"wal-append.queue_time_us":1015883}
I20260811 16:04:38.277290 13901 rpcz_store.cc:276] 0811 16:04:36.775166 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.004343 (+229177us) service_pool.cc:227] Handling call
0811 16:04:38.276699 (+1272356us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003b06d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:38.276825 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":486654336}
I20260811 16:04:38.278393 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.247713 16882 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:38.280272 13744 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:38.279731 16882 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.281710 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1790) took 1523 ms. Trace:
I20260811 16:04:38.282097 13744 rpcz_store.cc:276] 0811 16:04:36.757893 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.155396 (+397503us) service_pool.cc:227] Handling call
0811 16:04:38.280095 (+1124699us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:38.280691 (+   596us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.281476 (+   785us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001dc750. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:38.281628 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2585712000}
I20260811 16:04:38.190505 16836 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:38.265305 13824 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:38.297082 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.268810 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.270045 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:38.297942 13827 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:38.298444 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1541) took 1628 ms. Trace:
I20260811 16:04:38.278839 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1537) took 1610 ms. Trace:
I20260811 16:04:38.299353 13740 rpcz_store.cc:276] 0811 16:04:36.668660 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.042581 (+373921us) service_pool.cc:227] Handling call
0811 16:04:37.042877 (+   296us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:37.079490 (+ 36613us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.278580 (+1199090us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:38.278768 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":82572160}
W20260811 16:04:38.291877 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1867) took 1672 ms (client timeout 1761 ms). Trace:
I20260811 16:04:38.219380 16835 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:38.301288 13907 rpcz_store.cc:269] 0811 16:04:36.619171 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.621936 (+  2765us) service_pool.cc:227] Handling call
0811 16:04:38.291634 (+1669698us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000c7454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:38.291782 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2697045376}
I20260811 16:04:38.298916 13737 rpcz_store.cc:276] 0811 16:04:36.669801 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.994518 (+324717us) service_pool.cc:227] Handling call
0811 16:04:38.269806 (+1275288us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:38.298366 (+ 28560us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8520576}
W20260811 16:04:38.302737 13709 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.771s (SENT)
I20260811 16:04:38.314040 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:38.316227 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:38.318418 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:38.303625 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.367652 13824 raft_consensus.cc:2354] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:38.368777 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.369949 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.370903 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.299038 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.308836 13818 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:38.320380 16607 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:38.376231 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.376966 13818 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:38.324750 16608 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:38.327265 13825 raft_consensus.cc:2354] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6.
I20260811 16:04:38.327977 16707 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:38.278970 16781 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:38.383353 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.384878 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.387310 13818 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:38.382572 16836 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:38.391119 16836 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:38.302881 13820 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:38.359468 16875 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:38.346127 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 728) took 1564 ms. Trace:
I20260811 16:04:38.295984 16882 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.393043 14579 rpcz_store.cc:276] 0811 16:04:36.782120 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:36.782255 (+   135us) service_pool.cc:227] Handling call
0811 16:04:36.805284 (+ 23029us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:36.811529 (+  6245us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:36.811561 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:36.811978 (+   417us) log.cc:842] Serialized 26 byte log entry
0811 16:04:37.006958 (+194980us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:37.030683 (+ 23725us) log.cc:842] Serialized 14 byte log entry
0811 16:04:37.096937 (+ 66254us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.270738 (+1173801us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b18003247c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:04:38.345684 (+ 74946us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:38.345774 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:38.345844 (+    70us) raft_consensus.cc:1671] finished
0811 16:04:38.345863 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:38.346039 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":85308,"prepare.queue_time_us":23413,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":102677,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":31085,"spinlock_wait_cycles":22864000,"thread_start_us":194603,"threads_started":1,"wal-append.queue_time_us":341206}
W20260811 16:04:38.271490 13626 rpcz_store.cc:269] 0811 16:04:20.418187 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:20.418509 (+   322us) service_pool.cc:227] Handling call
0811 16:04:38.241209 (+17822700us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:29.576278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:29.669179 (+ 92901us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:29.669234 (+    55us) write_op.cc:435] Acquired schema lock
0811 16:04:29.669248 (+    14us) tablet.cc:660] Decoding operations
0811 16:04:29.761695 (+ 92447us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:29.761852 (+   157us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:29.761899 (+    47us) tablet.cc:683] Acquiring locks for 10 operations
0811 16:04:29.763224 (+  1325us) tablet.cc:699] Row locks acquired
0811 16:04:29.763260 (+    36us) write_op.cc:260] PREPARE: finished
0811 16:04:29.763461 (+   201us) write_op.cc:270] Start()
0811 16:04:29.763634 (+   173us) write_op.cc:276] Timestamp: P: 1786464269763388 usec, L: 0
0811 16:04:29.763674 (+    40us) op_driver.cc:331] REPLICATION: starting
0811 16:04:29.764559 (+   885us) log.cc:842] Serialized 4096 byte log entry
0811 16:04:30.316746 (+552187us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:30.463613 (+146867us) op_driver.cc:444] REPLICATION: finished
0811 16:04:32.367819 (+1904206us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5531c410
0811 16:04:33.380521 (+1012702us) write_op.cc:301] APPLY: starting
0811 16:04:33.380635 (+   114us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:33.380902 (+   267us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:33.380929 (+    27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:33.382419 (+  1490us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:33.382808 (+   389us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0811 16:04:33.382861 (+    53us) write_op.cc:312] APPLY: finished
0811 16:04:33.411135 (+ 28274us) log.cc:842] Serialized 77 byte log entry
0811 16:04:34.145178 (+734043us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:34.145342 (+   164us) write_op.cc:454] Released schema lock
0811 16:04:34.145419 (+    77us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:34.145739 (+   320us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:34.145769 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29359,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":2904263,"apply.run_cpu_time_us":20970,"apply.run_wall_time_us":765698,"num_ops":10,"prepare.queue_time_us":602189,"prepare.run_cpu_time_us":16349,"prepare.run_wall_time_us":231779,"raft.queue_time_us":113145,"raft.run_cpu_time_us":39369,"raft.run_wall_time_us":2819283,"replication_time_us":699819,"spinlock_wait_cycles":11795968,"thread_start_us":3930265,"threads_started":5,"wal-append.queue_time_us":787481,"wal-append.run_cpu_time_us":29160,"wal-append.run_wall_time_us":2977513}]]}
I20260811 16:04:38.377221 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.414779 13824 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
W20260811 16:04:38.378547 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59566.2us
I20260811 16:04:38.380795 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.396059 16838 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:38.373098 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:38.417122 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:38.386512 16746 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:38.423125 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.014s	sys 0.025s
W20260811 16:04:38.433760 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.015s	sys 0.025s
W20260811 16:04:38.434144 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.29468e+06us
I20260811 16:04:38.434047 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:38.434922 13907 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:38.453979 13820 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:38.454694 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:38.455613 13901 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:38.455693 13737 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:04:38.457170 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:38.457690 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:38.460749 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:38.461796 13744 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:38.463104 13740 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:38.460660 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:38.464089 13904 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:38.466408 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:38.466574 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:38.467638 13709 leader_election.cc:398] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
I20260811 16:04:38.468407 13709 leader_election.cc:401] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:04:38.468734 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:38.469660 13902 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:38.471650 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:38.472579 13904 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:38.431739 16819 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.004s
I20260811 16:04:38.477798 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:38.480981 13740 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:38.477432 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.027s	sys 0.016s
I20260811 16:04:38.482110 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:38.483976 13744 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260811 16:04:38.486140 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:38.485633 13744 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260811 16:04:38.482393 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.028s	sys 0.016s
W20260811 16:04:38.487991 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.08228e+06us
I20260811 16:04:38.488526 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:38.489451 13827 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:04:38.502696 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.007s	sys 0.059s
I20260811 16:04:38.505576 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:38.507830 13737 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:38.506098 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.008s	sys 0.059s
I20260811 16:04:38.490535 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:38.490070 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.011s	sys 0.011s
W20260811 16:04:38.519587 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.012s	sys 0.011s
W20260811 16:04:38.511458 13735 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.014s	sys 0.039s
I20260811 16:04:38.479192 16746 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:38.533717 13907 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:38.552693 13904 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:38.508512 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:38.464977 16707 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:38.565138 13820 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
W20260811 16:04:38.526194 13735 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.014s	sys 0.039s
I20260811 16:04:38.472002 16660 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260811 16:04:38.489909 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:38.577335 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68923.5us
I20260811 16:04:38.578572 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:38.579581 14581 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:38.554838 13901 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:38.581717 16754 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:38.536782 16636 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:38.590586 13743 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.022s	sys 0.039s
W20260811 16:04:38.519862 16789 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.006s	sys 0.018s
I20260811 16:04:38.563964 16882 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:38.590284 16685 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.205s	user 0.024s	sys 0.041s
W20260811 16:04:38.609716 16685 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.025s	sys 0.042s
W20260811 16:04:38.596494 16789 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.006s	sys 0.018s
I20260811 16:04:38.591128 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:38.617142 14579 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:38.561077 16707 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:38.567070 16835 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260811 16:04:38.574674 16852 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260811 16:04:38.619725 16852 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:04:38.619802 16835 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:38.620172 16852 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:38.620275 16835 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:38.621268 16835 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:38.621333 16852 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.622808 16835 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:38.606042 16660 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:38.622813 16852 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:04:38.520601 16836 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:38.594288 16572 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:38.592448 16754 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:38.642330 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:38.643361 14577 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:38.645898 16754 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:38.631263 16380 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260811 16:04:38.648402 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:38.630529 16707 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:38.649394 14577 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:38.595806 16636 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:38.649099 16826 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:38.613523 16884 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260811 16:04:38.607049 16882 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:38.647373 16874 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.577s	user 0.014s	sys 0.000s
I20260811 16:04:38.648905 16671 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:38.638435 16572 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:38.665768 16572 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:38.667359 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:38.668006 14573 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:38.670195 16671 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:38.670416 14577 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:38.671273 16671 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:38.672999 16671 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:38.650548 16768 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.023s	sys 0.073s
W20260811 16:04:38.675884 16768 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.024s	sys 0.074s
I20260811 16:04:38.664949 14580 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:38.650285 16380 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:38.727106 16839 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.799s	user 0.013s	sys 0.000s
I20260811 16:04:38.723412 16572 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:38.704036 16877 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.011s	sys 0.030s
W20260811 16:04:38.712730 16862 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.042s	sys 0.062s
I20260811 16:04:38.678645 16874 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:38.734920 16877 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.011s	sys 0.031s
W20260811 16:04:38.735512 16862 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.042s	sys 0.063s
W20260811 16:04:38.735260 16658 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.009s	sys 0.024s
W20260811 16:04:38.952204 16658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.554s	user 0.009s	sys 0.024s
I20260811 16:04:38.952735 16746 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4.
W20260811 16:04:38.955691 16563 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.020s	sys 0.025s
W20260811 16:04:38.956301 16563 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.020s	sys 0.025s
I20260811 16:04:38.958484 16572 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:38.871425 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.032s	sys 0.031s
I20260811 16:04:38.864244 13630 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to <none>, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:38.874564 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:38.591418 13743 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.022s	sys 0.040s
W20260811 16:04:38.876672 13742 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.004s	sys 0.023s
I20260811 16:04:38.879987 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1539) took 2210 ms. Trace:
W20260811 16:04:38.889202 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.017s	sys 0.020s
W20260811 16:04:38.889364 13821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.006s	sys 0.007s
W20260811 16:04:38.891592 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.310s	user 0.003s	sys 0.011s
W20260811 16:04:38.892333 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.000s	sys 0.008s
I20260811 16:04:38.893112 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:38.899302 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1413) took 1576 ms. Trace:
W20260811 16:04:38.907045 13903 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.000s	sys 0.013s
I20260811 16:04:38.907760 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:38.912942 13908 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.003s	sys 0.020s
W20260811 16:04:38.913640 13909 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.011s	sys 0.039s
W20260811 16:04:38.936376 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.000s	sys 0.015s
W20260811 16:04:38.936389 14542 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.004s	sys 0.008s
I20260811 16:04:38.944348 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:38.945341 14575 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:38.946184 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:38.946300 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:38.947922 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:38.789063 16874 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:38.765445 16882 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:38.963430 16818 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.505s	user 0.012s	sys 0.024s
W20260811 16:04:39.084097 16818 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.626s	user 0.013s	sys 0.024s
W20260811 16:04:38.963567 16849 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.205s	user 0.014s	sys 0.014s
W20260811 16:04:39.085714 16849 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.014s	sys 0.014s
W20260811 16:04:39.053117 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.017s	sys 0.021s
I20260811 16:04:39.035528 13823 rpcz_store.cc:276] 0811 16:04:37.312796 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.312972 (+   176us) service_pool.cc:227] Handling call
0811 16:04:37.319636 (+  6664us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:37.320000 (+   364us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.320042 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:37.320623 (+   581us) log.cc:842] Serialized 26 byte log entry
0811 16:04:38.520269 (+1199646us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:38.520321 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.520390 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:38.889192 (+368802us) raft_consensus.cc:1671] finished
0811 16:04:38.889238 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:38.889549 (+   311us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":12714,"thread_start_us":1129379,"threads_started":1,"wal-append.queue_time_us":1383834}
I20260811 16:04:38.861080 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:39.087949 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1414) took 1639 ms. Trace:
I20260811 16:04:39.088510 16774 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260811 16:04:38.805807 16873 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.004s	sys 0.015s
I20260811 16:04:38.968150 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:38.969592 16456 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.001s	sys 0.005s
I20260811 16:04:38.970709 16481 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:38.971736 16793 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
W20260811 16:04:38.947921 16469 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.009s	sys 0.003s
I20260811 16:04:38.975564 16838 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:38.977283 16839 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:38.978964 16847 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:38.980803 16884 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:38.982671 16813 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.013s
I20260811 16:04:38.954617 16636 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:39.021522 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.033s	sys 0.031s
I20260811 16:04:39.011989 16380 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:39.042991 14542 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.004s	sys 0.008s
W20260811 16:04:39.043484 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.000s	sys 0.016s
W20260811 16:04:39.046378 13908 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.003s	sys 0.020s
I20260811 16:04:39.064592 16893 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:39.047509 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.000s	sys 0.009s
W20260811 16:04:39.048162 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.467s	user 0.003s	sys 0.012s
W20260811 16:04:39.046866 13909 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.735s	user 0.012s	sys 0.039s
W20260811 16:04:39.050082 13742 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.503s	user 0.005s	sys 0.023s
W20260811 16:04:39.046535 13903 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.000s	sys 0.014s
I20260811 16:04:39.055433 14578 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:39.056411 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 499) took 1812 ms. Trace:
I20260811 16:04:39.056107 13630 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:39.125036 13905 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:39.125582 16873 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.005s	sys 0.015s
I20260811 16:04:39.126809 16877 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:39.127478 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.05165e+06us
I20260811 16:04:39.128067 16877 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.130234 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.25814e+06us
I20260811 16:04:39.131433 16899 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:39.132153 16899 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:39.132742 16899 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:39.135159 16481 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.137112 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1791) took 1998 ms. Trace:
W20260811 16:04:39.137462 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 244900us
I20260811 16:04:39.107365 16793 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:39.088435 13817 rpcz_store.cc:276] 0811 16:04:37.448572 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.449228 (+   656us) service_pool.cc:227] Handling call
0811 16:04:37.457784 (+  8556us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:37.503765 (+ 45981us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.514406 (+ 10641us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:37.590130 (+ 75724us) log.cc:842] Serialized 52 byte log entry
0811 16:04:39.087243 (+1497113us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:39.087366 (+   123us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.087543 (+   177us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.087614 (+    71us) raft_consensus.cc:1671] finished
0811 16:04:39.087625 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.087877 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3627,"raft.queue_time_us":19192,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":1417131,"threads_started":1,"wal-append.queue_time_us":1173051}
I20260811 16:04:39.106868 16832 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.178s
I20260811 16:04:39.033468 13741 rpcz_store.cc:276] 0811 16:04:36.669208 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.056854 (+387646us) service_pool.cc:227] Handling call
0811 16:04:37.057198 (+   344us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:38.877483 (+1820285us) raft_consensus.cc:1520] Early marking committed up to index 1
0811 16:04:38.877600 (+   117us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:38.877692 (+    92us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:38.877750 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:38.879097 (+  1347us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:38.879270 (+   173us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:38.879652 (+   382us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":93597,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":367,"spinlock_wait_cycles":4183199488}
I20260811 16:04:39.064512 16852 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.135802 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 433) took 1123 ms. Trace:
I20260811 16:04:39.126250 13630 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:04:39.046800 13821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.006s	sys 0.007s
W20260811 16:04:39.120142 16469 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.010s	sys 0.003s
W20260811 16:04:39.112846 16456 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.001s	sys 0.005s
I20260811 16:04:39.124821 16927 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:39.151880 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206025us
I20260811 16:04:39.160614 14574 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:39.161762 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 254502us
I20260811 16:04:39.145721 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1419) took 1436 ms. Trace:
I20260811 16:04:39.139441 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1416) took 1605 ms. Trace:
I20260811 16:04:39.142163 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 425) took 2193 ms. Trace:
I20260811 16:04:39.163654 16832 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:39.138866 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:39.126928 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 424) took 2188 ms. Trace:
I20260811 16:04:39.124037 13743 rpcz_store.cc:276] 0811 16:04:37.244332 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.927596 (+683264us) service_pool.cc:227] Handling call
0811 16:04:37.953107 (+ 25511us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:37.953419 (+   312us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.953458 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:37.970553 (+ 17095us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.055764 (+1085211us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:39.055832 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.055944 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.056003 (+    59us) raft_consensus.cc:1671] finished
0811 16:04:39.056015 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.056230 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1032599,"threads_started":1,"wal-append.queue_time_us":779247}
I20260811 16:04:39.163444 13741 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
W20260811 16:04:39.123024 16813 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.001s	sys 0.014s
I20260811 16:04:39.156643 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.174062 16832 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:39.160027 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.156840 13903 rpcz_store.cc:276] 0811 16:04:38.012856 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.013049 (+   193us) service_pool.cc:227] Handling call
0811 16:04:38.013425 (+   376us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:38.013705 (+   280us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:38.013751 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:38.028701 (+ 14950us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.135178 (+1106477us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:39.135251 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.135386 (+   135us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.135467 (+    81us) raft_consensus.cc:1671] finished
0811 16:04:39.135485 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.135735 (+   250us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1056697,"threads_started":1,"wal-append.queue_time_us":751184}
I20260811 16:04:39.174983 13905 rpcz_store.cc:276] 0811 16:04:36.938436 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.106827 (+168391us) service_pool.cc:227] Handling call
0811 16:04:37.107176 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:39.125640 (+2018464us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.126454 (+   814us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:39.126791 (+   337us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4553267584}
W20260811 16:04:39.186261 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47650.4us
I20260811 16:04:39.171736 13822 rpcz_store.cc:276] 0811 16:04:37.709005 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.709203 (+   198us) service_pool.cc:227] Handling call
0811 16:04:37.709662 (+   459us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:37.710076 (+   414us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.710114 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:37.722811 (+ 12697us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.145179 (+1422368us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:39.145293 (+   114us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.145420 (+   127us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.145477 (+    57us) raft_consensus.cc:1671] finished
0811 16:04:39.145493 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.145656 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":12749,"thread_start_us":1333766,"threads_started":1,"wal-append.queue_time_us":1037704}
I20260811 16:04:39.162101 16884 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.188511 16456 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:39.189074 16456 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:39.189489 16456 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:39.189632 16832 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.190409 16884 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:39.191298 13907 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.034s	sys 0.057s
W20260811 16:04:39.191721 13907 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.035s	sys 0.057s
I20260811 16:04:39.193393 13737 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:39.194689 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:39.195376 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74230.8us
I20260811 16:04:39.144438 16793 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.196122 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:39.147373 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:39.140677 16607 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.765s	user 0.013s	sys 0.003s
I20260811 16:04:39.160390 16847 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Stepping down as leader of term 3
W20260811 16:04:39.204739 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.015s	sys 0.013s
I20260811 16:04:39.204591 16380 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.138080 16481 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:39.137560 13742 rpcz_store.cc:276] 0811 16:04:37.138274 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.442910 (+304636us) service_pool.cc:227] Handling call
0811 16:04:37.478183 (+ 35273us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:37.478524 (+   341us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.478553 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:37.513796 (+ 35243us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.136617 (+1622821us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:39.136683 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.136799 (+   116us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.136858 (+    59us) raft_consensus.cc:1671] finished
0811 16:04:39.136869 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.137041 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1289,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":633,"thread_start_us":1589512,"threads_started":1,"wal-append.queue_time_us":1234930}
I20260811 16:04:39.158910 16874 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:39.162899 16875 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:04:39.204607 13818 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.004s	sys 0.024s
W20260811 16:04:39.205164 16731 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.015s
I20260811 16:04:39.157934 13630 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:39.172945 13826 rpcz_store.cc:276] 0811 16:04:37.534072 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.536650 (+  2578us) service_pool.cc:227] Handling call
0811 16:04:37.537128 (+   478us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:37.537576 (+   448us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.537614 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:37.545118 (+  7504us) log.cc:842] Serialized 52 byte log entry
0811 16:04:39.138830 (+1593712us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:39.138932 (+   102us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.139087 (+   155us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.139212 (+   125us) raft_consensus.cc:1671] finished
0811 16:04:39.139235 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.139383 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9294,"thread_start_us":1557582,"threads_started":1,"wal-append.queue_time_us":1234958}
I20260811 16:04:39.219534 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 525) took 1470 ms. Trace:
I20260811 16:04:39.221077 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.138410 16900 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:39.227249 13818 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.004s	sys 0.024s
W20260811 16:04:39.204660 16629 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.017s	sys 0.024s
I20260811 16:04:39.154086 16852 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.173291 13909 rpcz_store.cc:276] 0811 16:04:36.948426 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.111105 (+162679us) service_pool.cc:227] Handling call
0811 16:04:37.147805 (+ 36700us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:04:37.198725 (+ 50920us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.198770 (+    45us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:04:37.212499 (+ 13729us) log.cc:842] Serialized 78 byte log entry
0811 16:04:39.139834 (+1927335us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:39.140464 (+   630us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.141046 (+   582us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.141392 (+   346us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.141592 (+   200us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.141719 (+   127us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.141787 (+    68us) raft_consensus.cc:1671] finished
0811 16:04:39.141813 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.142073 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":97919,"prepare.queue_time_us":53673,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":76,"raft.queue_time_us":52040,"raft.run_cpu_time_us":638,"raft.run_wall_time_us":11833,"spinlock_wait_cycles":1590144,"thread_start_us":1850397,"threads_started":2,"wal-append.queue_time_us":1562428}
W20260811 16:04:39.227540 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.016s	sys 0.013s
W20260811 16:04:39.226976 16685 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.004s	sys 0.013s
I20260811 16:04:39.218297 16832 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:39.238669 16837 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:39.226886 16731 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.003s	sys 0.015s
I20260811 16:04:39.209394 16847 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:39.216109 16875 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:39.244799 16564 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:39.245133 13825 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.014s	sys 0.027s
W20260811 16:04:39.237958 16629 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.018s	sys 0.024s
I20260811 16:04:39.242389 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.235474 16877 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.223827 13821 rpcz_store.cc:276] 0811 16:04:37.749477 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.872149 (+122672us) service_pool.cc:227] Handling call
0811 16:04:37.922882 (+ 50733us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:37.923406 (+   524us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:37.923446 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:37.945755 (+ 22309us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.157559 (+1211804us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:39.158086 (+   527us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.174156 (+ 16070us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.185971 (+ 11815us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.199997 (+ 14026us) raft_consensus.cc:1671] finished
0811 16:04:39.200020 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.219444 (+ 19424us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5556,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":21965,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":15973,"thread_start_us":1170181,"threads_started":1,"wal-append.queue_time_us":847275}
I20260811 16:04:39.244153 14578 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:39.250273 16875 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.255055 16852 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.254726 16900 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.244827 16380 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.229178 16884 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:39.261139 13825 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.027s
I20260811 16:04:39.261685 16873 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:39.266561 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:39.260113 16564 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.282181 14579 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.568s	user 0.015s	sys 0.002s
W20260811 16:04:39.280670 14581 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.021s
W20260811 16:04:39.287789 14581 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.022s
I20260811 16:04:39.294771 14579 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
W20260811 16:04:39.295884 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.011s	sys 0.017s
W20260811 16:04:39.316274 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.012s	sys 0.017s
I20260811 16:04:39.239248 16927 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.271888 16882 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260811 16:04:39.307108 13630 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:39.268872 16874 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.282099 16563 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260811 16:04:39.330605 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 146060us
I20260811 16:04:39.253160 16837 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.331332 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 113934us
I20260811 16:04:39.348272 14578 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:39.333655 16875 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:39.353644 16564 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:39.356709 16862 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:39.341838 16849 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.357383 16862 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.357851 16849 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:39.359261 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.012s	sys 0.006s
W20260811 16:04:39.359701 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.012s	sys 0.006s
W20260811 16:04:39.360091 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 779338us
I20260811 16:04:39.360388 16849 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:39.344919 16658 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.361637 16658 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.363195 16572 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:39.364264 16658 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:39.365830 16826 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.710s	user 0.001s	sys 0.020s
W20260811 16:04:39.367250 13820 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.014s	sys 0.017s
W20260811 16:04:39.367619 13820 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.014s	sys 0.017s
W20260811 16:04:39.376170 16835 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.012s
W20260811 16:04:39.376394 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 162138us
I20260811 16:04:39.377066 16781 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:39.377599 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:39.381457 16685 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:39.383068 16685 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:39.383635 16685 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:39.382243 16658 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260811 16:04:39.387574 14573 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.008s
I20260811 16:04:39.388088 16658 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:39.388530 16658 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:39.389822 16874 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:39.389582 16658 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.341924 16770 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.028s
I20260811 16:04:39.390903 16658 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:39.392500 13744 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:39.311054 16873 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.353516 16836 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.019s	sys 0.010s
I20260811 16:04:39.358906 16793 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:39.328112 16884 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.399400 16770 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.004s	sys 0.028s
W20260811 16:04:39.409998 16836 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.019s	sys 0.011s
W20260811 16:04:39.453114 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 182804us
I20260811 16:04:39.388101 14573 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:39.470433 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:39.471658 14579 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:39.337328 16847 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:39.456924 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.012s	sys 0.006s
I20260811 16:04:39.414649 16781 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:39.478616 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.013s	sys 0.007s
I20260811 16:04:39.474202 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:39.494381 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68754.2us
W20260811 16:04:39.495667 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93831.6us
I20260811 16:04:39.499374 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 428) took 1680 ms. Trace:
I20260811 16:04:39.499578 16847 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:39.494163 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.013s	sys 0.018s
W20260811 16:04:39.500793 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.013s	sys 0.018s
W20260811 16:04:39.501133 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.08272e+06us
W20260811 16:04:39.501824 16707 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.728s	user 0.017s	sys 0.000s
I20260811 16:04:39.503322 16774 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.504094 16774 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.504714 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2118) took 1033 ms. Trace:
I20260811 16:04:39.505069 13902 rpcz_store.cc:276] 0811 16:04:38.474620 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.474858 (+   238us) service_pool.cc:227] Handling call
0811 16:04:38.475358 (+   500us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:38.475830 (+   472us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:38.475873 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:38.485247 (+  9374us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.238906 (+753659us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:39.238968 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.239099 (+   131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.504391 (+265292us) raft_consensus.cc:1671] finished
0811 16:04:39.504413 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.504630 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1162,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":669275,"threads_started":1,"wal-append.queue_time_us":981231}
W20260811 16:04:39.500465 16671 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.701s	user 0.006s	sys 0.013s
I20260811 16:04:39.503371 13900 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260811 16:04:39.494659 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74436.2us
I20260811 16:04:39.502396 16707 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.520939 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:39.489718 13630 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:39.491811 16862 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:39.533262 14574 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:04:39.499830 13908 rpcz_store.cc:276] 0811 16:04:37.819376 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.821097 (+  1721us) service_pool.cc:227] Handling call
0811 16:04:37.870220 (+ 49123us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:37.870410 (+   190us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:39.163239 (+1292829us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.421829 (+258590us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:39.452047 (+ 30218us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:39.461952 (+  9905us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.491973 (+ 30021us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.499289 (+  7316us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":936218,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":85804,"thread_start_us":1478152,"threads_started":2}
I20260811 16:04:39.498379 16607 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.506928 16774 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.515942 16469 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:39.547359 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52251.9us
I20260811 16:04:39.546631 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.532194 16380 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:39.562924 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.344s (SENT) [suppressed 26 similar messages]
W20260811 16:04:39.563125 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 156805us
I20260811 16:04:39.567312 16607 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.567940 16927 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:39.568882 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:39.570473 16707 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.571488 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:39.571920 13738 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:04:39.572815 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.573551 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:39.574497 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.575294 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 492) took 2772 ms. Trace:
I20260811 16:04:39.575779 13735 rpcz_store.cc:276] 0811 16:04:36.775349 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.273078 (+497729us) service_pool.cc:227] Handling call
0811 16:04:37.273472 (+   394us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:37.273702 (+   230us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:38.568019 (+1294317us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.410842 (+842823us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:39.456438 (+ 45596us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:39.474593 (+ 18155us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.497664 (+ 23071us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.545271 (+ 47607us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":49054,"prepare.queue_time_us":1482822,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6280,"raft.queue_time_us":40186,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":150,"spinlock_wait_cycles":16574336,"thread_start_us":1691847,"threads_started":2,"wal-append.queue_time_us":534596}
I20260811 16:04:39.577885 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:39.580991 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:39.581534 16905 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.582386 16905 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.584146 16884 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.584887 16884 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:39.585398 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.585456 16899 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.587783 14573 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:39.589020 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1425) took 1009 ms. Trace:
I20260811 16:04:39.589372 13820 rpcz_store.cc:276] 0811 16:04:38.579439 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.579628 (+   189us) service_pool.cc:227] Handling call
0811 16:04:38.597460 (+ 17832us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:38.597715 (+   255us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:39.368020 (+770305us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.588621 (+220601us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:39.588684 (+    63us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:39.588737 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.588824 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.588956 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15119,"prepare.queue_time_us":197092,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":6503,"raft.queue_time_us":28457,"thread_start_us":898601,"threads_started":2}
I20260811 16:04:39.591629 16481 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:39.592243 16481 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:39.592514 14574 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:39.593469 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:39.593319 16481 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.595518 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:39.598546 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:39.583412 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2180) took 1557 ms. Trace:
I20260811 16:04:39.599381 16789 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:39.600942 16789 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:39.601478 16789 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:39.601712 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.602499 13741 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:39.563122 16563 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:39.604132 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.605537 13630 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:39.571940 16873 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:39.607834 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.1179e+06us
I20260811 16:04:39.608299 16873 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260811 16:04:39.609227 16935 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.231s	user 0.000s	sys 0.003s
I20260811 16:04:39.611625 16608 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:39.612455 16608 consensus_queue.cc:1225] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260811 16:04:39.612696 16954 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260811 16:04:39.612835 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:39.612986 16608 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:39.613443 16608 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:39.614265 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2170) took 1623 ms. Trace:
I20260811 16:04:39.614656 13825 rpcz_store.cc:276] 0811 16:04:37.991155 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.433053 (+441898us) service_pool.cc:227] Handling call
0811 16:04:38.433442 (+   389us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:38.434732 (+  1290us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:38.434775 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:38.474121 (+ 39346us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:38.487179 (+ 13058us) log.cc:842] Serialized 52 byte log entry
0811 16:04:39.370181 (+883002us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:39.370273 (+    92us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.370419 (+   146us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.608282 (+237863us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:39.613998 (+  5716us) raft_consensus.cc:1671] finished
0811 16:04:39.614018 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.614201 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":821,"raft.queue_time_us":1341,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":23430,"spinlock_wait_cycles":116143360,"thread_start_us":750859,"threads_started":1,"wal-append.queue_time_us":843177}
I20260811 16:04:39.599567 13824 rpcz_store.cc:276] 0811 16:04:38.026068 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.431847 (+405779us) service_pool.cc:227] Handling call
0811 16:04:38.432195 (+   348us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:38.435205 (+  3010us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:38.435246 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:38.492357 (+ 57111us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:38.492813 (+   456us) log.cc:842] Serialized 26 byte log entry
0811 16:04:38.673202 (+180389us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4800060cd8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:04:39.411445 (+738243us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:39.494627 (+ 83182us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.529108 (+ 34481us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.545932 (+ 16824us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.583171 (+ 37239us) raft_consensus.cc:1671] finished
0811 16:04:39.583194 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.583352 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8169,"prepare.queue_time_us":40735,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":46661,"raft.run_cpu_time_us":3413,"raft.run_wall_time_us":252966,"spinlock_wait_cycles":88253056,"thread_start_us":789239,"threads_started":1,"wal-append.queue_time_us":978636}
I20260811 16:04:39.605543 16837 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.619114 16896 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:39.619634 16896 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:39.584085 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.582712 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:39.574582 16456 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:39.638214 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55670.2us
I20260811 16:04:39.614487 16608 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.629581 16873 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:39.667129 16564 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.667344 16896 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:39.668016 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 69579us
I20260811 16:04:39.668160 16380 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:04:39.667943 16564 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.668964 13739 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:39.669178 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:39.629500 16774 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:39.668902 16896 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:39.543123 16781 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.658314 16707 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.560917 16469 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.670269 16564 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:39.702924 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:39.704977 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 741) took 1045 ms. Trace:
I20260811 16:04:39.708673 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.710599 14577 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:39.711417 14574 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:39.679404 16572 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.706728 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:39.699266 16813 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:39.663949 16873 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:39.730278 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.724279 13630 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 4, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:39.749379 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:39.731117 14583 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:39.709815 16899 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:39.759418 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1797) took 1309 ms. Trace:
I20260811 16:04:39.712206 16837 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:04:39.710875 14581 rpcz_store.cc:276] 0811 16:04:38.655972 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.656104 (+   132us) service_pool.cc:227] Handling call
0811 16:04:38.656428 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:38.656627 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:39.296053 (+639426us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.520541 (+224488us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.637839 (+117298us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:39.651206 (+ 13367us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:39.666867 (+ 15661us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.698478 (+ 31611us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:39.701368 (+  2890us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":133694,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":208,"thread_start_us":847682,"threads_started":3,"wal-append.queue_time_us":390588}
I20260811 16:04:39.727731 16953 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.765216 13739 rpcz_store.cc:276] 0811 16:04:38.437851 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.438953 (+  1102us) service_pool.cc:227] Handling call
0811 16:04:39.729088 (+1290135us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000a9bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:39.747219 (+ 18131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2457789312}
I20260811 16:04:39.702198 16847 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260811 16:04:39.706321 16746 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.704269 16707 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.750293 16873 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:39.752306 16608 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:39.760375 16813 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:39.765376 16839 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.800127 13630 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 3, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 3 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:39.778771 16774 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:39.776404 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:39.812608 16469 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:39.812871 16976 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.814452 16877 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.871012 16877 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.871897 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:39.872709 13909 raft_consensus.cc:2362] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
W20260811 16:04:39.817466 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 88366.7us
I20260811 16:04:39.817993 16636 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:39.819671 16953 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.791455 16770 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:39.820430 16707 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.823988 16746 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.826618 16731 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.789745 16874 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:39.787578 16826 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.813751 16838 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:39.711596 16789 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.802281 16974 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.885154 16456 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:39.869868 16976 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:39.871433 16902 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:39.819252 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 148837us
I20260811 16:04:39.908795 16874 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:39.894064 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:39.870383 16813 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.960659 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:39.904129 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:39.904834 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:39.908038 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:39.908141 16970 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.873327 16877 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.909308 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:39.843012 16905 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.926194 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:39.973021 13630 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:39.869282 16900 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:39.806702 16572 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.775697 16685 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.848574 16839 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:39.978163 13909 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:39.980942 13909 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:39.976406 13630 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 4, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:39.963227 16456 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:39.993743 13630 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 4, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:04:39.965955 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:39.993053 13823 pending_rounds.cc:76] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:04:39.966279 16781 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.977661 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:40.004715 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53477.8us
W20260811 16:04:40.005242 16793 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.007s
I20260811 16:04:39.968940 14573 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:39.961151 16838 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:40.007979 16969 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.429s	user 0.003s	sys 0.000s
I20260811 16:04:40.008044 16839 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.980556 16636 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260811 16:04:40.019913 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:39.999729 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.011165 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.011355 13905 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:40.015239 13739 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:40.011875 13823 pending_rounds.cc:97] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260811 16:04:39.950894 16826 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.029690 13823 raft_consensus.cc:2866] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:40.014318 16875 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:39.997196 16902 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.018452 16952 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:40.035586 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2102) took 2175 ms (client timeout 2641 ms). Trace:
I20260811 16:04:40.048720 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:04:40.034991 16957 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260811 16:04:40.034853 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.034500 16874 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.053646 13906 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:40.054065 16874 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:40.054247 16902 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.055339 13826 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.036441 13817 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.031762 13736 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:40.056483 13744 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260811 16:04:40.035652 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.023631 16877 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:40.059319 16847 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:40.059536 13901 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:40.060408 16951 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.568s	user 0.003s	sys 0.000s
I20260811 16:04:40.060155 16847 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.061085 16952 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.062350 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1806) took 1176 ms. Trace:
I20260811 16:04:40.062520 16847 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.062789 13740 rpcz_store.cc:276] 0811 16:04:38.885582 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.892934 (+  7352us) service_pool.cc:227] Handling call
0811 16:04:38.893822 (+   888us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:38.894915 (+  1093us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:38.894966 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:38.896110 (+  1144us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.280623 (+384513us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:39.280676 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.280758 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:40.059509 (+778751us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:40.061878 (+  2369us) raft_consensus.cc:1671] finished
0811 16:04:40.061907 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:40.062184 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":77134,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":13682560,"thread_start_us":382748,"threads_started":1,"wal-append.queue_time_us":448866}
W20260811 16:04:40.064138 16938 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.497s	user 0.000s	sys 0.008s
I20260811 16:04:39.980769 16970 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.066069 16685 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.072175 16995 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:40.065886 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 434) took 1579 ms. Trace:
I20260811 16:04:40.039866 16746 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.040253 16884 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:39.971561 16974 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.039748 13743 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:40.041121 13904 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:40.075871 13907 rpcz_store.cc:276] 0811 16:04:38.486803 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.567616 (+ 80813us) service_pool.cc:227] Handling call
0811 16:04:38.569291 (+  1675us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:38.569963 (+   672us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:38.570005 (+    42us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:38.570663 (+   658us) log.cc:842] Serialized 52 byte log entry
0811 16:04:39.192288 (+621625us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:39.192349 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.192479 (+   130us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:40.063370 (+870891us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:40.065552 (+  2182us) raft_consensus.cc:1671] finished
0811 16:04:40.065578 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:40.065814 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12083,"raft.queue_time_us":4857,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4741,"spinlock_wait_cycles":80667008,"thread_start_us":607441,"threads_started":1,"wal-append.queue_time_us":979546}
I20260811 16:04:40.075879 16995 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:40.077682 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.078054 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.078392 13906 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:40.068965 16941 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.686s	user 0.000s	sys 0.002s
I20260811 16:04:40.078806 16995 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:40.081435 16942 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.658s	user 0.001s	sys 0.003s
I20260811 16:04:40.083308 16875 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:40.083956 16826 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:39.964712 16731 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:40.066527 16607 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.104421 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.105010 16731 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:40.105309 16839 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
W20260811 16:04:40.049151 13900 rpcz_store.cc:269] 0811 16:04:37.860052 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:37.860212 (+   160us) service_pool.cc:227] Handling call
0811 16:04:40.028879 (+2168667us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002acbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:40.035508 (+  6629us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3494755072}
I20260811 16:04:40.106096 13903 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:40.106392 16789 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:40.106802 13900 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260811 16:04:40.033672 16832 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.007s
I20260811 16:04:40.053469 13822 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:40.097780 16862 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:40.032338 16456 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.037189 16953 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.059821 16877 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:39.997319 16774 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.077857 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.132560 13904 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:40.067127 14573 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:04:40.134791 13736 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260811 16:04:40.136386 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.136762 16877 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:40.085496 16948 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.514s	user 0.003s	sys 0.004s
I20260811 16:04:40.085362 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.085867 16899 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.138203 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:40.067865 16959 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.501s	user 0.009s	sys 0.006s
I20260811 16:04:40.138527 13827 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
W20260811 16:04:40.040817 16986 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260811 16:04:40.139482 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:39.969363 16770 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.139906 13740 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260811 16:04:40.140051 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:40.140283 13740 pending_rounds.cc:76] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 3
I20260811 16:04:40.140595 13740 pending_rounds.cc:97] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260811 16:04:40.140874 13740 raft_consensus.cc:2866] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:40.140981 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.141647 13827 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:40.141959 16770 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.035667 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.084502 16875 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.142442 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.088199 13902 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260811 16:04:40.077886 16974 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.095569 16988 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:40.066619 16905 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:40.073597 16976 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:40.072321 16572 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.146891 13821 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:04:40.071784 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47868us
I20260811 16:04:40.098197 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:40.038415 16838 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.070847 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:40.099309 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:40.099907 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.109436 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.110363 13826 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:40.118005 13903 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:04:40.119668 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.118240 16862 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:40.126435 16456 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.110581 16839 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:40.127451 16952 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:40.107517 16961 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260811 16:04:40.131049 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.176440 13822 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:40.176925 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.137405 13736 raft_consensus.cc:2354] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7.
I20260811 16:04:40.144057 13742 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:40.143062 13827 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:40.182608 13906 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:40.088306 16970 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.029723 13909 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.153465 13901 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:40.163008 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:40.174667 13907 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:40.176076 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 125765us
I20260811 16:04:40.192919 13821 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.193903 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.194125 13824 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:40.177790 13740 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:40.196512 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:40.138617 16899 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.199280 16902 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:40.207245 16456 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:40.208154 16456 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:40.211388 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:40.203490 16970 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:40.212694 16970 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:40.213127 16970 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.213263 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:40.213516 16899 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.213795 16770 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260811 16:04:40.216392 16934 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260811 16:04:40.218463 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2160) took 2468 ms. Trace:
I20260811 16:04:40.214834 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:40.220598 16972 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.654s	user 0.003s	sys 0.000s
I20260811 16:04:40.233060 16838 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:40.233800 16838 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:40.234268 16838 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:40.245960 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:40.179262 16927 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260811 16:04:40.177416 16905 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.252813 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:40.257193 13909 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.206949 16902 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:40.253870 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1808) took 1052 ms. Trace:
I20260811 16:04:40.218842 13818 rpcz_store.cc:276] 0811 16:04:37.750393 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:38.388448 (+638055us) service_pool.cc:227] Handling call
0811 16:04:38.388810 (+   362us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:38.389824 (+  1014us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:38.389865 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:38.412711 (+ 22846us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.263613 (+850902us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:39.273888 (+ 10275us) log.cc:842] Serialized 14 byte log entry
0811 16:04:39.289023 (+ 15135us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.307077 (+ 18054us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:39.601212 (+294135us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18003415c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:40.051085 (+449873us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18003415c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:40.215520 (+164435us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:40.218218 (+  2698us) raft_consensus.cc:1671] finished
0811 16:04:40.218240 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:40.218377 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21945,"prepare.queue_time_us":273,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":7021,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":22872,"spinlock_wait_cycles":159604224,"thread_start_us":752648,"threads_started":1,"wal-append.queue_time_us":900459}
I20260811 16:04:40.259557 13740 raft_consensus.cc:2354] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7.
I20260811 16:04:40.249091 13821 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:40.267441 13825 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:04:40.250842 16813 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:40.284513 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 235537us
I20260811 16:04:40.285334 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:40.159351 16988 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.270915 13737 rpcz_store.cc:276] 0811 16:04:39.201423 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:39.218878 (+ 17455us) service_pool.cc:227] Handling call
0811 16:04:39.242964 (+ 24086us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:39.308712 (+ 65748us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:39.308750 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:39.324312 (+ 15562us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.480654 (+156342us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:39.480978 (+   324us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.481227 (+   249us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:40.219830 (+738603us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:40.222367 (+  2537us) raft_consensus.cc:1671] finished
0811 16:04:40.222390 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:40.253765 (+ 31375us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43248,"raft.queue_time_us":42719,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":16177,"spinlock_wait_cycles":84157312,"thread_start_us":123902,"threads_started":1,"wal-append.queue_time_us":211646}
I20260811 16:04:40.297130 13817 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:40.299417 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.305308 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:40.270321 16877 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.308274 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.311110 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:40.284181 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.305070 16927 consensus_queue.cc:1225] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:40.318082 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.301149 16952 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:40.313651 13871 connection.cc:232] RPC call timeout handler was delayed by -1.287149986019358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260811 16:04:40.320739 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 199713us
I20260811 16:04:40.323051 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:40.322418 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0486499860417098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260811 16:04:40.313617 16636 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.314960 16976 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.317557 16849 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.310374 16774 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:40.331390 13825 pending_rounds.cc:76] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 4
I20260811 16:04:40.336870 13825 pending_rounds.cc:97] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260811 16:04:40.337302 13825 raft_consensus.cc:2866] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:40.319442 16884 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:40.344103 13740 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:40.306993 16813 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.321992 16607 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:04:40.351207 13907 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:40.351450 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.356590 13906 raft_consensus.cc:2396] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260811 16:04:40.351727 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 182462us
W20260811 16:04:40.365139 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 59702.3us
I20260811 16:04:40.372000 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.334654 16636 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.322747 16877 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.394426 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.395481 14577 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:40.397061 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.398443 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:40.388114 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:40.402789 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.332687 16952 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.319563 16839 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.410068 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.411291 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.316603 16456 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.354971 16774 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.413117 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.415213 14580 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:40.324178 16902 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:40.396545 16873 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.006s
W20260811 16:04:40.428531 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46480.1us
I20260811 16:04:40.435230 13817 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:04:40.343634 16849 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.429821 13906 raft_consensus.cc:2354] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6.
I20260811 16:04:40.433797 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.416240 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.346596 16976 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.440892 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.432353 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.487921 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.440171 14574 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:40.424494 16998 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:40.492437 16998 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:40.493052 16998 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:40.498209 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:40.499079 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64305.9us
I20260811 16:04:40.498436 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.507886 14580 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:40.434481 16770 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:40.513808 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:40.516206 13906 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260811 16:04:40.516731 13907 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 3. Current term is 4.
I20260811 16:04:40.527413 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.535166 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.532832 13741 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 3: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:40.523062 17003 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260811 16:04:40.430377 16774 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.560093 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.561420 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:40.563185 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66187.2us
I20260811 16:04:40.510664 16481 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:40.437930 16873 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.575799 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.582149 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.527487 16988 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:40.582911 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:40.554366 16905 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.584519 13906 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:40.514396 16837 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260811 16:04:40.597713 13903 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260811 16:04:40.610989 13822 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:40.612409 13907 raft_consensus.cc:2354] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:04:40.615837 14582 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:40.586215 14573 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260811 16:04:40.594784 17000 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
W20260811 16:04:40.614171 17001 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260811 16:04:40.633121 13736 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260811 16:04:40.647948 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.651103 13906 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 4: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:40.656208 16636 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.662729 13824 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:04:40.641536 16884 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:40.594203 16481 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.682097 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.698794 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.701740 13821 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:40.672884 16873 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.711227 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.705250 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:40.713061 13736 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.716773 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.718947 13905 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:40.704774 16789 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260811 16:04:40.722133 16982 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.626s	user 0.003s	sys 0.001s
I20260811 16:04:40.659632 16988 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260811 16:04:40.687121 16900 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.674379 16976 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:40.784902 13909 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.009s
I20260811 16:04:40.712255 16813 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.707165 16952 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:40.796058 13901 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.004s
I20260811 16:04:40.702728 16877 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.785107 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.675726 16970 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.797856 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.798804 13902 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260811 16:04:40.798887 17002 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.316s	user 0.000s	sys 0.002s
I20260811 16:04:40.799520 16970 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:40.799772 17007 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260811 16:04:40.801419 17016 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260811 16:04:40.801568 16838 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260811 16:04:40.802127 16838 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.806046 16838 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.765556 16849 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:40.807390 16992 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:40.807881 16992 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:40.808871 16992 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.810199 16992 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:40.811683 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:40.812333 13823 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:40.673026 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:40.796550 13901 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:40.814584 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:40.792110 16988 consensus_queue.cc:1225] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:40.813867 13907 raft_consensus.cc:595] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:40.821537 13907 raft_consensus.cc:603] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:40.821717 13736 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:40.825052 13825 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:40.827174 13909 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260811 16:04:40.827908 13909 pending_rounds.cc:76] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 6
I20260811 16:04:40.791064 16607 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.860141 13909 pending_rounds.cc:97] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260811 16:04:40.802985 16987 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:40.873476 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.875411 13909 raft_consensus.cc:2866] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:40.873476 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.877720 13821 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:40.879798 13824 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:04:40.876632 16987 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:40.880867 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:40.898687 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.902940 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.904924 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.896587 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 445) took 1026 ms. Trace:
I20260811 16:04:40.881598 16837 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.882095 16607 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.890019 16952 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:40.917641 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1428) took 1138 ms. Trace:
W20260811 16:04:40.914629 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 353345us
I20260811 16:04:40.928709 13909 rpcz_store.cc:276] 0811 16:04:39.870628 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:39.888843 (+ 18215us) service_pool.cc:227] Handling call
0811 16:04:39.931377 (+ 42534us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:40.896293 (+964916us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:40.896502 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:40.911990 17006 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.327s	user 0.000s	sys 0.002s
I20260811 16:04:40.797176 16900 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.912236 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:40.904865 16789 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:40.948700 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73523us
I20260811 16:04:40.950273 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.954855 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.961907 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:40.951422 17012 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260811 16:04:40.971930 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.798815 16862 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:40.972298 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.987959 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:40.985491 14575 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 2.
I20260811 16:04:40.960968 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:40.962231 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.943724 13820 rpcz_store.cc:276] 0811 16:04:39.779533 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:39.787788 (+  8255us) service_pool.cc:227] Handling call
0811 16:04:39.835619 (+ 47831us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:40.048490 (+212871us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:40.073937 (+ 25447us) log.cc:842] Serialized 14 byte log entry
0811 16:04:40.166716 (+ 92779us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:40.166770 (+    54us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:40.166813 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:40.917399 (+750586us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:40.917453 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:40.917577 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8050,"prepare.queue_time_us":25758,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":8215,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":19456,"spinlock_wait_cycles":444830464,"thread_start_us":84235,"threads_started":1,"wal-append.queue_time_us":196557}
I20260811 16:04:40.979665 14580 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:40.974494 13904 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260811 16:04:40.963017 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:40.963212 13902 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:40.983546 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:40.993326 13736 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:40.988415 13742 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:04:40.995776 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:40.878577 16852 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.498s	user 0.032s	sys 0.045s
I20260811 16:04:40.938287 16774 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:40.959090 16988 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:40.999702 13817 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260811 16:04:41.005934 13817 pending_rounds.cc:76] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 1
I20260811 16:04:41.008488 13817 pending_rounds.cc:97] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260811 16:04:41.008809 13817 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:41.011720 13907 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:41.016016 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.019904 13821 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
W20260811 16:04:41.007567 16852 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.032s	sys 0.045s
I20260811 16:04:41.022231 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.023777 13904 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:40.944301 16837 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.000982 16481 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:41.035759 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.036705 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:04:41.100891 13902 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:41.036077 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.102735 13741 raft_consensus.cc:595] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:41.104178 13900 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:41.030380 16995 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.010s	sys 0.020s
W20260811 16:04:41.105044 16995 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.015s	sys 0.024s
I20260811 16:04:41.104526 13741 raft_consensus.cc:603] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:41.049595 16607 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:40.999967 16970 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260811 16:04:41.110323 16994 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.016s	user 0.003s	sys 0.003s
I20260811 16:04:41.050822 16873 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.113518 16873 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.106277 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:40.974133 16952 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:40.992507 16789 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:41.113546 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 526) took 1239 ms. Trace:
I20260811 16:04:41.028729 13901 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:41.475319 13826 rpcz_store.cc:276] 0811 16:04:39.874586 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:39.874726 (+   140us) service_pool.cc:227] Handling call
0811 16:04:41.113298 (+1238572us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b5400354b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:41.113455 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":210238848}
W20260811 16:04:41.274854 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 331255us
W20260811 16:04:41.182879 13822 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
W20260811 16:04:41.032325 17019 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260811 16:04:41.023818 16988 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:41.037391 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50647.4us
I20260811 16:04:41.175493 13823 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:04:41.176823 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 782) took 1548 ms (client timeout 1727 ms). Trace:
I20260811 16:04:41.162365 13827 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:41.504967 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:41.266317 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.506134 13901 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:41.459862 13906 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.758s	user 0.005s	sys 0.009s
I20260811 16:04:41.509554 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:41.213423 17006 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260811 16:04:41.048451 17011 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260811 16:04:41.051916 16997 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.976s	user 0.004s	sys 0.004s
I20260811 16:04:41.506773 13906 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:41.190541 13904 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:41.118592 14580 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:41.117480 13824 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 2. (term mismatch)
I20260811 16:04:41.489594 13822 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:41.505336 14582 rpcz_store.cc:269] 0811 16:04:39.583329 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:39.583642 (+   313us) service_pool.cc:227] Handling call
0811 16:04:41.115576 (+1531934us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54006603d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:41.115724 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2224125312}
W20260811 16:04:41.113003 17005 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.528s	user 0.000s	sys 0.005s
I20260811 16:04:41.034300 16849 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:41.519919 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:41.221524 16636 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:41.521871 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1434) took 1515 ms. Trace:
W20260811 16:04:41.483444 16893 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.419s	user 0.003s	sys 0.021s
I20260811 16:04:41.037348 16770 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:41.231200 16996 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:41.047837 17027 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260811 16:04:41.193858 16607 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.339471 16746 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.273432 16971 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.525857 13824 pending_rounds.cc:76] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 1
I20260811 16:04:41.569506 13824 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 6.2
I20260811 16:04:41.569959 13824 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:41.284825 16481 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:41.539650 13818 rpcz_store.cc:276] 0811 16:04:40.006170 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.287998 (+281828us) service_pool.cc:227] Handling call
0811 16:04:40.306153 (+ 18155us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:40.312427 (+  6274us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:40.436104 (+123677us) log.cc:842] Serialized 14 byte log entry
0811 16:04:40.626951 (+190847us) log.cc:842] Serialized 14 byte log entry
0811 16:04:41.195340 (+568389us) spinlock_profiling.cc:243] Waited 889 us on lock 0x7b18002cf0e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:04:41.521627 (+326287us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:41.521666 (+    39us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:41.521703 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:41.521747 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:41.521825 (+    78us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13397,"prepare.queue_time_us":21112,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":5824,"raft.queue_time_us":1223234,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":37598,"spinlock_wait_cycles":45787648,"thread_start_us":531472,"threads_started":3,"wal-append.queue_time_us":297546}
I20260811 16:04:41.503341 16608 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.529017 14575 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:41.482026 16837 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:41.057221 16900 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:41.220505 16976 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:41.545750 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:41.545760 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:41.519726 16838 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.521049 16685 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:41.563606 13825 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.000s
I20260811 16:04:41.592123 13825 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:41.550040 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:41.537006 16873 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:41.543320 17028 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260811 16:04:41.285624 16839 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.261s
W20260811 16:04:41.544229 16992 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.734s	user 0.015s	sys 0.000s
W20260811 16:04:41.573678 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44783.5us
W20260811 16:04:41.544142 16983 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.014s
I20260811 16:04:41.580391 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.581724 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1565) took 1453 ms. Trace:
I20260811 16:04:41.549191 16770 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:41.589525 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.547987 16849 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.604724 13900 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:41.034727 16987 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.548000 16847 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:41.578141 16998 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.084s	user 0.009s	sys 0.007s
W20260811 16:04:41.544030 16893 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.479s	user 0.003s	sys 0.024s
W20260811 16:04:41.593398 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47714.4us
I20260811 16:04:41.601006 13901 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:41.619208 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:41.614343 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89708.1us
I20260811 16:04:41.615579 13909 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:41.620092 13909 raft_consensus.cc:595] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:41.620548 13909 raft_consensus.cc:603] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:41.618156 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1562) took 1508 ms. Trace:
I20260811 16:04:41.570531 16607 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:41.608251 16983 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.008s	sys 0.014s
I20260811 16:04:41.605283 13743 rpcz_store.cc:276] 0811 16:04:40.128277 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.128534 (+   257us) service_pool.cc:227] Handling call
0811 16:04:40.128897 (+   363us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:40.129254 (+   357us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:40.129281 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:40.129792 (+   511us) log.cc:842] Serialized 26 byte log entry
0811 16:04:40.326437 (+196645us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:40.441823 (+115386us) log.cc:842] Serialized 14 byte log entry
0811 16:04:40.515968 (+ 74145us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:40.516149 (+   181us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:41.114203 (+598054us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b1800323680. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:41.561553 (+447350us) raft_consensus.cc:1671] finished
0811 16:04:41.581422 (+ 19869us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:41.581639 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14785,"prepare.queue_time_us":334776,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":16324,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":172,"spinlock_wait_cycles":13127040,"thread_start_us":302401,"threads_started":2,"wal-append.queue_time_us":388321}
I20260811 16:04:41.594254 16988 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.600031 17047 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:41.572933 16746 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.586189 16481 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:41.633627 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 754) took 1223 ms. Trace:
I20260811 16:04:41.601054 16608 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.639191 14582 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:41.566519 16996 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.582417 16971 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.641707 13900 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260811 16:04:41.621279 13739 rpcz_store.cc:276] 0811 16:04:40.110025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.117876 (+  7851us) service_pool.cc:227] Handling call
0811 16:04:40.118296 (+   420us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:40.124450 (+  6154us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:40.124480 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:40.124950 (+   470us) log.cc:842] Serialized 26 byte log entry
0811 16:04:40.356488 (+231538us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:40.577748 (+221260us) log.cc:842] Serialized 14 byte log entry
0811 16:04:40.578433 (+   685us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:40.579274 (+   841us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:41.112208 (+532934us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:41.610418 (+498210us) raft_consensus.cc:1671] finished
0811 16:04:41.617951 (+  7533us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:41.618093 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9378,"prepare.queue_time_us":336023,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":5568,"raft.queue_time_us":1375,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":6221,"spinlock_wait_cycles":6460288,"thread_start_us":403506,"threads_started":2,"wal-append.queue_time_us":316088}
I20260811 16:04:41.647987 14575 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:41.634095 14578 rpcz_store.cc:276] 0811 16:04:40.407844 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.418656 (+ 10812us) service_pool.cc:227] Handling call
0811 16:04:40.432098 (+ 13442us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:40.515476 (+ 83378us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:40.515519 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:40.560559 (+ 45040us) log.cc:842] Serialized 52 byte log entry
0811 16:04:40.785429 (+224870us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:40.906685 (+121256us) log.cc:842] Serialized 14 byte log entry
0811 16:04:40.912559 (+  5874us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:40.912683 (+   124us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:41.630979 (+718296us) raft_consensus.cc:1671] finished
0811 16:04:41.631006 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:41.631180 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6427,"prepare.queue_time_us":215109,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":21619,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":27626,"thread_start_us":239868,"threads_started":2,"wal-append.queue_time_us":243299}
I20260811 16:04:41.603103 16685 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.614935 14573 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:41.651962 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:41.603189 16976 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:41.648301 17041 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260811 16:04:41.619633 16849 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.636600 17047 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:41.607797 16838 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:41.634969 16847 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.624347 16998 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.668658 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1432) took 1698 ms. Trace:
I20260811 16:04:41.630496 17025 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
W20260811 16:04:41.671628 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 195752us
I20260811 16:04:41.676098 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.663691 13743 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:41.674304 13827 rpcz_store.cc:276] 0811 16:04:39.970013 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.191422 (+221409us) service_pool.cc:227] Handling call
0811 16:04:41.115878 (+924456us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:41.512694 (+396816us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:41.668377 (+155683us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400354b50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:41.668583 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2097558784}
I20260811 16:04:41.677110 13900 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260811 16:04:41.695452 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 127904us
I20260811 16:04:41.658798 17051 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:41.678251 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 435) took 1851 ms. Trace:
I20260811 16:04:41.704445 13901 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 2. (index mismatch)
I20260811 16:04:41.704907 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:41.704227 13908 rpcz_store.cc:276] 0811 16:04:39.826926 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:39.861037 (+ 34111us) service_pool.cc:227] Handling call
0811 16:04:39.872114 (+ 11077us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:39.872398 (+   284us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:39.872430 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:39.872928 (+   498us) log.cc:842] Serialized 26 byte log entry
0811 16:04:39.949353 (+ 76425us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:39.949680 (+   327us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:39.949781 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:40.984556 (+1034775us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:41.663838 (+679282us) raft_consensus.cc:1671] finished
0811 16:04:41.663873 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:41.678124 (+ 14251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":114792704,"thread_start_us":75890,"threads_started":1,"wal-append.queue_time_us":156346}
I20260811 16:04:41.705876 13906 raft_consensus.cc:595] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:41.706353 13906 raft_consensus.cc:603] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:41.712144 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1906) took 1105 ms. Trace:
W20260811 16:04:41.712956 14542 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.570s (SENT)
I20260811 16:04:41.714716 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:41.663129 16789 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:41.715551 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:41.679064 16952 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:41.670307 17050 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:41.703688 17049 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.675261 17047 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:41.724630 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.713389 13903 rpcz_store.cc:276] 0811 16:04:40.606917 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.607194 (+   277us) service_pool.cc:227] Handling call
0811 16:04:40.628245 (+ 21051us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:40.650448 (+ 22203us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:40.650486 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:40.662622 (+ 12136us) log.cc:842] Serialized 26 byte log entry
0811 16:04:40.793757 (+131135us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:40.957934 (+164177us) log.cc:842] Serialized 14 byte log entry
0811 16:04:40.966102 (+  8168us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:40.966322 (+   220us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:41.711863 (+745541us) raft_consensus.cc:1671] finished
0811 16:04:41.711893 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:41.712052 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7195,"prepare.queue_time_us":479263,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":8064,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":28876,"thread_start_us":255397,"threads_started":2,"wal-append.queue_time_us":278317}
I20260811 16:04:41.864075 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:41.851855 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:41.860366 16873 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:41.843537 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.718926 16456 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:41.746836 14582 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:41.729296 17050 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:41.773870 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:41.848237 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.678278 17046 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260811 16:04:41.716836 16636 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260811 16:04:41.764770 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:41.715775 17025 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:41.777442 17043 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260811 16:04:41.814086 17028 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260811 16:04:41.754045 16835 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260811 16:04:41.845110 16838 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:41.864351 16877 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.005s
W20260811 16:04:41.865162 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 108106us
W20260811 16:04:41.985215 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 347120us
I20260811 16:04:41.865957 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:41.866648 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:41.866983 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.001820 13820 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:41.968024 16456 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.025159 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:41.822570 13900 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:42.003132 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.026451 13900 raft_consensus.cc:595] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:42.026958 13900 raft_consensus.cc:603] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:04:41.843065 17044 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260811 16:04:41.902582 13904 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:41.962422 16793 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:41.879767 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:41.964445 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 112695us
I20260811 16:04:41.964291 17049 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:41.894691 16849 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:41.892043 16481 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:41.967203 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:41.966766 13905 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:41.971843 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:41.880350 17042 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260811 16:04:41.893322 16976 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:41.977847 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:41.973717 14573 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:41.870671 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:41.884199 17053 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.892961 16902 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:41.985409 13827 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
W20260811 16:04:41.972594 17048 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.268s	user 0.002s	sys 0.002s
I20260811 16:04:41.894068 16847 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:41.868320 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.000180 13825 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:41.887903 16998 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.050622 17046 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:41.975101 16607 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.015512 16884 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:42.017650 14582 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260811 16:04:42.019063 17029 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.778s	user 0.001s	sys 0.001s
W20260811 16:04:42.019948 17030 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.789s	user 0.000s	sys 0.003s
I20260811 16:04:42.023869 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:41.966719 17050 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.033316 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:41.996693 16877 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.006s	sys 0.005s
I20260811 16:04:42.062477 16902 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.080730 17025 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.088912 17070 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:42.089794 16902 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:41.842458 16996 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:41.986501 16952 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:42.090992 16952 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.092049 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.047600 13826 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260811 16:04:42.039700 13789 connection.cc:232] RPC call timeout handler was delayed by -1.6599328070878983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260811 16:04:42.095358 13789 connection.cc:232] RPC call timeout handler was delayed by -1.6072179770562798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260811 16:04:42.095706 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5640477730194107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2962s for a response
I20260811 16:04:42.095784 16849 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.031464 16456 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:42.029778 16971 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:42.059954 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.060180 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:41.980782 17040 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.323s	user 0.000s	sys 0.005s
I20260811 16:04:42.101404 13823 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:42.043883 16608 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.074446 13822 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 3.
I20260811 16:04:42.057169 16685 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.080742 13824 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 4: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:42.081856 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 373758us
I20260811 16:04:42.060137 16746 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.077549 16789 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260811 16:04:42.096375 16849 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.079572 17046 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.108520 17046 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.059886 17053 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.107012 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.112635 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1563) took 1985 ms. Trace:
I20260811 16:04:42.089139 17049 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.078999 16884 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:42.047458 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.098611 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:42.078752 16998 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.054606 16481 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260811 16:04:42.047740 17059 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
W20260811 16:04:42.086678 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53455.5us
I20260811 16:04:42.124012 17053 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.124538 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.113163 13744 rpcz_store.cc:276] 0811 16:04:40.127369 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.143489 (+ 16120us) service_pool.cc:227] Handling call
0811 16:04:40.144661 (+  1172us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:40.157917 (+ 13256us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:40.879351 (+721434us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b18002fbea0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:04:41.028141 (+148790us) log.cc:842] Serialized 14 byte log entry
0811 16:04:41.599441 (+571300us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:41.617244 (+ 17803us) log.cc:842] Serialized 26 byte log entry
0811 16:04:41.619986 (+  2742us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:41.620018 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:41.620085 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:42.112203 (+492118us) raft_consensus.cc:1671] finished
0811 16:04:42.112355 (+   152us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:42.112557 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":409823,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":10274,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":17785,"spinlock_wait_cycles":9740672,"thread_start_us":534358,"threads_started":2,"wal-append.queue_time_us":603665}
W20260811 16:04:42.124538 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77159.5us
I20260811 16:04:42.116102 13905 raft_consensus.cc:595] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:42.125809 16746 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.126206 17053 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:04:42.126324 16746 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.127583 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:42.128631 16746 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.129186 16746 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:04:42.124761 17065 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:42.132599 17065 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:04:42.134054 17065 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.134248 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.125092 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:42.122728 16998 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.138031 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.140671 13742 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:42.157922 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.216621 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.121683 16608 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.217630 14575 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:42.233559 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.224536 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.147197 17024 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.210844 16607 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:42.210485 16849 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:42.329748 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74241.3us
I20260811 16:04:42.332777 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.332897 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:42.333590 14580 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:42.289687 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 156087us
I20260811 16:04:42.302541 16902 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:42.249378 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:42.330209 14544 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.653s (SENT)
I20260811 16:04:42.346195 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:42.292799 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 196449us
I20260811 16:04:42.242650 17059 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260811 16:04:42.313813 17069 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260811 16:04:42.319752 16998 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:42.362236 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 112953us
W20260811 16:04:42.337421 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 283734us
I20260811 16:04:42.252564 17065 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260811 16:04:42.243309 17046 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260811 16:04:42.363723 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.333115 16607 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:42.372586 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.335666 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:42.369820 13789 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.767s (SENT)
I20260811 16:04:42.380992 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.382371 14582 raft_consensus.cc:2396] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:42.292838 17024 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.368178 16832 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:42.403779 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:42.421556 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 91387us
I20260811 16:04:42.422250 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.383867 17064 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.417970 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.399776 14573 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:42.427834 14575 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:42.425102 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:42.429278 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:42.401443 16902 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.402945 16832 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.435986 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.437727 14580 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:42.421206 16838 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.420284 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 530) took 1602 ms. Trace:
W20260811 16:04:42.440143 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89069.3us
I20260811 16:04:42.413513 16862 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:42.441509 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71764.7us
I20260811 16:04:42.434608 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:42.444446 13738 rpcz_store.cc:276] 0811 16:04:40.817433 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:40.819485 (+  2052us) service_pool.cc:227] Handling call
0811 16:04:42.344574 (+1525089us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:42.344820 (+   246us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:42.369115 (+ 24295us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:42.371247 (+  2132us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:42.378571 (+  7324us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:42.379059 (+   488us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:42.396979 (+ 17920us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:42.405662 (+  8683us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15397760}
I20260811 16:04:42.446040 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:42.446584 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3759477729909122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3171s for a response
I20260811 16:04:42.431370 16608 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:04:42.472764 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3696477729827166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3178s for a response
W20260811 16:04:42.473719 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2472477729897946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33140000000000003s for a response
W20260811 16:04:42.474175 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2031477729324251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33630000000000004s for a response
I20260811 16:04:42.443042 16832 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:42.479545 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 362827us
I20260811 16:04:42.424165 17049 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
W20260811 16:04:42.497394 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50954.5us
I20260811 16:04:42.422716 16793 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.047s
I20260811 16:04:42.441032 16746 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260811 16:04:42.512364 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65190.7us
I20260811 16:04:42.460173 16838 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.445328 17089 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:42.527114 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:42.532398 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:42.469417 16789 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260811 16:04:42.433589 17081 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260811 16:04:42.519501 17046 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.517207 17057 raft_consensus.cc:2741] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260811 16:04:42.558068 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.558329 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.559690 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.533111 17069 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.526729 17089 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:42.526546 17050 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:42.545931 17037 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.258s	user 0.007s	sys 0.005s
W20260811 16:04:42.546362 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 100441us
I20260811 16:04:42.547632 16998 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:42.549082 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.517371 16746 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.554767 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.594926 16998 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.595121 16746 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:42.595463 13827 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:42.521476 16877 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.509090 16607 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.599079 16877 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.601337 16877 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.562844 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.604933 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.563097 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.480181 16884 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.559020 13817 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:42.565644 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50090.8us
I20260811 16:04:42.566728 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.567046 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:42.578938 13871 leader_election.cc:398] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7.
I20260811 16:04:42.534958 16835 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.585304 17086 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:42.585307 17062 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.618510 13818 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:42.605295 13826 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:42.595466 16998 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:42.617278 17078 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:42.622443 17078 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.623518 13821 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:42.624142 17075 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260811 16:04:42.625684 17094 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:42.624696 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.627529 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.628283 13825 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:42.597747 17069 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:42.628690 17078 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.629066 17069 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.629137 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.629364 17078 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:42.629586 17069 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.630088 17078 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.606684 17077 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:42.631909 17077 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.632269 17077 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:42.632833 17078 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.609292 13823 raft_consensus.cc:2362] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
I20260811 16:04:42.635816 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.636000 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:42.636837 13820 raft_consensus.cc:2362] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
I20260811 16:04:42.637111 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.638087 13823 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:42.640064 16884 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.640969 17080 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260811 16:04:42.589754 17074 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260811 16:04:42.643311 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.644264 17074 consensus_queue.cc:1225] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:04:42.645308 17074 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:42.645821 17074 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:42.647558 17031 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.591s	user 0.004s	sys 0.000s
I20260811 16:04:42.602399 17024 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.590217 17089 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:42.623087 17090 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260811 16:04:42.614871 17086 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:42.690657 16456 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260811 16:04:42.690467 17086 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.605639 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 3.
I20260811 16:04:42.644292 13817 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:42.659310 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.660211 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.661425 13738 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:04:42.661505 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.563994 17046 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.702934 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:42.664415 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 122674us
I20260811 16:04:42.664703 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:42.704754 14581 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:42.641456 16746 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.699004 13827 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:42.707082 14575 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:42.698019 14574 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:42.670885 16971 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.616916 16835 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:42.671705 17074 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.720178 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.721120 13742 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
W20260811 16:04:42.676432 13789 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.962s (SENT)
I20260811 16:04:42.676913 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:42.712319 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 180285us
I20260811 16:04:42.722282 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:42.684196 17047 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260811 16:04:42.685331 14578 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:04:42.708123 13871 leader_election.cc:398] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7.
W20260811 16:04:42.692353 16770 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.067s	user 0.009s	sys 0.005s
I20260811 16:04:42.716668 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:42.617722 16793 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260811 16:04:42.691890 17086 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:42.722262 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.735981 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:42.740430 13739 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.737979 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1824) took 1111 ms. Trace:
I20260811 16:04:42.696341 17050 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.743058 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.739837 13738 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:42.745926 13742 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:42.746937 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 130922us
I20260811 16:04:42.747481 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:42.747761 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:42.749523 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:42.753149 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:42.719302 16988 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:42.749818 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.741348 13741 rpcz_store.cc:276] 0811 16:04:41.626114 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:41.626549 (+   435us) service_pool.cc:227] Handling call
0811 16:04:41.626928 (+   379us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:41.649146 (+ 22218us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:41.673842 (+ 24696us) log.cc:842] Serialized 14 byte log entry
0811 16:04:42.073180 (+399338us) log.cc:842] Serialized 14 byte log entry
0811 16:04:42.078825 (+  5645us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:42.078889 (+    64us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:42.079023 (+   134us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:42.737646 (+658623us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:42.737724 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:42.737901 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5382,"prepare.queue_time_us":32649,"prepare.run_cpu_time_us":5035,"prepare.run_wall_time_us":24112,"raft.queue_time_us":66430,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":5965,"spinlock_wait_cycles":50598272,"thread_start_us":398674,"threads_started":2,"wal-append.queue_time_us":307772}
I20260811 16:04:42.726457 17025 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.766170 16835 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.767433 16877 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:42.769055 17062 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:42.768771 16847 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:42.771559 17088 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:42.756568 17085 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:42.775657 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:42.776829 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 100523us
I20260811 16:04:42.781438 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.691118 16456 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:42.781087 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 178134us
W20260811 16:04:42.827329 17093 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260811 16:04:42.827812 16456 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.802225 17062 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.829314 17062 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.779162 17036 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:42.774026 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.728621 17065 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260811 16:04:42.818545 14544 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.094s (SENT)
I20260811 16:04:42.785099 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.841048 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.817641 14575 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:42.772682 16838 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:42.842978 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83420.8us
I20260811 16:04:42.761053 16988 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.866425 16988 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.868072 17046 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:42.872020 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1826) took 1240 ms. Trace:
I20260811 16:04:42.872556 13743 rpcz_store.cc:276] 0811 16:04:41.631614 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:41.631804 (+   190us) service_pool.cc:227] Handling call
0811 16:04:41.632182 (+   378us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:41.676990 (+ 44808us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:42.871715 (+1194725us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:42.871955 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":64869248}
I20260811 16:04:42.875350 17074 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:42.876058 16998 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.878420 17072 raft_consensus.cc:1050] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:04:42.730252 16971 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.880842 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:04:42.883921 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.776283 16976 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:42.739656 16770 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.847863 17081 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:42.896091 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:42.848954 17092 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260811 16:04:42.853591 13789 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.171s (SENT)
I20260811 16:04:42.817559 17085 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.732472 17047 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.815896 17054 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:42.921190 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.857760 16746 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:42.846374 17036 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.863030 14582 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:42.865399 17077 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.781491 16877 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.886722 14581 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:42.889901 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:42.892282 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.894632 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:42.896857 13902 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 6
I20260811 16:04:42.929708 14575 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:42.906095 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 103421us
I20260811 16:04:42.916625 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:42.930390 14583 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:42.917549 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.918233 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:42.931913 13903 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.918821 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.887247 16976 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.940352 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:42.941815 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88290.6us
I20260811 16:04:42.922469 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:42.921624 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.925760 13825 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:42.932924 13907 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:42.934430 13822 raft_consensus.cc:2354] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 3. Current term is 4.
I20260811 16:04:42.904752 17092 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:42.942983 13900 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:42.936180 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.939114 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.944607 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.944518 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.950995 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.950902 13743 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:42.920022 17085 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:42.895758 16636 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260811 16:04:42.976490 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.929026 17036 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:42.965340 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.928752 16563 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:42.948488 16976 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:42.976373 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.933363 16877 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:42.964318 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69805.2us
I20260811 16:04:42.987361 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:42.967489 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:42.967446 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.977768 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.964380 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:42.953526 13739 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:42.988168 13907 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:04:42.966411 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:42.980226 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:42.991027 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.984047 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.953763 17092 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:42.989065 13789 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.178s (SENT)
I20260811 16:04:42.966127 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.991609 13827 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:42.991652 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:42.989491 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.997597 13743 raft_consensus.cc:2354] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:04:42.992417 13741 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260811 16:04:43.000331 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61289.1us
I20260811 16:04:43.002681 13739 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:43.005821 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.006819 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:42.980254 16875 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:43.008646 14574 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:43.010952 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:43.043622 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52035.7us
I20260811 16:04:43.045647 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.045851 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:43.046298 13904 raft_consensus.cc:2362] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7. Re-sending same reply.
I20260811 16:04:43.047992 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:43.048915 14581 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:43.049966 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.984148 16998 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.052218 13741 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:43.049798 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.022746 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.053460 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.929996 17054 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.065073 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.067576 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.056512 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.056563 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:42.989661 17083 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:42.952590 16832 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:42.996436 17047 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.055753 13907 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7. Re-sending same reply.
I20260811 16:04:43.070032 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.007726 16835 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:43.045259 16793 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:43.057178 16875 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:43.096347 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:42.993045 16770 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.048866 16847 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:43.091876 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.049213 17118 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:43.097630 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.100023 14581 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:43.093801 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:43.102828 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 119972us
I20260811 16:04:43.103459 13826 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:43.104318 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.105947 13904 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:43.071983 17059 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:43.111088 13741 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260811 16:04:42.987501 16563 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.090484 16835 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:43.113600 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:43.121923 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:43.111915 17119 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260811 16:04:43.122798 17070 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:43.123528 17070 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:43.123075 17069 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.123895 17070 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:43.124346 17070 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:43.124536 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:43.125011 14573 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260811 16:04:43.125453 13900 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260811 16:04:43.125572 17069 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.126045 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.126480 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.126823 13742 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:04:43.115361 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.090174 16998 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:43.127934 17110 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260811 16:04:43.128166 16998 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.128916 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.130040 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.130307 16998 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:43.112310 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:43.132879 13738 pending_rounds.cc:76] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 1
I20260811 16:04:43.133214 13738 pending_rounds.cc:97] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260811 16:04:43.133446 13738 raft_consensus.cc:2866] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:43.133558 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.113107 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.120290 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.135459 13907 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:43.136642 13900 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:43.124145 13909 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:43.134071 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:43.140242 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.151885 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.169824 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.169838 14574 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:04:43.166764 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:43.171399 13744 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:43.173272 13789 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.314s (SENT)
I20260811 16:04:43.174134 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:43.174708 14581 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 2 FOLLOWER]: Advancing to term 4
I20260811 16:04:43.125411 14573 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:43.176927 17121 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260811 16:04:43.177183 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:43.178653 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.115302 16847 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:43.181584 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.182443 13904 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:43.136307 16835 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:43.187127 14581 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:43.171718 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:43.192716 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.194077 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.188596 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.197038 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:43.198613 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.189975 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.199954 14574 raft_consensus.cc:2354] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:04:43.149652 16607 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:43.206712 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.207352 16839 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:43.210705 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.213603 13744 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:43.226825 13907 raft_consensus.cc:2362] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:43.159333 17074 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:43.158998 16746 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:43.164235 17065 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:43.238322 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.239262 13900 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:43.167321 17094 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:43.159348 17047 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:43.163618 17102 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:04:43.148986 17083 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260811 16:04:43.236303 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109430us
I20260811 16:04:43.109910 16793 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:43.220710 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.114352 17059 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:43.247820 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 96040.8us
I20260811 16:04:43.298544 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:43.298921 13871 leader_election.cc:398] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:04:43.299222 14574 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:43.267246 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.291536 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.224251 16456 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:04:43.232363 17078 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:43.294374 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.299317 13871 leader_election.cc:401] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:04:43.111030 17118 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.234896 17074 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:43.304704 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.675s (SENT)
I20260811 16:04:43.309721 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.310396 13900 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:43.308301 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.312366 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.237636 17065 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:43.246706 17077 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.243279 16607 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:43.268183 16770 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:43.235284 16971 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:43.293123 17102 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:43.313987 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:43.315111 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 172948us
I20260811 16:04:43.330165 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:43.309072 17089 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260811 16:04:43.285197 16746 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:43.270555 16839 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:43.336266 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.336654 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.341259 14583 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:04:43.349612 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44970us
I20260811 16:04:43.323626 17065 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:43.368084 14575 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:04:43.316563 17109 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260811 16:04:43.243115 17129 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:43.313745 17074 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:43.325523 16789 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:43.372008 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.308936 17108 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:43.319911 16456 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:43.360292 17102 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:43.392926 14583 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:04:43.394515 13904 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:43.397699 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:43.402521 14574 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:43.270047 17094 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.405088 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:43.408316 13789 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.363s (SENT)
W20260811 16:04:43.411005 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.771s (SENT)
I20260811 16:04:43.430388 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:43.360234 17069 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:43.284238 16875 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.367445 16832 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.437054 14575 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:43.426119 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:43.443264 14542 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.931s (SENT)
I20260811 16:04:43.444341 14574 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:43.446662 17128 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260811 16:04:43.447609 17133 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260811 16:04:43.447307 16839 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.452520 14573 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260811 16:04:43.454411 13902 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.001s
I20260811 16:04:43.439752 17080 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:43.424080 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.367178 17134 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:43.433504 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.456454 13904 raft_consensus.cc:2396] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:43.383728 17054 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:43.456707 17118 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:43.457566 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.458602 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:43.411808 17129 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.459327 13817 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:43.384325 17083 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:43.460521 13907 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:43.466145 17118 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:43.466756 17118 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.468982 17118 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:43.470082 13903 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
I20260811 16:04:43.479833 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36246 (request call id 37) took 1399 ms. Trace:
I20260811 16:04:43.480301 13905 rpcz_store.cc:276] 0811 16:04:42.080455 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.080596 (+   141us) service_pool.cc:227] Handling call
0811 16:04:43.479436 (+1398840us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b5400201820. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a1dc0 00007f5c519069c2 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:43.479762 (+   326us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":217332992}
I20260811 16:04:43.480993 16998 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:43.481514 16998 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:43.481643 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.482316 13905 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:43.483736 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 814) took 1062 ms. Trace:
I20260811 16:04:43.484092 14582 rpcz_store.cc:276] 0811 16:04:42.421197 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.421939 (+   742us) service_pool.cc:227] Handling call
0811 16:04:43.483559 (+1061620us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54005280d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:43.483661 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1007447296}
I20260811 16:04:43.487871 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.429764 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:43.437412 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65548.8us
I20260811 16:04:43.413169 16789 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:43.454870 13902 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:43.495414 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.470638 13903 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:43.504905 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:43.505527 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.497453 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.505885 13902 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6. Re-sending same reply.
I20260811 16:04:43.458565 13904 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:43.506660 13909 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:43.507555 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.492492 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:43.491439 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:43.461665 17129 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.482434 16998 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.528038 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:43.373116 17089 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.525611 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:43.525715 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.532445 13817 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260811 16:04:43.458554 17125 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260811 16:04:43.347095 16847 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.522301 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260811 16:04:43.436844 17140 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:43.542625 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.547986 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.548271 13905 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:43.528909 13827 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:43.549155 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.549939 13905 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:43.550968 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.548600 13900 raft_consensus.cc:2362] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6. Re-sending same reply.
I20260811 16:04:43.492426 16849 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:43.488128 17077 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:43.551766 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:43.562742 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:43.560006 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 247708us
I20260811 16:04:43.563565 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.544622 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:43.567554 13904 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 8
I20260811 16:04:43.569496 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:43.522900 16789 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:43.570371 13737 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:43.522449 16852 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:43.575520 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 816) took 1153 ms. Trace:
I20260811 16:04:43.529500 17118 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260811 16:04:43.573951 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 162995us
I20260811 16:04:43.543972 16481 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:43.578158 14579 rpcz_store.cc:276] 0811 16:04:42.422435 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.422577 (+   142us) service_pool.cc:227] Handling call
0811 16:04:42.422944 (+   367us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:42.440819 (+ 17875us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:42.440864 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:42.468500 (+ 27636us) log.cc:842] Serialized 26 byte log entry
0811 16:04:42.753918 (+285418us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:42.753961 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:42.754023 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:43.575043 (+821020us) raft_consensus.cc:1671] finished
0811 16:04:43.575233 (+   190us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:43.575439 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23731,"raft.queue_time_us":12787,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":32616,"thread_start_us":236439,"threads_started":1,"wal-append.queue_time_us":436335}
I20260811 16:04:43.584223 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:43.587814 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 196541us
I20260811 16:04:43.565918 16849 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:43.571221 17078 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:43.609237 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 204261us
I20260811 16:04:43.586480 17118 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:43.627377 17118 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:43.584587 17077 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:43.635854 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.594327 17054 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:43.614805 16849 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.620304 17144 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:43.588109 17047 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:43.622804 17113 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.577s	user 0.002s	sys 0.003s
I20260811 16:04:43.624020 17079 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:43.624257 17089 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:43.624832 17135 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:43.586490 16481 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:43.633708 13904 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:04:43.613796 13789 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.690s (SENT)
I20260811 16:04:43.640336 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.645735 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.647261 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:43.612839 16793 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:43.658142 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.556790 16607 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.664013 13740 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:43.569288 16746 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:43.678098 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 102296us
I20260811 16:04:43.646682 17144 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:43.682399 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:43.690778 17022 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.610s	user 0.005s	sys 0.001s
I20260811 16:04:43.691444 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:43.583698 16456 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.724722 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.737990 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:43.748987 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 256545us
I20260811 16:04:43.670475 16481 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:43.750756 14542 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.105s (SENT)
I20260811 16:04:43.751387 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:43.692191 17123 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.431s	user 0.001s	sys 0.001s
I20260811 16:04:43.779711 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.681398 17134 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:43.722892 17010 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.613s	user 0.009s	sys 0.035s
W20260811 16:04:43.719914 16976 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.008s
I20260811 16:04:43.664556 17059 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:43.787076 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49221.7us
I20260811 16:04:43.719749 16563 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:43.789695 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
W20260811 16:04:43.781435 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 167661us
W20260811 16:04:43.725973 17062 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.004s
I20260811 16:04:43.794253 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:43.687441 16849 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:43.694335 17144 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:43.726733 16793 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:43.802858 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:43.692952 16988 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.826s	user 0.013s	sys 0.000s
W20260811 16:04:43.722884 16835 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
W20260811 16:04:43.805145 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54436.8us
W20260811 16:04:43.797544 17010 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.740s	user 0.015s	sys 0.038s
I20260811 16:04:43.810815 13871 leader_election.cc:398] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:04:43.812685 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:43.811398 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:43.798796 17087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.013s	sys 0.008s
I20260811 16:04:43.826992 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 556) took 1285 ms. Trace:
I20260811 16:04:43.827625 13820 rpcz_store.cc:276] 0811 16:04:42.541421 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.637677 (+ 96256us) service_pool.cc:227] Handling call
0811 16:04:42.638103 (+   426us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:42.638588 (+   485us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:42.638626 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:42.654616 (+ 15990us) log.cc:842] Serialized 26 byte log entry
0811 16:04:42.914446 (+259830us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:42.914499 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:42.914594 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:43.622037 (+707443us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:43.814286 (+192249us) raft_consensus.cc:1671] finished
0811 16:04:43.814317 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:43.826891 (+ 12574us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2199,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"spinlock_wait_cycles":27583360,"thread_start_us":230705,"threads_started":1,"wal-append.queue_time_us":279377}
I20260811 16:04:43.818289 16835 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.811910 17089 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:43.820144 16563 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:04:43.803846 17146 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:43.690822 17047 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.885528 17146 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:43.886534 17146 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.795970 17078 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.800098 17077 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:43.863999 17148 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:43.892033 17148 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:43.892436 17148 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:43.837706 17087 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:43.896013 17151 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260811 16:04:43.839185 16793 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:43.898414 17092 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.854s	user 0.014s	sys 0.000s
I20260811 16:04:43.898960 17092 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:43.903698 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 558) took 1361 ms. Trace:
W20260811 16:04:43.879709 17070 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.755s	user 0.015s	sys 0.000s
I20260811 16:04:43.842756 17080 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:43.947090 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 468) took 1023 ms. Trace:
I20260811 16:04:43.804853 16976 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.920054 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 546) took 1068 ms. Trace:
W20260811 16:04:43.958038 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 118493us
I20260811 16:04:43.904244 13824 rpcz_store.cc:276] 0811 16:04:42.541983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.693495 (+151512us) service_pool.cc:227] Handling call
0811 16:04:42.693878 (+   383us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:42.711074 (+ 17196us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:42.711184 (+   110us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:43.485994 (+774810us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:43.486566 (+   572us) log.cc:842] Serialized 52 byte log entry
0811 16:04:43.611606 (+125040us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:43.611652 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:43.611726 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:43.903233 (+291507us) raft_consensus.cc:1671] finished
0811 16:04:43.903264 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:43.903616 (+   352us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37764,"raft.queue_time_us":17323,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":15863,"spinlock_wait_cycles":6973312,"thread_start_us":124649,"threads_started":1,"wal-append.queue_time_us":333751}
W20260811 16:04:43.985139 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.833s (SENT)
I20260811 16:04:43.997503 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:43.812386 17062 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:43.997013 13736 rpcz_store.cc:276] 0811 16:04:42.851811 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.852018 (+   207us) service_pool.cc:227] Handling call
0811 16:04:42.852444 (+   426us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:42.855625 (+  3181us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:42.855653 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:42.856150 (+   497us) log.cc:842] Serialized 26 byte log entry
0811 16:04:42.935718 (+ 79568us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:42.935756 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:42.935838 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:43.919752 (+983914us) raft_consensus.cc:1671] finished
0811 16:04:43.919778 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:43.919966 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2692,"raft.queue_time_us":3857,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":79208,"threads_started":1,"wal-append.queue_time_us":212018}
I20260811 16:04:43.850255 17094 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.000597 13906 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
I20260811 16:04:43.821403 16988 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.000461 13900 rpcz_store.cc:276] 0811 16:04:42.925955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.558240 (+632285us) service_pool.cc:227] Handling call
0811 16:04:43.582391 (+ 24151us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:43.582671 (+   280us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:43.599078 (+ 16407us) log.cc:842] Serialized 14 byte log entry
0811 16:04:43.946467 (+347389us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:43.946540 (+    73us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:43.946717 (+   177us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:43.946820 (+   103us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:43.947002 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62329,"prepare.queue_time_us":22391,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":63837,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8740,"thread_start_us":260074,"threads_started":2,"wal-append.queue_time_us":266572}
W20260811 16:04:44.055958 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 243322us
I20260811 16:04:44.172644 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:44.172878 13826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 554) took 1637 ms (client timeout 1767 ms). Trace:
W20260811 16:04:44.076350 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 71925us
W20260811 16:04:44.075977 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90902.1us
W20260811 16:04:44.176151 13789 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.344s (SENT)
I20260811 16:04:44.107134 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:44.107455 13905 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:04:44.177829 13741 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.001s
I20260811 16:04:43.921908 17089 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:44.173981 13826 rpcz_store.cc:269] 0811 16:04:42.535511 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.621265 (+ 85754us) service_pool.cc:227] Handling call
0811 16:04:44.172612 (+1551347us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400355554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.172800 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":866796800}
W20260811 16:04:44.246351 13741 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.012s	sys 0.012s
W20260811 16:04:44.180873 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.964s (SENT)
I20260811 16:04:44.249624 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:44.251996 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71169.5us
I20260811 16:04:44.267349 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.267804 14577 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:04:44.267874 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:44.269259 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 96708.2us
I20260811 16:04:44.270267 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:44.185473 14581 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.014s	sys 0.017s
W20260811 16:04:44.274698 14581 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.014s	sys 0.036s
I20260811 16:04:44.160079 17051 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.130558 17062 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:44.253420 17081 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.344s	user 0.012s	sys 0.006s
I20260811 16:04:44.109887 17155 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:44.284920 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 278927us
I20260811 16:04:44.287747 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:44.178825 16563 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:44.280666 17036 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.286s	user 0.010s	sys 0.004s
I20260811 16:04:44.296201 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:44.274004 17094 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:44.298673 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.296723 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:43.993175 17070 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.309495 16563 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.316715 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:44.318475 16563 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.308483 17086 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.319495 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:44.319365 17086 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.320235 13823 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:44.321653 17086 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.322297 17086 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:44.312134 17102 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260811 16:04:44.323939 17102 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:44.324529 17156 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260811 16:04:44.326790 14583 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:44.326601 17089 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.295840 17059 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:44.329432 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 828) took 1109 ms. Trace:
I20260811 16:04:44.329808 14583 rpcz_store.cc:276] 0811 16:04:43.220401 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.436949 (+216548us) service_pool.cc:227] Handling call
0811 16:04:43.450006 (+ 13057us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:44.327209 (+877203us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:44.329129 (+  1920us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b5400571f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:44.329361 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2015995264}
I20260811 16:04:44.312661 17036 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.311367 17163 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260811 16:04:44.332973 17163 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:44.333406 17163 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:44.334277 17036 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.334905 17036 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:44.334652 17163 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.335740 17036 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.330962 17102 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.292142 17132 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260811 16:04:44.339463 16988 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.339883 17132 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:44.024307 16793 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.310097 17129 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260811 16:04:44.341688 17129 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:44.342193 17129 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:44.343209 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 172090us
I20260811 16:04:44.343437 16835 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:44.343820 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0197367329383269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3085s for a response
I20260811 16:04:44.353215 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:44.288125 17085 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.280s	user 0.013s	sys 0.001s
I20260811 16:04:44.314415 13871 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:04:44.361449 13871 leader_election.cc:401] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:04:44.362274 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:44.363610 13741 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:44.290126 17081 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.379222 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:44.298861 17155 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:04:44.414155 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 99867.9us
I20260811 16:04:44.414511 13744 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:44.322763 17086 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.311801 17157 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:44.428807 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 784) took 1376 ms. Trace:
I20260811 16:04:44.426381 13823 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:44.429838 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:44.340301 17132 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:44.282128 17051 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.429214 17080 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:04:44.435061 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.457751 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:44.436626 17086 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.310292 17136 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:44.458914 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:44.460784 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:44.471894 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.442971 14581 rpcz_store.cc:276] 0811 16:04:43.052087 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.239266 (+187179us) service_pool.cc:227] Handling call
0811 16:04:43.239656 (+   390us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:43.239926 (+   270us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:43.532617 (+292691us) log.cc:842] Serialized 14 byte log entry
0811 16:04:44.427235 (+894618us) log.cc:842] Serialized 14 byte log entry
0811 16:04:44.428335 (+  1100us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:44.428392 (+    57us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:44.428441 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:44.428512 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:44.428743 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":402888,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":138055,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":10708,"thread_start_us":1113385,"threads_started":3}
I20260811 16:04:44.417682 17163 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:44.480629 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:44.484311 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:44.487774 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:44.488981 13740 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:44.489378 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:44.439689 17092 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.459954 16852 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:44.497061 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 229305us
I20260811 16:04:44.497951 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.500033 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:44.500890 13826 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 6
I20260811 16:04:44.478116 17062 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.479310 16563 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:44.503648 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:44.478969 16976 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.479835 17080 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:44.484929 17086 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.376139 17085 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:44.511134 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.104s (SENT)
I20260811 16:04:44.520272 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:44.502434 16847 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.366096 17129 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.509217 13820 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 5
I20260811 16:04:44.524664 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:44.507409 17059 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:44.564894 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:44.569386 14581 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:44.503202 17081 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
W20260811 16:04:44.570457 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 115795us
I20260811 16:04:44.570820 14583 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260811 16:04:44.511842 16789 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.009s
I20260811 16:04:44.572482 13909 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:44.573580 14575 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:44.579856 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 108056us
I20260811 16:04:44.508625 16563 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:44.572814 17074 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.136s	user 0.011s	sys 0.002s
I20260811 16:04:44.564916 17158 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:44.488309 17136 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.583572 17081 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:44.505138 16852 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:44.585584 16481 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.792s	user 0.013s	sys 0.001s
I20260811 16:04:44.586999 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.591738 14581 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:44.601317 17036 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.582178 17059 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:44.523661 17047 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:44.601859 17168 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260811 16:04:44.625988 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:44.629834 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:44.572494 16847 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.587618 16563 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:44.622135 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:44.571556 17132 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.632328 17059 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.627314 16838 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:04:44.617811 17177 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260811 16:04:44.627593 17047 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.635876 16852 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.619760 16481 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.603526 17074 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:44.637310 17148 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.002s
W20260811 16:04:44.637780 17140 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.063s	user 0.010s	sys 0.000s
I20260811 16:04:44.577597 17169 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260811 16:04:44.643023 16987 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:44.643504 17136 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:44.644575 17135 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.000s
I20260811 16:04:44.644411 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.648654 17025 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:44.649451 16952 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:44.649727 13825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 552) took 2114 ms (client timeout 2104 ms). Trace:
I20260811 16:04:44.650156 17051 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:44.651748 17134 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.844s	user 0.007s	sys 0.004s
W20260811 16:04:44.652220 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1930) took 1652 ms (client timeout 1673 ms). Trace:
I20260811 16:04:44.652957 13824 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:44.654469 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 547) took 1222 ms. Trace:
W20260811 16:04:44.654910 13822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 543) took 2124 ms (client timeout 2208 ms). Trace:
W20260811 16:04:44.655503 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1943) took 1650 ms (client timeout 1979 ms). Trace:
W20260811 16:04:44.655856 14577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 736) took 1664 ms (client timeout 1882 ms). Trace:
W20260811 16:04:44.657207 16877 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.649s	user 0.014s	sys 0.000s
I20260811 16:04:44.661688 13826 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:44.671370 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:44.675625 13740 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:44.609068 17129 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
W20260811 16:04:44.658393 17065 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.254s	user 0.000s	sys 0.016s
I20260811 16:04:44.696580 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:44.581511 16789 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.625267 17070 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.721926 16852 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:44.738718 13742 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:44.734454 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 241687us
W20260811 16:04:44.744998 13825 rpcz_store.cc:269] 0811 16:04:42.534905 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.628879 (+ 93974us) service_pool.cc:227] Handling call
0811 16:04:44.649447 (+2020568us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.649641 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":680188160}
I20260811 16:04:44.627627 17036 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260811 16:04:44.728747 13908 raft_consensus.cc:2362] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
I20260811 16:04:44.759892 13743 rpcz_store.cc:276] 0811 16:04:43.432542 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.433126 (+   584us) service_pool.cc:227] Handling call
0811 16:04:44.654200 (+1221074us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000a9bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.654388 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2398118656}
W20260811 16:04:44.759424 13906 rpcz_store.cc:269] 0811 16:04:43.000116 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.046598 (+ 46482us) service_pool.cc:227] Handling call
0811 16:04:44.651963 (+1605365us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.652133 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2142221184}
W20260811 16:04:44.760205 13907 rpcz_store.cc:269] 0811 16:04:43.004767 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.229319 (+224552us) service_pool.cc:227] Handling call
0811 16:04:44.655286 (+1425967us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400088ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.655432 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":368781568}
W20260811 16:04:44.760680 14577 rpcz_store.cc:269] 0811 16:04:43.009694 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.009897 (+   203us) service_pool.cc:227] Handling call
0811 16:04:44.655678 (+1645781us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.655799 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2755539328}
W20260811 16:04:44.782253 13908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 461) took 1888 ms (client timeout 1931 ms). Trace:
W20260811 16:04:44.760360 13822 rpcz_store.cc:269] 0811 16:04:42.530286 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.532817 (+  2531us) service_pool.cc:227] Handling call
0811 16:04:44.654688 (+2121871us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400380ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.654818 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":862160640}
I20260811 16:04:44.736251 17140 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:44.782187 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.750187 17169 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:04:44.782883 13908 rpcz_store.cc:269] 0811 16:04:42.893916 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.934030 (+ 40114us) service_pool.cc:227] Handling call
0811 16:04:44.644246 (+1710216us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:44.782179 (+137933us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8502016}
I20260811 16:04:44.783670 13871 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
W20260811 16:04:44.788790 17181 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:04:44.770987 16877 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.789952 16789 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.791116 16877 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.722404 17148 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.757786 16988 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:44.641685 17085 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.800577 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.801271 13907 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:44.801599 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 171846us
I20260811 16:04:44.785068 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:44.786139 13736 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:44.786347 13902 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:04:44.758788 17025 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:44.793082 14579 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:44.749379 17132 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:44.793462 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:44.808614 13822 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:44.755949 17135 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:04:44.771296 17134 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.806715 17097 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:44.784686 17136 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.814785 13900 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:44.809333 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:44.802457 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.781849 16852 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:44.816823 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:44.817482 13826 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:44.815837 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:44.810818 17179 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:04:44.830765 17134 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:44.836520 17134 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:44.837540 17134 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.787322 17169 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:44.823000 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:44.841670 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:44.818930 13908 raft_consensus.cc:2362] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7. Re-sending same reply.
I20260811 16:04:44.824252 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:44.862210 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:44.823239 16852 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:44.842674 13907 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:44.863917 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2175) took 1168 ms. Trace:
I20260811 16:04:44.825098 16481 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:44.847572 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45186.8us
W20260811 16:04:44.864885 17118 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.225s	user 0.013s	sys 0.004s
I20260811 16:04:44.771339 17065 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.865329 17118 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.849056 16838 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:04:44.866794 16838 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:44.867165 16838 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:44.867352 14574 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:44.849891 16847 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.814360 17085 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.868011 17118 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.829545 17074 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.830374 17047 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:44.835003 17148 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:44.834182 17144 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.976s	user 0.009s	sys 0.005s
I20260811 16:04:44.869467 17144 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.870355 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:44.855635 17025 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:44.815881 16849 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.996s	user 0.012s	sys 0.000s
W20260811 16:04:44.878159 17084 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.539s	user 0.005s	sys 0.005s
I20260811 16:04:44.826980 17136 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.865626 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.848280 17194 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:44.884594 17065 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.873405 13907 rpcz_store.cc:276] 0811 16:04:43.695299 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.781883 (+1086584us) service_pool.cc:227] Handling call
0811 16:04:44.863861 (+ 81978us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:44.885627 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.886270 13907 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:04:44.748864 17081 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.808336 16988 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.883330 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.887871 13820 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:44.888315 13822 raft_consensus.cc:2396] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260811 16:04:44.890074 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:44.893601 13824 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:44.893697 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:44.898676 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.901782 13908 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:44.902434 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:44.903342 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.903909 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:44.886708 17036 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:44.910533 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.898808 17047 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:44.912019 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.895833 17194 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.868106 16838 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.914031 13908 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:44.915524 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:44.917433 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:44.918316 13823 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:44.922344 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:44.924425 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.909034 16847 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:44.927881 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:44.911252 17088 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:44.934396 14577 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:44.931042 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:44.941272 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 772) took 2458 ms. Trace:
I20260811 16:04:44.922696 17157 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.926694 17074 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:44.970953 17074 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:44.971428 17074 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:44.975574 17065 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.976338 17065 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.980947 17065 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.985368 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1940) took 1981 ms. Trace:
I20260811 16:04:44.985828 13905 rpcz_store.cc:276] 0811 16:04:43.004065 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.550662 (+546597us) service_pool.cc:227] Handling call
0811 16:04:44.985179 (+1434517us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.985305 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1277639424}
I20260811 16:04:44.986943 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.987390 16849 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.987531 17157 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.987965 16849 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.990162 17157 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:44.991711 16849 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.992898 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 478) took 1242 ms. Trace:
I20260811 16:04:44.993609 13906 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:44.995453 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:44.937031 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.987921 13905 raft_consensus.cc:2396] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:04:44.999905 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.996661 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:44.957690 17136 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.948503 17186 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260811 16:04:44.960304 17163 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:44.961167 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:45.018955 13826 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:44.965479 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 452) took 2118 ms. Trace:
I20260811 16:04:44.946700 17190 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:04:44.946820 17144 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:44.910563 17169 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:44.968292 17145 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:44.940055 17085 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:44.969715 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 473) took 2037 ms. Trace:
I20260811 16:04:44.970484 17051 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:44.982318 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1845) took 1624 ms. Trace:
I20260811 16:04:45.052484 13744 rpcz_store.cc:276] 0811 16:04:43.357708 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.357903 (+   195us) service_pool.cc:227] Handling call
0811 16:04:43.358326 (+   423us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:44.429502 (+1071176us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:44.981918 (+552416us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000302d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:44.982235 (+   317us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2428599168}
W20260811 16:04:44.983172 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 548) took 2451 ms (client timeout 1771 ms). Trace:
W20260811 16:04:45.053757 13821 rpcz_store.cc:269] 0811 16:04:42.532025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.540984 (+  8959us) service_pool.cc:227] Handling call
0811 16:04:44.982891 (+2441907us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b5400125f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.983068 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":144290176}
I20260811 16:04:45.021515 13901 rpcz_store.cc:276] 0811 16:04:42.846913 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.891260 (+ 44347us) service_pool.cc:227] Handling call
0811 16:04:42.891590 (+   330us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:42.891809 (+   219us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:42.987256 (+ 95447us) log.cc:842] Serialized 14 byte log entry
0811 16:04:44.964837 (+1977581us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b180046f8a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:04:44.964968 (+   131us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:44.965037 (+    69us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:44.965111 (+    74us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:44.965239 (+   128us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:44.965407 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26715,"prepare.queue_time_us":212221,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":132030,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":27798,"spinlock_wait_cycles":11681536,"thread_start_us":197045,"threads_started":3,"wal-append.queue_time_us":307093,"wal-append.run_cpu_time_us":2111,"wal-append.run_wall_time_us":1144052}
I20260811 16:04:44.983258 13827 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:44.947059 14580 rpcz_store.cc:276] 0811 16:04:42.477570 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.478310 (+   740us) service_pool.cc:227] Handling call
0811 16:04:42.512977 (+ 34667us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:42.524367 (+ 11390us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:42.524417 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:44.792025 (+2267608us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:44.792424 (+   399us) log.cc:842] Serialized 26 byte log entry
0811 16:04:44.806465 (+ 14041us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:44.806502 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:44.807069 (+   567us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:44.934952 (+127883us) raft_consensus.cc:1671] finished
0811 16:04:44.934982 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:44.935444 (+   462us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":74752,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":7685,"spinlock_wait_cycles":8418560,"thread_start_us":13638,"threads_started":1,"wal-append.queue_time_us":112112}
I20260811 16:04:45.055442 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:45.042608 13904 rpcz_store.cc:276] 0811 16:04:42.932310 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.662274 (+729964us) service_pool.cc:227] Handling call
0811 16:04:43.662671 (+   397us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:43.674266 (+ 11595us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:43.674300 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:43.674766 (+   466us) log.cc:842] Serialized 26 byte log entry
0811 16:04:43.946561 (+271795us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:44.076817 (+130256us) log.cc:842] Serialized 14 byte log entry
0811 16:04:44.137952 (+ 61135us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:44.138079 (+   127us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:44.514448 (+376369us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b180042e3e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:44.959920 (+445472us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b180042e3e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:44.969503 (+  9583us) raft_consensus.cc:1671] finished
0811 16:04:44.969525 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:44.969659 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":79352,"prepare.queue_time_us":117183,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":73443,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":20893,"spinlock_wait_cycles":28605184,"thread_start_us":138740,"threads_started":1,"wal-append.queue_time_us":563653}
I20260811 16:04:45.057883 13901 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:45.060562 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:45.069691 13901 raft_consensus.cc:2354] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
I20260811 16:04:44.955722 13823 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:45.001310 13906 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:44.993394 13900 rpcz_store.cc:276] 0811 16:04:43.750256 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.281104 (+530848us) service_pool.cc:227] Handling call
0811 16:04:44.971045 (+689941us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54002c10d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:44.992809 (+ 21764us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1159838464}
I20260811 16:04:44.927428 17194 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:45.007047 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:45.085811 13822 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
W20260811 16:04:45.010424 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72042.9us
I20260811 16:04:45.000798 13905 raft_consensus.cc:2362] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6. Re-sending same reply.
I20260811 16:04:44.966466 16563 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:44.935405 17088 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:45.017719 13907 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:45.092760 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:45.026448 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.208s (SENT)
I20260811 16:04:45.093429 13904 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:45.093622 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.030244 14582 raft_consensus.cc:2396] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:45.045274 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:45.080739 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:45.086375 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:45.087070 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.088173 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:45.096777 13901 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:45.094564 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68190.3us
I20260811 16:04:45.099720 13907 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:04:45.100521 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 475) took 2165 ms. Trace:
I20260811 16:04:45.101445 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:45.101843 13906 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:45.100901 13907 rpcz_store.cc:276] 0811 16:04:42.934782 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.092894 (+2158112us) service_pool.cc:227] Handling call
0811 16:04:45.093171 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.100239 (+  7068us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.100461 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:45.099573 17088 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:45.104801 17194 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:45.105285 17144 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:45.105875 17144 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:45.105978 16873 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:45.106523 16873 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:45.106931 16873 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:45.106873 17144 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:45.110702 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.111966 17053 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:45.113670 17053 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:04:45.114256 17053 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:45.114356 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:45.113940 17072 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:45.116624 16900 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:45.117319 16900 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:45.117779 16838 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:45.118414 17053 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:45.114130 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 802600us
I20260811 16:04:45.123283 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.101056 17096 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:45.123925 13744 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:45.124143 17096 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:45.126792 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.127529 13789 leader_election.cc:398] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
I20260811 16:04:45.127877 13789 leader_election.cc:401] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:04:45.114001 13709 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.534s (SENT)
W20260811 16:04:45.130887 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.584s (SENT) [suppressed 63 similar messages]
I20260811 16:04:45.134991 13904 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:45.135866 13906 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:45.136883 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1936) took 2135 ms. Trace:
I20260811 16:04:45.137033 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:45.067384 17085 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:45.144414 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.032359 17163 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:45.140054 13824 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:45.137459 13906 rpcz_store.cc:276] 0811 16:04:43.001721 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.102928 (+2101207us) service_pool.cc:227] Handling call
0811 16:04:45.135340 (+ 32412us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.136538 (+  1198us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.136810 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:45.145145 13743 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:45.138226 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.150519 13741 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:45.151064 13904 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:45.146828 13744 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260811 16:04:45.122648 17134 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:45.152314 17134 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:45.159303 16900 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:45.159453 17134 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:45.160890 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.162257 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.162781 17088 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:45.163654 17200 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260811 16:04:45.165154 17088 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:45.166092 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.168068 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 545) took 2515 ms. Trace:
I20260811 16:04:45.168453 13737 rpcz_store.cc:276] 0811 16:04:42.652839 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:42.653148 (+   309us) service_pool.cc:227] Handling call
0811 16:04:42.684513 (+ 31365us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:43.576574 (+892061us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.167835 (+1591261us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:45.168009 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2036863872}
I20260811 16:04:45.174527 17134 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:45.175819 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 831) took 1431 ms. Trace:
I20260811 16:04:45.176218 14574 rpcz_store.cc:276] 0811 16:04:43.744711 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.745351 (+   640us) service_pool.cc:227] Handling call
0811 16:04:43.745724 (+   373us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:44.867767 (+1122043us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.175544 (+307777us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54005c6cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:45.175745 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2579093760}
I20260811 16:04:45.151746 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1937) took 2148 ms. Trace:
I20260811 16:04:45.147714 14583 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:45.150270 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:45.141601 13826 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:45.180332 13904 rpcz_store.cc:276] 0811 16:04:43.003235 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.136557 (+2133322us) service_pool.cc:227] Handling call
0811 16:04:45.136876 (+   319us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.151496 (+ 14620us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.151695 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:45.181816 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:45.182745 13824 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 6
I20260811 16:04:45.178551 13743 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:45.151203 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1938) took 2147 ms. Trace:
I20260811 16:04:45.154716 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.156266 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:45.066973 17051 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:45.197568 13906 rpcz_store.cc:276] 0811 16:04:43.003556 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.150261 (+2146705us) service_pool.cc:227] Handling call
0811 16:04:45.150577 (+   316us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.150874 (+   297us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:45.150898 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:45.150938 (+    40us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:45.150965 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.151029 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:45.151127 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2026,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":94}
I20260811 16:04:45.232980 17088 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:45.264550 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:45.299387 13823 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:45.229386 13908 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:45.302692 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1952) took 1001 ms. Trace:
I20260811 16:04:45.303323 13908 rpcz_store.cc:276] 0811 16:04:44.301210 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.917743 (+616533us) service_pool.cc:227] Handling call
0811 16:04:45.302625 (+384882us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:45.220039 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:45.148296 17199 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
W20260811 16:04:45.307340 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 87430.8us
I20260811 16:04:45.176994 17134 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:45.280198 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 125585us
I20260811 16:04:45.313511 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.157439 17147 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:45.277827 17059 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:45.288522 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.289039 17135 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:45.289263 17051 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:45.289899 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.290620 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.291567 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.292419 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.331867 13737 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:45.332062 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.294124 16793 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:45.295622 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:45.296690 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.337090 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.218812 16988 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:45.297158 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:45.285540 13824 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:45.269874 13901 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:45.340215 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:45.340309 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.248494 17065 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:04:45.248131 17095 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:45.308511 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.183308 17074 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:45.311545 13826 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:04:45.264163 17087 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:45.324841 13908 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:04:45.294732 17089 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260811 16:04:45.362829 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1944) took 2357 ms. Trace:
I20260811 16:04:45.330736 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:45.364624 13908 rpcz_store.cc:276] 0811 16:04:43.005007 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.304579 (+2299572us) service_pool.cc:227] Handling call
0811 16:04:45.304972 (+   393us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.362525 (+ 57553us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.362769 (+   244us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:45.343545 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:45.344674 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:45.347681 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.357704 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:45.366957 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.368634 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.369903 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.330991 17108 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
W20260811 16:04:45.359180 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63626.4us
I20260811 16:04:45.313320 16789 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:45.309038 16636 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260811 16:04:45.307876 17025 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:45.358871 17085 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:45.373020 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:45.336930 17059 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:45.390535 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:45.936197 13908 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:45.404246 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:45.438792 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:45.576174 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 138902us
I20260811 16:04:45.350417 17148 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:04:45.940404 13738 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:45.348850 17188 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:45.449911 13901 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260811 16:04:45.330322 17199 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:45.437618 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:45.944882 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 636402us
W20260811 16:04:45.860096 13904 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.005s
W20260811 16:04:45.956168 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 583163us
I20260811 16:04:45.990855 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:45.884075 13905 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.001s	sys 0.017s
W20260811 16:04:45.991945 13905 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.002s	sys 0.018s
I20260811 16:04:45.444088 13823 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:45.992472 13741 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:45.349395 17088 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:45.357929 17157 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:45.992482 13789 leader_election.cc:398] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
W20260811 16:04:45.863667 13735 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.008s	sys 0.009s
I20260811 16:04:45.993788 13789 leader_election.cc:401] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260811 16:04:46.037787 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45616.6us
W20260811 16:04:46.038517 13735 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.012s	sys 0.021s
I20260811 16:04:45.363672 17147 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:45.369011 16836 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:45.954331 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:46.051652 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:45.993614 13904 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.009s
I20260811 16:04:46.058410 13738 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:46.053419 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2164) took 3046 ms. Trace:
W20260811 16:04:45.620870 17132 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.805s	user 0.018s	sys 0.000s
W20260811 16:04:45.707423 17024 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.037s	sys 0.042s
I20260811 16:04:46.059059 13901 rpcz_store.cc:276] 0811 16:04:43.009763 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.409080 (+2399317us) service_pool.cc:227] Handling call
0811 16:04:45.409569 (+   489us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.053134 (+643565us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.053363 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:45.951423 16789 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.064366 17059 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:45.596199 17080 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.065800 16685 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.066744 14581 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:04:45.436344 17089 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:45.375567 17087 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:45.436317 17129 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:45.988278 16852 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.124s	user 0.010s	sys 0.004s
I20260811 16:04:45.685276 17163 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:46.076683 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.000s	sys 0.022s
W20260811 16:04:46.130055 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.000s	sys 0.023s
W20260811 16:04:46.130465 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 999548us
I20260811 16:04:45.368508 17095 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:46.131212 13709 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.615s (SENT)
W20260811 16:04:46.134222 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.012s	sys 0.024s
I20260811 16:04:46.136912 13743 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
W20260811 16:04:46.143414 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.013s	sys 0.024s
I20260811 16:04:45.391036 16998 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:46.082258 13900 raft_consensus.cc:2396] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:04:45.664333 16563 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:45.545018 16987 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.539s
I20260811 16:04:45.639393 17108 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:45.392081 17046 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:45.357637 17135 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:45.991402 17186 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:46.098368 17188 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:46.071869 13908 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:45.919485 17074 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:46.101650 16873 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.003s
W20260811 16:04:46.102406 17210 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260811 16:04:46.101753 17089 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.148027 17190 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.103420 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 792) took 1523 ms. Trace:
I20260811 16:04:46.145766 17163 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:46.104453 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43532.7us
I20260811 16:04:46.104746 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1466) took 1797 ms. Trace:
I20260811 16:04:46.195982 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:46.195778 13827 rpcz_store.cc:276] 0811 16:04:44.307598 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.307729 (+   131us) service_pool.cc:227] Handling call
0811 16:04:44.983046 (+675317us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.054855 (+ 71809us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.104537 (+1049682us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400125f50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:46.104679 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1552225024}
I20260811 16:04:46.105651 17132 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
W20260811 16:04:46.106047 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113692us
I20260811 16:04:46.102643 17199 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5.
I20260811 16:04:46.107806 17162 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.107935 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 751) took 1650 ms. Trace:
I20260811 16:04:45.999063 16636 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:45.955192 17025 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:46.110337 16607 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:04:46.110025 17147 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.112299 14579 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:04:46.237365 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:46.238647 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:46.076373 17024 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.039s	sys 0.047s
W20260811 16:04:46.116446 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 430642us
I20260811 16:04:46.245479 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:46.084499 17214 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260811 16:04:46.066680 17073 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.079416 16836 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:46.146340 13737 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.000s
W20260811 16:04:46.145895 17081 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.006s	sys 0.024s
I20260811 16:04:46.078050 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.134100 16893 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.148507 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.191032 14583 rpcz_store.cc:276] 0811 16:04:44.579963 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.580221 (+   258us) service_pool.cc:227] Handling call
0811 16:04:44.592610 (+ 12389us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.177504 (+584894us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.103077 (+925573us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003d13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:46.103325 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1273100160}
I20260811 16:04:46.103892 17140 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:46.279031 14573 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:46.084288 17088 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.279495 16836 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.280233 16893 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.123255 17080 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.146281 16998 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:46.203346 17087 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.205200 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:46.126330 16685 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.212131 13827 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:46.212821 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.212980 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.213341 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.176604 17186 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:46.218394 14582 rpcz_store.cc:276] 0811 16:04:44.457280 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.457447 (+   167us) service_pool.cc:227] Handling call
0811 16:04:46.107703 (+1650256us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54004c0c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:46.107872 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1313858304}
I20260811 16:04:46.135968 16852 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.220485 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:46.113061 14578 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.015s	sys 0.009s
I20260811 16:04:46.239641 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.194626 17074 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.244215 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.239347 13818 raft_consensus.cc:2362] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:46.218930 17057 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.210088 17129 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:46.259637 13737 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:46.273079 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.238476 17025 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:04:46.265705 17081 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.006s	sys 0.025s
I20260811 16:04:46.274045 13901 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:46.265290 17073 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.248347 16793 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.283100 16893 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.286653 13743 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:46.288008 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.328410 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1859) took 1036 ms. Trace:
I20260811 16:04:46.328749 13743 rpcz_store.cc:276] 0811 16:04:45.291985 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.285881 (+993896us) service_pool.cc:227] Handling call
0811 16:04:46.286341 (+   460us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.328080 (+ 41739us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.328346 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.329121 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.330302 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:46.330586 17204 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.468s	user 0.001s	sys 0.000s
I20260811 16:04:46.238579 16607 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:46.240633 16874 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.187950 16873 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.248891 16987 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:46.236891 17132 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:46.288739 13821 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:46.288441 13824 raft_consensus.cc:2354] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8.
I20260811 16:04:46.288441 13823 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:46.301487 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1615) took 1012 ms. Trace:
I20260811 16:04:46.301800 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 840) took 1006 ms. Trace:
I20260811 16:04:46.371819 13737 rpcz_store.cc:276] 0811 16:04:45.288831 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.292173 (+  3342us) service_pool.cc:227] Handling call
0811 16:04:46.301414 (+1009241us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.372219 14574 rpcz_store.cc:276] 0811 16:04:45.295708 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.296447 (+   739us) service_pool.cc:227] Handling call
0811 16:04:45.296741 (+   294us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.162571 (+865830us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.162614 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.162686 (+    72us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:46.162731 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.301575 (+138844us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540056ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:46.301622 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.301745 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1990653312}
I20260811 16:04:46.373731 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.374729 13821 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:46.301915 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.310335 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1481) took 1413 ms. Trace:
I20260811 16:04:46.378355 13820 rpcz_store.cc:276] 0811 16:04:44.896854 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.897102 (+   248us) service_pool.cc:227] Handling call
0811 16:04:44.897617 (+   515us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:44.920867 (+ 23250us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:44.920900 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:44.920940 (+    40us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:44.920970 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.310115 (+1389145us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:46.310171 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.310277 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":52982528}
W20260811 16:04:46.294420 14578 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.016s	sys 0.009s
W20260811 16:04:46.294808 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74425.8us
W20260811 16:04:46.285898 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 80803us
I20260811 16:04:46.374611 14574 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:04:46.301594 13817 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:46.330421 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 558) took 1014 ms. Trace:
I20260811 16:04:46.382596 13743 rpcz_store.cc:276] 0811 16:04:45.316301 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.329631 (+1013330us) service_pool.cc:227] Handling call
0811 16:04:46.329925 (+   294us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.330110 (+   185us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.330137 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.330175 (+    38us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:46.330209 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.330261 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.330370 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.383388 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 559) took 1066 ms. Trace:
I20260811 16:04:46.383582 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:46.383827 13737 rpcz_store.cc:276] 0811 16:04:45.316807 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.382559 (+1065752us) service_pool.cc:227] Handling call
0811 16:04:46.382886 (+   327us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.383066 (+   180us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.383097 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.383156 (+    59us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:46.383187 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.383242 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.383337 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.309801 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1853) took 1020 ms. Trace:
I20260811 16:04:46.294713 17087 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:46.340348 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.300506 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.342871 14581 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:46.298027 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 486) took 1294 ms. Trace:
I20260811 16:04:46.236084 17162 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.311045 16793 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.289896 17080 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.210486 17190 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.204638 17163 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.234829 17188 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.099s
I20260811 16:04:46.379809 17164 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:46.224289 17046 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260811 16:04:46.384829 13744 rpcz_store.cc:276] 0811 16:04:45.289847 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.983185 (+693338us) service_pool.cc:227] Handling call
0811 16:04:46.045744 (+ 62559us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.209724 (+163980us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.209764 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.209821 (+    57us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:46.209865 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.309583 (+ 99718us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:46.309632 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.309743 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":376580864}
I20260811 16:04:46.299695 13822 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:46.385761 14580 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:46.393004 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.322154 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1592) took 2693 ms. Trace:
I20260811 16:04:46.394452 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 842) took 1073 ms. Trace:
I20260811 16:04:46.395298 13900 rpcz_store.cc:276] 0811 16:04:45.003260 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.079687 (+ 76427us) service_pool.cc:227] Handling call
0811 16:04:46.297766 (+1218079us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:46.297951 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2223158144}
I20260811 16:04:46.293632 16852 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.384393 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 560) took 1067 ms. Trace:
I20260811 16:04:46.466135 13743 rpcz_store.cc:276] 0811 16:04:45.317245 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.383691 (+1066446us) service_pool.cc:227] Handling call
0811 16:04:46.383961 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.384110 (+   149us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.384133 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.384168 (+    35us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:46.384207 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.384254 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.384346 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.399415 13827 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:46.295161 16685 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:46.356134 17217 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260811 16:04:46.406236 16607 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.355299 16874 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.310312 17073 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:46.356047 17108 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.295665 17074 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.410203 17132 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.410897 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 804) took 1281 ms. Trace:
I20260811 16:04:46.291880 17096 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:46.344871 16893 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.412000 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 474) took 3479 ms. Trace:
I20260811 16:04:46.483565 17046 consensus_queue.cc:1225] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:04:46.414018 17150 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:04:46.415460 17135 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.415910 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.399477 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.542091 13818 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:46.416632 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.300830 17057 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.426766 13817 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:46.417706 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 801) took 1558 ms. Trace:
I20260811 16:04:46.548810 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.314391 17025 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.437343 16793 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.223750 17142 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260811 16:04:46.439745 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.552750 13820 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260811 16:04:46.451589 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.554345 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.555073 13823 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:46.554824 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.555927 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.556048 13821 raft_consensus.cc:2362] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:46.376083 17153 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.557092 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.285255 16998 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.457793 17163 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.379364 16987 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:46.417851 16838 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.300s	user 0.014s	sys 0.000s
I20260811 16:04:46.462489 13824 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:46.464726 14578 rpcz_store.cc:276] 0811 16:04:45.321349 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.324266 (+  2917us) service_pool.cc:227] Handling call
0811 16:04:45.342493 (+ 18227us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.342744 (+   251us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:45.400384 (+ 57640us) log.cc:842] Serialized 14 byte log entry
0811 16:04:46.394069 (+993685us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.394143 (+    74us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:46.394202 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.394264 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.394389 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14212,"prepare.queue_time_us":58097,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":5965,"raft.queue_time_us":20798,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":21603,"spinlock_wait_cycles":38279552,"thread_start_us":979008,"threads_started":1,"wal-append.queue_time_us":998926}
W20260811 16:04:46.473089 13709 connection.cc:232] RPC call timeout handler was delayed by -1.2725958629744127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25510000000000005s for a response
W20260811 16:04:46.571444 13709 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.544s (SENT)
I20260811 16:04:46.571977 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:46.401314 16983 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:46.484216 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:46.575896 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91787.5us
I20260811 16:04:46.462867 13735 rpcz_store.cc:276] 0811 16:04:43.628984 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.629478 (+   494us) service_pool.cc:227] Handling call
0811 16:04:43.652294 (+ 22816us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:43.652807 (+   513us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:43.683849 (+ 31042us) log.cc:842] Serialized 14 byte log entry
0811 16:04:44.973274 (+1289425us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800461f80. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:04:45.233351 (+260077us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:45.233949 (+   598us) log.cc:842] Serialized 26 byte log entry
0811 16:04:45.234125 (+   176us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:46.321246 (+1087121us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800461f80. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f
0811 16:04:46.321469 (+   223us) log.cc:842] Serialized 14 byte log entry
0811 16:04:46.321761 (+   292us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.321873 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:46.321913 (+    40us) raft_consensus.cc:1671] finished
0811 16:04:46.321924 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.322085 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":216643,"prepare.queue_time_us":830608,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":303972,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":26973,"spinlock_wait_cycles":44930688,"thread_start_us":872403,"threads_started":2,"wal-append.queue_time_us":1378045}
I20260811 16:04:46.515192 13901 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: [7.2-7.2]
I20260811 16:04:46.485940 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.579471 13827 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:46.580497 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.512176 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.522468 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.523262 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.582816 13822 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:46.584844 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.584997 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.582221 13900 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:46.586530 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.586038 13821 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260811 16:04:46.453003 17087 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:46.413357 17224 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260811 16:04:46.485040 17140 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.289218 17186 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.528816 13905 rpcz_store.cc:276] 0811 16:04:42.932623 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.088131 (+2155508us) service_pool.cc:227] Handling call
0811 16:04:45.088613 (+   482us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:45.095070 (+  6457us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:45.095115 (+    45us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:45.145365 (+ 50250us) log.cc:842] Serialized 52 byte log entry
0811 16:04:45.992397 (+847032us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:45.992435 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.992511 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:46.411773 (+419262us) raft_consensus.cc:1671] finished
0811 16:04:46.411796 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.411938 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5365,"raft.queue_time_us":128,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":36721,"thread_start_us":759194,"threads_started":1,"wal-append.queue_time_us":1098988}
I20260811 16:04:46.536043 14582 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:46.519035 17129 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.610299 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.512132 17164 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:46.543134 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.537735 16893 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.525561 16789 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.431862 13738 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:46.550845 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:46.552376 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:46.621938 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77894.9us
I20260811 16:04:46.528584 16607 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:04:46.456000 17232 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:46.560372 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1934) took 3559 ms (client timeout 2447 ms). Trace:
W20260811 16:04:46.640941 13902 rpcz_store.cc:269] 0811 16:04:43.001211 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.506950 (+505739us) service_pool.cc:227] Handling call
0811 16:04:46.560191 (+3053241us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:46.560303 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2802279680}
I20260811 16:04:46.532691 17097 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.567708 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.557026 17153 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.548337 14575 rpcz_store.cc:276] 0811 16:04:44.859565 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.860046 (+   481us) service_pool.cc:227] Handling call
0811 16:04:44.860392 (+   346us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:44.861034 (+   642us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:44.861066 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:44.861513 (+   447us) log.cc:842] Serialized 26 byte log entry
0811 16:04:45.245255 (+383742us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:45.245316 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:45.245422 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:46.329735 (+1084313us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:46.417399 (+ 87664us) raft_consensus.cc:1671] finished
0811 16:04:46.417422 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.417642 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":72333568,"thread_start_us":295841,"threads_started":1,"wal-append.queue_time_us":811747}
I20260811 16:04:46.568534 17149 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:04:46.585654 13820 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:46.594264 13709 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.567s (SENT)
W20260811 16:04:46.656327 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62114.9us
W20260811 16:04:46.657153 13709 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.654s (SENT)
W20260811 16:04:46.658182 13709 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.706s (SENT)
I20260811 16:04:46.525211 14577 rpcz_store.cc:276] 0811 16:04:45.129261 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.129527 (+   266us) service_pool.cc:227] Handling call
0811 16:04:45.163725 (+ 34198us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:45.164139 (+   414us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:45.295775 (+131636us) log.cc:842] Serialized 14 byte log entry
0811 16:04:45.746539 (+450764us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:46.034403 (+287864us) log.cc:842] Serialized 26 byte log entry
0811 16:04:46.034561 (+   158us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:46.034592 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.034671 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:46.410666 (+375995us) raft_consensus.cc:1671] finished
0811 16:04:46.410685 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.410832 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70575,"prepare.queue_time_us":141315,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":46346,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":19741,"thread_start_us":405864,"threads_started":1,"wal-append.queue_time_us":1045511}
W20260811 16:04:46.599860 13741 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260811 16:04:46.601485 13907 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260811 16:04:46.551501 17095 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:46.551671 17089 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:46.587247 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:46.673846 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.674614 13900 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:46.675540 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.568827 16793 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260811 16:04:46.562150 17216 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260811 16:04:46.605690 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1848) took 2580 ms. Trace:
I20260811 16:04:46.606398 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.645043 17163 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:46.608143 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.654964 17144 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.612002 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.616137 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:46.544131 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 551) took 2856 ms (client timeout 1702 ms). Trace:
I20260811 16:04:46.586004 17073 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:46.691112 13742 rpcz_store.cc:269] 0811 16:04:43.683931 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.684068 (+   137us) service_pool.cc:227] Handling call
0811 16:04:46.540127 (+2856059us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:46.540291 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2252811136}
I20260811 16:04:46.609105 17140 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.591486 16852 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.619038 14583 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:04:46.574967 16983 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.623104 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:46.643782 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:46.651933 14581 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:46.652949 17087 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.654111 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.660096 13741 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:46.704682 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1856) took 1413 ms. Trace:
I20260811 16:04:46.705144 13741 rpcz_store.cc:276] 0811 16:04:45.290822 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.365563 (+ 74741us) service_pool.cc:227] Handling call
0811 16:04:46.704594 (+1339031us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.658685 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:46.665210 13906 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.014s
W20260811 16:04:46.706312 13906 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.015s
W20260811 16:04:46.659781 14544 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.013s	sys 0.021s
W20260811 16:04:46.707413 14544 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.013s	sys 0.021s
I20260811 16:04:46.675705 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.708598 13900 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:46.674134 17230 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:46.604375 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.674935 16789 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:46.715457 13823 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:46.717129 13823 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: [7.2-7.2]
I20260811 16:04:46.643736 16873 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:46.648399 17097 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:46.607792 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:46.720008 13905 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:46.679648 13736 rpcz_store.cc:276] 0811 16:04:44.025036 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:44.025280 (+   244us) service_pool.cc:227] Handling call
0811 16:04:44.025703 (+   423us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:44.802886 (+777183us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.605438 (+1802552us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54002814d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:46.605627 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1747785472}
I20260811 16:04:46.653220 16987 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.610299 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.687544 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.688812 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.655767 17145 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.656227 17059 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.700062 13818 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260811 16:04:46.733156 13824 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260811 16:04:46.734912 13902 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:04:46.617789 17129 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:46.702965 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 79946.8us
W20260811 16:04:46.706714 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48563.2us
I20260811 16:04:46.686213 17163 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:46.676697 13817 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:46.677657 17079 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.712071 17150 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:46.714690 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:46.765188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50606.3us
I20260811 16:04:46.725345 13822 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
W20260811 16:04:46.726735 13739 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.030s	sys 0.014s
W20260811 16:04:46.713212 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69526.6us
W20260811 16:04:46.769080 13739 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.030s	sys 0.014s
I20260811 16:04:46.694499 17080 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:46.738286 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 510162us
I20260811 16:04:46.739298 17134 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260811 16:04:46.739789 13709 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.708s (SENT)
I20260811 16:04:46.788727 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:46.704273 16874 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:46.713876 16983 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:46.754927 13817 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260811 16:04:46.707844 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 957020us
I20260811 16:04:46.756791 13824 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:46.757020 13903 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260811 16:04:46.758128 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:46.734344 13708 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.021s
I20260811 16:04:46.789920 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:46.769848 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:46.820127 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50397.6us
I20260811 16:04:46.714485 17162 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.649343 17232 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.769771 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1604) took 1645 ms. Trace:
I20260811 16:04:46.703029 17144 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:46.712549 17231 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:46.785480 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.710176 13900 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260811 16:04:46.652988 17164 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:46.756847 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1932) took 3756 ms (client timeout 2731 ms). Trace:
W20260811 16:04:46.820358 13708 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.017s	sys 0.021s
I20260811 16:04:46.748195 17163 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
W20260811 16:04:46.841470 13909 rpcz_store.cc:269] 0811 16:04:43.000665 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.507312 (+506647us) service_pool.cc:227] Handling call
0811 16:04:46.756618 (+3249306us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400007b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:46.756777 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2446735232}
I20260811 16:04:46.737485 17089 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260811 16:04:46.844899 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.724409 16852 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.770382 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:46.821313 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:46.788463 17134 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:46.779318 13827 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:46.858295 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.745378 17135 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:46.830431 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.764210 17074 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.762729 17095 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.834195 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2171) took 3527 ms. Trace:
I20260811 16:04:46.781776 17142 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:46.773372 17150 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:46.789618 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49875.9us
W20260811 16:04:46.889235 13709 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.765s (SENT)
W20260811 16:04:46.890704 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.843s (SENT)
I20260811 16:04:46.772267 17234 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:46.845971 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:46.820705 14544 connection.cc:232] RPC call timeout handler was delayed by -1.0537166699068621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260811 16:04:46.847774 13738 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:46.837968 17143 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.848673 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:46.852667 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:46.900049 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:46.900883 17233 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260811 16:04:46.903053 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:46.859515 17231 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:46.858217 13823 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:46.826875 13820 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:46.860224 13905 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:04:46.750873 17079 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:46.862419 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92140.2us
I20260811 16:04:46.786861 17080 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.741256 17059 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.865181 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:46.867865 13736 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:46.867908 13900 rpcz_store.cc:276] 0811 16:04:43.307254 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.709407 (+3402153us) service_pool.cc:227] Handling call
0811 16:04:46.709858 (+   451us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.833946 (+124088us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.834143 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:46.852617 16685 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:46.875440 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:46.878995 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:46.880766 14581 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 3 LEARNER]: Advancing to term 5
I20260811 16:04:46.881512 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.948770 13827 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:46.839171 17025 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:46.892344 13821 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:46.742208 17145 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.826745 13739 rpcz_store.cc:276] 0811 16:04:45.124070 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.125959 (+  1889us) service_pool.cc:227] Handling call
0811 16:04:45.126310 (+   351us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:45.126484 (+   174us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:45.355611 (+229127us) log.cc:842] Serialized 14 byte log entry
0811 16:04:46.769428 (+1413817us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.769480 (+    52us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:46.769535 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.769610 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.769716 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":796267,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":171988,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":119,"spinlock_wait_cycles":24960,"thread_start_us":1613247,"threads_started":3,"wal-append.queue_time_us":884669}
I20260811 16:04:46.898675 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:46.907630 13709 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.891s (SENT)
I20260811 16:04:46.862998 14574 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:46.863862 17134 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:46.966969 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:46.921739 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1939) took 3917 ms. Trace:
I20260811 16:04:46.968706 13904 rpcz_store.cc:276] 0811 16:04:43.003811 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.181227 (+2177416us) service_pool.cc:227] Handling call
0811 16:04:45.252298 (+ 71071us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:45.264633 (+ 12335us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:46.057801 (+793168us) log.cc:842] Serialized 14 byte log entry
0811 16:04:46.447644 (+389843us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:46.488005 (+ 40361us) log.cc:842] Serialized 26 byte log entry
0811 16:04:46.488209 (+   204us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:46.488596 (+   387us) log.cc:842] Serialized 14 byte log entry
0811 16:04:46.556828 (+ 68232us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b18002fd460. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:04:46.557035 (+   207us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.557108 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:46.921433 (+364325us) raft_consensus.cc:1671] finished
0811 16:04:46.921473 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.921660 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54180,"prepare.queue_time_us":951564,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":83,"raft.queue_time_us":118223,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":36079,"spinlock_wait_cycles":10895744,"thread_start_us":1073830,"threads_started":2,"wal-append.queue_time_us":618387}
I20260811 16:04:46.833588 17188 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260811 16:04:46.938180 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73073.9us
I20260811 16:04:46.735288 17230 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.945376 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:46.879698 16874 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:46.873142 16836 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:46.879946 17074 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:46.961985 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:46.964620 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:46.898787 17150 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:46.974524 17129 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.903266 17144 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:46.878364 17135 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:46.890379 17095 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:47.405774 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.004s	sys 0.007s
W20260811 16:04:47.000000 14544 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.767s (SENT)
W20260811 16:04:47.475354 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.006s	sys 0.008s
W20260811 16:04:47.476058 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 686207us
I20260811 16:04:47.201994 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:46.934065 16793 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:47.202952 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:47.314774 14577 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.014s
W20260811 16:04:47.479389 14577 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.003s	sys 0.018s
W20260811 16:04:47.327455 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 479835us
I20260811 16:04:47.480914 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:47.322291 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.010s
W20260811 16:04:47.465075 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 557440us
W20260811 16:04:47.482160 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.010s	sys 0.011s
I20260811 16:04:47.402832 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:47.471364 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:47.475435 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:47.487255 13822 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.003s	sys 0.010s
W20260811 16:04:47.487653 13822 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.010s
W20260811 16:04:47.448947 13817 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.018s
W20260811 16:04:47.278448 13906 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.028s
I20260811 16:04:46.986013 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:47.488456 13906 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.008s	sys 0.032s
I20260811 16:04:47.471992 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:47.491017 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:47.492136 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 492162us
W20260811 16:04:47.488163 13817 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.004s	sys 0.019s
W20260811 16:04:47.494551 13789 connection.cc:232] RPC call timeout handler was delayed by -3.068394694942981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24470000000000003s for a response
W20260811 16:04:47.464707 16832 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.003s	sys 0.008s
I20260811 16:04:46.917055 17231 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:46.989418 17153 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:47.447754 17087 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.006s
W20260811 16:04:47.500985 13789 connection.cc:232] RPC call timeout handler was delayed by -2.8127946949098259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2731s for a response
I20260811 16:04:46.965466 17162 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.493286 13743 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:47.558744 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:47.501606 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:47.496927 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:46.984318 17202 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.387s	user 0.000s	sys 0.004s
I20260811 16:04:46.959192 17147 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:47.498623 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:47.296185 17097 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.003s
W20260811 16:04:47.502264 13709 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.046s (SENT)
I20260811 16:04:47.591639 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:47.592476 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:47.592885 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90648.4us
I20260811 16:04:47.571092 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:47.513320 13827 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:47.505517 17025 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.513695 17072 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:47.514736 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:47.516183 17095 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:46.935189 17054 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.568s
I20260811 16:04:47.517123 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 838) took 2367 ms. Trace:
I20260811 16:04:47.517341 17129 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:46.978842 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 844) took 1586 ms. Trace:
I20260811 16:04:46.980693 17079 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:47.493525 17074 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:47.504873 16988 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260811 16:04:47.383746 17235 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.501303 17144 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:47.534050 16852 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.536882 16998 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:47.538444 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 848) took 1161 ms. Trace:
W20260811 16:04:47.541538 14544 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.032s (SENT)
I20260811 16:04:47.544895 17059 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:47.548231 16607 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.002s
I20260811 16:04:47.549489 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:46.975224 17140 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.554447 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 479) took 3803 ms. Trace:
I20260811 16:04:47.555912 13744 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:47.651237 13744 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:46.976994 17080 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.492550 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:47.655743 13820 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:47.518247 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1494) took 1296 ms. Trace:
I20260811 16:04:46.964939 16893 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.478988 16874 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:47.564386 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:47.564992 13741 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:47.558291 14575 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.007s	sys 0.027s
I20260811 16:04:47.480149 16836 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:47.467655 17232 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.989744 17057 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:46.920258 17143 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:47.556854 17087 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.009s	sys 0.007s
I20260811 16:04:47.500195 17065 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:47.595269 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:47.593670 14581 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:47.708293 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:47.594219 13709 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.094s (SENT)
W20260811 16:04:47.709568 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 115388us
I20260811 16:04:47.555187 17231 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:47.603386 14579 rpcz_store.cc:276] 0811 16:04:45.150150 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.151373 (+  1223us) service_pool.cc:227] Handling call
0811 16:04:46.111935 (+960562us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.238857 (+126922us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.516907 (+1278050us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54004c0c50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:47.517048 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2208370944}
I20260811 16:04:47.606700 17150 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:47.507206 17244 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:46.919739 17234 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:47.570842 16873 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.597044 17097 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:47.519865 17227 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260811 16:04:47.601413 17238 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:47.643090 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:47.642603 14574 rpcz_store.cc:276] 0811 16:04:46.377322 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.383844 (+  6522us) service_pool.cc:227] Handling call
0811 16:04:46.384095 (+   251us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.988891 (+604796us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.538101 (+549210us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54005c6cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.538355 (+   254us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1100966272}
I20260811 16:04:47.604347 17147 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:47.648173 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 98781.2us
I20260811 16:04:47.648980 16852 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:47.297618 17239 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.651063 13900 rpcz_store.cc:276] 0811 16:04:43.750599 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.936217 (+3185618us) service_pool.cc:227] Handling call
0811 16:04:46.936602 (+   385us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.936866 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:47.078120 (+141254us) log.cc:842] Serialized 14 byte log entry
0811 16:04:47.553975 (+475855us) log.cc:842] Serialized 14 byte log entry
0811 16:04:47.554118 (+   143us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:47.554160 (+    42us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:47.554205 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.554275 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:47.554391 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":145242,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"thread_start_us":475034,"threads_started":1}
W20260811 16:04:47.649438 17108 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.000s	sys 0.017s
I20260811 16:04:47.597549 17158 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260811 16:04:47.590354 17162 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:47.656505 13818 rpcz_store.cc:276] 0811 16:04:46.221789 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.733848 (+512059us) service_pool.cc:227] Handling call
0811 16:04:46.745625 (+ 11777us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.745849 (+   224us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.745885 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.745939 (+    54us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:46.745980 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.746047 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:47.518024 (+771977us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b540014d7d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:47.518175 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26410752}
W20260811 16:04:47.670626 14575 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.008s	sys 0.028s
I20260811 16:04:47.670837 13742 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:04:47.652436 13744 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:47.677549 13743 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260811 16:04:47.670277 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160840us
I20260811 16:04:47.646138 17250 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.671108 16874 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:47.686769 17230 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:47.646759 17079 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:47.703547 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 563) took 1388 ms. Trace:
I20260811 16:04:47.657707 17252 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:47.605631 17025 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:04:47.604187 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 89538.6us
I20260811 16:04:47.643934 17235 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:47.679198 16836 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:47.773020 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2173) took 4238 ms. Trace:
I20260811 16:04:47.802497 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 493) took 1398 ms. Trace:
I20260811 16:04:48.120878 13821 rpcz_store.cc:276] 0811 16:04:46.360961 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.610096 (+249135us) service_pool.cc:227] Handling call
0811 16:04:47.692523 (+1082427us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400173c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:47.703454 (+ 10931us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":646414720}
I20260811 16:04:48.127960 13902 rpcz_store.cc:276] 0811 16:04:46.404009 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.642123 (+238114us) service_pool.cc:227] Handling call
0811 16:04:47.802329 (+1160206us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5400300a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:47.802438 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":70073088}
I20260811 16:04:47.726393 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:47.728032 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 855) took 1034 ms. Trace:
I20260811 16:04:47.734232 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 561) took 2416 ms. Trace:
I20260811 16:04:47.727164 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:47.761826 13741 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260811 16:04:48.129057 14577 rpcz_store.cc:276] 0811 16:04:46.694125 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.694316 (+   191us) service_pool.cc:227] Handling call
0811 16:04:46.732663 (+ 38347us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:46.733037 (+   374us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.733077 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:46.733592 (+   515us) log.cc:842] Serialized 52 byte log entry
0811 16:04:47.479855 (+746263us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:47.479895 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.479962 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:47.727812 (+247850us) raft_consensus.cc:1671] finished
0811 16:04:47.727833 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:47.727968 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2156,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8751,"thread_start_us":688167,"threads_started":1,"wal-append.queue_time_us":870172}
I20260811 16:04:48.130295 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1622) took 1279 ms. Trace:
I20260811 16:04:47.678692 17188 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:47.692889 17080 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:04:47.737103 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2176) took 4041 ms. Trace:
I20260811 16:04:48.147341 13909 rpcz_store.cc:276] 0811 16:04:43.695643 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.842579 (+3146936us) service_pool.cc:227] Handling call
0811 16:04:46.842883 (+   304us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:47.508927 (+666044us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:47.508986 (+    59us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:47.509027 (+    41us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:04:47.509060 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.736879 (+227819us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400321254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.736924 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:47.737043 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1531300736}
I20260811 16:04:48.149094 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:48.151832 13736 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:48.152745 13736 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:48.154546 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.154793 17232 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:04:48.145732 17054 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260811 16:04:48.145349 16832 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260811 16:04:47.725512 17169 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:48.145480 17260 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.485s	user 0.002s	sys 0.002s
I20260811 16:04:47.803053 17073 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:47.725848 17157 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:47.999780 17092 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:48.100399 17085 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.929s	user 0.022s	sys 0.033s
W20260811 16:04:47.745144 17134 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.000s
I20260811 16:04:48.155117 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.163771 17134 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.155274 13818 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:48.166577 17134 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.773478 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2166) took 4723 ms. Trace:
I20260811 16:04:48.125022 13744 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:48.171722 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.171653 13901 rpcz_store.cc:276] 0811 16:04:43.050259 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.308231 (+3257972us) service_pool.cc:227] Handling call
0811 16:04:46.308564 (+   333us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.578751 (+270187us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.773239 (+1194488us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400322154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.773422 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":474333952}
W20260811 16:04:48.172873 16998 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260811 16:04:48.173034 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:47.714309 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 133060us
I20260811 16:04:48.174029 13901 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:47.723582 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.126730 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.175025 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:48.124362 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1620) took 1274 ms. Trace:
I20260811 16:04:48.121939 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:48.137030 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:48.177827 13743 rpcz_store.cc:276] 0811 16:04:46.850397 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.676866 (+826469us) service_pool.cc:227] Handling call
0811 16:04:47.677214 (+   348us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.124110 (+446896us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.124304 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:48.178821 13709 connection.cc:232] RPC call timeout handler was delayed by -1.2710119260009378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260811 16:04:48.179263 13709 connection.cc:232] RPC call timeout handler was delayed by -1.2053119259653613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260811 16:04:48.179930 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:47.911306 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 197517us
I20260811 16:04:47.802135 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 470) took 4874 ms. Trace:
W20260811 16:04:48.032222 17163 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.147s	user 0.007s	sys 0.005s
I20260811 16:04:48.190457 13900 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:47.809010 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 845) took 1865 ms. Trace:
I20260811 16:04:48.160926 13740 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:48.200239 14582 rpcz_store.cc:276] 0811 16:04:45.943312 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.304217 (+360905us) service_pool.cc:227] Handling call
0811 16:04:46.304534 (+   317us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.607703 (+303169us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.808750 (+1201047us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.808944 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":523134208}
I20260811 16:04:48.200892 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:48.201763 13900 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:48.127449 13905 rpcz_store.cc:276] 0811 16:04:43.534377 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.720809 (+3186432us) service_pool.cc:227] Handling call
0811 16:04:46.721213 (+   404us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.917381 (+196168us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.772766 (+855385us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002c15d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.772965 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":318764928}
W20260811 16:04:47.738961 17237 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.756s	user 0.003s	sys 0.000s
W20260811 16:04:48.145579 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 604065us
W20260811 16:04:48.210454 14544 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.221s (SENT)
W20260811 16:04:48.211388 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.818s (SENT)
I20260811 16:04:48.211884 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.123643 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 856) took 1333 ms. Trace:
I20260811 16:04:48.212616 14575 rpcz_store.cc:276] 0811 16:04:46.790592 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.790796 (+   204us) service_pool.cc:227] Handling call
0811 16:04:46.791238 (+   442us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.791700 (+   462us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.791737 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:46.792280 (+   543us) log.cc:842] Serialized 26 byte log entry
0811 16:04:48.123318 (+1331038us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:48.123355 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.123417 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:48.123462 (+    45us) raft_consensus.cc:1671] finished
0811 16:04:48.123472 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:48.123589 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2506,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11070,"thread_start_us":1265667,"threads_started":1,"wal-append.queue_time_us":841878}
I20260811 16:04:48.122653 17079 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:47.725703 17074 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:47.772228 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2162) took 4785 ms. Trace:
I20260811 16:04:48.277853 13907 rpcz_store.cc:276] 0811 16:04:42.986566 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.102849 (+2116283us) service_pool.cc:227] Handling call
0811 16:04:45.117841 (+ 14992us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.601208 (+1483367us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b540026c8a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190e300 00007f5c5190f371 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc
0811 16:04:46.669152 (+ 67944us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.771906 (+1102754us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.772147 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":339764352}
I20260811 16:04:48.168499 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.278815 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:48.262423 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.280176 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:48.281580 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:47.742249 17036 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:47.724255 17135 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.740540 17190 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:47.747641 16983 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.000s
I20260811 16:04:47.785751 17145 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:47.736065 17143 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:47.812757 17248 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260811 16:04:48.170143 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 569) took 1322 ms. Trace:
I20260811 16:04:48.386018 13742 rpcz_store.cc:276] 0811 16:04:46.848025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.848141 (+   116us) service_pool.cc:227] Handling call
0811 16:04:46.848406 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.123263 (+1274857us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.169845 (+ 46582us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400310e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:48.170070 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1882464000}
I20260811 16:04:48.126801 16873 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.182274 13903 rpcz_store.cc:276] 0811 16:04:42.928101 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:43.596157 (+668056us) service_pool.cc:227] Handling call
0811 16:04:46.756755 (+3160598us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:46.829656 (+ 72901us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.801902 (+972246us) spinlock_profiling.cc:243] Waited 3.16 s on lock 0x7b5400007b50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:47.802063 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7267855616}
I20260811 16:04:48.182786 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.015587 16793 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.269s
I20260811 16:04:48.388335 13820 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:48.175818 13901 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:47.920159 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1630) took 1032 ms. Trace:
I20260811 16:04:48.389756 13738 rpcz_store.cc:276] 0811 16:04:46.888124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.806719 (+918595us) service_pool.cc:227] Handling call
0811 16:04:47.807004 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:47.919652 (+112648us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:47.919701 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:47.919758 (+    57us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:47.919812 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.919904 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:47.920078 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1735,"raft.queue_time_us":80985,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":20144}
W20260811 16:04:48.038563 17267 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260811 16:04:48.375276 13744 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260811 16:04:48.393244 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 489) took 3214 ms. Trace:
I20260811 16:04:48.181519 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:48.120417 17108 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.012s	sys 0.018s
I20260811 16:04:47.724685 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.402601 14581 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:04:48.271569 16875 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:48.158903 14578 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:48.161301 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:47.813982 17246 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.494s	user 0.003s	sys 0.008s
I20260811 16:04:48.272215 17276 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:48.130673 13741 rpcz_store.cc:276] 0811 16:04:46.850986 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.760843 (+909857us) service_pool.cc:227] Handling call
0811 16:04:47.761363 (+   520us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.130025 (+368662us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.130240 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:48.129309 13737 rpcz_store.cc:276] 0811 16:04:45.317560 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.384741 (+1067181us) service_pool.cc:227] Handling call
0811 16:04:46.433388 (+ 48647us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.436276 (+  2888us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.436318 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:46.436395 (+    77us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:46.436438 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.733877 (+1297439us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5400344ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.733945 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:47.734143 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6069632}
I20260811 16:04:47.776497 17186 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:48.087779 17256 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:47.728013 14580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 835) took 2600 ms (client timeout 3130 ms). Trace:
W20260811 16:04:48.486953 14580 rpcz_store.cc:269] 0811 16:04:45.127369 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.128375 (+  1006us) service_pool.cc:227] Handling call
0811 16:04:47.727775 (+2599400us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005280d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:47.727924 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2544036736}
I20260811 16:04:48.214793 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.126317 17244 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:48.164513 13821 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260811 16:04:48.215669 13739 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260811 16:04:47.750622 17065 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:48.219862 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.492457 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:48.276026 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.024s	sys 0.050s
W20260811 16:04:48.493235 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.024s	sys 0.050s
I20260811 16:04:48.314971 17144 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:48.314477 17088 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:48.159610 17073 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.288367 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:48.155965 17232 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:04:48.297216 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.507619 13818 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
W20260811 16:04:47.721135 17226 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.376s	user 0.001s	sys 0.001s
W20260811 16:04:48.299155 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.013s	sys 0.011s
W20260811 16:04:48.517577 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.013s	sys 0.011s
I20260811 16:04:48.205513 17163 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.156719 17162 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:48.216428 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:48.311710 13740 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:48.376107 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:48.392192 13744 pending_rounds.cc:76] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 4
I20260811 16:04:48.536993 13744 pending_rounds.cc:97] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260811 16:04:48.537351 13744 raft_consensus.cc:2866] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:48.394881 13901 rpcz_store.cc:276] 0811 16:04:45.178704 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.392219 (+3213515us) service_pool.cc:227] Handling call
0811 16:04:48.392708 (+   489us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.392903 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:48.392938 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:48.392988 (+    50us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:48.393030 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.393093 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:48.393179 (+    86us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:48.153928 13736 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.2, Last appended by leader: 2, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:48.160660 17085 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.017s	user 0.022s	sys 0.034s
I20260811 16:04:48.539182 13736 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:48.403437 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.540143 14581 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:48.197924 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:48.225250 17238 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:48.160573 17097 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:48.161710 17235 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:48.275470 17249 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:48.409096 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:48.400650 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:48.159931 17157 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:48.271476 17173 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:48.156117 17254 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.230s
I20260811 16:04:48.207006 16852 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:48.419209 13908 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260811 16:04:48.155972 17129 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.227s
I20260811 16:04:48.230810 17158 consensus_queue.cc:1225] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260811 16:04:48.158396 17230 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:48.285247 17164 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.003s	sys 0.028s
I20260811 16:04:48.161868 17188 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:48.160384 17092 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.274272 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.496205 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:48.163031 17150 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:48.158531 17227 consensus_queue.cc:1225] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:04:48.374616 17074 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:48.503660 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.387568 17229 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:47.616883 14573 rpcz_store.cc:276] 0811 16:04:45.392438 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.301605 (+909167us) service_pool.cc:227] Handling call
0811 16:04:46.301959 (+   354us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.302226 (+   267us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.302253 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:46.302783 (+   530us) log.cc:842] Serialized 26 byte log entry
0811 16:04:46.690733 (+387950us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:46.698339 (+  7606us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:46.731686 (+ 33347us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:46.978598 (+246912us) raft_consensus.cc:1671] finished
0811 16:04:46.978625 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:46.978778 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":371674,"threads_started":1,"wal-append.queue_time_us":601067,"wal-append.run_cpu_time_us":2046,"wal-append.run_wall_time_us":1082766}
I20260811 16:04:48.300746 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 810) took 1337 ms. Trace:
I20260811 16:04:48.479275 16875 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:48.509200 17065 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.492131 17149 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:48.525701 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 575) took 1014 ms. Trace:
I20260811 16:04:48.525594 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 485) took 3577 ms. Trace:
I20260811 16:04:48.657545 13739 rpcz_store.cc:276] 0811 16:04:47.511672 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.821716 (+310044us) service_pool.cc:227] Handling call
0811 16:04:47.821992 (+   276us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.490139 (+668147us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.525496 (+ 35357us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54003471d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:48.525644 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":904411904}
I20260811 16:04:48.658036 13905 rpcz_store.cc:276] 0811 16:04:44.949249 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.203040 (+3253791us) service_pool.cc:227] Handling call
0811 16:04:48.222135 (+ 19095us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.499610 (+277475us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:48.499654 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:48.499712 (+    58us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:48.499761 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.525161 (+ 25400us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000339d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:48.525364 (+   203us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:48.525519 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":637526912}
I20260811 16:04:48.527834 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 758) took 1743 ms. Trace:
I20260811 16:04:48.659718 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.659919 14578 rpcz_store.cc:276] 0811 16:04:46.784043 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.784981 (+   938us) service_pool.cc:227] Handling call
0811 16:04:48.527584 (+1742603us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:48.527759 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2987406720}
W20260811 16:04:48.532291 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 244017us
I20260811 16:04:48.545558 14581 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:04:48.398346 16832 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:48.547674 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 335512us
I20260811 16:04:48.550516 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.543527 13909 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:48.665768 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1962) took 1120 ms. Trace:
I20260811 16:04:48.666198 13909 rpcz_store.cc:276] 0811 16:04:47.545368 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.197603 (+652235us) service_pool.cc:227] Handling call
0811 16:04:48.665689 (+468086us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:48.553334 13901 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
W20260811 16:04:48.557291 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 340927us
I20260811 16:04:48.558248 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:48.669775 14580 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:48.563913 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1618) took 1714 ms. Trace:
I20260811 16:04:48.670751 13744 rpcz_store.cc:276] 0811 16:04:46.849835 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.484553 (+634718us) service_pool.cc:227] Handling call
0811 16:04:47.555747 (+ 71194us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.563575 (+1007828us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.563835 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:48.672011 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:48.417124 16847 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:48.475931 16987 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:48.676302 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1602) took 3552 ms (client timeout 1730 ms). Trace:
I20260811 16:04:48.590536 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:48.676859 13740 rpcz_store.cc:269] 0811 16:04:45.123445 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.144182 (+ 20737us) service_pool.cc:227] Handling call
0811 16:04:46.985816 (+1841634us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:48.676060 (+1690244us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54000a91d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:48.676210 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1549438080}
I20260811 16:04:48.572023 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:48.678628 14575 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:48.284258 17269 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.296s
I20260811 16:04:48.493044 17244 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:48.599568 13742 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:48.493314 17153 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:48.600368 13904 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:48.724675 14583 raft_consensus.cc:2396] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260811 16:04:48.607414 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:48.726017 13741 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:48.611475 13736 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 2. (term mismatch)
I20260811 16:04:48.511411 17054 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:48.599951 13820 raft_consensus.cc:2362] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:48.507179 17232 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:48.274793 17252 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.620635 14579 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260811 16:04:48.614802 17164 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.004s	sys 0.029s
I20260811 16:04:48.622462 17057 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:48.215801 17239 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.547763 17108 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:48.274945 17250 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:48.630131 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 442672us
I20260811 16:04:48.298708 17036 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:48.639715 14577 rpcz_store.cc:276] 0811 16:04:46.963087 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.188961 (+1225874us) service_pool.cc:227] Handling call
0811 16:04:48.300067 (+111106us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.300332 (+   265us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:48.300369 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:48.300426 (+    57us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:48.300468 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.300534 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:48.300674 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:48.438428 17209 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 3.102s	user 0.019s	sys 0.022s
I20260811 16:04:48.510890 16893 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
W20260811 16:04:48.620530 17237 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:04:48.617169 17235 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260811 16:04:48.624812 17231 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.000s
I20260811 16:04:48.646207 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.608872 16852 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:48.399255 16793 consensus_queue.cc:1225] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:48.379810 16983 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.678984 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2180) took 3289 ms. Trace:
I20260811 16:04:48.682739 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:48.676551 13735 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:48.685245 13905 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:04:48.685681 13909 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:48.687728 13903 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:48.157167 17147 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.699689 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2165) took 5684 ms. Trace:
I20260811 16:04:48.694720 13740 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:04:48.689054 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:48.646078 17132 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.000s	sys 0.062s
I20260811 16:04:48.727452 13736 pending_rounds.cc:76] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 1
I20260811 16:04:48.728806 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:48.609635 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:48.521834 17079 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.615607 17173 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:48.598642 17238 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:48.644024 17229 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:48.502238 17256 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:48.676551 17097 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:49.431437 13736 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 7.2
I20260811 16:04:49.432139 13736 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:49.400418 17073 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:48.837284 13744 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260811 16:04:48.772048 17054 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.392745 17163 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.433300 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1636) took 1894 ms. Trace:
I20260811 16:04:49.423697 17158 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
I20260811 16:04:49.433693 13736 rpcz_store.cc:276] 0811 16:04:47.539167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.151236 (+612069us) service_pool.cc:227] Handling call
0811 16:04:48.151663 (+   427us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.433052 (+1281389us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.433249 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:48.688573 16847 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:49.434849 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 706090us
I20260811 16:04:49.198269 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 859) took 1732 ms. Trace:
I20260811 16:04:49.423914 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:49.382606 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.028s	sys 0.028s
I20260811 16:04:49.315851 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 484) took 4425 ms. Trace:
W20260811 16:04:49.386394 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.005s	sys 0.015s
W20260811 16:04:49.178107 16874 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.032s	user 0.008s	sys 0.000s
W20260811 16:04:49.174363 17283 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260811 16:04:48.807695 17025 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:49.190302 17277 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.366s	user 0.000s	sys 0.000s
I20260811 16:04:49.179594 17092 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:48.808313 17272 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.713s
I20260811 16:04:48.686806 17149 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.109277 17234 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:49.486285 13817 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.011s	sys 0.026s
W20260811 16:04:49.486726 13817 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.011s	sys 0.026s
W20260811 16:04:49.008371 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.026s	sys 0.040s
W20260811 16:04:49.487170 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.038s	sys 0.060s
I20260811 16:04:48.901680 16849 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.432096 17097 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.424058 17290 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:49.438596 13827 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:04:48.686421 17142 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.017s	sys 0.049s
I20260811 16:04:49.437873 13904 rpcz_store.cc:276] 0811 16:04:44.890828 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.016741 (+2125913us) service_pool.cc:227] Handling call
0811 16:04:47.224344 (+207603us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.729863 (+1505519us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.315508 (+585645us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:49.315769 (+   261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3164011264}
I20260811 16:04:49.442734 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2263) took 1209 ms. Trace:
I20260811 16:04:49.499982 13823 rpcz_store.cc:276] 0811 16:04:48.233201 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.627335 (+394134us) service_pool.cc:227] Handling call
0811 16:04:49.442661 (+815326us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:49.443583 13907 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.002s	sys 0.014s
W20260811 16:04:49.436340 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.004s	sys 0.006s
W20260811 16:04:49.444003 14574 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.009s	sys 0.001s
W20260811 16:04:49.500805 13907 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.002s	sys 0.014s
W20260811 16:04:49.500941 14574 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.009s	sys 0.001s
W20260811 16:04:49.444880 14580 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.003s	sys 0.008s
I20260811 16:04:49.444056 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2265) took 1210 ms. Trace:
W20260811 16:04:49.501430 14580 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.004s	sys 0.008s
I20260811 16:04:49.501567 13821 rpcz_store.cc:276] 0811 16:04:48.233873 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.682428 (+448555us) service_pool.cc:227] Handling call
0811 16:04:49.443865 (+761437us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:49.449379 14575 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.770s	user 0.011s	sys 0.000s
I20260811 16:04:49.448499 13908 rpcz_store.cc:276] 0811 16:04:43.015201 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.177367 (+3162166us) service_pool.cc:227] Handling call
0811 16:04:46.177754 (+   387us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:48.618086 (+2440332us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.690717 (+ 72631us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5400205420. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190fb42 00007f5c5190bf26 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:48.699376 (+  8659us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b5400087ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:48.699627 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5203051008}
I20260811 16:04:49.450683 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2182) took 3827 ms. Trace:
I20260811 16:04:49.448426 17074 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:48.687098 17095 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:04:48.771694 17157 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:49.508023 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.003s	sys 0.014s
W20260811 16:04:49.508478 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.004s	sys 0.014s
I20260811 16:04:49.509001 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:49.509238 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1941) took 6504 ms. Trace:
I20260811 16:04:48.732132 17059 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.762s
I20260811 16:04:49.447943 17262 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.485948 17065 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:48.835335 17271 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260811 16:04:48.687338 17227 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:49.181501 17273 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.490s	user 0.000s	sys 0.000s
I20260811 16:04:49.435585 17163 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:49.135368 16873 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:49.533182 17163 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:49.533764 17163 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.533562 16873 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:04:49.512849 17238 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.533788 17227 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.536736 17227 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.537187 16847 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.506273 17290 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.539769 17290 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.539835 16983 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.059841 17274 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:49.540768 17274 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.542968 17274 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.543396 17229 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:49.543640 17186 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.046s	user 0.015s	sys 0.000s
I20260811 16:04:49.544580 17256 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.514706 17298 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260811 16:04:49.546283 17250 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.495853 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:49.450820 17209 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 4.162s	user 0.022s	sys 0.042s
I20260811 16:04:49.463320 17230 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:49.502175 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 868) took 1206 ms. Trace:
I20260811 16:04:49.443490 17231 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:48.696776 16987 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.502424 14575 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:48.687934 16832 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.461314 17046 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:49.477072 16875 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:49.502825 17142 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.721s	user 0.021s	sys 0.112s
I20260811 16:04:49.556370 17046 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:49.435591 14583 rpcz_store.cc:276] 0811 16:04:47.465581 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.726827 (+261246us) service_pool.cc:227] Handling call
0811 16:04:49.197979 (+1471152us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54006dfbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.198182 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1366881024}
I20260811 16:04:49.558110 16832 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.498050 17085 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:48.756948 17153 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.458739 16874 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.562083 16874 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.562394 16987 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:49.564060 17249 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.955s	user 0.007s	sys 0.003s
I20260811 16:04:49.564392 17153 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.564606 17249 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:49.498236 17092 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.508113 17074 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:49.533350 17282 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260811 16:04:49.566814 17074 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.567643 17092 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.540275 17097 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:49.546393 17244 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.726s	user 0.001s	sys 0.006s
W20260811 16:04:49.448573 17132 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.630s	user 0.001s	sys 0.075s
I20260811 16:04:49.445344 17079 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.558434 16852 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.572957 16852 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.573087 17054 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:48.731704 17188 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.525533 17262 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.548475 17230 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:49.549836 17252 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.504398 17232 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.446719 17036 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.581295 17230 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.661201 17036 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:49.660916 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:49.074540 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.007s	sys 0.009s
I20260811 16:04:49.435094 13736 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
W20260811 16:04:49.663726 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.011s	sys 0.012s
I20260811 16:04:49.663932 13826 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:49.666296 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1501) took 3279 ms. Trace:
I20260811 16:04:49.446864 13738 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 4.
I20260811 16:04:49.446122 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1863) took 1319 ms. Trace:
I20260811 16:04:49.666968 13824 rpcz_store.cc:276] 0811 16:04:46.386598 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.819812 (+433214us) service_pool.cc:227] Handling call
0811 16:04:46.842655 (+ 22843us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:47.323182 (+480527us) raft_consensus.cc:1520] Early marking committed up to index 2
0811 16:04:47.323249 (+    67us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:47.489516 (+166267us) log.cc:842] Serialized 52 byte log entry
0811 16:04:48.517978 (+1028462us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:48.518020 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.518105 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:49.665315 (+1147210us) raft_consensus.cc:1671] finished
0811 16:04:49.665378 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.665856 (+   478us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45351,"raft.queue_time_us":48832,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":21448,"thread_start_us":1423464,"threads_started":2,"wal-append.queue_time_us":1100595}
I20260811 16:04:49.641925 13741 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:49.437724 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.031s	sys 0.030s
I20260811 16:04:49.433518 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 581) took 1275 ms. Trace:
I20260811 16:04:49.701654 17239 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.702462 13744 rpcz_store.cc:276] 0811 16:04:48.158175 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.731374 (+573199us) service_pool.cc:227] Handling call
0811 16:04:48.837015 (+105641us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:49.433296 (+596281us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.433473 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.703349 16793 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:49.704397 16793 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:49.644752 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.016s	sys 0.003s
I20260811 16:04:48.751401 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:49.707510 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.017s	sys 0.003s
I20260811 16:04:49.707815 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.708576 13818 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:49.708976 13904 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:49.709424 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2264) took 1475 ms. Trace:
I20260811 16:04:49.709704 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1969) took 1013 ms. Trace:
I20260811 16:04:49.441267 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1639) took 1231 ms. Trace:
W20260811 16:04:49.440742 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.006s	sys 0.015s
I20260811 16:04:49.710168 13904 rpcz_store.cc:276] 0811 16:04:48.696181 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.499804 (+803623us) service_pool.cc:227] Handling call
0811 16:04:49.709576 (+209772us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.709435 17234 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.711913 17234 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.713704 17186 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.714522 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:49.715852 17234 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.716879 16832 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:49.717420 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:49.437409 13820 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.727880 13739 rpcz_store.cc:276] 0811 16:04:48.209860 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.688712 (+478852us) service_pool.cc:227] Handling call
0811 16:04:49.441192 (+752480us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.729419 17256 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:49.730567 13826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2214) took 3518 ms (client timeout 1534 ms). Trace:
I20260811 16:04:49.730396 17256 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.731274 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1865) took 1590 ms. Trace:
I20260811 16:04:49.731693 13741 rpcz_store.cc:276] 0811 16:04:48.128068 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.727887 (+599819us) service_pool.cc:227] Handling call
0811 16:04:48.819753 (+ 91866us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.695575 (+875822us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.698793 (+  3218us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:49.699124 (+   331us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1889270016}
I20260811 16:04:49.734030 17256 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.498381 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 568) took 2880 ms. Trace:
I20260811 16:04:49.737557 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 771) took 1524 ms. Trace:
I20260811 16:04:49.738149 16875 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:49.739064 16875 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.740482 17173 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.741369 17173 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:49.741888 16875 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:49.155622 13900 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.000s
I20260811 16:04:49.757187 13900 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:04:49.758111 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1964) took 2212 ms (client timeout 2229 ms). Trace:
W20260811 16:04:49.758622 13900 rpcz_store.cc:269] 0811 16:04:47.546028 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.200458 (+654430us) service_pool.cc:227] Handling call
0811 16:04:49.757984 (+1557526us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.759892 17231 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.760462 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.486635 13902 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:49.762158 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.444890 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2181) took 3863 ms. Trace:
W20260811 16:04:49.763554 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 496) took 2277 ms (client timeout 1801 ms). Trace:
I20260811 16:04:49.763962 16793 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.509752 13906 rpcz_store.cc:276] 0811 16:04:43.004313 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.286700 (+2282387us) service_pool.cc:227] Handling call
0811 16:04:45.287157 (+   457us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:46.058336 (+771179us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:46.058365 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:46.085480 (+ 27115us) log.cc:842] Serialized 26 byte log entry
0811 16:04:46.706809 (+621329us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:46.748891 (+ 42082us) log.cc:842] Serialized 14 byte log entry
0811 16:04:47.490397 (+741506us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:47.721462 (+231065us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54000884d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:47.721510 (+    48us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:47.738618 (+ 17108us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b2400244898. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:04:49.509026 (+1770408us) raft_consensus.cc:1671] finished
0811 16:04:49.509051 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.509174 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31877,"prepare.queue_time_us":41828,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":67102,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":41489,"spinlock_wait_cycles":1764259968,"thread_start_us":1285333,"threads_started":2,"wal-append.queue_time_us":754953}
I20260811 16:04:49.737139 13817 rpcz_store.cc:276] 0811 16:04:46.610852 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.823688 (+212836us) service_pool.cc:227] Handling call
0811 16:04:46.840511 (+ 16823us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:46.840788 (+   277us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:47.500528 (+659740us) log.cc:842] Serialized 14 byte log entry
0811 16:04:49.490808 (+1990280us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.490872 (+    64us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:49.490965 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.491061 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.491222 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":755702,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":136673,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6827,"thread_start_us":2612243,"threads_started":3,"wal-append.queue_time_us":1095085}
I20260811 16:04:49.766278 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.516885 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.555383 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 774) took 1282 ms. Trace:
W20260811 16:04:49.504765 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.004s	sys 0.006s
I20260811 16:04:49.547971 14580 rpcz_store.cc:276] 0811 16:04:48.296025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.670577 (+374552us) service_pool.cc:227] Handling call
0811 16:04:48.724645 (+ 54068us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.501806 (+777161us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.501839 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.501880 (+    41us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:49.501910 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.501990 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.502121 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":673443,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":750947,"threads_started":1}
W20260811 16:04:49.768842 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.10425e+06us
I20260811 16:04:49.770238 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:49.504001 13909 rpcz_store.cc:276] 0811 16:04:45.623679 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.666937 (+3043258us) service_pool.cc:227] Handling call
0811 16:04:48.667302 (+   365us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.450380 (+783078us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.450596 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:49.551862 16836 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.385s	user 0.010s	sys 0.001s
I20260811 16:04:49.498504 16849 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.774748 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:49.773072 13902 rpcz_store.cc:269] 0811 16:04:47.485909 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.133084 (+647175us) service_pool.cc:227] Handling call
0811 16:04:49.763030 (+1629946us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002ad0d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.763316 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2466014592}
I20260811 16:04:49.776912 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:49.777383 16849 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.557618 17046 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.777559 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:49.568107 17095 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:49.558832 17085 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.779507 17239 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:49.780817 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:49.781764 17085 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.782814 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:49.783933 13739 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:04:49.784528 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1643) took 1397 ms. Trace:
I20260811 16:04:49.785183 17239 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:04:49.785061 13738 rpcz_store.cc:276] 0811 16:04:48.386927 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.390962 (+  4035us) service_pool.cc:227] Handling call
0811 16:04:49.784031 (+1393069us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b5400310e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.784283 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1892140416}
I20260811 16:04:49.580901 17232 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:49.788259 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:49.789412 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2261) took 1557 ms (client timeout 1780 ms). Trace:
W20260811 16:04:49.789915 13827 rpcz_store.cc:269] 0811 16:04:48.232521 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.492196 (+259675us) service_pool.cc:227] Handling call
0811 16:04:49.755288 (+1263092us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54000d6454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.789182 (+ 33894us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2173928320}
I20260811 16:04:49.790912 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1644) took 1106 ms. Trace:
I20260811 16:04:49.491120 17194 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:49.578074 17244 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.791651 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:49.792624 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 488) took 4614 ms. Trace:
I20260811 16:04:49.792392 17194 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.793277 17239 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:49.793015 13903 rpcz_store.cc:276] 0811 16:04:45.178358 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.387943 (+3209585us) service_pool.cc:227] Handling call
0811 16:04:48.388265 (+   322us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.439736 (+1051471us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.792049 (+352313us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:49.792400 (+   351us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":688316288}
I20260811 16:04:49.793850 17239 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:49.794131 17244 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.794291 17239 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:49.588826 17262 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.794503 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:49.554019 17163 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:49.664256 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.3468e+06us
I20260811 16:04:49.454623 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1638) took 1246 ms. Trace:
I20260811 16:04:49.796425 13737 rpcz_store.cc:276] 0811 16:04:48.208428 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.500823 (+292395us) service_pool.cc:227] Handling call
0811 16:04:49.454549 (+953726us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.796948 13900 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:04:49.797461 17163 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.797906 13903 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.798738 13822 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:49.662853 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2257) took 1456 ms. Trace:
I20260811 16:04:49.664043 13736 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:49.799316 13823 rpcz_store.cc:276] 0811 16:04:48.206232 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.506003 (+1299771us) service_pool.cc:227] Handling call
0811 16:04:49.662716 (+156713us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.800516 17149 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.800351 13736 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.801318 17046 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:49.801780 13736 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:49.775269 16836 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.802368 17230 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.688645 17238 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:49.804171 16836 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.803886 17238 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.791334 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:49.806288 17238 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.809279 13737 pending_rounds.cc:76] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 3
I20260811 16:04:49.709981 13818 rpcz_store.cc:276] 0811 16:04:48.233537 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.677430 (+443893us) service_pool.cc:227] Handling call
0811 16:04:49.709287 (+1031857us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.815555 13738 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:49.816208 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:49.816509 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1867) took 1192 ms. Trace:
I20260811 16:04:49.817021 13908 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:49.818259 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:49.578812 16998 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:49.819468 16998 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:49.821072 16998 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.505450 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:49.496438 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:49.714422 17186 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.719636 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 860) took 2252 ms. Trace:
I20260811 16:04:49.823356 13821 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:49.824048 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2267) took 1589 ms. Trace:
I20260811 16:04:49.824496 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1619) took 2974 ms. Trace:
I20260811 16:04:49.824985 17186 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.720943 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:49.824908 13735 rpcz_store.cc:276] 0811 16:04:46.850122 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:47.503175 (+653053us) service_pool.cc:227] Handling call
0811 16:04:48.676217 (+1173042us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.440483 (+764266us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.824106 (+383623us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000a91d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.824325 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2562631424}
I20260811 16:04:49.826071 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2259) took 1594 ms. Trace:
W20260811 16:04:49.701785 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.52008e+06us
I20260811 16:04:49.826697 13735 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:49.445737 13901 rpcz_store.cc:276] 0811 16:04:45.389543 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.538224 (+3148681us) service_pool.cc:227] Handling call
0811 16:04:48.538604 (+   380us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:48.678748 (+140144us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:48.678929 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.727933 17252 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:49.828274 17252 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:49.828773 17252 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:49.690665 17092 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.767899 14575 rpcz_store.cc:276] 0811 16:04:48.273143 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.505278 (+232135us) service_pool.cc:227] Handling call
0811 16:04:49.555318 (+1050040us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.551429 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 866) took 1342 ms. Trace:
I20260811 16:04:49.763700 13905 rpcz_store.cc:276] 0811 16:04:45.581360 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.659033 (+3077673us) service_pool.cc:227] Handling call
0811 16:04:48.659393 (+   360us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.444634 (+785241us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.444832 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.831254 14579 rpcz_store.cc:276] 0811 16:04:48.209290 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.549105 (+339815us) service_pool.cc:227] Handling call
0811 16:04:48.549476 (+   371us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.437155 (+887679us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.551191 (+114036us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b540063e2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:49.551368 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":162576640}
I20260811 16:04:49.831930 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.832890 13905 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
I20260811 16:04:49.834009 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.778800 17095 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:04:49.835599 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 327468us
I20260811 16:04:49.816978 13738 rpcz_store.cc:276] 0811 16:04:48.624147 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.786424 (+1162277us) service_pool.cc:227] Handling call
0811 16:04:49.786992 (+   568us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.816155 (+ 29163us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.816408 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.826442 13824 rpcz_store.cc:276] 0811 16:04:48.231400 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.720317 (+1488917us) service_pool.cc:227] Handling call
0811 16:04:49.825992 (+105675us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.837498 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:49.540002 17169 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.382s	user 0.017s	sys 0.003s
I20260811 16:04:49.809892 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 487) took 4692 ms. Trace:
I20260811 16:04:49.840708 13904 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:49.841205 17157 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:49.840543 13907 rpcz_store.cc:276] 0811 16:04:45.117300 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.278838 (+3161538us) service_pool.cc:227] Handling call
0811 16:04:48.401971 (+123133us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:48.532901 (+130930us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:48.532944 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:48.564904 (+ 31960us) log.cc:842] Serialized 26 byte log entry
0811 16:04:49.501208 (+936304us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:49.699414 (+198206us) log.cc:842] Serialized 14 byte log entry
0811 16:04:49.702891 (+  3477us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.809330 (+106439us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000343d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:49.809372 (+    42us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:49.809439 (+    67us) raft_consensus.cc:1671] finished
0811 16:04:49.809557 (+   118us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.809718 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35143,"prepare.queue_time_us":319804,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":39280,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":23264,"spinlock_wait_cycles":252801280,"thread_start_us":1121681,"threads_started":2,"wal-append.queue_time_us":933205}
I20260811 16:04:49.843945 13825 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:04:49.844602 16877 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.845082 17291 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:49.845235 16877 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.800458 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:49.641054 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 842831us
I20260811 16:04:49.772383 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.766685 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:49.848498 13822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2256) took 1642 ms (client timeout 1923 ms). Trace:
I20260811 16:04:49.848778 13909 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 4.
W20260811 16:04:49.848971 13822 rpcz_store.cc:269] 0811 16:04:48.205965 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.627342 (+421377us) service_pool.cc:227] Handling call
0811 16:04:49.848281 (+1220939us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540004e054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.848428 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2616644480}
I20260811 16:04:49.850502 13909 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:04:49.850656 16998 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:49.691654 13740 rpcz_store.cc:276] 0811 16:04:48.126478 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.693989 (+567511us) service_pool.cc:227] Handling call
0811 16:04:48.694301 (+   312us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.445790 (+751489us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.445956 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.742153 17173 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.811952 13743 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:49.852489 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1514) took 1664 ms. Trace:
I20260811 16:04:49.852918 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 578) took 2140 ms. Trace:
I20260811 16:04:49.852881 13817 rpcz_store.cc:276] 0811 16:04:48.184665 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.766212 (+1581547us) service_pool.cc:227] Handling call
0811 16:04:49.849041 (+ 82829us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.853333 13743 rpcz_store.cc:276] 0811 16:04:47.712785 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.203609 (+490824us) service_pool.cc:227] Handling call
0811 16:04:48.203896 (+   287us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.852063 (+1648167us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.852708 (+   645us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:49.852868 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3677067136}
I20260811 16:04:49.823405 14574 rpcz_store.cc:276] 0811 16:04:47.465950 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.175234 (+709284us) service_pool.cc:227] Handling call
0811 16:04:48.175568 (+   334us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:48.175965 (+   397us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:48.626388 (+450423us) log.cc:842] Serialized 14 byte log entry
0811 16:04:49.711847 (+1085459us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:49.712745 (+   898us) log.cc:842] Serialized 26 byte log entry
0811 16:04:49.712995 (+   250us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:49.713028 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.713197 (+   169us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:49.717767 (+  4570us) raft_consensus.cc:1671] finished
0811 16:04:49.717798 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.718033 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2046,"prepare.queue_time_us":1274131,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":28304,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":16047,"thread_start_us":1435162,"threads_started":3,"wal-append.queue_time_us":803961}
I20260811 16:04:49.718039 16832 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:49.845294 13825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1484) took 4841 ms (client timeout 1903 ms). Trace:
I20260811 16:04:49.828161 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:49.855650 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1516) took 1651 ms. Trace:
I20260811 16:04:49.855826 13827 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:49.856268 13901 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:49.856966 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2254) took 1651 ms. Trace:
I20260811 16:04:49.857300 16877 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.824602 13821 rpcz_store.cc:276] 0811 16:04:48.234503 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.505160 (+1270657us) service_pool.cc:227] Handling call
0811 16:04:49.823959 (+318799us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:49.855487 13825 rpcz_store.cc:269] 0811 16:04:45.004346 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:45.016500 (+ 12154us) service_pool.cc:227] Handling call
0811 16:04:49.845020 (+4828520us) spinlock_profiling.cc:243] Waited 4.75 s on lock 0x7b54000d5054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.845200 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10918228224}
I20260811 16:04:49.850709 13822 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 2. (index mismatch)
I20260811 16:04:49.859148 13821 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:49.834703 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:49.738032 14573 rpcz_store.cc:276] 0811 16:04:48.212544 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.686577 (+474033us) service_pool.cc:227] Handling call
0811 16:04:49.111667 (+425090us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:49.385317 (+273650us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.388529 (+  3212us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:49.542711 (+154182us) log.cc:842] Serialized 564 byte log entry
0811 16:04:49.658891 (+116180us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:49.736616 (+ 77725us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5400715fa0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189ffb3 00007f5c5190cf0f 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c
0811 16:04:49.736684 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.736864 (+   180us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:49.736922 (+    58us) raft_consensus.cc:1671] finished
0811 16:04:49.736941 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.737320 (+   379us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34308352,"thread_start_us":115445,"threads_started":1,"wal-append.queue_time_us":113335}
I20260811 16:04:49.859745 13825 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:04:49.861825 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2251) took 1657 ms. Trace:
I20260811 16:04:49.777878 13902 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:49.863240 13737 pending_rounds.cc:97] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260811 16:04:49.863653 13737 raft_consensus.cc:2894] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260811 16:04:49.864203 13737 raft_consensus.cc:2866] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:49.843050 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 491) took 4048 ms. Trace:
I20260811 16:04:49.838936 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:49.856062 13817 rpcz_store.cc:276] 0811 16:04:48.204185 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.853746 (+1649561us) service_pool.cc:227] Handling call
0811 16:04:49.854119 (+   373us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.855159 (+  1040us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.855191 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.855349 (+   158us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:49.855391 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.855458 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.855581 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":311,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":201}
I20260811 16:04:49.857640 13901 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
W20260811 16:04:49.859759 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89804.6us
I20260811 16:04:49.860726 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:49.885283 16849 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:49.885576 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168386us
I20260811 16:04:49.886054 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:49.886534 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 389993us
I20260811 16:04:49.868628 13735 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:49.886266 16849 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:04:49.868311 13824 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260811 16:04:49.835805 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1864) took 1708 ms. Trace:
I20260811 16:04:49.866420 17194 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.868584 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2185) took 3649 ms. Trace:
I20260811 16:04:49.887831 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 495) took 2404 ms. Trace:
I20260811 16:04:49.746547 17256 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:49.860076 17294 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:49.857647 16832 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:49.874874 17234 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:04:49.877158 13905 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:04:49.866714 13825 rpcz_store.cc:276] 0811 16:04:48.204573 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.858996 (+1654423us) service_pool.cc:227] Handling call
0811 16:04:49.859349 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.861524 (+  2175us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.861753 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.879680 17158 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.882521 13908 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:49.752455 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44149.5us
W20260811 16:04:49.731120 13826 rpcz_store.cc:269] 0811 16:04:46.212311 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:46.212427 (+   116us) service_pool.cc:227] Handling call
0811 16:04:49.730190 (+3517763us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b5400240754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.730458 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7747340672}
I20260811 16:04:49.852990 17173 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:49.889132 16873 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:49.867892 13904 rpcz_store.cc:276] 0811 16:04:45.949144 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.841774 (+3892630us) service_pool.cc:227] Handling call
0811 16:04:49.842290 (+   516us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.842645 (+   355us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.842672 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.842745 (+    73us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:49.842795 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.842857 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.842973 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.859172 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1513) took 1675 ms. Trace:
I20260811 16:04:49.791378 13739 rpcz_store.cc:276] 0811 16:04:48.684744 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.789341 (+1104597us) service_pool.cc:227] Handling call
0811 16:04:49.789873 (+   532us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.790271 (+   398us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.790307 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.790382 (+    75us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:49.790430 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.790500 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.790621 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.857331 13827 rpcz_store.cc:276] 0811 16:04:48.205429 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.790965 (+1585536us) service_pool.cc:227] Handling call
0811 16:04:49.856813 (+ 65848us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:49.856908 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":116571008}
I20260811 16:04:49.913335 13822 rpcz_store.cc:276] 0811 16:04:48.184127 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.849837 (+1665710us) service_pool.cc:227] Handling call
0811 16:04:49.850274 (+   437us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.858636 (+  8362us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.859072 (+   436us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.836357 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:49.896410 13818 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:49.896978 16849 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:49.912402 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1958) took 2368 ms. Trace:
I20260811 16:04:49.888193 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:49.897884 13909 rpcz_store.cc:276] 0811 16:04:46.201850 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.849503 (+3647653us) service_pool.cc:227] Handling call
0811 16:04:49.849930 (+   427us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.850905 (+   975us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.851120 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.887105 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:49.898636 13901 rpcz_store.cc:276] 0811 16:04:47.485356 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.856967 (+2371611us) service_pool.cc:227] Handling call
0811 16:04:49.857352 (+   385us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.887508 (+ 30156us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.887745 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.874326 13907 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:04:49.905921 13902 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:49.907222 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2183) took 4219 ms. Trace:
I20260811 16:04:49.918835 13905 rpcz_store.cc:276] 0811 16:04:45.715891 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.834989 (+4119098us) service_pool.cc:227] Handling call
0811 16:04:49.876732 (+ 41743us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.903599 (+ 26867us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.903857 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.859874 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2250) took 1655 ms. Trace:
I20260811 16:04:49.919909 13821 rpcz_store.cc:276] 0811 16:04:48.204231 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.858497 (+1654266us) service_pool.cc:227] Handling call
0811 16:04:49.858843 (+   346us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.859643 (+   800us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.859821 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.920622 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2184) took 3719 ms. Trace:
I20260811 16:04:49.921180 13907 rpcz_store.cc:276] 0811 16:04:46.201490 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.843571 (+3642081us) service_pool.cc:227] Handling call
0811 16:04:49.844050 (+   479us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.918678 (+ 74628us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.920529 (+  1851us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.910943 17092 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:49.924000 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:49.894665 13742 rpcz_store.cc:276] 0811 16:04:48.127314 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.722802 (+595488us) service_pool.cc:227] Handling call
0811 16:04:48.723207 (+   405us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:49.441053 (+717846us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.441087 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:49.441585 (+   498us) log.cc:842] Serialized 26 byte log entry
0811 16:04:49.642827 (+201242us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:49.686516 (+ 43689us) log.cc:842] Serialized 14 byte log entry
0811 16:04:49.773644 (+ 87128us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.835269 (+ 61625us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:49.835342 (+    73us) raft_consensus.cc:1671] finished
0811 16:04:49.835360 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.835591 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":304794,"prepare.queue_time_us":119715,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":746754,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":317,"thread_start_us":239367,"threads_started":2,"wal-append.queue_time_us":112120}
I20260811 16:04:49.926070 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:49.924952 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:49.913013 16873 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:49.916481 13906 rpcz_store.cc:276] 0811 16:04:47.544024 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.884117 (+2340093us) service_pool.cc:227] Handling call
0811 16:04:49.884539 (+   422us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.912026 (+ 27487us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.912058 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.912122 (+    64us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:49.912161 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.912225 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.912344 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5191,"raft.queue_time_us":25728,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98}
I20260811 16:04:49.921240 16849 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:04:49.937215 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 149183us
I20260811 16:04:49.941203 13820 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:04:49.942257 13820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2266) took 1708 ms (client timeout 2061 ms). Trace:
I20260811 16:04:49.942456 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1518) took 1720 ms. Trace:
I20260811 16:04:49.942585 13823 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:49.943324 16875 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.943936 16875 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.946611 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1963) took 2401 ms. Trace:
I20260811 16:04:49.947458 17262 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:49.942961 13826 rpcz_store.cc:276] 0811 16:04:48.222011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.916384 (+1694373us) service_pool.cc:227] Handling call
0811 16:04:49.941798 (+ 25414us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.942101 (+   303us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.942129 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.942177 (+    48us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:04:49.942210 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.942268 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.942377 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.948909 17173 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:49.947065 13909 rpcz_store.cc:276] 0811 16:04:47.545716 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.927224 (+2381508us) service_pool.cc:227] Handling call
0811 16:04:49.945853 (+ 18629us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.946163 (+   310us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.946200 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.946314 (+   114us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:49.946358 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.946425 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.946549 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.952601 13904 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260811 16:04:49.952904 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46618.9us
W20260811 16:04:49.942669 13820 rpcz_store.cc:269] 0811 16:04:48.234174 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.730702 (+496528us) service_pool.cc:227] Handling call
0811 16:04:49.942175 (+1211473us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.949687 17173 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.957697 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1961) took 2408 ms. Trace:
I20260811 16:04:49.958168 13904 rpcz_store.cc:276] 0811 16:04:47.545027 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.913197 (+2368170us) service_pool.cc:227] Handling call
0811 16:04:49.932158 (+ 18961us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.952975 (+ 20817us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.953151 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.932542 13735 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:49.912838 17256 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.961241 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1519) took 1674 ms. Trace:
I20260811 16:04:49.937243 16873 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:49.971009 17092 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.986377 13824 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:49.991472 13908 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260811 16:04:49.914882 17158 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:49.964501 13827 rpcz_store.cc:276] 0811 16:04:48.287013 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.928902 (+1641889us) service_pool.cc:227] Handling call
0811 16:04:49.960508 (+ 31606us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.960807 (+   299us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.960842 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.960896 (+    54us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:49.960961 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.961023 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:49.961154 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:49.985136 17294 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:49.993134 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:50.010450 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56817us
I20260811 16:04:50.029506 17256 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.024843 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1960) took 2480 ms. Trace:
I20260811 16:04:50.026875 13735 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:50.033061 13902 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:04:50.030542 13908 rpcz_store.cc:276] 0811 16:04:47.544736 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.921703 (+2376967us) service_pool.cc:227] Handling call
0811 16:04:49.969023 (+ 47320us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:50.024557 (+ 55534us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.024785 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:50.033818 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1970) took 1337 ms. Trace:
I20260811 16:04:50.033352 17095 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.034207 13902 rpcz_store.cc:276] 0811 16:04:48.696476 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.930022 (+1233546us) service_pool.cc:227] Handling call
0811 16:04:50.021024 (+ 91002us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:50.033552 (+ 12528us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.033761 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1139968}
I20260811 16:04:50.033078 13817 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260811 16:04:50.034767 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2253) took 1819 ms. Trace:
I20260811 16:04:50.036818 13908 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260811 16:04:49.969770 17163 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:49.962967 17173 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.036938 13824 rpcz_store.cc:276] 0811 16:04:48.205154 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.922465 (+1717311us) service_pool.cc:227] Handling call
0811 16:04:49.952966 (+ 30501us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:50.021617 (+ 68651us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.024791 (+  3174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:50.035595 13817 pending_rounds.cc:76] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:04:50.040395 13817 pending_rounds.cc:97] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260811 16:04:50.045181 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2248) took 1870 ms. Trace:
I20260811 16:04:50.045634 13823 rpcz_store.cc:276] 0811 16:04:48.187475 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.847899 (+1660424us) service_pool.cc:227] Handling call
0811 16:04:49.942159 (+ 94260us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.943213 (+  1054us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.044939 (+101726us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b5400241150. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:50.045087 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":215591808}
I20260811 16:04:50.040709 13817 raft_consensus.cc:2866] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:50.049765 13906 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260811 16:04:50.040017 17163 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:50.064258 13909 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260811 16:04:50.065183 13903 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
W20260811 16:04:50.068111 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 181199us
W20260811 16:04:50.073357 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 108704us
I20260811 16:04:50.073537 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 862) took 2407 ms. Trace:
W20260811 16:04:50.107471 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70236.2us
I20260811 16:04:50.074766 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 663) took 7076 ms. Trace:
I20260811 16:04:50.118873 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:50.124922 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58309.2us
I20260811 16:04:50.114053 13907 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260811 16:04:50.127946 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1971) took 1388 ms. Trace:
I20260811 16:04:50.128587 13906 rpcz_store.cc:276] 0811 16:04:48.727683 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.958364 (+1230681us) service_pool.cc:227] Handling call
0811 16:04:50.038218 (+ 79854us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:50.054764 (+ 16546us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.116077 (+ 61313us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:50.132150 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1642) took 1748 ms. Trace:
I20260811 16:04:50.054024 17092 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.135746 13736 rpcz_store.cc:276] 0811 16:04:48.383649 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.434705 (+1051056us) service_pool.cc:227] Handling call
0811 16:04:49.434998 (+   293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:50.070903 (+635905us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:50.108558 (+ 37655us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:50.108631 (+    73us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:50.108689 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.108797 (+   108us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:50.132048 (+ 23251us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4976,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":16164}
I20260811 16:04:50.113860 14582 rpcz_store.cc:276] 0811 16:04:47.665823 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:48.204992 (+539169us) service_pool.cc:227] Handling call
0811 16:04:48.205279 (+   287us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:49.982204 (+1776925us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.982262 (+    58us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:49.982323 (+    61us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:49.982373 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.073019 (+ 90646us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:50.073073 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:50.073329 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1358,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":4085420416}
I20260811 16:04:50.142143 17074 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:50.142887 16852 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.005s
I20260811 16:04:50.083369 17163 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:50.035389 17294 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.103346 17095 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:50.116298 13908 rpcz_store.cc:276] 0811 16:04:42.998241 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.053609 (+7055368us) service_pool.cc:227] Handling call
0811 16:04:50.074643 (+ 21034us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:50.160945 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.078729 17158 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:50.148559 17262 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:50.077800 17132 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:50.190783 13735 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260811 16:04:50.192420 13735 pending_rounds.cc:76] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 1
I20260811 16:04:50.199395 13735 pending_rounds.cc:97] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260811 16:04:50.199877 13735 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:50.158443 17291 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260811 16:04:50.208045 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63192.8us
W20260811 16:04:50.209314 14542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.952s (SENT) [suppressed 26 similar messages]
I20260811 16:04:50.185814 16849 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.205515 17232 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:50.224648 13900 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260811 16:04:50.228659 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86315us
I20260811 16:04:50.229166 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 498) took 2739 ms. Trace:
I20260811 16:04:50.231082 13900 rpcz_store.cc:276] 0811 16:04:47.486565 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.874385 (+2387820us) service_pool.cc:227] Handling call
0811 16:04:50.199309 (+324924us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:50.201572 (+  2263us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:50.225317 (+ 23745us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.225594 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34305408}
W20260811 16:04:50.235275 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62428.8us
I20260811 16:04:50.238343 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:50.239223 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.240360 14582 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:50.241433 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.241704 16852 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:50.242626 16852 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.245482 16852 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.245323 17239 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:50.247498 17239 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:50.230347 17036 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.568s	user 0.020s	sys 0.000s
W20260811 16:04:50.250473 17316 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260811 16:04:50.206686 17252 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:50.251413 17262 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:50.258836 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1967) took 2711 ms. Trace:
I20260811 16:04:50.259378 13907 rpcz_store.cc:276] 0811 16:04:47.547847 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.926991 (+2379144us) service_pool.cc:227] Handling call
0811 16:04:50.071129 (+144138us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.126051 (+ 54922us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.258598 (+132547us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54002ad5d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:50.258763 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":156547456}
I20260811 16:04:50.205914 17132 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.280723 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.287192 16875 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.287954 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.290122 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:50.293483 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:50.297217 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 166910us
I20260811 16:04:50.308104 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:50.310127 17314 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.182s	user 0.000s	sys 0.005s
I20260811 16:04:50.313717 14583 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260811 16:04:50.313719 17232 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:50.315249 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1866) took 1836 ms. Trace:
I20260811 16:04:50.315644 13744 rpcz_store.cc:276] 0811 16:04:48.478398 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.703946 (+1225548us) service_pool.cc:227] Handling call
0811 16:04:49.704796 (+   850us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:49.705542 (+   746us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.705569 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:49.706636 (+  1067us) log.cc:842] Serialized 52 byte log entry
0811 16:04:49.890284 (+183648us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:49.912014 (+ 21730us) log.cc:842] Serialized 14 byte log entry
0811 16:04:49.912258 (+   244us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:49.912347 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:50.289248 (+376901us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b1800220fc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:50.292276 (+  3028us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:50.315009 (+ 22733us) raft_consensus.cc:1671] finished
0811 16:04:50.315030 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:50.315183 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11857,"prepare.queue_time_us":21537,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":3089,"raft.queue_time_us":2350,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":500,"spinlock_wait_cycles":27477632,"thread_start_us":183118,"threads_started":1,"wal-append.queue_time_us":232486}
I20260811 16:04:50.319234 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1517) took 2110 ms. Trace:
I20260811 16:04:50.319651 13825 rpcz_store.cc:276] 0811 16:04:48.208857 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.906486 (+1697629us) service_pool.cc:227] Handling call
0811 16:04:49.933439 (+ 26953us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.027766 (+ 94327us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.027797 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:50.035212 (+  7415us) log.cc:842] Serialized 26 byte log entry
0811 16:04:50.056573 (+ 21361us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:50.056615 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.056693 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:50.318987 (+262294us) raft_consensus.cc:1671] finished
0811 16:04:50.319006 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:50.319154 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":38437,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":13175,"threads_started":1,"wal-append.queue_time_us":141590}
I20260811 16:04:50.321683 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:50.322755 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2252) took 2117 ms. Trace:
I20260811 16:04:50.323124 13817 rpcz_store.cc:276] 0811 16:04:48.204868 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.894942 (+1690074us) service_pool.cc:227] Handling call
0811 16:04:49.923463 (+ 28521us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:50.069603 (+146140us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.322485 (+252882us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5400219654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:50.322688 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":149213440}
I20260811 16:04:50.323925 17291 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:50.325605 17291 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:50.326639 17291 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:50.327046 17291 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:50.327756 13628 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 2, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:50.323941 14577 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260811 16:04:50.330075 13628 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 7, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 7 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.341212 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.343024 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.343524 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:50.343420 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:50.347232 17294 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:50.348970 14544 connection.cc:232] RPC call timeout handler was delayed by -1.2744877940276638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260811 16:04:50.351089 14544 connection.cc:232] RPC call timeout handler was delayed by -1.0640486680204049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260811 16:04:50.349695 17294 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:50.352914 17321 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.103s	user 0.003s	sys 0.000s
W20260811 16:04:50.354581 17319 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260811 16:04:50.372880 16998 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:50.360131 17323 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260811 16:04:50.360102 17252 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:50.374810 17252 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:50.375042 17234 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:50.375392 17252 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:50.376732 17252 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:50.362125 13630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 326) took 19850 ms (client timeout 15000 ms). Trace:
I20260811 16:04:50.362709 13628 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 3, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.363548 17230 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:50.365214 13739 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:50.381908 17230 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.385118 17230 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:50.384366 13628 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.388554 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1966) took 2842 ms. Trace:
I20260811 16:04:50.367494 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:50.397498 17132 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.391129 13628 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 5 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.397583 17325 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:50.408684 17262 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:50.389114 13905 rpcz_store.cc:276] 0811 16:04:47.547381 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.932382 (+2385001us) service_pool.cc:227] Handling call
0811 16:04:49.968414 (+ 36032us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:49.978517 (+ 10103us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.978548 (+    31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:50.042842 (+ 64294us) log.cc:842] Serialized 52 byte log entry
0811 16:04:50.179778 (+136936us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:04:50.194063 (+ 14285us) log.cc:842] Serialized 14 byte log entry
0811 16:04:50.221611 (+ 27548us) log.cc:842] Serialized 14 byte log entry
0811 16:04:50.222149 (+   538us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.222267 (+   118us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:50.349843 (+127576us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:50.388277 (+ 38434us) raft_consensus.cc:1671] finished
0811 16:04:50.388306 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:50.388482 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50141,"prepare.queue_time_us":68996,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":105,"raft.queue_time_us":19706,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":18653,"spinlock_wait_cycles":24572160,"thread_start_us":136401,"threads_started":1,"wal-append.queue_time_us":205840}
I20260811 16:04:50.409826 14577 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:50.412707 16849 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.419266 17294 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.429911 13739 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:50.430634 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.437806 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.438740 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.441053 16793 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:50.378037 16873 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.445308 17095 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260811 16:04:50.378033 13630 rpcz_store.cc:269] 0811 16:04:30.511407 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:30.511682 (+   275us) service_pool.cc:227] Handling call
0811 16:04:33.508999 (+2997317us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b54000311d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c57866d6c 00007f5c57960c3e 00007f5c55c72fb4 00007f5c55c72f42 00007f5c55c72e71 00007f5c55c72dec 00007f5c55c720a2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:50.361808 (+16852809us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:40.656175 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:40.657014 (+   839us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:40.657073 (+    59us) write_op.cc:435] Acquired schema lock
0811 16:04:40.657128 (+    55us) tablet.cc:660] Decoding operations
0811 16:04:40.898262 (+241134us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:40.898381 (+   119us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:40.898412 (+    31us) tablet.cc:683] Acquiring locks for 12 operations
0811 16:04:40.899851 (+  1439us) tablet.cc:699] Row locks acquired
0811 16:04:40.899892 (+    41us) write_op.cc:260] PREPARE: finished
0811 16:04:40.900171 (+   279us) write_op.cc:270] Start()
0811 16:04:40.900347 (+   176us) write_op.cc:276] Timestamp: P: 1786464280900068 usec, L: 0
0811 16:04:40.900387 (+    40us) op_driver.cc:331] REPLICATION: starting
0811 16:04:41.057664 (+157277us) log.cc:842] Serialized 4809 byte log entry
0811 16:04:43.319385 (+2261721us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb
0811 16:04:44.978526 (+1659141us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b18002c01a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:04:45.288259 (+309733us) op_driver.cc:444] REPLICATION: finished
0811 16:04:47.686386 (+2398127us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5531c410
0811 16:04:48.807920 (+1121534us) write_op.cc:301] APPLY: starting
0811 16:04:48.918206 (+110286us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:49.304655 (+386449us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:49.383595 (+ 78940us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:49.544505 (+160910us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:49.544893 (+   388us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0811 16:04:49.544946 (+    53us) write_op.cc:312] APPLY: finished
0811 16:04:49.545367 (+   421us) log.cc:842] Serialized 89 byte log entry
0811 16:04:49.587045 (+ 41678us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:49.590166 (+  3121us) write_op.cc:454] Released schema lock
0811 16:04:49.590277 (+   111us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:49.722810 (+132533us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:49.722892 (+    82us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17623,"reported_tablets":30,"spinlock_wait_cycles":6354404608,"child_traces":[["op",{"apply.queue_time_us":3370582,"apply.run_cpu_time_us":12956,"apply.run_wall_time_us":998388,"num_ops":12,"prepare.queue_time_us":391786,"prepare.run_cpu_time_us":62810,"prepare.run_wall_time_us":3202874,"raft.queue_time_us":297215,"raft.run_cpu_time_us":64989,"raft.run_wall_time_us":4269124,"replication_time_us":4387755,"spinlock_wait_cycles":99752064,"thread_start_us":7312184,"threads_started":5,"wal-append.queue_time_us":2937836,"wal-append.run_cpu_time_us":35337,"wal-append.run_wall_time_us":1182625}]]}
I20260811 16:04:50.446158 17231 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:50.423017 17163 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.519600 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.449021 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:50.449654 17036 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:04:50.453263 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.453918 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.454056 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.524542 13825 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:50.455274 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:50.471114 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.494589 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 1965) took 2937 ms. Trace:
I20260811 16:04:50.497332 13628 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 5, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 5 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:04:50.493896 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 250486us
W20260811 16:04:50.521530 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49930.4us
I20260811 16:04:50.527562 13737 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:50.531975 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.537593 13736 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:04:50.539470 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.540632 13744 raft_consensus.cc:2396] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260811 16:04:50.540704 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 250686us
W20260811 16:04:50.534773 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 85888.4us
I20260811 16:04:50.542181 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.542698 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.542906 13739 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:50.543161 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.547819 13823 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:50.546361 13826 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
W20260811 16:04:50.551795 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 208491us
I20260811 16:04:50.552227 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.551883 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.554795 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.470292 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:50.559403 13907 raft_consensus.cc:595] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.559700 14577 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:50.561178 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.559780 13907 raft_consensus.cc:603] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:50.529995 16875 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:50.573988 16875 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:50.575295 17294 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:50.576284 16875 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:50.576830 17163 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:50.579351 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.581979 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:50.583065 17232 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:50.586022 17234 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:50.544008 17239 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:50.567559 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.587996 13737 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:50.568162 14580 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:04:50.570607 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.570983 17074 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:04:50.573243 16873 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:50.565843 13820 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:50.589807 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.589015 13740 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:50.543502 17231 consensus_queue.cc:1225] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:50.527108 13901 rpcz_store.cc:276] 0811 16:04:47.546296 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:49.924295 (+2377999us) service_pool.cc:227] Handling call
0811 16:04:49.954703 (+ 30408us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:49.970422 (+ 15719us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:49.970467 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:50.103564 (+133097us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:50.104037 (+   473us) log.cc:842] Serialized 26 byte log entry
0811 16:04:50.183127 (+ 79090us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:04:50.394622 (+211495us) log.cc:842] Serialized 14 byte log entry
0811 16:04:50.394950 (+   328us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.395055 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:50.395114 (+    59us) raft_consensus.cc:1671] finished
0811 16:04:50.483253 (+ 88139us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:50.483460 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10746,"prepare.queue_time_us":54922,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":133206,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9226,"spinlock_wait_cycles":3644672,"thread_start_us":256279,"threads_started":2,"wal-append.queue_time_us":120356}
I20260811 16:04:50.598800 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.606559 16893 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:04:50.596101 17239 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:50.607890 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.604604 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:50.610317 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52133.9us
I20260811 16:04:50.618297 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:50.622704 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.628545 16998 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:50.626751 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:50.613989 13628 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 3, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.634889 13817 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:50.636485 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.646552 14583 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:50.614396 16893 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:50.624675 17239 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:50.573994 17309 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260811 16:04:50.659746 17309 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:50.660158 17309 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:50.660598 17173 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:50.661561 17309 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.662348 17173 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:50.663038 17173 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:50.666078 14581 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:50.666529 17173 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:50.666599 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:50.667418 13821 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:50.667281 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.668850 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:50.669590 17287 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260811 16:04:50.681337 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49177.6us
I20260811 16:04:50.681005 16893 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.684547 17329 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
W20260811 16:04:50.685159 17329 raft_consensus.cc:1054] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Illegal state: Leader has not yet committed an operation in its own term
I20260811 16:04:50.632995 16873 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260811 16:04:50.687520 16793 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:50.691869 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.693470 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.694862 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.656291 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.658155 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.653155 13628 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 3, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.679816 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.697747 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.698187 14578 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:50.651907 13823 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:50.701036 13740 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:50.696915 13827 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:50.671084 17095 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:50.676229 13744 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:50.696302 13741 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:50.710139 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.710901 16793 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:50.711591 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:50.682953 16893 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:50.719666 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.710357 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.711019 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:50.724255 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:50.704461 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.673418 17230 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:50.721577 13628 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:04:50.732615 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.729559 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.733503 13820 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:04:50.734570 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.732254 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.754081 13827 raft_consensus.cc:2396] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260811 16:04:50.735993 13628 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 3 to 4, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:50.757169 13628 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 3 to 4, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:50.762104 17092 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:50.734468 16793 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:50.764457 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:50.765734 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.705119 17095 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:50.766850 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.753284 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:50.778373 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47326.3us
I20260811 16:04:50.778793 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.778312 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.769268 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:50.771279 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:50.753153 13738 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:50.789783 14575 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:04:50.796176 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:50.712935 17074 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260811 16:04:50.731896 17230 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:50.754801 17309 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:50.787937 13901 raft_consensus.cc:595] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:50.814745 13901 raft_consensus.cc:603] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:04:50.802296 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 92983.8us
I20260811 16:04:50.820717 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.781556 17095 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:50.774825 17036 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:50.811384 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 109015us
I20260811 16:04:50.825778 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:50.830651 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.645s (SENT)
I20260811 16:04:50.833050 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:50.835569 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:04:50.854200 17256 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:50.854859 17256 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:50.856015 17256 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:50.858042 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.870769 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:50.832160 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:50.877751 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.881283 13821 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:50.885322 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:50.886598 14581 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:50.883484 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:50.890164 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 105602us
I20260811 16:04:50.828964 16873 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:50.897145 13817 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:50.923691 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:50.925350 13901 raft_consensus.cc:595] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:50.875347 17287 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:50.876737 16852 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:50.781291 17291 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:50.932825 13821 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:50.938849 14581 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260811 16:04:50.858700 17231 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260811 16:04:50.942939 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173761us
I20260811 16:04:50.940973 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:50.944598 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:50.947461 14578 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:50.923422 16873 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:50.955194 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:50.943449 14581 pending_rounds.cc:76] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 6
I20260811 16:04:50.958002 14581 pending_rounds.cc:97] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260811 16:04:50.953303 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:50.958752 13827 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:50.887601 17157 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260811 16:04:50.928853 17158 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:50.959475 14581 raft_consensus.cc:2866] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:04:51.002110 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 182714us
I20260811 16:04:51.003082 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:50.882230 17232 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:50.967212 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109284us
I20260811 16:04:50.967558 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:50.975695 17348 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:50.975410 17230 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:50.976454 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:50.939836 16852 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:50.932001 17287 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:51.018463 13901 raft_consensus.cc:595] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:51.026032 13901 raft_consensus.cc:603] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:50.834888 17036 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:50.887557 17294 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:50.898813 17256 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:51.012256 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:51.022410 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 295707us
I20260811 16:04:50.897816 17234 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
I20260811 16:04:50.989843 17158 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:51.018117 17074 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:51.007241 17238 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:51.043447 17158 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.041043 17294 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.052014 17234 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:51.025409 16852 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.055758 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:04:51.018507 17346 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:51.032859 17036 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.042802 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:51.062840 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.760s (SENT)
I20260811 16:04:51.012344 17232 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.080096 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:51.058246 17173 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:51.063385 17074 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:51.061887 17238 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:04:51.100889 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 139260us
W20260811 16:04:51.105302 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49578.4us
I20260811 16:04:51.077968 17230 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.110050 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:51.083981 17232 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.018826 16873 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.082641 17333 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:51.112407 13901 raft_consensus.cc:595] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:51.112881 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:51.117415 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53789.9us
I20260811 16:04:51.081121 17350 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:51.103021 17074 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:51.097818 17173 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:51.114447 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 71732.1us
I20260811 16:04:51.133736 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:51.135259 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 108663us
I20260811 16:04:51.139370 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:51.140468 13817 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:51.146648 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.150767 13905 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:51.151623 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:51.082835 17288 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:51.159921 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.160671 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.155747 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:04:51.168236 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:51.136036 17173 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.212143 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.212949 13905 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
W20260811 16:04:51.223733 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 70129.5us
I20260811 16:04:51.137180 17350 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.157828 17291 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:51.227640 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:51.231329 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 97673.9us
I20260811 16:04:51.228811 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:04:51.153120 17355 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:51.239897 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:51.245313 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 96736.4us
I20260811 16:04:51.221721 16873 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:51.115214 17287 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.131845 17238 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.217226 17288 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:51.252890 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90200.2us
I20260811 16:04:51.253036 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:51.253988 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.254709 13901 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.227089 17362 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:51.236083 17350 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.261152 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:51.264870 13905 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:51.239728 17355 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:51.281101 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 135552us
I20260811 16:04:51.284190 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:51.282335 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 73741.3us
I20260811 16:04:51.286412 13908 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:04:51.253731 16875 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:51.289469 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.610s (SENT)
I20260811 16:04:51.289505 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:51.252573 17347 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260811 16:04:51.293248 17341 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260811 16:04:51.293987 17239 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260811 16:04:51.256616 17362 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.307752 14583 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:51.312201 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.294996 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:51.321241 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.282316 17355 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:51.256232 17291 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260811 16:04:51.317740 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:51.330005 13905 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:51.325795 13908 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:51.274103 17288 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:51.336643 13900 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:51.337881 17163 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:04:51.309209 16875 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.356928 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:51.358417 13908 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:51.313477 17351 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:51.319931 17362 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.356978 16875 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.358299 17074 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.339618 17287 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.371584 13906 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:04:51.372646 17294 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:51.374544 17132 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:04:51.357585 17330 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260811 16:04:51.381846 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 357452us
W20260811 16:04:51.385113 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134864us
I20260811 16:04:51.319723 17239 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:51.378719 17337 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260811 16:04:51.394114 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.397490 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.400676 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.366115 17351 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:51.406893 13905 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:51.408612 13907 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:51.333701 17095 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.425913 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.392786 17346 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:51.449177 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.453140 13906 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:51.453461 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:51.454380 13908 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7. Re-sending same reply.
I20260811 16:04:51.402324 17294 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:51.462224 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.462435 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.462826 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.457147 13827 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:51.381347 17231 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260811 16:04:51.467799 13739 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260811 16:04:51.431663 16793 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.006s
W20260811 16:04:51.431945 16893 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.002s
I20260811 16:04:51.471411 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:51.444439 17343 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260811 16:04:51.418149 17351 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:51.487270 13821 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: [8.2-8.2]
I20260811 16:04:51.489689 13822 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:51.459795 17346 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:51.474913 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:51.507473 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 212570us
W20260811 16:04:51.518079 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 228660us
I20260811 16:04:51.476027 17367 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:51.523569 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 117577us
I20260811 16:04:51.479053 16998 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:51.479288 16793 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:51.519655 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.527556 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.529951 13744 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:51.530992 13736 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:51.479422 17360 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.538254 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.520025 17294 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:51.540560 13736 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:51.460732 17370 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260811 16:04:51.545109 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 879) took 1117 ms. Trace:
I20260811 16:04:51.546938 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.545409 14582 rpcz_store.cc:276] 0811 16:04:50.427910 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.431590 (+  3680us) service_pool.cc:227] Handling call
0811 16:04:50.431975 (+   385us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.432257 (+   282us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.432285 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:50.432760 (+   475us) log.cc:842] Serialized 26 byte log entry
0811 16:04:50.731186 (+298426us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:50.731241 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.731315 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:51.544917 (+813602us) raft_consensus.cc:1671] finished
0811 16:04:51.544937 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:51.545061 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":286534,"threads_started":1,"wal-append.queue_time_us":475309}
I20260811 16:04:51.553587 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:51.554128 14581 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:51.544327 17340 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260811 16:04:51.558972 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.495939 17374 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260811 16:04:51.556255 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:51.557307 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.569587 13738 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.569779 14579 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:51.535790 16893 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260811 16:04:51.557809 17349 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260811 16:04:51.563548 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.555945 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.551369 17370 consensus_queue.cc:1225] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260811 16:04:51.571962 17345 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
I20260811 16:04:51.562003 17359 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
W20260811 16:04:51.582170 17256 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
W20260811 16:04:51.582237 17352 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260811 16:04:51.588538 17238 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:04:51.574144 17364 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260811 16:04:51.667184 17239 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:51.667719 17333 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:51.668308 17333 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.670585 17333 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:51.671238 17328 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:51.672220 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1523) took 1021 ms. Trace:
I20260811 16:04:51.671952 17328 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.673555 13736 raft_consensus.cc:2396] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:04:51.672734 13824 rpcz_store.cc:276] 0811 16:04:50.650349 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.663272 (+ 12923us) service_pool.cc:227] Handling call
0811 16:04:50.664096 (+   824us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.706182 (+ 42086us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.706233 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:50.841071 (+134838us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:50.842528 (+  1457us) log.cc:842] Serialized 564 byte log entry
0811 16:04:51.071717 (+229189us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:51.071754 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:51.094652 (+ 22898us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:51.094729 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:51.671946 (+577217us) raft_consensus.cc:1671] finished
0811 16:04:51.671973 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:51.672128 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":80226432,"thread_start_us":228656,"threads_started":1,"wal-append.queue_time_us":276156}
I20260811 16:04:51.674191 17328 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:51.593943 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.675432 17383 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:51.675901 17383 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:51.676278 17383 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:51.591406 17380 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:51.671376 17385 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:51.591593 17294 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.676070 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:51.685693 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 144034us
I20260811 16:04:51.544481 16998 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.558192 17085 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:51.666940 17338 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.557s	user 0.003s	sys 0.001s
I20260811 16:04:51.691385 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:51.548405 17367 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.539341 17360 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:51.691910 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:51.691385 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:51.693956 13736 raft_consensus.cc:2396] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260811 16:04:51.697476 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 171294us
I20260811 16:04:51.679329 17380 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:51.684645 17095 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:51.688992 17340 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260811 16:04:51.704185 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:51.569989 17157 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
W20260811 16:04:51.687892 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 124406us
I20260811 16:04:51.707646 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:51.688724 17074 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:51.713294 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.718568 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:51.722187 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:51.725222 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.723891 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:51.695900 14581 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:51.726827 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.731568 17239 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:51.733088 17239 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.735410 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:51.679100 17355 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:51.737066 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:51.740228 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:51.742334 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:51.753741 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:51.708101 17380 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.696724 17359 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260811 16:04:51.779011 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50366.5us
W20260811 16:04:51.796078 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65442.1us
I20260811 16:04:51.720201 17384 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:51.832119 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:51.696656 17373 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:51.755518 17376 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260811 16:04:51.735960 17348 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:04:51.743626 16852 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.008s
I20260811 16:04:51.693933 17085 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.735123 17381 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:51.840592 14574 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:04:51.844859 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 116738us
I20260811 16:04:51.845033 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:51.722666 17095 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.111s
W20260811 16:04:51.833151 17340 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260811 16:04:51.861032 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1522) took 1207 ms. Trace:
W20260811 16:04:51.862632 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 132095us
I20260811 16:04:51.680126 17385 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:51.838559 17232 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.001s
I20260811 16:04:51.708619 17346 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:51.871665 13901 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.613s	user 0.015s	sys 0.006s
I20260811 16:04:51.876061 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.884948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:51.878916 13826 rpcz_store.cc:276] 0811 16:04:50.646264 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.646578 (+   314us) service_pool.cc:227] Handling call
0811 16:04:50.661673 (+ 15095us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:50.662274 (+   601us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.662314 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:50.663042 (+   728us) log.cc:842] Serialized 52 byte log entry
0811 16:04:51.071370 (+408328us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:51.071417 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:51.071495 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:51.853028 (+781533us) raft_consensus.cc:1671] finished
0811 16:04:51.853055 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:51.853208 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2478,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":330178,"threads_started":1,"wal-append.queue_time_us":417523}
W20260811 16:04:51.883662 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.022s	sys 0.038s
I20260811 16:04:51.888756 13818 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:51.891026 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.023s	sys 0.038s
I20260811 16:04:51.861783 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:51.891925 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 590251us
I20260811 16:04:51.830710 17384 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:51.893713 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.859314 17359 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:51.891678 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:51.902148 13744 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260811 16:04:51.907828 17379 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260811 16:04:51.908175 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.852349 17373 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.909312 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:51.868117 16852 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.951234 13818 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260811 16:04:51.952340 13900 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.615s	user 0.015s	sys 0.008s
I20260811 16:04:51.908068 17382 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:51.910657 17377 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260811 16:04:51.953426 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 91748.4us
I20260811 16:04:51.971385 13817 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:51.971920 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.972129 17234 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.972699 17234 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.974665 17234 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:51.975658 17234 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:51.975785 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:51.976202 17234 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:51.955128 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:51.956568 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.960618 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:51.960707 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65588.7us
I20260811 16:04:51.960553 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
W20260811 16:04:51.966408 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73792.7us
I20260811 16:04:51.967272 13824 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:51.967535 17400 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:51.968201 17406 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:51.968969 16852 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:51.969568 17367 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:51.976951 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:51.907934 17392 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:51.954258 17173 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260811 16:04:51.975032 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:51.955055 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 231311us
I20260811 16:04:51.979619 14579 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:04:51.999830 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.979254 13738 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:52.000453 13905 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:51.899464 17384 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:51.964208 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.986315 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.961709 17333 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:51.971421 17377 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:51.987198 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:51.995886 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.895211 17232 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:52.008560 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 161979us
I20260811 16:04:51.991493 13744 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:52.002099 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:52.005177 13901 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:52.007237 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:51.990190 16998 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.010480 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:52.015564 17230 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.895s	user 0.011s	sys 0.002s
I20260811 16:04:52.013082 17377 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:52.061558 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 43992.3us
I20260811 16:04:52.065578 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.015841 16852 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:52.066572 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64555.5us
W20260811 16:04:52.074142 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63739.3us
I20260811 16:04:51.983790 17382 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.076512 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.003016 17173 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.059963 17333 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:52.023590 17360 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.089255 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:52.073654 17036 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.976s	user 0.006s	sys 0.008s
I20260811 16:04:52.086359 17230 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:52.092556 13738 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:52.061234 16893 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:04:52.080353 13904 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:52.067571 17355 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:52.094964 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.075891 17370 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.067358 17239 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:52.111320 17393 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260811 16:04:52.106091 17385 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.101548 17388 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:52.102932 17371 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.112499 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.108017 17402 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260811 16:04:52.110811 17386 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260811 16:04:52.107256 17401 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260811 16:04:52.110144 17398 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260811 16:04:52.109400 17390 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260811 16:04:52.122259 13826 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:52.002173 17392 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:52.132405 16873 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260811 16:04:52.101917 17368 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.195s
W20260811 16:04:52.133188 17288 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.007s
I20260811 16:04:52.133461 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.133709 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.134436 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.121421 17085 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:52.135244 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:52.136071 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:52.137393 17309 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.312s	user 0.014s	sys 0.001s
I20260811 16:04:52.183509 14575 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:04:52.169811 13744 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:04:52.138397 17158 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.059s	user 0.004s	sys 0.014s
I20260811 16:04:52.138752 17173 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.139556 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.140475 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2197) took 1008 ms. Trace:
W20260811 16:04:52.141013 17351 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
W20260811 16:04:52.142326 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76863.8us
I20260811 16:04:52.087949 17238 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260811 16:04:52.143399 17346 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:52.143704 17383 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.148970 13739 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:52.150341 13738 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:52.152654 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:52.154799 17396 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260811 16:04:52.239101 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:52.154330 17371 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.095554 13707 leader_election.cc:398] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:04:52.240491 13707 leader_election.cc:401] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:04:52.132707 17234 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.112270 17373 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:52.172189 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 189679us
I20260811 16:04:52.150018 17333 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:52.172331 13904 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:52.172926 13906 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:52.199122 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.218259 13907 rpcz_store.cc:276] 0811 16:04:51.131936 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.137539 (+  5603us) service_pool.cc:227] Handling call
0811 16:04:52.140266 (+1002727us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:52.140413 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":452344064}
I20260811 16:04:52.216990 13902 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:52.182436 13909 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7. Re-sending same reply.
I20260811 16:04:52.097815 17036 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.224853 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.149045 16849 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260811 16:04:52.225538 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:52.252806 13905 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:04:52.147570 17328 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260811 16:04:52.200806 17157 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.227850 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 880) took 1799 ms. Trace:
I20260811 16:04:52.158349 17239 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260811 16:04:52.231369 17399 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260811 16:04:52.231750 17422 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
W20260811 16:04:52.232059 17344 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.042s	user 0.004s	sys 0.002s
I20260811 16:04:52.198500 17288 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.231768 17289 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:52.160136 17401 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260811 16:04:52.246332 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 92351.6us
I20260811 16:04:52.152722 17370 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.282363 14579 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
W20260811 16:04:52.281500 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 204823us
I20260811 16:04:52.324692 14582 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:04:52.326884 17328 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:04:52.327728 17328 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:52.328862 17335 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.219s	user 0.000s	sys 0.004s
I20260811 16:04:52.329144 17328 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.2, Last appended by leader: 2, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.295630 17346 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:04:52.242285 17362 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.011s
I20260811 16:04:52.283733 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:52.281044 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 211164us
I20260811 16:04:52.295042 13823 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260811 16:04:52.296797 17406 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:52.287076 14573 rpcz_store.cc:276] 0811 16:04:50.428241 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.433345 (+  5104us) service_pool.cc:227] Handling call
0811 16:04:50.493177 (+ 59832us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.537901 (+ 44724us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.537935 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:50.538441 (+   506us) log.cc:842] Serialized 26 byte log entry
0811 16:04:50.797402 (+258961us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:50.797430 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.797483 (+    53us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:51.666159 (+868676us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:51.847492 (+181333us) raft_consensus.cc:1671] finished
0811 16:04:51.847525 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:52.227657 (+380132us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b540063e2d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:52.227786 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18567,"raft.queue_time_us":19065,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":149914752,"thread_start_us":258559,"threads_started":1,"wal-append.queue_time_us":440051}
I20260811 16:04:52.219293 17351 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:52.286672 17287 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.895s	user 0.012s	sys 0.018s
I20260811 16:04:52.284963 17348 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:52.313160 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:52.282951 17402 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:04:52.226356 17158 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:52.337270 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 242254us
I20260811 16:04:52.326951 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:52.339182 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:52.373368 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 590) took 2038 ms. Trace:
I20260811 16:04:52.305908 17422 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:52.378497 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160346us
I20260811 16:04:52.385538 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:52.329378 13686 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet 801054abfed346a09c04b7cd13d7c62f
I20260811 16:04:52.386261 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.384012 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:52.382825 13735 rpcz_store.cc:276] 0811 16:04:50.334462 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.339821 (+  5359us) service_pool.cc:227] Handling call
0811 16:04:50.347336 (+  7515us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.376827 (+ 29491us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.376861 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:50.377394 (+   533us) log.cc:842] Serialized 26 byte log entry
0811 16:04:50.737200 (+359806us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:04:50.737306 (+   106us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:50.737403 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:52.164395 (+1426992us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:52.330867 (+166472us) raft_consensus.cc:1671] finished
0811 16:04:52.330898 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:52.373280 (+ 42382us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29002,"raft.queue_time_us":32095,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":9324288,"thread_start_us":359282,"threads_started":1,"wal-append.queue_time_us":583273}
W20260811 16:04:52.388202 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47325us
I20260811 16:04:52.335671 16998 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.317242 17289 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:52.392704 13741 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:52.384562 13742 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:52.335031 17238 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:52.297474 17157 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.399636 13740 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:52.379501 17376 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260811 16:04:52.322535 17414 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260811 16:04:52.381209 17347 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.338642 17346 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:52.387244 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68021.4us
W20260811 16:04:52.391499 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86334.9us
I20260811 16:04:52.385210 17328 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:04:52.386226 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet 801054abfed346a09c04b7cd13d7c62f
I20260811 16:04:52.428611 14583 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:04:52.437542 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51387.3us
I20260811 16:04:52.441936 13735 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:52.302799 17232 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.445432 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.400806 17287 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:04:52.432896 17380 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
I20260811 16:04:52.399416 17348 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:52.374586 17362 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.479693 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.489312 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.475320 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:52.485092 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.489364 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:52.508924 13818 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:52.507244 13907 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:52.482120 13826 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260811 16:04:52.511099 13901 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:52.475742 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.484922 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:52.512447 13817 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:52.513648 13904 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:04:52.452600 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.453925 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:52.517623 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:04:52.518674 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:52.530686 13822 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:52.489243 17085 raft_consensus.cc:979] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:52.443174 17346 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:52.534678 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:52.538590 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:52.539251 16875 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.141s	user 0.016s	sys 0.007s
I20260811 16:04:52.508931 17380 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.542482 13821 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:52.539682 16875 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.428396 17419 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260811 16:04:52.432444 17238 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:52.568434 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 115909us
I20260811 16:04:52.565006 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:52.451337 17347 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.426704 16998 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.548727 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.489689 17392 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.571358 13906 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:04:52.572250 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:52.473150 17400 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
W20260811 16:04:52.567286 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 289307us
I20260811 16:04:52.536330 17414 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.445863 17382 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:52.394938 17333 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.514325 17287 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:52.603467 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:52.604095 13742 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:52.609073 13740 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260811 16:04:52.600529 13737 pending_rounds.cc:76] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 3
I20260811 16:04:52.613097 13737 pending_rounds.cc:97] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260811 16:04:52.613374 13737 raft_consensus.cc:2866] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:52.547683 17036 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.618239 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.586289 17085 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.584441 17419 consensus_queue.cc:1225] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:04:52.627780 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:52.614480 17359 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.001s
I20260811 16:04:52.601300 17400 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:52.615558 17287 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:52.635589 17438 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:52.636329 17436 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260811 16:04:52.637037 17353 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:52.637727 17430 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:52.638790 17415 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260811 16:04:52.527907 17406 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.602708 17371 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.602464 17383 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.616503 17234 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:52.712880 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:52.584062 16849 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260811 16:04:52.722675 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104529us
I20260811 16:04:52.710098 17382 raft_consensus.cc:1067] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:52.728960 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:52.740483 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 295097us
I20260811 16:04:52.636348 17362 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.516716 17289 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.489634 17422 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.717051 17359 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:52.727591 16873 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:52.721462 17232 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:52.772053 13787 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.932s (SENT)
I20260811 16:04:52.599448 17414 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.633796 17381 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260811 16:04:52.644140 17085 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.784873 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:52.916353 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 144354us
I20260811 16:04:52.838845 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:52.918411 13787 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 2.229s (SENT)
W20260811 16:04:52.800426 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 320774us
W20260811 16:04:52.919667 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173205us
I20260811 16:04:52.734081 17401 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260811 16:04:52.919298 13735 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:52.927350 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:52.928128 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2280) took 1207 ms. Trace:
I20260811 16:04:52.735057 17158 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.784281 17430 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
W20260811 16:04:52.918022 17338 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260811 16:04:52.928628 13824 rpcz_store.cc:276] 0811 16:04:51.720296 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.987796 (+267500us) service_pool.cc:227] Handling call
0811 16:04:52.004683 (+ 16887us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.015078 (+ 10395us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:04:52.015110 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:52.015591 (+   481us) log.cc:842] Serialized 26 byte log entry
0811 16:04:52.207808 (+192217us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:52.207863 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:52.207958 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:52.927890 (+719932us) raft_consensus.cc:1671] finished
0811 16:04:52.927920 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:52.928067 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":599,"raft.queue_time_us":142448,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"thread_start_us":187436,"threads_started":1,"wal-append.queue_time_us":267381}
I20260811 16:04:52.741914 17036 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.834921 17380 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.942663 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:52.921711 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 181501us
I20260811 16:04:52.907887 17234 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:52.643402 17348 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.784313 17370 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.956995 13735 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:52.941347 17430 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:52.911847 17353 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:52.961386 16998 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.015753 17353 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.018556 17353 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.959378 17036 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:52.927631 17239 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260811 16:04:52.978597 17388 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:52.981319 17363 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.458s	user 0.005s	sys 0.000s
I20260811 16:04:52.958211 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1663) took 1233 ms. Trace:
I20260811 16:04:52.926556 16873 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:52.998545 17435 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.004632 17085 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:52.957713 17432 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:52.922820 17232 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:53.006254 17447 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:04:53.007488 17457 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election won for term 7
W20260811 16:04:53.008379 17377 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.935s	user 0.013s	sys 0.000s
I20260811 16:04:52.962071 16875 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.976114 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.988420 17414 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.961036 17238 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:52.934188 17400 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:52.977427 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:52.985308 17378 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.029980 13736 rpcz_store.cc:276] 0811 16:04:51.724465 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.784475 (+ 60010us) service_pool.cc:227] Handling call
0811 16:04:51.784870 (+   395us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:51.959953 (+175083us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:51.959984 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:51.960412 (+   428us) log.cc:842] Serialized 26 byte log entry
0811 16:04:52.024312 (+ 63900us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:52.024353 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:52.957628 (+933275us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:52.957711 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:52.957798 (+    87us) raft_consensus.cc:1671] finished
0811 16:04:52.957819 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:52.958128 (+   309us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":19434,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"spinlock_wait_cycles":392094976,"thread_start_us":27923,"threads_started":1,"wal-append.queue_time_us":233342}
I20260811 16:04:52.740060 17438 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.038599 13735 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:53.040292 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 601) took 2107 ms. Trace:
W20260811 16:04:53.038776 17384 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.023s	user 0.011s	sys 0.002s
I20260811 16:04:53.094453 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:53.094944 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 117612us
W20260811 16:04:53.051867 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75850.5us
I20260811 16:04:52.986160 17454 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:53.038451 16873 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:53.087297 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:53.105538 13736 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:52.991783 17350 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.732s	user 0.015s	sys 0.008s
I20260811 16:04:53.091751 13740 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:53.092672 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:53.029632 17388 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:53.095755 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.103881 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 788) took 1397 ms. Trace:
I20260811 16:04:53.173723 14574 rpcz_store.cc:276] 0811 16:04:51.698688 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.698872 (+   184us) service_pool.cc:227] Handling call
0811 16:04:53.095798 (+1396926us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540057fdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:53.095978 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":291864448}
I20260811 16:04:53.092062 13743 rpcz_store.cc:276] 0811 16:04:50.932920 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.935107 (+  2187us) service_pool.cc:227] Handling call
0811 16:04:50.945271 (+ 10164us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:50.945474 (+   203us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:51.156672 (+211198us) log.cc:842] Serialized 14 byte log entry
0811 16:04:53.039871 (+1883199us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b1800059260. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:04:53.039965 (+    94us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:53.040011 (+    46us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:53.040054 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.040115 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:53.040234 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":302152,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3605,"raft.queue_time_us":227185,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":15168,"spinlock_wait_cycles":40177920,"thread_start_us":446588,"threads_started":2}
I20260811 16:04:53.174609 13735 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260811 16:04:53.090270 17353 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:52.988032 17234 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:53.188654 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 247705us
I20260811 16:04:53.190101 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:53.101691 16875 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:53.101342 17457 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:53.102649 17432 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:04:53.191462 13739 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.007s	sys 0.016s
W20260811 16:04:53.198256 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 102582us
W20260811 16:04:53.248006 13739 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.008s	sys 0.017s
I20260811 16:04:53.248771 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1665) took 1011 ms. Trace:
I20260811 16:04:53.248066 17432 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.085415 17346 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.015947 17430 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:53.249109 13739 rpcz_store.cc:276] 0811 16:04:52.237762 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.244758 (+  6996us) service_pool.cc:227] Handling call
0811 16:04:52.250210 (+  5452us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:52.250449 (+   239us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:04:52.336945 (+ 86496us) log.cc:842] Serialized 14 byte log entry
0811 16:04:53.248429 (+911484us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:53.248484 (+    55us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:04:53.248533 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.248596 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:53.248712 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59186,"prepare.queue_time_us":221792,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3119,"raft.queue_time_us":77608,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13290,"spinlock_wait_cycles":50879744,"thread_start_us":875948,"threads_started":3,"wal-append.queue_time_us":382244}
I20260811 16:04:53.250444 14577 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:53.251461 17432 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.253222 17346 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:53.209821 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1532) took 2269 ms. Trace:
I20260811 16:04:53.109434 17449 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:53.198061 17380 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260811 16:04:53.109138 17453 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:53.095633 17378 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.258136 17457 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.191300 17455 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260811 16:04:53.254920 13820 rpcz_store.cc:276] 0811 16:04:50.940656 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.940808 (+   152us) service_pool.cc:227] Handling call
0811 16:04:50.954248 (+ 13440us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:50.964314 (+ 10066us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:50.964348 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:51.007092 (+ 42744us) log.cc:842] Serialized 26 byte log entry
0811 16:04:51.225741 (+218649us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:51.225804 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:51.225911 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:52.980528 (+1754617us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:53.195850 (+215322us) raft_consensus.cc:1671] finished
0811 16:04:53.195879 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:53.209706 (+ 13827us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8110464,"thread_start_us":152741,"threads_started":1,"wal-append.queue_time_us":402816}
I20260811 16:04:53.076382 17377 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.269371 17377 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.197795 17256 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:53.282114 13743 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:53.255158 17449 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.194636 17353 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:53.296200 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.019s	sys 0.011s
W20260811 16:04:53.298666 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.019s	sys 0.011s
I20260811 16:04:53.042776 17435 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.305863 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:53.302073 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.010s	sys 0.020s
W20260811 16:04:53.309963 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.010s	sys 0.020s
W20260811 16:04:53.310458 13904 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.007s	sys 0.024s
W20260811 16:04:53.311316 13904 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.024s
I20260811 16:04:53.309100 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.309612 14574 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
W20260811 16:04:53.305598 13737 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.020s
W20260811 16:04:53.326179 13737 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.011s	sys 0.020s
I20260811 16:04:53.103610 17384 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.173033 17350 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:53.336879 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.296357 17447 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:53.301994 17383 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:53.338111 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.348104 13744 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:53.347007 14574 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:53.332309 17378 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.356976 13817 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:53.331852 17377 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.358093 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:53.363801 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 343326us
I20260811 16:04:53.363858 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.366649 13908 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:53.367729 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:53.346423 17447 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:53.370992 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:04:53.372143 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 918267us
I20260811 16:04:53.374176 13736 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:04:53.371243 13742 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.001s
I20260811 16:04:53.376121 13742 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:53.350661 17232 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:53.413028 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 214763us
I20260811 16:04:53.413326 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.355398 17036 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:53.432401 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 183240us
I20260811 16:04:53.443758 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.444226 13909 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8. Re-sending same reply.
W20260811 16:04:53.372926 17328 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.000s
I20260811 16:04:53.337656 17346 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260811 16:04:53.381315 17447 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:53.460096 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.415294 17378 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.464394 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.465725 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.464977 13907 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 9 because replica has last-logged OpId of term: 8 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:53.465996 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.466923 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.356484 17383 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.476145 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.473946 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.479573 13909 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:53.480983 14582 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:53.490767 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:53.372596 17377 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.496655 14582 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:53.498428 14582 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:53.500209 14580 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:53.505113 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.506003 13901 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:53.509052 14574 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260811 16:04:53.510244 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47843.1us
W20260811 16:04:53.535971 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 78146us
W20260811 16:04:53.538440 17287 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.798s	user 0.012s	sys 0.000s
I20260811 16:04:53.538002 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:53.543774 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.476399 17378 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.513697 17438 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.453313 17353 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.537732 17346 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:53.580631 13612 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62211.5us
I20260811 16:04:53.598654 13742 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:53.580097 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:53.581283 13901 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
W20260811 16:04:53.565330 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 109822us
I20260811 16:04:53.538332 17477 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260811 16:04:53.619724 17477 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:53.625996 13901 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:53.628495 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:53.647097 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:53.647524 13824 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:04:53.647930 13822 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:53.648098 13824 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:04:53.648488 13824 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:53.650761 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.650609 17414 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:53.652194 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.652616 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1901) took 1072 ms. Trace:
I20260811 16:04:53.652993 13740 rpcz_store.cc:276] 0811 16:04:52.580176 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.627427 (+ 47251us) service_pool.cc:227] Handling call
0811 16:04:53.652451 (+1025024us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54002814d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:53.652558 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":809435008}
I20260811 16:04:53.653672 17381 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:53.653805 17157 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:53.654222 17381 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:53.655418 17347 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:53.656155 17234 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:04:53.656610 17234 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:53.657104 17234 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:53.656450 17381 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.659195 17232 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260811 16:04:53.658524 13820 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:53.610553 17438 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260811 16:04:53.660818 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:53.608512 17384 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.612340 17470 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:53.573235 17287 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.667034 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:53.672437 13740 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:53.612663 17350 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:53.628062 17435 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.625257 17475 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:53.611545 17346 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.712113 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:53.663353 17158 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:04:53.720602 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:53.662555 17449 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.712908 13742 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:53.731627 17414 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.732484 17414 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.736649 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:53.738289 17347 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:53.739902 13822 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:53.738801 17347 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:53.741580 17347 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:53.741710 17414 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:53.747766 14578 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
W20260811 16:04:53.764918 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 122965us
I20260811 16:04:53.765897 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:53.674463 17470 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:53.712196 17475 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:53.780942 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:53.785315 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 133195us
I20260811 16:04:53.748176 17333 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.766425 17485 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:53.801348 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:53.775759 17383 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:53.719225 17464 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260811 16:04:53.774832 17484 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.785043 17470 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:53.812129 17460 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260811 16:04:53.811087 17484 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:53.801175 17333 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:53.803566 17466 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260811 16:04:53.809746 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.789281 17475 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:53.818302 17484 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:53.816012 17489 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:53.820029 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1542) took 2313 ms. Trace:
I20260811 16:04:53.825112 13821 rpcz_store.cc:276] 0811 16:04:51.506703 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.506905 (+   202us) service_pool.cc:227] Handling call
0811 16:04:51.525022 (+ 18117us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:52.563560 (+1038538us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.819726 (+1256166us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400125a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:53.819950 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2339541248}
I20260811 16:04:53.825922 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1667) took 1587 ms. Trace:
I20260811 16:04:53.821007 14573 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
W20260811 16:04:53.820688 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 779) took 2419 ms (client timeout 2138 ms). Trace:
I20260811 16:04:53.821269 17333 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:53.827505 14583 rpcz_store.cc:269] 0811 16:04:51.401167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.425655 (+ 24488us) service_pool.cc:227] Handling call
0811 16:04:53.820410 (+2394755us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54005703d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:53.820572 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2303773440}
I20260811 16:04:53.822252 17411 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:04:53.828231 17471 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260811 16:04:53.828541 17411 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:53.822994 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:53.829991 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1993) took 1694 ms (client timeout 1932 ms). Trace:
I20260811 16:04:53.829475 17411 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:53.830603 13900 rpcz_store.cc:269] 0811 16:04:52.135106 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:53.822660 (+1687554us) service_pool.cc:227] Handling call
0811 16:04:53.829845 (+  7185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:53.831990 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2210) took 1384 ms. Trace:
I20260811 16:04:53.833506 13905 rpcz_store.cc:276] 0811 16:04:52.447478 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.447991 (+   513us) service_pool.cc:227] Handling call
0811 16:04:52.448302 (+   311us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:52.945512 (+497210us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:52.945544 (+    32us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:52.997579 (+ 52035us) log.cc:842] Serialized 52 byte log entry
0811 16:04:53.322758 (+325179us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:53.322822 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.322922 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:53.831709 (+508787us) raft_consensus.cc:1671] finished
0811 16:04:53.831735 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:53.831916 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18872,"raft.queue_time_us":124836,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":15694,"thread_start_us":716395,"threads_started":2,"wal-append.queue_time_us":614034}
I20260811 16:04:53.826371 13737 rpcz_store.cc:276] 0811 16:04:52.238499 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.386352 (+147853us) service_pool.cc:227] Handling call
0811 16:04:52.427175 (+ 40823us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.633044 (+205869us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:52.633091 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:52.643937 (+ 10846us) log.cc:842] Serialized 26 byte log entry
0811 16:04:53.326631 (+682694us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:53.326670 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.825444 (+498774us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000a8cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:53.825496 (+    52us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:53.825546 (+    50us) raft_consensus.cc:1671] finished
0811 16:04:53.825562 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:53.825851 (+   289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":398053760,"thread_start_us":558998,"threads_started":1,"wal-append.queue_time_us":746709}
W20260811 16:04:53.806214 17467 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
I20260811 16:04:53.799854 17485 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:53.847893 13905 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:53.847980 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:53.850711 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:53.855798 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:53.851028 13824 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:53.831000 17411 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:53.802620 17377 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:53.864704 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 202251us
I20260811 16:04:53.866693 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.868016 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:53.867852 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:53.845233 17158 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:53.881310 13908 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
I20260811 16:04:53.871773 13827 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:04:53.840231 17487 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:53.883093 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:53.883425 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.883425 17158 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.886147 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:53.891402 14581 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:53.930146 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:53.898631 17485 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:53.863996 17414 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
W20260811 16:04:53.903509 17441 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.069s	user 0.000s	sys 0.004s
I20260811 16:04:53.903851 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 900) took 1279 ms. Trace:
W20260811 16:04:53.904570 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53938.9us
I20260811 16:04:53.881835 13908 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
W20260811 16:04:53.897630 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 87965.2us
I20260811 16:04:53.930176 13900 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:04:53.937851 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.932186 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:53.900115 17074 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:53.857708 17378 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:53.930433 13824 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:53.937880 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.935566 14578 rpcz_store.cc:276] 0811 16:04:52.624751 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.624972 (+   221us) service_pool.cc:227] Handling call
0811 16:04:52.625398 (+   426us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:53.748273 (+1122875us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.903568 (+155295us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540052b7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:53.903775 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2580751744}
I20260811 16:04:53.949085 13742 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:04:53.945609 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:53.872764 17346 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:53.954447 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.934482 17163 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:53.959403 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:53.929693 16793 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:53.960789 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:53.961273 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:53.868501 17157 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260811 16:04:53.962419 13905 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:53.964697 13900 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:53.965713 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.967664 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:53.960196 17163 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:53.953984 17414 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:53.973578 17494 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:53.975891 17085 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:53.978658 17477 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:53.964432 16793 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.980275 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:53.981129 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2216) took 1531 ms (client timeout 1992 ms). Trace:
I20260811 16:04:53.981335 16793 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:53.981479 13903 rpcz_store.cc:269] 0811 16:04:52.449233 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.449676 (+   443us) service_pool.cc:227] Handling call
0811 16:04:53.980146 (+1530470us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:04:53.981066 (+   920us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2933888}
I20260811 16:04:53.982823 17428 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:53.956827 17287 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:53.929860 17347 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:53.961347 17485 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:53.999197 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:53.999953 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.001487 16793 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:54.002305 17470 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.003216 17347 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:53.999191 13709 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.551s (SENT)
W20260811 16:04:54.001384 16873 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.000s
I20260811 16:04:54.007576 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:53.973168 17406 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:53.974541 17163 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:54.013602 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:53.971913 17499 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:04:54.016829 13909 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260811 16:04:54.017329 13909 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:53.967322 17383 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260811 16:04:54.006898 17328 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:54.029281 13824 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:53.968370 17498 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260811 16:04:54.009300 17406 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:54.033183 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:54.033944 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:54.034176 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:54.037151 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.038488 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:54.034740 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:54.040094 17287 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:54.040582 17477 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:04:54.040705 17287 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:54.040717 17498 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:54.041553 17498 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:54.041826 17287 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.043798 17414 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.044307 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:54.044817 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:54.042380 17498 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.046397 17498 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:54.039083 13905 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:54.038053 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:04:54.030335 17388 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.003s
I20260811 16:04:54.029134 17382 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:04:54.075659 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.075906 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.076742 14574 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:54.034890 16793 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:54.036368 17328 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:54.098170 16793 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:04:54.098675 16793 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:54.099018 16793 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:04:54.099093 17470 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:54.099910 17470 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:54.012940 16873 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.080590 17394 raft_consensus.cc:979] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:54.081372 13909 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:54.105165 14583 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:54.083436 17288 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:54.107031 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:54.107120 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.108825 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:54.036010 17499 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.079820 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:54.111747 13742 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:54.094327 13736 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260811 16:04:54.064153 17477 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:54.104974 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.019218 17494 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
I20260811 16:04:54.074225 17388 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.116895 14578 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:04:54.087587 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:54.091513 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.117686 14577 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:54.117630 13740 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:54.022367 17475 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.116127 13739 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:54.120069 17475 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:54.120648 16873 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:54.035787 17353 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.070s
I20260811 16:04:54.104713 17428 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260811 16:04:54.117143 17447 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.006s
I20260811 16:04:54.122210 17428 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:54.122104 17447 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.122632 17428 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:54.108232 17158 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:54.123633 17428 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.124393 17447 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:54.124902 17428 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:54.125379 13742 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:54.126492 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:54.127619 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:54.128110 17509 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260811 16:04:54.128304 13736 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:54.129640 13736 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260811 16:04:54.129400 17499 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.121356 17353 consensus_queue.cc:1225] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:04:54.131975 17499 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:54.132601 17394 raft_consensus.cc:1067] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:54.077669 17382 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:54.135011 17481 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:54.136536 17382 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:04:54.137463 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 144203us
I20260811 16:04:54.131006 13736 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:04:54.117040 14580 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:04:54.141400 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:54.152843 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 893) took 2165 ms. Trace:
I20260811 16:04:54.152971 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.153750 14580 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:54.153434 14581 rpcz_store.cc:276] 0811 16:04:51.985399 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.986749 (+  1350us) service_pool.cc:227] Handling call
0811 16:04:51.995985 (+  9236us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:53.930496 (+1934511us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.150790 (+220294us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400526054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.151020 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4358629248}
I20260811 16:04:54.074132 17234 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.142218 17288 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260811 16:04:54.171782 17234 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:54.171945 17163 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.182690 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:54.189452 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:54.192389 13709 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.754s (SENT)
I20260811 16:04:54.195329 13908 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:54.199705 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:54.212652 17291 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.057s	user 0.002s	sys 0.013s
W20260811 16:04:54.213312 17291 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.058s	user 0.002s	sys 0.013s
I20260811 16:04:54.155742 17406 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.243151 17074 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:54.243208 17158 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:54.244095 17158 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.246124 17158 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:54.250630 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:54.224030 17447 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:54.265506 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:54.266431 14580 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:54.269809 13737 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:54.250113 17388 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:54.284412 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 829) took 3549 ms (client timeout 2374 ms). Trace:
I20260811 16:04:54.285007 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 894) took 2221 ms. Trace:
W20260811 16:04:54.284842 14575 rpcz_store.cc:269] 0811 16:04:50.734646 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:50.817761 (+ 83115us) service_pool.cc:227] Handling call
0811 16:04:54.284215 (+3466454us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:54.284338 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3000866048}
I20260811 16:04:54.285449 14579 rpcz_store.cc:276] 0811 16:04:52.063816 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.064104 (+   288us) service_pool.cc:227] Handling call
0811 16:04:52.081397 (+ 17293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:52.323432 (+242035us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.284759 (+1961327us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.284950 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":461464320}
I20260811 16:04:54.287370 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1539) took 2819 ms. Trace:
I20260811 16:04:54.287845 13823 rpcz_store.cc:276] 0811 16:04:51.468230 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.468335 (+   105us) service_pool.cc:227] Handling call
0811 16:04:51.488656 (+ 20321us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.337655 (+848999us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.287019 (+1949364us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b540025f654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.287293 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1839257856}
I20260811 16:04:54.294157 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:54.300110 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2217) took 1850 ms (client timeout 1618 ms). Trace:
I20260811 16:04:54.301514 17354 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:54.302268 17354 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:54.300203 17163 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:54.303406 17354 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:54.300834 13907 rpcz_store.cc:269] 0811 16:04:52.449974 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.516415 (+ 66441us) service_pool.cc:227] Handling call
0811 16:04:54.288945 (+1772530us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400322154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:54.299995 (+ 11050us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2115265792}
W20260811 16:04:54.309767 17522 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260811 16:04:54.312005 17437 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:54.312456 17437 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:54.313309 17437 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.314761 17437 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:54.315980 17384 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:54.316466 17384 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:54.317444 17384 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.318779 17384 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:54.322589 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20ad41e4f434442792e36eb47449b101"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:54.323457 13907 raft_consensus.cc:595] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:54.324366 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 609) took 2164 ms. Trace:
I20260811 16:04:54.325168 13744 rpcz_store.cc:276] 0811 16:04:52.159812 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.217277 (+ 57465us) service_pool.cc:227] Handling call
0811 16:04:52.217653 (+   376us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:53.348656 (+1131003us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.323608 (+974952us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002099d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.324253 (+   645us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2599310720}
I20260811 16:04:54.337972 13744 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:54.344470 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1549) took 1830 ms. Trace:
I20260811 16:04:54.345175 13817 rpcz_store.cc:276] 0811 16:04:52.514433 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.514562 (+   129us) service_pool.cc:227] Handling call
0811 16:04:52.514824 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:53.357476 (+842652us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.344086 (+986610us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54002db9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.344370 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1936405376}
W20260811 16:04:54.337953 17095 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.182s	user 0.031s	sys 0.045s
I20260811 16:04:54.350899 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1666) took 2112 ms. Trace:
I20260811 16:04:54.352376 13738 rpcz_store.cc:276] 0811 16:04:52.238136 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.238280 (+   144us) service_pool.cc:227] Handling call
0811 16:04:52.238633 (+   353us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.378105 (+139472us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:52.378134 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:52.381330 (+  3196us) log.cc:842] Serialized 26 byte log entry
0811 16:04:52.585298 (+203968us) raft_consensus.cc:1631] Marking committed up to 1
0811 16:04:52.585336 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.343994 (+1758658us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.344071 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:54.344134 (+    63us) raft_consensus.cc:1671] finished
0811 16:04:54.344151 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:54.350818 (+  6667us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22924,"raft.queue_time_us":414,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12433,"spinlock_wait_cycles":319862656,"thread_start_us":142575,"threads_started":1,"wal-append.queue_time_us":491222,"wal-append.run_cpu_time_us":1872,"wal-append.run_wall_time_us":1057795}
I20260811 16:04:54.349642 17158 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260811 16:04:54.360587 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "930faff3981346c88c8864a1f3b15158"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:54.361613 13907 raft_consensus.cc:595] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:54.362133 13907 raft_consensus.cc:603] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:54.361990 17382 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.282531 17447 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.367050 17447 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:54.377388 17469 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.770s	user 0.002s	sys 0.002s
I20260811 16:04:54.379647 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2212) took 1931 ms. Trace:
I20260811 16:04:54.336789 17464 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260811 16:04:54.380549 17309 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:54.325949 16793 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.381465 17464 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:54.381860 17464 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:54.380043 13902 rpcz_store.cc:276] 0811 16:04:52.448078 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.448177 (+    99us) service_pool.cc:227] Handling call
0811 16:04:52.485543 (+ 37366us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.485846 (+   303us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:52.485896 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:52.486430 (+   534us) log.cc:842] Serialized 26 byte log entry
0811 16:04:53.300997 (+814567us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:53.301055 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.301155 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:54.376903 (+1075748us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:04:54.379277 (+  2374us) raft_consensus.cc:1671] finished
0811 16:04:54.379302 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:54.379577 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46785792,"thread_start_us":732594,"threads_started":1,"wal-append.queue_time_us":962744}
I20260811 16:04:54.388211 17464 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.389720 17464 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:54.391523 17477 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:54.392740 17430 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:54.363065 17470 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:54.356617 17095 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.198s	user 0.031s	sys 0.046s
I20260811 16:04:54.402594 17351 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:54.418287 17422 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:54.407591 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:54.408937 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:54.424486 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:54.424765 17378 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:54.381423 17309 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:54.411397 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:54.429157 17378 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:54.412269 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:54.413060 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:54.414494 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.2169e+06us
I20260811 16:04:54.409152 13900 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:54.426892 14542 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.429389 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:54.611783 13817 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260811 16:04:54.612951 13824 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:04:54.597503 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:54.734073 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:54.481212 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 204266us
I20260811 16:04:54.433238 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1548) took 1924 ms. Trace:
I20260811 16:04:54.718454 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:54.431048 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 987356us
W20260811 16:04:54.792001 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173298us
I20260811 16:04:54.800311 13826 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:54.479853 13902 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:54.803176 13821 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:54.451345 13901 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:54.715540 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 605) took 3292 ms. Trace:
I20260811 16:04:54.798038 13824 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:04:54.803970 13825 rpcz_store.cc:276] 0811 16:04:52.509228 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.509363 (+   135us) service_pool.cc:227] Handling call
0811 16:04:52.509715 (+   352us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.744466 (+234751us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:04:52.777486 (+ 33020us) log.cc:842] Serialized 14 byte log entry
0811 16:04:53.195628 (+418142us) log.cc:842] Serialized 14 byte log entry
0811 16:04:54.413806 (+1218178us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b18000a72c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:04:54.413988 (+   182us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:54.418299 (+  4311us) log.cc:842] Serialized 26 byte log entry
0811 16:04:54.418511 (+   212us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:54.418550 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.418624 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:54.432870 (+ 14246us) raft_consensus.cc:1671] finished
0811 16:04:54.432897 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:54.433153 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1191468,"prepare.queue_time_us":29268,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":109,"raft.queue_time_us":1360503,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":9629,"spinlock_wait_cycles":24493696,"thread_start_us":521738,"threads_started":2,"wal-append.queue_time_us":844262}
I20260811 16:04:54.805445 13741 rpcz_store.cc:276] 0811 16:04:51.423352 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.426765 (+  3413us) service_pool.cc:227] Handling call
0811 16:04:51.448662 (+ 21897us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:52.424353 (+975691us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.715210 (+2290857us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400280fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:54.715457 (+   247us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2054076288}
W20260811 16:04:54.797629 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 370786us
W20260811 16:04:54.535995 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 443843us
I20260811 16:04:54.799566 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:54.599057 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:54.430186 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:54.617132 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:54.806162 13824 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:54.809062 13909 raft_consensus.cc:2362] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5. Re-sending same reply.
I20260811 16:04:54.807632 13820 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:54.811420 14581 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.022s
W20260811 16:04:54.817467 14581 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.022s
I20260811 16:04:54.811528 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:54.809782 13908 raft_consensus.cc:595] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:54.819206 13908 raft_consensus.cc:603] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:54.822204 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:54.796969 13905 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
W20260811 16:04:54.790545 17488 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.958s	user 0.001s	sys 0.002s
I20260811 16:04:54.883328 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:54.883961 14579 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:04:54.453337 17472 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.679s	user 0.002s	sys 0.000s
W20260811 16:04:54.673223 17425 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.221s	user 0.000s	sys 0.009s
I20260811 16:04:54.874976 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:54.875727 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72469.8us
I20260811 16:04:54.502038 17419 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.826627 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:54.915934 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89401.7us
I20260811 16:04:54.916878 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.918161 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:54.578737 17405 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.037s	sys 0.104s
I20260811 16:04:54.878815 17288 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:54.495803 17092 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.418613 16793 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:54.890836 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:54.930908 13825 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:54.891924 13901 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:54.902278 17163 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.436137 17423 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:54.900221 13824 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.800719 13706 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:54.881425 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59360.3us
I20260811 16:04:54.903611 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:54.430267 17453 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:54.787751 17372 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:04:54.920027 17405 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.042s	sys 0.114s
W20260811 16:04:54.943845 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 143253us
I20260811 16:04:54.502758 17351 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.808918 17447 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.820286 17346 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:54.582511 17411 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:54.928046 17288 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:54.716966 17360 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:54.887604 13900 pending_rounds.cc:76] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 5
I20260811 16:04:54.972268 13824 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:54.973619 13900 pending_rounds.cc:97] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260811 16:04:54.974004 13900 raft_consensus.cc:2866] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:54.658704 16849 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.254s
I20260811 16:04:54.892958 17498 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:54.975324 17498 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:54.972431 17351 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.975711 17498 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:54.977346 17351 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:54.950675 17384 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:54.979486 17411 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.982424 17411 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:54.431560 17431 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:54.985133 14579 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:04:54.931346 17380 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:54.692327 17252 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.231s
I20260811 16:04:54.618135 17477 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:54.946655 13820 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:54.945291 13826 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:54.888353 16852 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260811 16:04:54.946169 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.936839 17423 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:54.944734 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:54.430223 17309 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.919992 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.430120 17378 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.924252 17437 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:54.690977 17382 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:54.999321 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54686.1us
I20260811 16:04:55.025782 17384 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260811 16:04:55.007685 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61827.4us
I20260811 16:04:55.005313 13821 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:55.032177 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.033735 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:55.027258 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 107332us
I20260811 16:04:55.036276 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.027788 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 520) took 1677 ms. Trace:
I20260811 16:04:54.923847 17419 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.983762 17288 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:54.997687 17372 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:54.998559 17477 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:54.940467 17163 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:55.071851 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72240.6us
I20260811 16:04:54.948608 17381 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260811 16:04:54.995801 17397 raft_consensus.cc:2741] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260811 16:04:55.030652 17368 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:55.030256 17380 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:55.037367 13906 rpcz_store.cc:276] 0811 16:04:53.350256 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:53.350384 (+   128us) service_pool.cc:227] Handling call
0811 16:04:53.350772 (+   388us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:53.383324 (+ 32552us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:53.431843 (+ 48519us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:53.446797 (+ 14954us) log.cc:842] Serialized 52 byte log entry
0811 16:04:54.242167 (+795370us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b18004aadc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411
0811 16:04:54.242361 (+   194us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:04:54.242740 (+   379us) log.cc:842] Serialized 14 byte log entry
0811 16:04:54.242921 (+   181us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.243002 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:54.789738 (+546736us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:55.027443 (+237705us) raft_consensus.cc:1671] finished
0811 16:04:55.027473 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:55.027711 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10776,"prepare.queue_time_us":778,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":142121,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":10220,"spinlock_wait_cycles":26909312,"thread_start_us":50060,"threads_started":1,"wal-append.queue_time_us":279820}
I20260811 16:04:55.077395 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:55.078147 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:54.934377 17092 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:55.039973 17472 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260811 16:04:55.039109 17449 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:55.030553 17431 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260811 16:04:55.132194 17531 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260811 16:04:55.083851 17411 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:54.990048 17447 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.085664 17419 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:55.088158 17423 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:55.158465 17423 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:55.061082 17453 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:55.123364 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45303.5us
I20260811 16:04:54.988747 17360 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.133658 16852 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:55.165100 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:55.101799 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68159.4us
I20260811 16:04:55.097551 17380 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:55.167236 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:55.076296 17437 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260811 16:04:55.147190 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.572s (SENT)
I20260811 16:04:55.188687 13903 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:55.189324 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:55.191773 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 3.731s (SENT) [suppressed 41 similar messages]
I20260811 16:04:55.167902 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:55.194746 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.180923 17411 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:55.086184 17291 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260811 16:04:55.202310 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.104723 17449 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:55.164532 16793 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:55.193003 17368 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260811 16:04:55.180658 17419 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:55.211966 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2220) took 2761 ms. Trace:
I20260811 16:04:55.211627 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:55.138343 17036 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:55.234050 13825 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
W20260811 16:04:55.200014 17095 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.020s	sys 0.039s
I20260811 16:04:55.206105 16852 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:04:55.242213 13735 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.053s	sys 0.119s
I20260811 16:04:55.211800 17437 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:55.232120 13904 rpcz_store.cc:276] 0811 16:04:52.450780 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:52.559525 (+108745us) service_pool.cc:227] Handling call
0811 16:04:52.575136 (+ 15611us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:52.575402 (+   266us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:52.575437 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:52.582942 (+  7505us) log.cc:842] Serialized 26 byte log entry
0811 16:04:53.312685 (+729743us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:53.336724 (+ 24039us) log.cc:842] Serialized 14 byte log entry
0811 16:04:53.336951 (+   227us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:53.337025 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:54.452839 (+1115814us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:04:55.206089 (+753250us) raft_consensus.cc:1671] finished
0811 16:04:55.211679 (+  5590us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:55.211856 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":26168,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":125513,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":11908,"spinlock_wait_cycles":83225984,"thread_start_us":690589,"threads_started":1,"wal-append.queue_time_us":1071358}
W20260811 16:04:55.269079 14544 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.028s	sys 0.061s
W20260811 16:04:55.291257 14544 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.029s	sys 0.061s
W20260811 16:04:55.245564 17095 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.020s	sys 0.040s
W20260811 16:04:55.245393 17422 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.826s	user 0.013s	sys 0.000s
I20260811 16:04:55.239234 17411 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:04:55.245241 17528 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:55.243291 17524 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:55.287912 17372 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:55.291697 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 601524us
W20260811 16:04:55.290153 13735 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.053s	sys 0.120s
I20260811 16:04:55.248724 16852 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:55.293716 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 473458us
I20260811 16:04:55.237967 16793 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.248845 17419 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:55.286231 17368 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:55.299252 17528 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:55.268726 17392 raft_consensus.cc:2741] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260811 16:04:55.234062 17373 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.045s	sys 0.070s
I20260811 16:04:55.361836 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:55.341228 13709 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.688s (SENT)
I20260811 16:04:55.344997 13739 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:55.299753 13823 raft_consensus.cc:2396] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:04:55.266199 17380 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.367779 13741 raft_consensus.cc:2396] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260811 16:04:55.309746 17354 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.003s	sys 0.010s
W20260811 16:04:55.362317 17464 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.972s	user 0.011s	sys 0.006s
I20260811 16:04:55.354609 17368 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:55.372481 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:55.361719 17373 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.046s	sys 0.071s
I20260811 16:04:55.354568 17477 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:55.363981 17529 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260811 16:04:55.359738 17528 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:55.349869 16852 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:55.361903 17498 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.408481 13738 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
W20260811 16:04:55.391235 17354 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.003s	sys 0.011s
W20260811 16:04:55.357682 17481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.008s	sys 0.012s
I20260811 16:04:55.373199 17422 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:55.402704 17291 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260811 16:04:55.412369 17481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.009s	sys 0.013s
W20260811 16:04:55.403331 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62156.5us
W20260811 16:04:55.460186 13709 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.739s (SENT)
I20260811 16:04:55.460855 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:55.308214 17449 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:55.463588 13709 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.618s (SENT)
I20260811 16:04:55.466244 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:55.433743 17092 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:55.482583 13709 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.859s (SENT)
I20260811 16:04:55.483286 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:55.490348 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 413027us
I20260811 16:04:55.463001 17360 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:55.469192 17518 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:55.493189 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 904) took 1390 ms. Trace:
I20260811 16:04:55.495925 14583 rpcz_store.cc:276] 0811 16:04:54.102657 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.102857 (+   200us) service_pool.cc:227] Handling call
0811 16:04:54.103293 (+   436us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:54.105601 (+  2308us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:55.492895 (+1387294us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b5400437bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:55.493115 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3848576}
I20260811 16:04:55.497478 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:55.491448 17405 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.037s
I20260811 16:04:55.487368 17524 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:55.487037 17498 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:55.487306 17291 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:55.504473 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.972s (SENT)
I20260811 16:04:55.505270 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:55.511960 17534 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260811 16:04:55.512655 17532 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260811 16:04:55.513510 17530 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:04:55.517186 17372 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:04:55.458436 17422 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:04:55.523072 17540 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260811 16:04:55.500675 17360 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:04:55.525624 17518 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:04:55.528431 17541 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:55.472533 17368 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.531363 16793 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:55.547971 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 336403us
I20260811 16:04:55.535522 17291 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:04:55.535686 17541 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:55.560067 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.558429 17036 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:55.538673 17518 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:55.547917 17368 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:55.565680 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.571399 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 624) took 1430 ms. Trace:
I20260811 16:04:55.572510 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 836) took 2294 ms. Trace:
I20260811 16:04:55.577777 14573 rpcz_store.cc:276] 0811 16:04:53.278519 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:53.278707 (+   188us) service_pool.cc:227] Handling call
0811 16:04:53.820781 (+542074us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:53.827117 (+  6336us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:55.572262 (+1745145us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54005703d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:55.572437 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1177065856}
I20260811 16:04:55.568756 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 914) took 1348 ms. Trace:
I20260811 16:04:55.577663 13742 rpcz_store.cc:276] 0811 16:04:54.140738 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.140911 (+   173us) service_pool.cc:227] Handling call
0811 16:04:54.155938 (+ 15027us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:54.156177 (+   239us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:54.156228 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:54.156538 (+   310us) log.cc:842] Serialized 26 byte log entry
0811 16:04:54.579633 (+423095us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:54.579684 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:54.579763 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:55.571196 (+991433us) raft_consensus.cc:1671] finished
0811 16:04:55.571218 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:55.571338 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2279,"raft.queue_time_us":32253,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":1739,"thread_start_us":388480,"threads_started":1,"wal-append.queue_time_us":1208837}
I20260811 16:04:55.578356 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1563) took 1550 ms. Trace:
I20260811 16:04:55.575989 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1907) took 2845 ms. Trace:
I20260811 16:04:55.580889 13827 rpcz_store.cc:276] 0811 16:04:54.028208 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.028348 (+   140us) service_pool.cc:227] Handling call
0811 16:04:54.048355 (+ 20007us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:54.574650 (+526295us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:54.574692 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:54.807384 (+232692us) log.cc:842] Serialized 26 byte log entry
0811 16:04:55.265631 (+458247us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:55.265677 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:55.265760 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:55.578146 (+312386us) raft_consensus.cc:1671] finished
0811 16:04:55.578168 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:55.578299 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":490491,"raft.queue_time_us":491984,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":3949,"thread_start_us":379031,"threads_started":1,"wal-append.queue_time_us":578082}
I20260811 16:04:55.581010 13735 rpcz_store.cc:276] 0811 16:04:52.730506 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:53.208999 (+478493us) service_pool.cc:227] Handling call
0811 16:04:53.246338 (+ 37339us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:53.246568 (+   230us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:53.246921 (+   353us) log.cc:842] Serialized 14 byte log entry
0811 16:04:54.248495 (+1001574us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b18002d0dc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:04:55.570192 (+1321697us) log.cc:842] Serialized 14 byte log entry
0811 16:04:55.575656 (+  5464us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:55.575714 (+    58us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:04:55.575770 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:55.575832 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:55.575935 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5178,"prepare.queue_time_us":192,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":64,"raft.queue_time_us":1917,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":10872,"spinlock_wait_cycles":284919680,"thread_start_us":1319885,"threads_started":2,"wal-append.queue_time_us":2154793}
I20260811 16:04:55.579198 14581 rpcz_store.cc:276] 0811 16:04:54.220040 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.220207 (+   167us) service_pool.cc:227] Handling call
0811 16:04:54.220588 (+   381us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:54.220823 (+   235us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:04:54.818145 (+597322us) log.cc:842] Serialized 14 byte log entry
0811 16:04:55.568251 (+750106us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:55.568330 (+    79us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:04:55.568398 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:55.568488 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:55.568655 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14888,"prepare.queue_time_us":47771,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":109997,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":1329744,"threads_started":3,"wal-append.queue_time_us":664841}
I20260811 16:04:55.560238 17291 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:55.585196 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:55.633175 13709 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.628s (SENT)
I20260811 16:04:55.638409 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:55.639570 17550 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:55.643886 17518 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.646672 17036 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.648360 17372 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:55.649879 16852 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.569949 17353 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:55.649796 17372 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:55.653342 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68257.3us
I20260811 16:04:55.653764 13818 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:55.655512 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:55.656855 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:55.657987 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:55.656282 14581 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:55.662550 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.657965 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:55.664218 14580 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:55.664311 13820 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:55.666771 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.668960 13824 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:55.669279 14573 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:04:55.669909 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.670363 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:55.670447 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.671077 14583 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:04:55.671919 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.673966 13817 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:55.676951 13826 raft_consensus.cc:2396] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260811 16:04:55.652005 17422 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:55.682473 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:55.637538 17546 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:55.659157 17353 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:55.704391 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.705574 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:55.671025 17423 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.009s
I20260811 16:04:55.711751 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.710758 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:55.715327 13709 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.090s (SENT)
I20260811 16:04:55.715873 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:55.665510 17548 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:55.717805 17541 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.720330 13825 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:55.718778 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.719405 17546 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:55.722342 13827 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:55.720064 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50111.2us
I20260811 16:04:55.723935 13826 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:55.723798 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:55.665585 17381 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260811 16:04:55.672206 17550 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260811 16:04:55.721617 17354 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:55.738893 13827 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260811 16:04:55.741303 13827 pending_rounds.cc:76] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 6
I20260811 16:04:55.741641 13827 pending_rounds.cc:97] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260811 16:04:55.741954 13827 raft_consensus.cc:2866] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:55.729262 17423 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:55.739295 17548 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:55.746440 13826 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:55.724610 17095 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260811 16:04:55.731918 17353 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:55.752669 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.740533 17549 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:55.757736 13822 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:55.764329 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.765625 13827 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:55.767985 17542 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:55.768405 17353 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.771157 17552 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:55.771895 16852 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:55.772099 16873 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:55.771843 17552 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.772570 16873 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:55.774200 17288 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.007s
I20260811 16:04:55.774325 17552 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:55.773607 16873 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.779953 17372 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:55.779069 17548 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.779423 17549 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:55.783667 17549 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:55.784781 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.786137 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.786768 13817 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:55.790589 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.792336 17553 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:55.792361 13825 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260811 16:04:55.799808 17544 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.288s	user 0.005s	sys 0.002s
I20260811 16:04:55.803668 17289 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:55.813475 17380 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:55.792950 17163 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:55.792788 17553 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:55.774760 17288 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.768817 17542 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.795286 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:55.816723 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 93012.1us
I20260811 16:04:55.818722 13827 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:55.819339 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:55.795935 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:55.758991 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.797149 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 536) took 1388 ms. Trace:
I20260811 16:04:55.727787 17291 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.726130 17546 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.798547 13817 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:55.821473 13903 rpcz_store.cc:276] 0811 16:04:54.408766 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.796415 (+387649us) service_pool.cc:227] Handling call
0811 16:04:55.796970 (+1000555us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54000c6f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:55.797087 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":656935680}
I20260811 16:04:55.794117 17528 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.822973 13822 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:55.834584 13744 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:55.838678 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.838490 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.840579 13826 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:55.847045 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:55.867967 13822 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260811 16:04:55.869786 13735 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:04:55.868609 17541 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:55.890836 17372 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:55.891386 17372 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:55.892305 17372 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.860190 17232 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:55.894778 17561 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260811 16:04:55.899328 17232 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:55.937649 17377 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:55.938505 17377 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.899343 17549 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.974308 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1561) took 2118 ms. Trace:
I20260811 16:04:55.974737 13818 rpcz_store.cc:276] 0811 16:04:53.855682 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:53.856125 (+   443us) service_pool.cc:227] Handling call
0811 16:04:53.880289 (+ 24164us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:55.655752 (+1775463us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:55.974014 (+318262us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:55.974233 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4078034304}
I20260811 16:04:55.852005 17553 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:55.933243 17232 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:56.044023 17528 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.046484 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:56.046206 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 871619us
I20260811 16:04:56.047449 13818 raft_consensus.cc:2354] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10.
I20260811 16:04:56.046948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.050354 13822 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.048617 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:56.053198 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.053910 13741 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:04:56.057541 13823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1568) took 1452 ms (client timeout 1591 ms). Trace:
I20260811 16:04:56.057964 13739 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260811 16:04:56.057956 13823 rpcz_store.cc:269] 0811 16:04:54.605124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.605375 (+   251us) service_pool.cc:227] Handling call
0811 16:04:56.052826 (+1447451us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54002ab7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:56.057472 (+  4646us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1126158080}
I20260811 16:04:56.059342 13739 pending_rounds.cc:76] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 6
I20260811 16:04:56.046506 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.060137 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.058158 13827 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
W20260811 16:04:56.059715 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 154754us
I20260811 16:04:56.060784 13739 pending_rounds.cc:97] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260811 16:04:56.062825 13739 raft_consensus.cc:2866] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:56.062968 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.061865 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.046607 17291 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:56.063824 13827 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:04:56.066046 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.067461 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:56.066354 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.063661 13818 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:56.067377 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.070932 13822 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.049065 17372 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:56.060118 17524 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260811 16:04:56.073181 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:04:56.073483 13787 connection.cc:232] RPC call timeout handler was delayed by -1.9431238981196657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260811 16:04:56.057149 16875 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260811 16:04:56.077742 13740 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:04:56.293748 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.097304 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:56.294915 13818 raft_consensus.cc:2396] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260811 16:04:56.098747 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:56.240657 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 664) took 1615 ms. Trace:
I20260811 16:04:56.064772 17383 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:56.064919 17528 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:04:56.060316 17553 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:56.097057 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.119773 17485 raft_consensus.cc:979] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:56.355405 13823 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:56.114959 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.078580 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.097854 17549 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.295280 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.357015 13738 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:56.357892 13744 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:56.295249 13737 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:56.298596 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.299129 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.358789 14573 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:56.359131 14583 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:04:56.285351 13709 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.963s (SENT)
W20260811 16:04:56.273048 17562 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260811 16:04:56.077981 13736 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:56.096984 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.274665 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.274474 16873 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:56.118328 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.339754 13742 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:56.338584 13909 rpcz_store.cc:276] 0811 16:04:54.618171 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.825849 (+207678us) service_pool.cc:227] Handling call
0811 16:04:56.233196 (+1407347us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002c1ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:56.233807 (+   611us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2816145664}
I20260811 16:04:56.350831 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.375644 13740 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:56.068303 17431 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:56.122987 17504 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:04:56.360134 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:56.245342 17428 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:56.113188 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 540) took 1703 ms. Trace:
I20260811 16:04:56.188187 13821 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:56.283874 17309 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:56.270833 17378 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:56.103312 17377 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.096745 16793 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.293290 17555 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260811 16:04:56.215386 17481 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:56.300808 17541 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260811 16:04:56.062608 17548 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.283s
I20260811 16:04:56.378693 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.379719 13741 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:56.072320 17288 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:56.426128 17566 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260811 16:04:56.206414 17561 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.290458 17406 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:56.097160 17546 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:56.492465 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.120905 17252 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:56.122418 17477 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:56.123565 16849 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:56.122483 17092 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.279949 17542 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:56.285638 17465 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.375120 14583 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:56.099606 17447 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.122169 17487 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:56.391160 13826 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:56.347818 17383 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:04:56.395407 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 110112us
W20260811 16:04:56.520416 13709 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.992s (SENT)
I20260811 16:04:56.520792 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:56.350898 13787 connection.cc:232] RPC call timeout handler was delayed by -1.6992238981183618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260811 16:04:56.343703 17462 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:56.392560 13902 rpcz_store.cc:276] 0811 16:04:54.409932 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.803476 (+393544us) service_pool.cc:227] Handling call
0811 16:04:54.803884 (+   408us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:54.804170 (+   286us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:04:54.804527 (+   357us) log.cc:842] Serialized 14 byte log entry
0811 16:04:56.112635 (+1308108us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18003a68a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:04:56.112788 (+   153us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:56.112840 (+    52us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:04:56.112883 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:56.112972 (+    89us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:56.113113 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5301,"prepare.queue_time_us":4749,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":1313937,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":29065600}
I20260811 16:04:56.398999 13827 pending_rounds.cc:76] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:04:56.347664 17528 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:56.382025 17382 raft_consensus.cc:1067] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:04:56.118958 17435 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.271s
I20260811 16:04:56.434549 14573 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:56.456668 16793 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.438777 13737 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:56.444480 13823 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:56.377490 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.114359 17458 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.287s
I20260811 16:04:56.437849 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:56.425859 13628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 307) took 27939 ms (client timeout 15000 ms). Trace:
I20260811 16:04:56.119307 17524 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:56.424930 17552 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:56.522791 17383 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:56.493901 13742 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:56.439720 17481 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:56.497605 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:56.506944 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 382730us
I20260811 16:04:56.460814 17555 consensus_queue.cc:1225] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:04:56.505487 13825 raft_consensus.cc:2354] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10.
I20260811 16:04:56.428956 13627 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 4 to 5, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 5 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:56.415027 17504 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.411779 17428 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.560297 13627 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 2 to 6, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:56.561262 17428 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:56.514802 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.70344e+06us
I20260811 16:04:56.563952 17430 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:04:56.564961 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:56.514875 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:56.521522 13787 connection.cc:232] RPC call timeout handler was delayed by -1.4070683739846572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260811 16:04:56.566123 13787 connection.cc:232] RPC call timeout handler was delayed by -1.4040238980669528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2312s for a response
I20260811 16:04:56.534682 17549 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 16:04:56.513152 17380 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.004s
I20260811 16:04:56.528901 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.516175 17092 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.573311 13821 raft_consensus.cc:2396] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260811 16:04:56.510658 16849 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:56.510208 17557 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:56.535373 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.550474 17552 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:56.542640 13822 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.542382 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:04:56.486827 17232 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:56.488998 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.66173e+06us
I20260811 16:04:56.583122 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.584309 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.530798 17462 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.496282 17561 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.530342 17528 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:56.521929 17465 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.556304 13818 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.487058 17485 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.530189 17289 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:56.565933 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.523918 13827 pending_rounds.cc:97] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260811 16:04:56.601105 13827 raft_consensus.cc:2866] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:04:56.601256 13817 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.499531 17252 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:56.565977 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 51207.6us
I20260811 16:04:56.515542 17477 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.570300 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:56.555191 17565 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
I20260811 16:04:56.575883 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.576295 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.576891 14583 raft_consensus.cc:1203] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Deduplicated request from leader. Original: 5.6->[7.7-7.7]   Dedup: 7.7->[]
I20260811 16:04:56.577255 14581 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260811 16:04:56.542805 13628 rpcz_store.cc:269] 0811 16:04:28.487028 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:28.487266 (+   238us) service_pool.cc:227] Handling call
0811 16:04:56.425743 (+27938477us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:51.474305 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:51.587526 (+113221us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:51.587600 (+    74us) write_op.cc:435] Acquired schema lock
0811 16:04:51.587615 (+    15us) tablet.cc:660] Decoding operations
0811 16:04:51.588748 (+  1133us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:51.588854 (+   106us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:51.588880 (+    26us) tablet.cc:683] Acquiring locks for 11 operations
0811 16:04:51.590008 (+  1128us) tablet.cc:699] Row locks acquired
0811 16:04:51.590040 (+    32us) write_op.cc:260] PREPARE: finished
0811 16:04:51.590265 (+   225us) write_op.cc:270] Start()
0811 16:04:51.590416 (+   151us) write_op.cc:276] Timestamp: P: 1786464291590154 usec, L: 0
0811 16:04:51.590446 (+    30us) op_driver.cc:331] REPLICATION: starting
0811 16:04:51.688996 (+ 98550us) log.cc:842] Serialized 4432 byte log entry
0811 16:04:52.915533 (+1226537us) op_driver.cc:444] REPLICATION: finished
0811 16:04:53.481883 (+566350us) write_op.cc:301] APPLY: starting
0811 16:04:53.504694 (+ 22811us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:53.594764 (+ 90070us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:53.594908 (+   144us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:53.823117 (+228209us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:53.962901 (+139784us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0811 16:04:53.966112 (+  3211us) write_op.cc:312] APPLY: finished
0811 16:04:53.975903 (+  9791us) log.cc:842] Serialized 83 byte log entry
0811 16:04:54.017995 (+ 42092us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:54.022222 (+  4227us) write_op.cc:454] Released schema lock
0811 16:04:54.037211 (+ 14989us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:54.104212 (+ 67001us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:54.104248 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1387609,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":526317,"apply.run_cpu_time_us":31682,"apply.run_wall_time_us":647302,"num_ops":11,"prepare.queue_time_us":344816,"prepare.run_cpu_time_us":46202,"prepare.run_wall_time_us":396265,"raft.queue_time_us":375116,"raft.run_cpu_time_us":22995,"raft.run_wall_time_us":276013,"replication_time_us":1324965,"thread_start_us":639137,"threads_started":5,"wal-append.queue_time_us":302749,"wal-append.run_cpu_time_us":36574,"wal-append.run_wall_time_us":2878812}]]}
I20260811 16:04:56.578408 13823 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:56.592904 17458 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:56.578903 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.580092 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.582085 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.582460 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.617524 14574 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:56.582799 14577 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:56.588085 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.590708 13824 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:56.595786 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:56.569777 17563 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:56.528599 17487 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.575274 17555 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.578106 17557 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:56.604555 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.606514 13627 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 3 to 4, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:56.608502 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.541216 13735 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:04:56.613206 14583 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260811 16:04:56.613360 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.614158 14573 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:56.615413 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.617614 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.653573 13818 raft_consensus.cc:2396] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260811 16:04:56.653827 13820 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.612216 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.611986 13825 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:56.655128 13822 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:56.622619 14579 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:56.622824 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.640336 14578 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:04:56.616143 17431 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:56.642613 13823 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:04:56.646569 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.600521 17418 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260811 16:04:56.659811 13826 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.656060 14581 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:56.650871 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.635389 17542 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:56.663375 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.664268 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.667723 13825 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
W20260811 16:04:56.664570 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51311.7us
I20260811 16:04:56.664664 13627 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 4 to 5, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 5 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:56.666186 17575 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:56.670198 17575 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.671298 17524 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:56.674194 16793 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.674419 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.675414 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.676126 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.676172 13822 raft_consensus.cc:2362] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10. Re-sending same reply.
I20260811 16:04:56.676920 13818 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:56.677750 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.677495 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.678309 13818 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:56.678766 13822 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:56.622665 17428 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260811 16:04:56.679795 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.681732 17561 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.682552 17557 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.668089 13820 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5. Re-sending same reply.
I20260811 16:04:56.683900 17092 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:56.651513 16849 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.684620 16849 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:56.684716 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.685721 13820 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:56.686547 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.602555 17485 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:56.687461 17163 consensus_queue.cc:1159] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 5 status { last_received { term: 5 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 5 index: 2 } }
I20260811 16:04:56.669262 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.681165 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.689378 17485 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:56.690456 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.603636 17481 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.692006 17481 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:56.692168 13820 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:56.693331 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.695032 13820 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:04:56.665746 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.666764 17542 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:56.696615 17158 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.697301 17542 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:56.697515 17158 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.698330 13823 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:56.650602 17291 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:56.699606 17291 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:56.700570 17487 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.700630 17291 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.702407 17449 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:56.703704 17462 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.636909 17563 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:56.704213 17465 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:56.705042 17563 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.705601 17252 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.708539 17477 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:56.709327 13709 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.777s (SENT)
I20260811 16:04:56.709787 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:56.711097 17384 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:56.711951 17380 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:56.643568 17555 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.715235 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.716142 13823 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
W20260811 16:04:56.716952 13874 connection.cc:232] RPC call timeout handler was delayed by -1.0197590499883518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260811 16:04:56.717361 13874 connection.cc:232] RPC call timeout handler was delayed by -1.0019922459032387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260811 16:04:56.704032 13820 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "20ad41e4f434442792e36eb47449b101"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40908
I20260811 16:04:56.721037 13820 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:04:56.722074 13820 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:56.661834 13821 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:56.696664 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 542) took 2286 ms. Trace:
I20260811 16:04:56.726611 13900 rpcz_store.cc:276] 0811 16:04:54.410542 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:54.808135 (+397593us) service_pool.cc:227] Handling call
0811 16:04:54.887297 (+ 79162us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:04:56.120299 (+1233002us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:56.120328 (+    29us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:04:56.120964 (+   636us) log.cc:842] Serialized 78 byte log entry
0811 16:04:56.511394 (+390430us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:56.569696 (+ 58302us) log.cc:842] Serialized 14 byte log entry
0811 16:04:56.598496 (+ 28800us) log.cc:842] Serialized 14 byte log entry
0811 16:04:56.606213 (+  7717us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:56.606595 (+   382us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:56.696444 (+ 89849us) raft_consensus.cc:1671] finished
0811 16:04:56.696464 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:56.696604 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1192582,"prepare.queue_time_us":131061,"raft.queue_time_us":1165929,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":28335,"thread_start_us":429160,"threads_started":2,"wal-append.queue_time_us":473360}
W20260811 16:04:56.729525 17580 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260811 16:04:56.730852 17095 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:04:56.731315 17095 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:56.645344 17552 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.732417 17095 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:56.734442 17372 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.001s
I20260811 16:04:56.734338 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.736163 17418 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:04:56.736560 17418 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:56.736909 17418 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:56.737850 17576 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:04:56.738240 17576 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:56.739096 17576 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.740195 17576 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:56.741722 17232 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:56.747820 13709 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.102s (SENT)
I20260811 16:04:56.748106 17557 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:56.748366 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:56.749717 13709 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.107s (SENT)
I20260811 16:04:56.750813 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.751519 13825 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:56.752403 17252 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:56.753135 13903 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:04:56.753641 17477 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.754361 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:56.754736 13904 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:04:56.755021 17462 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.755559 17462 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.756664 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.757439 13817 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:56.757581 17462 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:56.758438 17462 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.753556 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:56.754174 17477 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.759050 17462 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.761195 17462 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.761503 17477 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.761808 17462 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.762498 13901 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:04:56.763535 17582 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260811 16:04:56.765774 13900 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260811 16:04:56.770573 17383 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:56.771317 17232 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:56.772630 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.773232 17431 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:56.773522 13742 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:56.774251 17431 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:56.776925 13735 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260811 16:04:56.777735 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108580us
I20260811 16:04:56.779350 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:56.717563 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50604.2us
W20260811 16:04:56.780871 13709 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.844s (SENT)
I20260811 16:04:56.781051 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.781373 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:04:56.782481 13709 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.569s (SENT)
I20260811 16:04:56.783012 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:56.784720 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:56.785391 13906 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:56.784731 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.786226 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:56.786996 13908 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:56.788767 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.789043 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:56.789817 13906 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:56.790892 17036 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:04:56.783129 14580 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:04:56.791893 13907 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260811 16:04:56.793135 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.793465 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:56.794126 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.031656 13908 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:57.030809 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:56.899747 13901 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:56.969178 14583 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:57.032272 13739 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:57.033072 14581 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:57.031836 13825 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:57.034947 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:57.043381 13826 raft_consensus.cc:2362] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10. Re-sending same reply.
I20260811 16:04:56.792881 17232 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:56.869295 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:57.036046 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:57.084419 13740 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:56.803970 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.085269 13742 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:57.085831 13744 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:57.087368 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.868546 17158 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:56.794170 13741 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:04:56.868646 17384 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:56.855644 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.048298 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:56.794832 13627 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 2 to 5, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 5 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:04:56.863130 13900 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:57.059667 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.898483 13738 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:57.094848 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.856315 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.077108 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.125234 13905 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:04:57.038172 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:56.869050 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.126489 14575 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:56.852079 14574 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:04:57.127780 13908 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:57.127746 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:56.872373 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:57.128798 13735 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:57.088289 13744 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:57.129936 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:56.789440 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:57.131420 13741 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:57.131513 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:57.114061 13820 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:57.101920 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 322625us
I20260811 16:04:57.114797 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:56.794360 17541 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:56.785827 17411 raft_consensus.cc:2741] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260811 16:04:57.134727 13820 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:57.133862 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:57.147475 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:57.147735 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.092007 17458 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.137408 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.139607 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.140396 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:57.143010 13742 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:04:56.827816 17392 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:57.032682 17464 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:57.145180 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 96982.6us
I20260811 16:04:57.148440 13735 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:56.785342 17383 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:57.083775 16875 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.136108 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.150440 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.153568 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.188651 14574 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:57.189421 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:57.190611 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50298.7us
I20260811 16:04:57.192022 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.192852 13742 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
W20260811 16:04:57.150978 13871 connection.cc:232] RPC call timeout handler was delayed by -1.2446832690620795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260811 16:04:57.196463 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1537832689937204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
I20260811 16:04:57.196813 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 612) took 1527 ms. Trace:
I20260811 16:04:57.082759 17575 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:56.852286 17528 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.197933 13744 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:57.225631 14578 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:57.199707 13825 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:57.199435 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:57.231212 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:57.232589 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:57.199853 13741 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:57.197194 13824 rpcz_store.cc:276] 0811 16:04:55.669055 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:55.669679 (+   624us) service_pool.cc:227] Handling call
0811 16:04:57.196644 (+1526965us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400125554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:57.196756 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2085340544}
I20260811 16:04:57.198556 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:57.222690 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.237739 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:56.762374 17462 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.241137 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.240803 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.139200 17431 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:57.118800 17384 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.251356 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.252355 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.262759 13742 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:57.144390 17541 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:57.255576 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.258507 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.250262 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:57.156896 17360 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:57.193589 17548 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:57.196070 17392 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:57.271831 13909 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:57.201270 17309 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260811 16:04:57.275241 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.271109 14579 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:57.146164 17553 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260811 16:04:57.279435 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.231107 17458 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.162569 17158 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260811 16:04:57.298532 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.151883 17546 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260811 16:04:57.201269 17464 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.201171 16875 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.308377 14575 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:57.281535 17498 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.282577 17392 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:57.328038 13900 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:57.328997 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:57.325456 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 191665us
I20260811 16:04:57.287001 17360 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:57.278399 17541 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:57.336280 13909 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:04:57.343611 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:57.311583 17524 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:04:57.343528 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 144069us
I20260811 16:04:57.268873 17431 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.342986 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:57.337183 17252 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.007s
I20260811 16:04:57.370502 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:57.375944 13903 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:57.336913 17411 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:57.370954 17574 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.381271 17384 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:57.381160 17574 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.384425 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.344090 17036 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:57.348974 17372 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:57.397293 17596 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:57.397677 17542 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.002s
I20260811 16:04:57.397837 17397 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:57.398214 17585 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260811 16:04:57.398650 17378 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.978s	user 0.012s	sys 0.000s
W20260811 16:04:57.399760 17588 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260811 16:04:57.400456 17584 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260811 16:04:57.420008 13900 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:57.330582 17498 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:57.448925 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 250338us
I20260811 16:04:57.384069 17561 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.385460 17411 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:57.449901 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:57.457635 14575 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260811 16:04:57.448314 17380 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.008s
W20260811 16:04:57.465385 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 94499.4us
I20260811 16:04:57.451870 17595 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.396373 17574 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.402247 17372 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:57.474187 17618 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:04:57.475215 17528 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.482502 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:57.502471 14580 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.012s
W20260811 16:04:57.502941 14580 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.012s
I20260811 16:04:57.481603 13740 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:04:57.503347 13735 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:57.495795 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.504056 13900 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 8
I20260811 16:04:57.474944 16875 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.501298 13739 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:57.504271 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:57.534368 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:57.532457 14575 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:04:57.476665 17518 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.402980 17036 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.496512 17411 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:57.497279 17589 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.144s	user 0.003s	sys 0.000s
I20260811 16:04:57.554560 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:57.542894 13742 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:57.536754 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:57.537580 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:57.561965 13900 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:57.543792 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:57.562738 13738 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:57.562919 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.543529 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:57.480911 17524 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:57.564071 13901 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:04:57.546594 13741 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:04:57.564978 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.530035 17252 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:57.495313 17291 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:57.496796 17380 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.001s	sys 0.009s
I20260811 16:04:57.502300 17590 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:57.617506 17380 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:57.532547 16873 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.141s	user 0.011s	sys 0.003s
I20260811 16:04:57.504030 17372 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:57.459649 17542 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.570232 17575 raft_consensus.cc:2741] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260811 16:04:57.627835 14574 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:04:57.628597 17542 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:57.629823 17542 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:57.630281 17542 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:57.625670 17036 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.563522 13900 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:57.528237 17462 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:57.565816 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 641) took 1024 ms. Trace:
I20260811 16:04:57.631630 13737 rpcz_store.cc:276] 0811 16:04:56.541672 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.542107 (+   435us) service_pool.cc:227] Handling call
0811 16:04:56.542470 (+   363us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:56.545337 (+  2867us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:56.545379 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:56.552158 (+  6779us) log.cc:842] Serialized 26 byte log entry
0811 16:04:57.030643 (+478485us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:57.030684 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:57.030750 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:57.565623 (+534873us) raft_consensus.cc:1671] finished
0811 16:04:57.565644 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:57.565760 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4603,"raft.queue_time_us":4186,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4497,"thread_start_us":343072,"threads_started":1,"wal-append.queue_time_us":636505}
W20260811 16:04:57.548192 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.573s (SENT)
I20260811 16:04:57.633810 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:57.634869 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86726.9us
W20260811 16:04:57.635555 14544 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.592s (SENT)
W20260811 16:04:57.638185 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.809s (SENT)
I20260811 16:04:57.542608 17574 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:57.502461 17384 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.463023 17397 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.640022 17590 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:57.639818 17609 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:04:57.569989 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:57.567907 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 67039.8us
I20260811 16:04:57.566273 17528 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.565809 16875 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.603063 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:57.535380 17602 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:57.652287 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 122051us
I20260811 16:04:57.656704 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:04:57.653595 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50632.1us
I20260811 16:04:57.568856 17431 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.659775 13738 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:57.565824 13901 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260811 16:04:57.616201 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78709.1us
I20260811 16:04:57.619110 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:57.664914 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:57.665738 13820 raft_consensus.cc:2362] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5. Re-sending same reply.
I20260811 16:04:57.554486 17604 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:57.460198 17360 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.496371 17561 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.625658 13818 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:57.621690 17458 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.641268 13824 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:57.568647 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:57.602406 17586 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260811 16:04:57.455298 17596 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.643151 14580 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:57.544415 17163 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:04:57.608896 17580 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260811 16:04:57.646565 13905 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.004s
W20260811 16:04:57.598994 17449 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.006s
I20260811 16:04:57.670069 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.675766 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:57.674984 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.744809 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.676318 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:57.677613 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:57.564081 17524 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.536105 17595 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.626780 14582 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:57.680383 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:57.650779 17036 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:04:57.700134 17617 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260811 16:04:57.701797 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:57.555449 17518 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.683051 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:57.607687 16849 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260811 16:04:57.604337 17563 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260811 16:04:57.746958 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:57.775790 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 98306.8us
I20260811 16:04:57.679620 17447 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:57.639850 17384 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.696187 17604 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.669414 16875 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.652347 17291 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:57.696429 17542 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.674736 17602 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.793263 13820 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:57.897506 13822 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:57.841447 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:57.696439 17575 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:58.246063 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:57.705834 17418 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.967s	user 0.011s	sys 0.002s
W20260811 16:04:57.883441 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 189173us
I20260811 16:04:57.978618 17620 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:57.836624 13906 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:04:58.221939 17609 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:58.305099 17609 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.308005 17609 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:58.174062 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2190350210294127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260811 16:04:58.308887 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2181350210448727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260811 16:04:58.309463 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2118350210366771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260811 16:04:58.309897 13789 connection.cc:232] RPC call timeout handler was delayed by -1.210035021067597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260811 16:04:58.310313 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2064350210130215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260811 16:04:58.310711 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1596350210020319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260811 16:04:58.312227 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1146350209601223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260811 16:04:58.313840 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0741350210737437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260811 16:04:58.250614 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:58.315620 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65079.7us
I20260811 16:04:58.316474 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:58.055572 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2284) took 2268 ms. Trace:
I20260811 16:04:58.318943 13827 rpcz_store.cc:276] 0811 16:04:55.800905 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.069388 (+268483us) service_pool.cc:227] Handling call
0811 16:04:56.398414 (+329026us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:04:56.398715 (+   301us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:56.626627 (+227912us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:56.626647 (+    20us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:56.627218 (+   571us) log.cc:842] Serialized 52 byte log entry
0811 16:04:57.000148 (+372930us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:57.208967 (+208819us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.444843 (+235876us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.445011 (+   168us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:57.445087 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:58.055184 (+610097us) raft_consensus.cc:1671] finished
0811 16:04:58.055239 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:58.055476 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12413,"prepare.queue_time_us":277125,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":3213,"raft.queue_time_us":278678,"raft.run_cpu_time_us":491,"raft.run_wall_time_us":32904,"spinlock_wait_cycles":52842880,"thread_start_us":750849,"threads_started":3,"wal-append.queue_time_us":509793}
I20260811 16:04:58.322245 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.092535 17552 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:58.255347 13818 raft_consensus.cc:2362] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6. Re-sending same reply.
W20260811 16:04:57.701412 17607 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260811 16:04:58.247526 13737 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:57.696233 17546 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:57.705965 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:57.700138 17397 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.332561 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:58.333889 13824 raft_consensus.cc:2354] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7.
I20260811 16:04:57.774977 13905 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:04:58.335642 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2240) took 1545 ms. Trace:
I20260811 16:04:58.336062 13905 rpcz_store.cc:276] 0811 16:04:56.789836 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.789946 (+   110us) service_pool.cc:227] Handling call
0811 16:04:58.335537 (+1545591us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":286208}
I20260811 16:04:58.269685 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:57.696251 17600 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:58.338429 13820 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:58.338341 17600 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.339359 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.339932 13820 raft_consensus.cc:2362] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8. Re-sending same reply.
I20260811 16:04:58.273463 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:58.340706 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.256358 17158 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.248703 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:58.285751 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:58.246877 17586 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260811 16:04:57.902118 17576 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.162s	user 0.007s	sys 0.006s
I20260811 16:04:58.248543 14575 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:58.256809 17575 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:58.370956 14579 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:58.290300 13743 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:57.841899 17380 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.318346 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:04:57.914916 13627 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.015s
W20260811 16:04:58.377777 13627 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.011s	sys 0.019s
I20260811 16:04:57.776082 13741 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:58.348320 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:58.378625 13905 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:58.334920 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.379437 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:58.247732 17447 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:57.663630 17528 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:57.855465 17498 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:57.833912 17618 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:58.285212 17465 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.018s	sys 0.002s
I20260811 16:04:58.350996 13827 raft_consensus.cc:2354] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7.
I20260811 16:04:58.353870 13901 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:58.354279 13826 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260811 16:04:58.367211 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 118528us
I20260811 16:04:58.403008 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2008) took 1182 ms. Trace:
W20260811 16:04:57.798928 17481 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.106s	user 0.011s	sys 0.001s
I20260811 16:04:57.880533 17601 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.541s
I20260811 16:04:58.355912 17602 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.377013 17575 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:58.340678 17600 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.415838 13902 raft_consensus.cc:595] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:04:58.416296 13902 raft_consensus.cc:603] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:04:58.382025 17552 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.290026 17418 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:57.829538 17036 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.392110 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.350718 17608 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.416771 17163 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.427285 17608 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.428049 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:58.429272 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:58.369735 17158 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.403416 13901 rpcz_store.cc:276] 0811 16:04:57.220485 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.775455 (+554970us) service_pool.cc:227] Handling call
0811 16:04:58.402951 (+627496us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.303344 17622 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:58.380281 14580 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:04:58.388840 17392 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.046s	user 0.013s	sys 0.000s
W20260811 16:04:58.508427 13709 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.723s (SENT)
I20260811 16:04:58.384845 17447 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:58.418968 13744 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260811 16:04:58.402310 17465 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.018s	sys 0.002s
W20260811 16:04:58.420324 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 102073us
I20260811 16:04:58.515235 13820 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:58.516820 14581 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10.
I20260811 16:04:58.517089 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:04:58.341878 17504 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.395113 17621 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.543740 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:58.544941 13820 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:58.424022 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.424369 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:58.412338 17609 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260811 16:04:58.478204 17557 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.729s	user 0.008s	sys 0.009s
I20260811 16:04:58.399955 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:58.430133 13817 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:04:57.707275 17590 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.408939 17614 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:58.551707 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 151890us
I20260811 16:04:58.432241 17036 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.435098 13907 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:58.443759 13905 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:58.444590 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:58.437762 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 1999) took 1220 ms (client timeout 1566 ms). Trace:
W20260811 16:04:58.431936 17616 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260811 16:04:58.511638 17309 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:58.512641 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:58.446147 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.513511 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.439623 17360 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:58.546006 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 121734us
I20260811 16:04:58.427493 17163 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.517444 17620 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:58.431113 17643 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:58.477885 17600 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.442797 17485 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:04:58.602975 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 857) took 2023 ms (client timeout 2694 ms). Trace:
I20260811 16:04:58.440040 17596 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.514002 17392 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.553885 13817 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
I20260811 16:04:58.554425 17629 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:58.555743 17595 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:58.552938 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 107942us
W20260811 16:04:58.587559 13903 rpcz_store.cc:269] 0811 16:04:57.217058 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.217278 (+   220us) service_pool.cc:227] Handling call
0811 16:04:58.437550 (+1220272us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001b1554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.437701 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":240364288}
I20260811 16:04:58.589497 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2009) took 1350 ms. Trace:
I20260811 16:04:58.424671 17481 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:04:58.590938 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:58.681571 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 90700.5us
W20260811 16:04:58.592308 14542 leader_election.cc:334] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.926s (SENT)
W20260811 16:04:58.682622 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 90344.9us
I20260811 16:04:58.591876 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2250) took 1136 ms. Trace:
W20260811 16:04:58.596166 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 82769.8us
W20260811 16:04:58.607102 14582 rpcz_store.cc:269] 0811 16:04:56.579702 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.579845 (+   143us) service_pool.cc:227] Handling call
0811 16:04:58.602750 (+2022905us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54007e04d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.602899 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2321430912}
I20260811 16:04:58.683097 13901 rpcz_store.cc:276] 0811 16:04:57.454998 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.512313 (+1057315us) service_pool.cc:227] Handling call
0811 16:04:58.591787 (+ 79474us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.435935 17608 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.553105 17546 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.708577 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:58.708364 17546 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.709261 13738 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:04:58.709620 17528 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.552109 17602 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:58.590454 17458 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:58.710507 17458 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.447216 17552 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.713204 17552 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.714166 17619 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:04:58.714665 17619 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:58.591221 17618 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.673727 17485 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:58.596421 17641 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
W20260811 16:04:58.674001 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 388338us
I20260811 16:04:58.678620 13905 rpcz_store.cc:276] 0811 16:04:57.238838 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.337133 (+1098295us) service_pool.cc:227] Handling call
0811 16:04:58.589416 (+252283us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.732257 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:58.679073 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:58.681599 14578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 801) took 1899 ms (client timeout 1623 ms). Trace:
W20260811 16:04:58.733815 14578 rpcz_store.cc:269] 0811 16:04:56.782636 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.782781 (+   145us) service_pool.cc:227] Handling call
0811 16:04:58.681424 (+1898643us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54005401d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.681524 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":48807168}
W20260811 16:04:58.689057 13707 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.723s (SENT)
I20260811 16:04:58.548374 17621 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.691118 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.692276 17418 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.593034 17309 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.599157 17628 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:58.692845 16875 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:58.693825 13789 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.566s (SENT)
I20260811 16:04:58.694423 17384 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.546804 17504 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.593250 17360 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.697139 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:58.697366 13787 connection.cc:232] RPC call timeout handler was delayed by -1.1397536559961736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260811 16:04:58.698772 17095 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:58.699862 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2330) took 1984 ms. Trace:
W20260811 16:04:58.701926 13743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1914) took 2634 ms (client timeout 1655 ms). Trace:
W20260811 16:04:58.702747 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 942) took 1918 ms (client timeout 2450 ms). Trace:
I20260811 16:04:58.703508 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2244) took 1549 ms. Trace:
I20260811 16:04:58.704232 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.704505 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.705103 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.705178 17392 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.705717 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.706228 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:58.707782 17613 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.624s	user 0.006s	sys 0.002s
I20260811 16:04:58.674314 13817 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:58.722297 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.723840 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:58.726420 13900 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:58.728246 17524 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.608800 17600 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.600775 17601 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:58.738085 13738 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
W20260811 16:04:58.738560 13709 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.649s (SENT)
I20260811 16:04:58.848610 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:58.848951 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 110428us
I20260811 16:04:58.739315 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2012) took 1499 ms. Trace:
W20260811 16:04:58.754521 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2001) took 1536 ms (client timeout 1713 ms). Trace:
I20260811 16:04:58.850785 13903 rpcz_store.cc:276] 0811 16:04:57.239767 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.685032 (+1445265us) service_pool.cc:227] Handling call
0811 16:04:58.739127 (+ 54095us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:04:58.851613 13906 rpcz_store.cc:269] 0811 16:04:57.217925 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.239939 (+ 22014us) service_pool.cc:227] Handling call
0811 16:04:58.754306 (+1514367us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.754457 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1365655424}
I20260811 16:04:58.853117 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.736418 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:58.738420 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.608932 17643 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:04:58.746857 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53062.8us
W20260811 16:04:58.687458 17616 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.092s	user 0.011s	sys 0.008s
I20260811 16:04:58.513918 17622 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.872581 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.750582 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:58.746570 17291 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:58.808323 17636 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260811 16:04:58.813519 17602 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:04:58.840333 14582 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:58.848203 13817 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.886906 17602 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.887645 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.888451 17232 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:58.888845 17232 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:58.889178 17232 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:58.889308 17602 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:58.873272 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 134949us
I20260811 16:04:58.840955 13742 raft_consensus.cc:2396] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260811 16:04:58.891119 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:58.887589 13817 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:58.892122 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:58.874497 13824 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:58.840198 13825 rpcz_store.cc:276] 0811 16:04:56.715460 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.126548 (+411088us) service_pool.cc:227] Handling call
0811 16:04:58.699665 (+1573117us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b540014dcd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.699803 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":118268800}
I20260811 16:04:58.720470 17596 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:04:58.842264 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2007) took 1622 ms. Trace:
W20260811 16:04:58.842366 13743 rpcz_store.cc:269] 0811 16:04:56.067035 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.067211 (+   176us) service_pool.cc:227] Handling call
0811 16:04:58.701747 (+2634536us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003476d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.701856 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5012482304}
I20260811 16:04:58.841475 13908 rpcz_store.cc:276] 0811 16:04:57.154671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.154942 (+   271us) service_pool.cc:227] Handling call
0811 16:04:57.155380 (+   438us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:57.155829 (+   449us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:57.155869 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:58.436109 (+1280240us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:04:58.436524 (+   415us) log.cc:842] Serialized 26 byte log entry
0811 16:04:58.591430 (+154906us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:58.591467 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:58.591543 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:58.703226 (+111683us) raft_consensus.cc:1671] finished
0811 16:04:58.703246 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:58.703450 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":471,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":17338,"spinlock_wait_cycles":81072384,"thread_start_us":154503,"threads_started":1,"wal-append.queue_time_us":262400}
W20260811 16:04:58.843530 14583 rpcz_store.cc:269] 0811 16:04:56.784377 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.784483 (+   106us) service_pool.cc:227] Handling call
0811 16:04:58.702578 (+1918095us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400571f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.702689 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":419070720}
W20260811 16:04:58.674804 14544 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.044s (SENT)
I20260811 16:04:58.596534 17624 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:04:58.845228 13741 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:58.846395 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.905339 13739 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:58.738649 17485 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:58.909576 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:58.586520 17614 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.873360 13906 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:58.910422 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.905367 13827 raft_consensus.cc:2362] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7. Re-sending same reply.
I20260811 16:04:58.911501 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:58.874601 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.753322 17561 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.751853 17481 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:58.882313 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:58.929471 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 410761us
I20260811 16:04:58.929884 13735 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 11 because replica has last-logged OpId of term: 8 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:04:58.883198 17092 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:58.883045 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.930645 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:58.815069 17447 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:58.883595 17392 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:04:58.880379 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:58.872977 17637 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
W20260811 16:04:58.885313 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 196331us
W20260811 16:04:58.936550 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2238) took 2143 ms (client timeout 1723 ms). Trace:
I20260811 16:04:58.886143 17563 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260811 16:04:58.936972 13909 rpcz_store.cc:269] 0811 16:04:56.788996 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.789120 (+   124us) service_pool.cc:227] Handling call
0811 16:04:58.931798 (+2142678us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003b01d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.931902 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":338198272}
I20260811 16:04:58.779507 17641 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:58.786561 17621 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:58.903107 13901 rpcz_store.cc:276] 0811 16:04:57.220171 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.721986 (+1501815us) service_pool.cc:227] Handling call
0811 16:04:58.842184 (+120198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.902772 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:04:58.904485 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 229827us
I20260811 16:04:58.945717 13823 raft_consensus.cc:2362] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7. Re-sending same reply.
W20260811 16:04:58.946369 14544 leader_election.cc:334] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.926s (SENT)
I20260811 16:04:58.946782 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:58.874681 17546 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:58.914848 17648 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:58.914059 17291 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:58.880766 13737 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:58.910434 13908 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:58.914105 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.912328 13906 raft_consensus.cc:2362] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:04:58.967186 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.935527 17602 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:58.909097 17629 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:58.919632 17596 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:04:58.928583 13822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 629) took 1360 ms (client timeout 1592 ms). Trace:
I20260811 16:04:58.930913 17092 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:58.931092 13903 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:58.932401 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:58.991343 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2017) took 1588 ms. Trace:
W20260811 16:04:58.919734 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45221.6us
I20260811 16:04:58.991742 13903 rpcz_store.cc:276] 0811 16:04:57.402529 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.851954 (+1449425us) service_pool.cc:227] Handling call
0811 16:04:58.991269 (+139315us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.898944 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:58.938071 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.898563 17430 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:04:58.899715 17653 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:58.927235 17372 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.301s	user 0.010s	sys 0.003s
I20260811 16:04:58.942080 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:58.869791 17601 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:58.948732 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:58.955214 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:58.958446 17615 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.604s	user 0.001s	sys 0.001s
I20260811 16:04:58.961025 17528 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:58.963176 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.705s (SENT)
I20260811 16:04:58.993016 13909 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
W20260811 16:04:59.000295 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 106105us
I20260811 16:04:58.962731 17563 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:58.747867 17628 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.928073 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.008323 13825 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:58.968418 17637 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:04:59.009028 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53930.4us
W20260811 16:04:58.986691 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72717.3us
I20260811 16:04:59.009146 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 636) took 1398 ms. Trace:
W20260811 16:04:58.986930 13822 rpcz_store.cc:269] 0811 16:04:57.568055 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.568281 (+   226us) service_pool.cc:227] Handling call
0811 16:04:58.928380 (+1360099us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:58.928527 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":449718656}
I20260811 16:04:59.009650 13825 rpcz_store.cc:276] 0811 16:04:57.610889 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.996329 (+1385440us) service_pool.cc:227] Handling call
0811 16:04:59.007936 (+ 11607us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:59.008849 (+   913us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.009086 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.995187 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.010962 13821 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260811 16:04:59.011680 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:59.012214 13903 raft_consensus.cc:2362] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11. Re-sending same reply.
I20260811 16:04:59.012585 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2258) took 1034 ms. Trace:
I20260811 16:04:59.012831 13903 rpcz_store.cc:276] 0811 16:04:57.978402 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.997911 (+1019509us) service_pool.cc:227] Handling call
0811 16:04:59.012546 (+ 14635us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.993070 17092 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:58.996126 14583 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:58.947714 17462 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:58.964995 17291 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:58.999044 13901 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:58.969038 17406 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:04:59.000869 14544 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.737s (SENT)
I20260811 16:04:59.056926 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2251) took 1565 ms. Trace:
I20260811 16:04:59.057055 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.034687 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.058342 13739 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:04:59.058189 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57353.4us
I20260811 16:04:59.057483 13901 rpcz_store.cc:276] 0811 16:04:57.491226 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.945548 (+1454322us) service_pool.cc:227] Handling call
0811 16:04:59.056863 (+111315us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.000306 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2257) took 1130 ms. Trace:
I20260811 16:04:59.059610 13909 rpcz_store.cc:276] 0811 16:04:57.870179 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.937787 (+1067608us) service_pool.cc:227] Handling call
0811 16:04:59.000248 (+ 62461us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:58.884930 16875 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260811 16:04:58.947407 17555 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.001284 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:59.075079 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73921.9us
I20260811 16:04:59.076081 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:59.016721 17541 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.647s	user 0.011s	sys 0.004s
I20260811 16:04:58.943558 17604 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.923272 13817 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260811 16:04:59.107780 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 635) took 1497 ms. Trace:
I20260811 16:04:59.108148 13817 rpcz_store.cc:276] 0811 16:04:57.610593 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.553442 (+942849us) service_pool.cc:227] Handling call
0811 16:04:58.553771 (+   329us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:59.107502 (+553731us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.107721 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.108879 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.109386 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.011531 13908 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:04:58.990764 17608 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:58.874099 17619 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:58.995456 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130915us
I20260811 16:04:59.073882 17557 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:59.060052 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.061347 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.062261 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.063038 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.063828 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.064806 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:59.065927 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50830.5us
I20260811 16:04:59.122228 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 554) took 2337 ms. Trace:
I20260811 16:04:59.067317 17622 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.007517 17528 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.067605 17596 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.115497 17541 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:59.138681 17552 consensus_queue.cc:1159] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:04:58.999130 17653 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.158144 17541 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:59.015345 17563 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:04:59.069566 17654 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260811 16:04:58.993801 17643 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.070350 17658 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:59.115825 17645 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:59.116925 17555 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:59.070876 17629 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:58.994709 17447 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.000262 17601 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:59.173476 17563 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.076939 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:59.175806 17653 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:59.003961 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:04:59.177155 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173287us
I20260811 16:04:59.080320 17576 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:59.081040 17628 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.073999 17291 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:59.083479 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:59.187417 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 110539us
I20260811 16:04:59.084474 17464 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.085107 17618 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.085719 17648 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:04:59.070895 17232 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.087244 17163 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.086863 17383 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:04:59.209280 13906 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:59.089766 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.071239 17637 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.090754 17158 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.091517 17600 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:59.054005 17411 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.420s	user 0.013s	sys 0.002s
I20260811 16:04:59.094799 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 941) took 2311 ms. Trace:
I20260811 16:04:59.186635 17309 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.095243 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.266199 13739 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:59.267479 13739 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260811 16:04:59.268586 13739 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:04:59.093506 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 632) took 1484 ms. Trace:
I20260811 16:04:59.109704 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2246) took 1822 ms. Trace:
I20260811 16:04:59.269682 13901 rpcz_store.cc:276] 0811 16:04:57.287036 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.073088 (+1786052us) service_pool.cc:227] Handling call
0811 16:04:59.109643 (+ 36555us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.269601 13826 rpcz_store.cc:276] 0811 16:04:57.609543 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.609706 (+   163us) service_pool.cc:227] Handling call
0811 16:04:57.610047 (+   341us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:58.403962 (+793915us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.093287 (+689325us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540025f154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:04:59.093449 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1710766848}
I20260811 16:04:59.270853 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.271392 13826 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:59.272154 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.272696 13826 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:59.007838 13824 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:59.007349 17662 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:58.995018 17602 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:04:59.127255 13823 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:59.128104 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.282086 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.282758 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:59.131628 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:59.130119 13707 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.590s (SENT)
I20260811 16:04:59.133138 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.283416 14575 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:04:59.129249 13904 rpcz_store.cc:276] 0811 16:04:56.784642 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.786099 (+  1457us) service_pool.cc:227] Handling call
0811 16:04:56.791729 (+  5630us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:57.092732 (+301003us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:57.092783 (+    51us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:57.138454 (+ 45671us) log.cc:842] Serialized 52 byte log entry
0811 16:04:57.542710 (+404256us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:04:57.607072 (+ 64362us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.607726 (+   654us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:57.607924 (+   198us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:58.707103 (+1099179us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:04:59.109214 (+402111us) raft_consensus.cc:1671] finished
0811 16:04:59.121917 (+ 12703us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:59.122135 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":299806,"prepare.queue_time_us":62133,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":280483,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":43227,"spinlock_wait_cycles":12222720,"thread_start_us":304242,"threads_started":1,"wal-append.queue_time_us":922738}
W20260811 16:04:59.120956 17431 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260811 16:04:59.128403 14583 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:59.125896 17650 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260811 16:04:59.151597 17619 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:59.156853 17622 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.073035 17546 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260811 16:04:59.163792 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:59.264482 17360 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:58.999899 17372 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.115640 17608 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:59.167909 13909 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:59.014947 17481 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.154749 17528 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.067341 17641 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.2, Last appended by leader: 2, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:59.311596 17671 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260811 16:04:59.313678 17372 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.320286 17602 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:04:59.325567 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2015) took 1994 ms (client timeout 2066 ms). Trace:
W20260811 16:04:59.326174 13900 rpcz_store.cc:269] 0811 16:04:57.330718 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.802478 (+471760us) service_pool.cc:227] Handling call
0811 16:04:59.325338 (+1522860us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54002c1ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:59.325490 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":985339648}
I20260811 16:04:59.300974 17622 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.327574 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.329571 17622 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.330470 17458 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:59.331728 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2010) took 2092 ms (client timeout 1823 ms). Trace:
W20260811 16:04:59.332221 13907 rpcz_store.cc:269] 0811 16:04:57.239205 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.250562 (+ 11357us) service_pool.cc:227] Handling call
0811 16:04:59.331497 (+2080935us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:59.331645 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2510300416}
I20260811 16:04:59.333467 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:59.337942 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 640) took 1693 ms (client timeout 2201 ms). Trace:
W20260811 16:04:59.338440 13827 rpcz_store.cc:269] 0811 16:04:57.644495 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.402730 (+758235us) service_pool.cc:227] Handling call
0811 16:04:59.337747 (+935017us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b5400125554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:59.337875 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":826891520}
I20260811 16:04:59.188014 13903 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:04:59.344327 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2261) took 1181 ms. Trace:
I20260811 16:04:59.344733 13903 rpcz_store.cc:276] 0811 16:04:58.162909 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.057085 (+894176us) service_pool.cc:227] Handling call
0811 16:04:59.344259 (+287174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.191742 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.163473 17557 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.188268 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.346010 13738 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:59.198895 16849 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:59.115154 17652 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260811 16:04:59.208091 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:59.348528 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 160372us
W20260811 16:04:59.349227 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 141280us
I20260811 16:04:59.183584 17576 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:59.350395 17458 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:59.186462 17624 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
W20260811 16:04:59.095114 13709 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.409s (SENT)
I20260811 16:04:59.261875 14573 rpcz_store.cc:276] 0811 16:04:56.783788 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.783901 (+   113us) service_pool.cc:227] Handling call
0811 16:04:57.043447 (+259546us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:57.043913 (+   466us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:04:57.293120 (+249207us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.478998 (+185878us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.479179 (+   181us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:57.534551 (+ 55372us) log.cc:842] Serialized 52 byte log entry
0811 16:04:57.534735 (+   184us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:57.534766 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:57.534830 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:59.094587 (+1559757us) raft_consensus.cc:1671] finished
0811 16:04:59.094608 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:59.094743 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43521,"prepare.queue_time_us":302147,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":6712,"raft.queue_time_us":93765,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":23696,"thread_start_us":280777,"threads_started":2,"wal-append.queue_time_us":854794}
I20260811 16:04:59.110522 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2019) took 1628 ms. Trace:
I20260811 16:04:59.273538 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.279074 13739 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:59.279558 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:59.283563 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 153492us
I20260811 16:04:59.283679 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:59.286561 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.178363 17555 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.287752 13817 raft_consensus.cc:2396] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:04:59.298451 13743 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:04:59.164953 14544 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.138s (SENT)
I20260811 16:04:59.299821 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.302280 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.277452 17662 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:59.290189 17612 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.306879 17608 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:59.275520 17411 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:04:59.310628 17232 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.180713 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:59.402427 13742 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:59.341041 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:59.403396 14583 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:04:59.405237 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 240306us
W20260811 16:04:59.406020 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.162s (SENT)
I20260811 16:04:59.341475 13820 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260811 16:04:59.201553 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 644) took 1553 ms (client timeout 1705 ms). Trace:
W20260811 16:04:59.407719 13818 rpcz_store.cc:269] 0811 16:04:57.647869 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.680134 (+ 32265us) service_pool.cc:227] Handling call
0811 16:04:59.201352 (+1521218us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54000e1fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:59.201478 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1062488448}
I20260811 16:04:59.334843 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.354300 17576 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:59.191673 17618 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.353446 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.376751 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:04:59.428436 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77364us
I20260811 16:04:59.429287 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.376965 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:59.376704 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:59.377607 13824 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:59.432500 14582 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:59.304023 16875 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.389353 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.354800 17620 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:04:59.391799 17380 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.348433 16849 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:59.433050 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:59.379577 17600 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260811 16:04:59.387372 17392 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260811 16:04:59.399945 17504 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:04:59.377843 17575 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.005s
I20260811 16:04:59.409466 13907 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:04:59.457063 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53446.9us
I20260811 16:04:59.461838 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:59.463594 14542 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:04:59.414013 14544 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.201s (SENT)
I20260811 16:04:59.420755 13738 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260811 16:04:59.422075 13823 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:04:59.407545 13904 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:59.378036 13908 rpcz_store.cc:276] 0811 16:04:57.482034 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.903661 (+1421627us) service_pool.cc:227] Handling call
0811 16:04:59.110437 (+206776us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.467650 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.468132 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:59.439697 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.470029 13908 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:59.470341 13818 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:59.441545 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2260) took 1279 ms. Trace:
I20260811 16:04:59.449633 13742 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:04:59.472817 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.474050 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.470988 13903 rpcz_store.cc:276] 0811 16:04:58.162422 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.429006 (+1266584us) service_pool.cc:227] Handling call
0811 16:04:59.441459 (+ 12453us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.474938 13827 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:59.476852 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.477820 13903 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:59.474051 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.481124 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:04:59.482185 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1877718749456108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260811 16:04:59.482626 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0338718750281259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260811 16:04:59.482401 13742 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:04:59.485997 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:04:59.486783 13742 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:59.487619 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:04:59.497287 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 402187us
W20260811 16:04:59.499292 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52228us
I20260811 16:04:59.474400 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:59.478829 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.449795 13743 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:59.381680 17638 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:59.382267 17662 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:59.534341 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:59.534631 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:04:59.455868 17648 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.454109 14573 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260811 16:04:59.451663 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1921) took 1953 ms. Trace:
I20260811 16:04:59.436755 13737 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260811 16:04:59.469204 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55233.1us
I20260811 16:04:59.504096 13908 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:04:59.544510 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:04:59.545004 14544 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.248s (SENT)
I20260811 16:04:59.545395 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:59.545542 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.523737 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.506317 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:59.389496 17612 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.527576 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.527822 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.445065 16849 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:59.549595 13823 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:04:59.551081 14544 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.929s (SENT)
W20260811 16:04:59.552363 14544 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.996s (SENT)
W20260811 16:04:59.525826 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44820.2us
I20260811 16:04:59.450631 17458 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:04:59.534952 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.554672 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:59.555790 13827 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:59.546597 13904 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:59.536192 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.503024 17658 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:04:59.537449 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 806) took 2618 ms (client timeout 2483 ms). Trace:
W20260811 16:04:59.560230 14574 rpcz_store.cc:269] 0811 16:04:56.918999 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.222282 (+303283us) service_pool.cc:227] Handling call
0811 16:04:59.537222 (+2314940us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54003dcf54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:04:59.537378 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":900635392}
I20260811 16:04:59.537611 14578 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:04:59.453467 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:59.543833 13736 rpcz_store.cc:276] 0811 16:04:57.497950 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.499304 (+  1354us) service_pool.cc:227] Handling call
0811 16:04:57.499694 (+   390us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:04:57.539914 (+ 40220us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:57.539962 (+    48us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:04:57.540795 (+   833us) log.cc:842] Serialized 78 byte log entry
0811 16:04:57.646376 (+105581us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:04:57.696945 (+ 50569us) log.cc:842] Serialized 14 byte log entry
0811 16:04:59.196720 (+1499775us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b1800312760. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:04:59.451245 (+254525us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.451321 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:59.451361 (+    40us) raft_consensus.cc:1671] finished
0811 16:04:59.451439 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:04:59.451604 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39665,"prepare.queue_time_us":50345,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3200,"raft.queue_time_us":631800,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":58832,"spinlock_wait_cycles":14842752,"thread_start_us":329729,"threads_started":2,"wal-append.queue_time_us":430269,"wal-append.run_cpu_time_us":2682,"wal-append.run_wall_time_us":1118938}
I20260811 16:04:59.561712 13824 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:59.538887 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:59.564393 13903 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:04:59.564797 13903 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:04:59.539584 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:04:59.448329 17614 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.455643 17639 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:04:59.445887 16875 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.444855 17163 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:04:59.497874 17542 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:04:59.448485 14583 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:04:59.536973 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:04:59.614023 13738 raft_consensus.cc:2354] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:04:59.524050 17635 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:04:59.472277 17504 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:59.563493 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.571074 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.530051 17232 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:59.576687 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.352001 17557 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.497164 17645 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:59.607707 17095 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:59.606371 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.606371 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.534039 17309 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:59.528875 17563 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:04:59.579015 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:04:59.650708 13818 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:04:59.612495 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.452373 17380 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.608446 14580 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260811 16:04:59.558880 17383 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:59.628001 17635 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:59.472455 17575 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.627063 13903 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.621598 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.632158 17528 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:04:59.555473 17458 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:04:59.640455 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77062us
W20260811 16:04:59.640731 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69777.5us
I20260811 16:04:59.579216 17637 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:04:59.647326 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.647348 13823 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:59.681780 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:59.647977 13824 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:59.647228 13904 raft_consensus.cc:2362] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7. Re-sending same reply.
I20260811 16:04:59.557962 17648 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.649840 17309 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:59.655989 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:04:59.527024 17638 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.629959 17614 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:04:59.720559 13900 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:04:59.651414 13827 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:04:59.643559 17621 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:59.642202 17232 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:04:59.684667 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.651741 17639 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.689536 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.655369 17504 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.678988 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:04:59.743674 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.693074 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.691051 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.670786 17635 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:04:59.708571 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52711.4us
W20260811 16:04:59.712141 14542 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.578s (SENT)
I20260811 16:04:59.761257 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:59.725037 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190770us
I20260811 16:04:59.663461 17095 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:59.663798 17372 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:04:59.745455 13904 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:04:59.706543 13903 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:59.766086 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:59.741739 13824 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:04:59.759163 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:04:59.761345 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49266.8us
I20260811 16:04:59.659888 17605 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:04:59.767668 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:59.704670 17458 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:04:59.767829 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.713658 17596 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:59.769757 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.789019 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.790369 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.791077 13824 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:04:59.792495 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.794689 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:59.795884 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:04:59.719772 17637 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:04:59.798243 13827 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:04:59.777258 13903 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:04:59.578085 17658 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.810216 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.758033 17232 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:04:59.771740 17672 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260811 16:04:59.717486 17485 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.005s
I20260811 16:04:59.784523 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.817963 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.717136 17618 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.819229 13904 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260811 16:04:59.720238 17158 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:59.653579 17645 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.806635 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.826253 13903 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:04:59.713447 17309 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:04:59.826362 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.811785 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:04:59.827425 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.813647 14582 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:04:59.810910 13823 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:04:59.828102 13903 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:59.828186 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:59.770074 17092 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.005s
I20260811 16:04:59.828891 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.830099 13903 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:59.793275 13824 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:04:59.831763 13903 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:04:59.833400 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2002) took 2615 ms. Trace:
I20260811 16:04:59.833622 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:04:59.725651 17383 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260811 16:04:59.833947 13903 rpcz_store.cc:276] 0811 16:04:57.218245 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.830714 (+2612469us) service_pool.cc:227] Handling call
0811 16:04:59.831551 (+   837us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:59.833147 (+  1596us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.833349 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:04:59.841747 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:04:59.825830 17601 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.005s
I20260811 16:04:59.846654 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.757288 17406 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260811 16:04:59.742187 17614 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.849258 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.811291 17411 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:04:59.837154 17685 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260811 16:04:59.853030 14580 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:04:59.853861 13907 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260811 16:04:59.781821 17372 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.770452 17650 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260811 16:04:59.859171 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 135671us
I20260811 16:04:59.838925 17652 raft_consensus.cc:2741] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260811 16:04:59.834344 17688 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:04:59.848460 17687 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:04:59.848881 17360 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:04:59.886153 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:04:59.890604 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.891484 13907 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:59.891649 14582 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: []
I20260811 16:04:59.884588 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:04:59.892108 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.893385 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.893997 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:04:59.857297 17524 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260811 16:04:59.891734 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.856225 17692 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:04:59.829516 17485 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.903447 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.833319 17092 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:04:59.893630 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:04:59.861822 16875 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.851255 17601 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.901703 17158 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:04:59.901631 17557 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.902601 17518 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:59.919634 17680 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260811 16:04:59.919854 17681 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260811 16:04:59.920377 17679 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260811 16:04:59.921478 17658 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:04:59.921941 17682 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260811 16:04:59.922358 17648 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.924158 17504 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.899452 17637 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:04:59.927635 17608 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.541s	user 0.004s	sys 0.008s
I20260811 16:04:59.927932 17645 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.928627 17614 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.911564 17380 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.904520 17605 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:59.937099 17608 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.938439 17605 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.939230 17608 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:04:59.914012 17575 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.942027 17601 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:04:59.905994 17692 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:04:59.944734 17692 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:04:59.958269 17638 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:04:59.782105 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:04:59.994264 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 212111us
W20260811 16:04:59.780198 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 273971us
I20260811 16:04:59.999101 13740 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:00.006237 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 194436us
I20260811 16:05:00.013983 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:00.024942 13901 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:04:59.894461 13904 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:00.027846 13907 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260811 16:05:00.028636 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2006) took 2808 ms. Trace:
I20260811 16:05:00.029042 13907 rpcz_store.cc:276] 0811 16:04:57.219835 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.892090 (+2672255us) service_pool.cc:227] Handling call
0811 16:05:00.027234 (+135144us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:00.028361 (+  1127us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.028567 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.027860 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2011) took 2788 ms. Trace:
I20260811 16:05:00.031855 13904 rpcz_store.cc:276] 0811 16:04:57.239476 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.893942 (+2654466us) service_pool.cc:227] Handling call
0811 16:04:59.894215 (+   273us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.027064 (+132849us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.027599 (+   535us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.033706 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.035547 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.037187 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 657) took 1863 ms. Trace:
I20260811 16:05:00.037674 13818 rpcz_store.cc:276] 0811 16:04:58.173779 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.840158 (+1666379us) service_pool.cc:227] Handling call
0811 16:05:00.015508 (+175350us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:00.016157 (+   649us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.016201 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:00.017630 (+  1429us) log.cc:842] Serialized 26 byte log entry
0811 16:05:00.036654 (+ 19024us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:00.036699 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.036778 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:00.036826 (+    48us) raft_consensus.cc:1671] finished
0811 16:05:00.036836 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.036958 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":18361,"threads_started":1,"wal-append.queue_time_us":5665}
I20260811 16:05:00.039274 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36246 (request call id 46) took 3497 ms. Trace:
I20260811 16:05:00.040748 13904 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:05:00.037417 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:00.043839 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 247830us
I20260811 16:05:00.044967 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1699) took 3186 ms. Trace:
I20260811 16:05:00.047011 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 634) took 2436 ms. Trace:
I20260811 16:04:59.920253 17372 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:00.060034 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55043.7us
I20260811 16:05:00.055902 13744 rpcz_store.cc:276] 0811 16:04:56.858050 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.229624 (+371574us) service_pool.cc:227] Handling call
0811 16:04:57.230117 (+   493us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:58.525751 (+1295634us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.044224 (+1518473us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002774d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:00.044719 (+   495us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2725813632}
I20260811 16:05:00.056035 13820 rpcz_store.cc:276] 0811 16:04:57.610258 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.552284 (+942026us) service_pool.cc:227] Handling call
0811 16:04:59.341051 (+788767us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:59.407646 (+ 66595us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.046410 (+638764us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b5400125550. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.046765 (+   355us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1813247232}
W20260811 16:05:00.043886 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2255) took 2373 ms (client timeout 1920 ms). Trace:
W20260811 16:05:00.085631 13905 rpcz_store.cc:269] 0811 16:04:57.670275 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.731914 (+1061639us) service_pool.cc:227] Handling call
0811 16:05:00.043255 (+1311341us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54000884d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.043615 (+   360us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1873445248}
I20260811 16:04:59.912647 17383 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:00.087492 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.088579 13905 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:00.089825 17481 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:00.089875 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:04:59.943630 17485 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:00.104679 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:00.114761 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2252) took 2568 ms (client timeout 2865 ms). Trace:
W20260811 16:05:00.114948 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 805) took 3196 ms (client timeout 1794 ms). Trace:
I20260811 16:05:00.115166 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:00.115321 14581 rpcz_store.cc:269] 0811 16:04:56.918629 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:57.059374 (+140745us) service_pool.cc:227] Handling call
0811 16:05:00.114522 (+3055148us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.114750 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3229463424}
I20260811 16:05:00.112569 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 563) took 1064 ms. Trace:
I20260811 16:05:00.054219 13902 rpcz_store.cc:276] 0811 16:04:56.541962 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.542250 (+   288us) service_pool.cc:227] Handling call
0811 16:05:00.038859 (+3496609us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54002c1ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.039038 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4218688768}
W20260811 16:05:00.126041 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2016) took 2750 ms (client timeout 2694 ms). Trace:
I20260811 16:05:00.127934 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 656) took 1255 ms. Trace:
I20260811 16:05:00.128405 13740 rpcz_store.cc:276] 0811 16:04:58.872294 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.872438 (+   144us) service_pool.cc:227] Handling call
0811 16:05:00.127577 (+1255139us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002099d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.127825 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2441662208}
I20260811 16:05:00.128988 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:00.129997 14582 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:00.130677 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:00.131935 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 652) took 2370 ms. Trace:
I20260811 16:05:00.132381 13825 rpcz_store.cc:276] 0811 16:04:57.761958 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.024700 (+1262742us) service_pool.cc:227] Handling call
0811 16:04:59.273828 (+249128us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:59.293730 (+ 19902us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:59.293759 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:59.299501 (+  5742us) log.cc:842] Serialized 52 byte log entry
0811 16:04:59.534013 (+234512us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:59.777793 (+243780us) log.cc:842] Serialized 14 byte log entry
0811 16:04:59.820706 (+ 42913us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.820802 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:59.998686 (+177884us) raft_consensus.cc:1671] finished
0811 16:04:59.998762 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.131521 (+132759us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54002dc8d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.131722 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":293640,"prepare.queue_time_us":413427,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":64945,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":26438,"spinlock_wait_cycles":451660544,"thread_start_us":383680,"threads_started":2,"wal-append.queue_time_us":366060}
W20260811 16:05:00.134399 17619 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.002s
I20260811 16:04:59.915303 17158 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:00.137498 17158 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.139434 14580 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:00.140239 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 558) took 1093 ms. Trace:
I20260811 16:05:00.140311 13827 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:00.128301 16875 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:00.141438 16875 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:04:59.930805 17309 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.141716 17601 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.141916 16875 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.142299 17601 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:00.142506 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2334) took 1546 ms. Trace:
I20260811 16:05:00.142815 17601 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:04:59.861486 17095 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.144100 13907 raft_consensus.cc:2362] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5. Re-sending same reply.
I20260811 16:05:00.144492 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.116747 13900 rpcz_store.cc:276] 0811 16:04:59.048339 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.327241 (+278902us) service_pool.cc:227] Handling call
0811 16:05:00.112134 (+784893us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54000343d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.112371 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":901651200}
W20260811 16:05:00.115262 13909 rpcz_store.cc:269] 0811 16:04:57.546201 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.060295 (+1514094us) service_pool.cc:227] Handling call
0811 16:05:00.114364 (+1054069us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400320d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.114555 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90000256}
I20260811 16:05:00.142872 13827 rpcz_store.cc:276] 0811 16:04:58.596437 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.846250 (+1249813us) service_pool.cc:227] Handling call
0811 16:04:59.846667 (+   417us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.140875 (+294208us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.142194 (+  1319us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400125054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:00.142444 (+   250us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":673564544}
W20260811 16:05:00.126839 13906 rpcz_store.cc:269] 0811 16:04:57.375965 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.966830 (+1590865us) service_pool.cc:227] Handling call
0811 16:05:00.125446 (+1158616us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400142654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.125755 (+   309us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":555266816}
I20260811 16:05:00.140730 13901 rpcz_store.cc:276] 0811 16:04:59.046828 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.285017 (+238189us) service_pool.cc:227] Handling call
0811 16:05:00.139924 (+854907us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400022454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.140159 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1486763264}
I20260811 16:05:00.160183 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.161788 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.163596 17092 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:00.090770 17481 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.170315 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.172199 17481 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:00.176559 17662 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.007s
I20260811 16:05:00.178256 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.178601 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:00.169456 17648 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:00.176239 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:00.181955 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51572.7us
I20260811 16:05:00.182410 17555 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:00.183096 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:00.187845 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.189316 13901 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:00.176483 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.192247 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.192764 13904 raft_consensus.cc:2362] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6. Re-sending same reply.
I20260811 16:05:00.193248 13909 raft_consensus.cc:2362] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7. Re-sending same reply.
I20260811 16:05:00.193815 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.194175 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.190618 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.192308 13900 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:00.196601 13909 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:00.186736 17518 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.199786 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:00.200804 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56277.1us
I20260811 16:05:00.201846 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:00.202400 17576 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.757s	user 0.014s	sys 0.000s
W20260811 16:05:00.202593 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46401us
I20260811 16:05:00.202979 17576 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:00.204685 17291 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.015s	user 0.009s	sys 0.013s
I20260811 16:05:00.206265 17576 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:00.127976 17705 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:00.206480 17291 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.208314 13735 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:00.208258 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:05:00.209223 17291 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:00.209167 13902 raft_consensus.cc:595] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:00.209786 13902 raft_consensus.cc:603] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:00.209904 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.210626 13906 raft_consensus.cc:2362] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5. Re-sending same reply.
I20260811 16:05:00.210992 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:00.212056 13741 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 5: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:00.212404 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:00.211994 13740 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:00.205690 13901 raft_consensus.cc:2362] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9. Re-sending same reply.
I20260811 16:05:00.213680 13906 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:00.214313 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2256) took 2467 ms. Trace:
I20260811 16:05:00.214537 13901 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:00.215099 13901 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:00.214668 13906 rpcz_store.cc:276] 0811 16:04:57.747346 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.212755 (+2465409us) service_pool.cc:227] Handling call
0811 16:05:00.213259 (+   504us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.214034 (+   775us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.214234 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.217401 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:05:00.224313 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:00.177191 17662 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.227877 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2254) took 2605 ms. Trace:
I20260811 16:05:00.229517 13907 raft_consensus.cc:2354] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:00.228806 13902 rpcz_store.cc:276] 0811 16:04:57.612014 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.211086 (+2599072us) service_pool.cc:227] Handling call
0811 16:05:00.211563 (+   477us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.217278 (+  5715us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.217325 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.217403 (+    78us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:00.217449 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.217518 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.217632 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.231948 17705 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:00.233352 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 405099us
I20260811 16:05:00.234634 17705 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.235044 13901 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.236228 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:00.236812 13901 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:00.237568 17648 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:00.239449 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 56581.4us
I20260811 16:05:00.239665 13825 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:00.232069 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.216037 17518 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:00.244174 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 99007.5us
I20260811 16:05:00.222870 17595 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Stepping down as leader of term 4
W20260811 16:05:00.250609 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 74669.1us
I20260811 16:05:00.257041 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:00.244061 17518 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.259102 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:00.256845 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 654) took 2161 ms. Trace:
I20260811 16:05:00.260294 13823 rpcz_store.cc:276] 0811 16:04:57.956754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.836269 (+1879515us) service_pool.cc:227] Handling call
0811 16:05:00.019422 (+183153us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:00.020533 (+  1111us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.020573 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:00.021180 (+   607us) log.cc:842] Serialized 26 byte log entry
0811 16:05:00.073524 (+ 52344us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:00.086455 (+ 12931us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.117010 (+ 30555us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.117092 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:00.117128 (+    36us) raft_consensus.cc:1671] finished
0811 16:05:00.117138 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.117265 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30155,"prepare.queue_time_us":53559,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":105912,"raft.run_cpu_time_us":662,"raft.run_wall_time_us":30703,"thread_start_us":51439,"threads_started":1,"wal-append.queue_time_us":57539}
I20260811 16:05:00.265622 17692 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:00.268424 17713 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.269289 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:00.253669 17595 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:00.249701 17635 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:00.265412 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50566.4us
I20260811 16:05:00.346500 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:00.350322 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108937us
I20260811 16:05:00.272805 13825 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.347301 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 954) took 1928 ms. Trace:
W20260811 16:05:00.376605 17643 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.008s	sys 0.008s
I20260811 16:05:00.378118 17095 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260811 16:05:00.379951 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 178265us
I20260811 16:05:00.351122 13909 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260811 16:05:00.378791 17643 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.008s	sys 0.008s
I20260811 16:05:00.381223 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2249) took 2993 ms. Trace:
I20260811 16:05:00.381769 13909 rpcz_store.cc:276] 0811 16:04:57.387754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.216319 (+2828565us) service_pool.cc:227] Handling call
0811 16:05:00.263013 (+ 46694us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.380874 (+117861us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.381147 (+   273us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.347591 13904 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
W20260811 16:05:00.282619 17542 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.005s
I20260811 16:05:00.295063 17291 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:00.283689 17392 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260811 16:05:00.271520 17605 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:00.284957 17309 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:00.345589 13817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1588) took 1265 ms (client timeout 1650 ms). Trace:
I20260811 16:05:00.282420 17639 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.389015 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:00.397996 13817 rpcz_store.cc:269] 0811 16:04:59.079605 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.109014 (+ 29409us) service_pool.cc:227] Handling call
0811 16:05:00.345040 (+1236026us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400125f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.345381 (+   341us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":407695616}
I20260811 16:05:00.399101 13823 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:00.399744 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:00.387046 17158 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.400660 13823 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260811 16:05:00.401335 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1581) took 1390 ms. Trace:
I20260811 16:05:00.401614 13823 rpcz_store.cc:276] 0811 16:04:59.010560 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.400029 (+1389469us) service_pool.cc:227] Handling call
0811 16:05:00.400433 (+   404us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:00.401064 (+   631us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.401257 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:00.389943 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 120471us
I20260811 16:05:00.402729 17158 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.404505 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:00.374051 14579 rpcz_store.cc:276] 0811 16:04:58.419844 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:58.427488 (+  7644us) service_pool.cc:227] Handling call
0811 16:04:58.427912 (+   424us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:58.428335 (+   423us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:58.428363 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:58.428950 (+   587us) log.cc:842] Serialized 52 byte log entry
0811 16:04:58.605649 (+176699us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:58.681888 (+ 76239us) log.cc:842] Serialized 14 byte log entry
0811 16:04:58.682114 (+   226us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:58.682183 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:58.889161 (+206978us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18003ca060. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:00.325457 (+1436296us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b18003ca060. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:00.346719 (+ 21262us) raft_consensus.cc:1671] finished
0811 16:05:00.346743 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.347047 (+   304us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":76125,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":88506,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":55984,"spinlock_wait_cycles":107754624,"thread_start_us":176106,"threads_started":1,"wal-append.queue_time_us":327292}
W20260811 16:05:00.390605 17716 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260811 16:05:00.407042 17378 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:00.408816 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 653) took 2559 ms. Trace:
I20260811 16:05:00.410015 17688 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:00.410658 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:00.411739 13818 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:00.412487 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1591) took 1332 ms. Trace:
I20260811 16:05:00.412658 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 867) took 1349 ms. Trace:
I20260811 16:05:00.409350 13821 rpcz_store.cc:276] 0811 16:04:57.849119 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.053852 (+1204733us) service_pool.cc:227] Handling call
0811 16:04:59.071334 (+ 17482us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:59.071733 (+   399us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:59.071769 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:59.076348 (+  4579us) log.cc:842] Serialized 26 byte log entry
0811 16:05:00.049746 (+973398us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18003ecce0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:05:00.239568 (+189822us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:00.251274 (+ 11706us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.264824 (+ 13550us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.265494 (+   670us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:00.408269 (+142775us) raft_consensus.cc:1671] finished
0811 16:05:00.408416 (+   147us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.408623 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":9320,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":5760,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":30615,"spinlock_wait_cycles":2302848,"thread_start_us":176245,"threads_started":1,"wal-append.queue_time_us":1204413}
I20260811 16:05:00.413277 14578 rpcz_store.cc:276] 0811 16:04:59.062611 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.291247 (+228636us) service_pool.cc:227] Handling call
0811 16:04:59.537443 (+246196us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:59.573181 (+ 35738us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.412220 (+839039us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54003dcf50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.412431 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":565430656}
I20260811 16:05:00.413957 17628 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.414490 17628 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:00.341301 17674 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.940s	user 0.002s	sys 0.000s
I20260811 16:05:00.414888 17628 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.408845 17622 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.416375 17622 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:00.416436 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:00.416986 17622 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.418009 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:00.418803 13820 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:00.419726 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 650) took 2769 ms. Trace:
I20260811 16:05:00.420130 13822 rpcz_store.cc:276] 0811 16:04:57.650188 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.010237 (+1360049us) service_pool.cc:227] Handling call
0811 16:04:59.065792 (+ 55555us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:59.075216 (+  9424us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:59.075267 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:59.096327 (+ 21060us) log.cc:842] Serialized 26 byte log entry
0811 16:04:59.282856 (+186529us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:04:59.282893 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:59.282954 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:00.340122 (+1057168us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:00.419208 (+ 79086us) raft_consensus.cc:1671] finished
0811 16:05:00.419244 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.419559 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1436,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":9470,"spinlock_wait_cycles":26194688,"thread_start_us":151296,"threads_started":1,"wal-append.queue_time_us":291226}
I20260811 16:05:00.422235 17702 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.422734 17702 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:00.385651 17542 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:05:00.414296 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:00.412878 13818 rpcz_store.cc:276] 0811 16:04:59.080429 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.411044 (+1330615us) service_pool.cc:227] Handling call
0811 16:05:00.411450 (+   406us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.412200 (+   750us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.412416 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.431356 14580 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:00.269835 17662 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:00.347597 17648 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:00.434554 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43544.1us
W20260811 16:05:00.343446 17678 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.624s	user 0.000s	sys 0.002s
I20260811 16:05:00.387512 17605 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:00.435534 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1592) took 1311 ms. Trace:
I20260811 16:05:00.380585 17713 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:00.368575 16875 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.423152 17702 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.386111 17291 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:00.443991 13821 rpcz_store.cc:276] 0811 16:04:59.113981 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.414323 (+1300342us) service_pool.cc:227] Handling call
0811 16:05:00.414720 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.415013 (+   293us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.415037 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.415081 (+    44us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:00.415115 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.424940 (+  9825us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.425064 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.390486 17705 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:00.447242 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:00.410676 17688 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.444551 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.448786 17713 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.451032 17605 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:00.452083 17624 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.004s	sys 0.023s
I20260811 16:05:00.453703 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:00.454644 14573 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:05:00.450598 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2003) took 3046 ms. Trace:
W20260811 16:05:00.468299 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 122053us
I20260811 16:05:00.383834 17458 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:00.468343 17624 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.004s	sys 0.023s
I20260811 16:05:00.460502 17291 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:00.460716 17705 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:00.475747 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:00.478372 13822 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:00.478525 17684 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:00.481413 17684 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:00.482174 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:00.483029 17553 raft_consensus.cc:2741] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260811 16:05:00.473300 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:00.483858 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:00.470376 17431 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:00.486271 13909 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.486764 14578 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:00.470177 13903 rpcz_store.cc:276] 0811 16:04:57.218650 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.847407 (+2628757us) service_pool.cc:227] Handling call
0811 16:04:59.847719 (+   312us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:04:59.848115 (+   396us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:59.848143 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:04:59.852517 (+  4374us) log.cc:842] Serialized 26 byte log entry
0811 16:05:00.232986 (+380469us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:00.233115 (+   129us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.233249 (+   134us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:00.250684 (+ 17435us) raft_consensus.cc:1671] finished
0811 16:05:00.250704 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.265090 (+ 14386us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2541,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4449,"thread_start_us":138494,"threads_started":1,"wal-append.queue_time_us":360868}
I20260811 16:05:00.494906 13818 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:05:00.478830 17378 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:00.498342 17378 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:00.498521 17718 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260811 16:05:00.498831 17378 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.502123 17431 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.484549 17705 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:00.509454 17431 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:00.503386 13907 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.507213 13908 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:00.501219 14583 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:00.513759 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1590) took 1430 ms. Trace:
I20260811 16:05:00.515694 13821 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 10 index: 3. (index mismatch)
I20260811 16:05:00.482524 17684 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.491600 17662 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:00.472399 17692 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260811 16:05:00.493660 17648 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:00.517566 13817 rpcz_store.cc:276] 0811 16:04:59.080132 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.406924 (+1326792us) service_pool.cc:227] Handling call
0811 16:05:00.407886 (+   962us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.411134 (+  3248us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:00.412369 (+  1235us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.504633 (+ 92264us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.504686 (+    53us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:00.510372 (+  5686us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.510457 (+    85us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.510586 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":219,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":28644,"thread_start_us":60674,"threads_started":1}
I20260811 16:05:00.517385 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2336) took 1699 ms. Trace:
I20260811 16:05:00.483381 17624 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:00.486089 17518 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:00.527974 16849 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.908s	user 0.002s	sys 0.018s
I20260811 16:05:00.547566 16849 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.549791 16849 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:00.550596 13905 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:00.553396 17518 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:00.554646 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50286.6us
I20260811 16:05:00.520512 17662 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:00.531471 17380 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:05:00.535610 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:00.536010 17637 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:00.532280 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:00.535437 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:00.537977 17477 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:00.539023 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:00.541599 13825 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:00.522679 13826 rpcz_store.cc:276] 0811 16:04:58.691304 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.167736 (+1476432us) service_pool.cc:227] Handling call
0811 16:05:00.176935 (+  9199us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.177485 (+   550us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:00.177984 (+   499us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.384014 (+206030us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.384064 (+    50us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:00.384114 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.384172 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.390800 (+  6628us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10535,"prepare.queue_time_us":2291,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":61363,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":27909,"thread_start_us":126105,"threads_started":1,"wal-append.queue_time_us":182539}
I20260811 16:05:00.572440 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:00.573485 17477 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:00.573935 17477 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:00.574460 17720 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260811 16:05:00.575176 17477 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:00.546893 17232 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.690s	user 0.016s	sys 0.000s
I20260811 16:05:00.579167 13901 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260811 16:05:00.583417 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:00.594834 17477 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.595453 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:00.595966 17622 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.596635 13736 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.598708 17619 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:00.599416 17619 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.601622 17619 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:00.598552 17622 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.518860 17601 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.602946 17606 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260811 16:05:00.603940 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 566) took 1488 ms. Trace:
I20260811 16:05:00.604483 17601 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.605315 17542 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:00.605979 17542 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.608397 17542 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.604341 13900 rpcz_store.cc:276] 0811 16:04:59.115189 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.216037 (+1100848us) service_pool.cc:227] Handling call
0811 16:05:00.248235 (+ 32198us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.323569 (+ 75334us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:00.469569 (+146000us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.603607 (+134038us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.603659 (+    52us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:00.603701 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.603762 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.603872 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20516,"prepare.queue_time_us":236513,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2836,"raft.queue_time_us":20636,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"thread_start_us":206874,"threads_started":2}
I20260811 16:05:00.611191 13900 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:00.611995 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 655) took 2464 ms. Trace:
I20260811 16:05:00.612358 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2021) took 1082 ms. Trace:
I20260811 16:05:00.612841 13900 rpcz_store.cc:276] 0811 16:04:59.530077 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.610219 (+1080142us) service_pool.cc:227] Handling call
0811 16:05:00.610802 (+   583us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.611698 (+   896us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.612265 (+   567us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.612489 13824 rpcz_store.cc:276] 0811 16:04:58.028848 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.832348 (+1803500us) service_pool.cc:227] Handling call
0811 16:04:59.832779 (+   431us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:59.834036 (+  1257us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:00.238519 (+404483us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.439448 (+200929us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.459234 (+ 19786us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:00.469348 (+ 10114us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.476499 (+  7151us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.492014 (+ 15515us) inbound_call.cc:173] Queueing success response
0811 16:05:00.573677 (+ 81663us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:00.576931 (+  3254us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b1800397e40. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f
Metrics: {"mutex_wait_us":10226,"prepare.queue_time_us":113693,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":70161,"spinlock_wait_cycles":38018560,"thread_start_us":517470,"threads_started":2,"wal-append.queue_time_us":211243}
I20260811 16:05:00.615428 17637 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.616381 13900 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:00.617051 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2022) took 1086 ms. Trace:
I20260811 16:05:00.617398 13900 rpcz_store.cc:276] 0811 16:04:59.530402 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.614123 (+1083721us) service_pool.cc:227] Handling call
0811 16:05:00.614586 (+   463us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.616804 (+  2218us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.616999 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.617189 17624 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.619992 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:00.621243 17637 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.582559 13901 pending_rounds.cc:76] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 7
W20260811 16:05:00.631938 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93022us
I20260811 16:05:00.632964 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:00.567628 17662 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:00.628619 13901 pending_rounds.cc:97] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260811 16:05:00.638599 13901 raft_consensus.cc:2866] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:00.633308 17635 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.664235 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:00.668524 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88948.4us
I20260811 16:05:00.670241 17604 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:00.671406 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:00.676445 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 233534us
I20260811 16:05:00.677215 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:00.656792 17458 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:00.686530 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45266.4us
I20260811 16:05:00.693785 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2263) took 1645 ms. Trace:
I20260811 16:05:00.697317 13901 rpcz_store.cc:276] 0811 16:04:59.048613 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.213887 (+1165274us) service_pool.cc:227] Handling call
0811 16:05:00.214329 (+   442us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.693423 (+479094us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.693697 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.525789 17595 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.712445 13901 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260811 16:05:00.714527 14578 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:00.717206 14579 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:00.652917 17232 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.723331 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:00.723758 17232 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.722457 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:00.783394 17602 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.026s	sys 0.011s
W20260811 16:05:00.783918 17602 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.026s	sys 0.011s
I20260811 16:05:00.725446 17619 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:00.725590 17392 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260811 16:05:00.679095 17705 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.784879 13823 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:00.769313 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2025) took 1077 ms. Trace:
I20260811 16:05:00.823926 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:00.937163 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 234967us
I20260811 16:05:00.818462 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:00.879493 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 176727us
I20260811 16:05:00.944170 13901 rpcz_store.cc:276] 0811 16:04:59.639188 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.698328 (+1059140us) service_pool.cc:227] Handling call
0811 16:05:00.711967 (+ 13639us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.712986 (+  1019us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.713246 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:00.818835 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:00.801605 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 659) took 1712 ms (client timeout 2101 ms). Trace:
W20260811 16:05:00.955404 13735 rpcz_store.cc:269] 0811 16:04:59.089275 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.089458 (+   183us) service_pool.cc:227] Handling call
0811 16:05:00.732266 (+1642808us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400310e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:00.801522 (+ 69256us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2240180096}
I20260811 16:05:00.962495 13736 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:00.838802 16875 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:00.818364 17232 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:00.972570 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 573) took 1417 ms. Trace:
I20260811 16:05:00.973127 13900 rpcz_store.cc:276] 0811 16:04:59.555107 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.624436 (+1069329us) service_pool.cc:227] Handling call
0811 16:05:00.624850 (+   414us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.625184 (+   334us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:00.626809 (+  1625us) log.cc:842] Serialized 14 byte log entry
0811 16:05:00.972088 (+345279us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:00.972175 (+    87us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:00.972235 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.972327 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:00.972490 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":266821,"prepare.queue_time_us":4719,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":9121,"thread_start_us":320851,"threads_started":1}
I20260811 16:05:00.799489 17602 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:00.980942 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:00.800259 17645 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:00.818895 17481 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:00.994372 17481 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:00.994951 17481 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:00.979172 13909 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:00.999595 17574 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:05:00.999956 17611 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.657s	user 0.013s	sys 0.009s
I20260811 16:05:00.784906 17619 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.983837 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.000974 14579 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:00.979774 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:00.988009 17542 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:00.988591 17601 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:00.989326 17465 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:00.621062 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:01.006930 17465 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.008680 13741 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:05:01.009189 17465 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.009824 17542 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.010670 14579 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
W20260811 16:05:01.011674 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 308099us
I20260811 16:05:01.012466 17542 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.012677 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:00.990413 17612 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:00.990832 17477 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:05:01.002749 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 803) took 4196 ms. Trace:
I20260811 16:05:00.993810 16849 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:01.014978 17619 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.014846 16849 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.985075 17595 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:05:01.014034 14577 rpcz_store.cc:276] 0811 16:04:56.806129 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:56.806298 (+   169us) service_pool.cc:227] Handling call
0811 16:04:56.891074 (+ 84776us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:04:56.920557 (+ 29483us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:04:57.152569 (+232012us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.531526 (+378957us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:04:57.544741 (+ 13215us) log.cc:842] Serialized 52 byte log entry
0811 16:04:57.544898 (+   157us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:57.545127 (+   229us) log.cc:842] Serialized 14 byte log entry
0811 16:04:57.547955 (+  2828us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:04:57.548051 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:04:58.550780 (+1002729us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b48000606d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:00.158018 (+1607238us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b48000606d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:00.961518 (+803500us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:01.002289 (+ 40771us) raft_consensus.cc:1671] finished
0811 16:05:01.002311 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:01.002511 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29643,"prepare.queue_time_us":390487,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":179827,"raft.run_cpu_time_us":36024,"raft.run_wall_time_us":3527480,"spinlock_wait_cycles":115061760,"thread_start_us":368141,"threads_started":2,"wal-append.queue_time_us":946442}
I20260811 16:05:01.015914 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.017158 16849 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.000247 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 872) took 1936 ms. Trace:
I20260811 16:05:00.977799 17232 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.978106 17458 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260811 16:05:01.019981 17232 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.002060 13909 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260811 16:05:01.020645 13909 pending_rounds.cc:76] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 4
I20260811 16:05:01.020912 13909 pending_rounds.cc:97] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260811 16:05:01.020172 16849 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260811 16:05:01.021803 17601 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:01.021502 17602 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.022249 17601 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:01.022749 17601 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:01.019857 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:01.023865 17602 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.018246 14575 rpcz_store.cc:276] 0811 16:04:59.063954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.290607 (+226653us) service_pool.cc:227] Handling call
0811 16:04:59.291015 (+   408us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:04:59.452801 (+161786us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:04:59.452829 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:04:59.452862 (+    33us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:04:59.452889 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.999813 (+1546924us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54006dfbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:00.999914 (+   101us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:01.000073 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":371558784}
I20260811 16:05:00.969312 17380 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260811 16:05:01.030293 17481 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.021202 13909 raft_consensus.cc:2866] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:01.031387 16849 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:01.032931 13909 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:01.035432 13871 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10.
I20260811 16:05:01.035077 17232 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:01.039158 13909 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:05:01.050076 13742 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:01.050179 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.053061 17232 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
W20260811 16:05:01.035813 17734 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.204s	user 0.004s	sys 0.001s
I20260811 16:05:01.055411 13909 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:05:01.056175 13735 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:05:01.056726 13909 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:01.059595 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.061041 13742 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:01.062459 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:00.824150 17713 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:00.807217 17702 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.072760 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.088500 13901 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:01.090477 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:00.798257 17688 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.093024 13909 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:01.092555 13741 raft_consensus.cc:2354] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:01.094745 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2029) took 1279 ms. Trace:
I20260811 16:05:01.095252 13901 rpcz_store.cc:276] 0811 16:04:59.816070 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.963437 (+1147367us) service_pool.cc:227] Handling call
0811 16:05:01.070839 (+107402us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.094432 (+ 23593us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.094665 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:01.092516 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:01.100958 13735 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:01.101771 17618 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:01.102604 13735 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260811 16:05:01.102705 17729 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.276s	user 0.000s	sys 0.005s
I20260811 16:05:01.103616 17637 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:01.089715 17606 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260811 16:05:01.104213 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 569) took 1761 ms. Trace:
I20260811 16:05:01.104784 17481 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.104244 17637 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.085582 17553 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260811 16:05:01.107478 17637 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.107638 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1583) took 2046 ms. Trace:
I20260811 16:05:01.108011 13823 rpcz_store.cc:276] 0811 16:04:59.060936 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.402386 (+1341450us) service_pool.cc:227] Handling call
0811 16:05:00.402818 (+   432us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.916249 (+513431us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.107409 (+191160us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:01.107577 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":877996416}
I20260811 16:05:01.109337 17645 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:01.109781 17645 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:00.868110 17628 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:00.830470 17291 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.128666 13900 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:05:00.998780 17378 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.132571 13741 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:01.104686 13902 rpcz_store.cc:276] 0811 16:04:59.342938 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.248623 (+905685us) service_pool.cc:227] Handling call
0811 16:05:00.323547 (+ 74924us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:00.394761 (+ 71214us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.394812 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:00.461296 (+ 66484us) log.cc:842] Serialized 26 byte log entry
0811 16:05:00.700431 (+239135us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:00.700470 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:00.700547 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:01.101834 (+401287us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:01.103867 (+  2033us) raft_consensus.cc:1671] finished
0811 16:05:01.103895 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:01.104116 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":11716,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":226,"spinlock_wait_cycles":198013312,"thread_start_us":215551,"threads_started":1,"wal-append.queue_time_us":351249}
W20260811 16:05:01.134755 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62130.2us
I20260811 16:05:01.141646 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2032) took 1281 ms. Trace:
I20260811 16:05:01.142158 13900 rpcz_store.cc:276] 0811 16:04:59.860117 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.043793 (+1183676us) service_pool.cc:227] Handling call
0811 16:05:01.097425 (+ 53632us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.130505 (+ 33080us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.141575 (+ 11070us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:01.129974 17481 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:01.093866 17601 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.157588 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:01.159037 13744 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:01.224936 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53017us
I20260811 16:05:01.148713 17637 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:01.233734 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.227479 17705 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.247040 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.247890 17563 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:01.248603 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:01.249274 13900 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:01.250161 17738 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260811 16:05:01.246171 17637 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:01.251070 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99341.7us
I20260811 16:05:01.252453 17291 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.252996 17637 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.254329 17702 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.255398 17561 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:01.255630 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:01.256042 17561 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:01.257983 17719 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.872s	user 0.005s	sys 0.008s
W20260811 16:05:01.262424 17732 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.429s	user 0.000s	sys 0.008s
I20260811 16:05:01.264895 17713 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.265242 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 665) took 3571 ms. Trace:
W20260811 16:05:01.265477 17736 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.433s	user 0.000s	sys 0.007s
I20260811 16:05:01.265632 13901 rpcz_store.cc:276] 0811 16:04:57.693978 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.111112 (+3417134us) service_pool.cc:227] Handling call
0811 16:05:01.265124 (+154012us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:01.267589 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.268440 13909 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:01.237991 17684 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260811 16:05:01.269433 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.270118 13909 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:01.273128 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.273949 13902 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260811 16:05:01.274616 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:01.276118 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1595) took 1990 ms. Trace:
I20260811 16:05:01.276520 13822 rpcz_store.cc:276] 0811 16:04:59.289727 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.421733 (+1132006us) service_pool.cc:227] Handling call
0811 16:05:00.422161 (+   428us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:00.480678 (+ 58517us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.275896 (+795218us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54000983d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:01.276060 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":128779136}
I20260811 16:05:01.278625 13736 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:01.279668 17601 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.280313 17481 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:01.281369 17481 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:01.284467 17673 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.892s	user 0.004s	sys 0.008s
I20260811 16:05:01.284858 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.286187 14575 raft_consensus.cc:2396] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260811 16:05:01.285003 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.287017 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2035) took 1265 ms. Trace:
I20260811 16:05:01.287559 14579 raft_consensus.cc:2354] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:01.287452 13905 rpcz_store.cc:276] 0811 16:05:00.021396 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.089410 (+ 68014us) service_pool.cc:227] Handling call
0811 16:05:01.286821 (+1197411us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54002c0bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:01.286958 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1056776960}
I20260811 16:05:01.289078 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:01.154392 17232 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:01.292311 17232 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:01.295928 13908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2026) took 1638 ms (client timeout 2182 ms). Trace:
I20260811 16:05:01.252367 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.305894 13906 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:01.318141 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65866.9us
I20260811 16:05:01.315462 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.311939 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.310832 17561 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.330209 13737 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:01.331272 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.332387 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:01.333488 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:01.296432 13908 rpcz_store.cc:269] 0811 16:04:59.657597 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.689223 (+ 31626us) service_pool.cc:227] Handling call
0811 16:05:01.295678 (+1606455us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54000c7454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:01.295855 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1748787968}
I20260811 16:05:01.341693 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.346385 14574 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:01.349346 14578 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:01.353317 17232 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:01.354326 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 98864.5us
I20260811 16:05:01.354598 17392 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:01.355572 17684 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:01.355882 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:01.356402 17431 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:01.356923 17431 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:01.357115 17606 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:01.357858 14582 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260811 16:05:01.357776 17606 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.356464 13741 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260811 16:05:01.240347 17662 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.578s	user 0.014s	sys 0.027s
I20260811 16:05:01.362910 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 571) took 1932 ms. Trace:
I20260811 16:05:01.357993 17431 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.363478 17628 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.371637 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:01.318141 17625 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:01.372412 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.318218 17637 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:01.308277 17378 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.382936 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.387490 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.388029 13901 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:01.390511 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.393322 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 572) took 1962 ms. Trace:
I20260811 16:05:01.394098 13907 rpcz_store.cc:276] 0811 16:04:59.431762 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.634813 (+1203051us) service_pool.cc:227] Handling call
0811 16:05:00.672058 (+ 37245us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:00.706361 (+ 34303us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.706394 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:00.807093 (+100699us) log.cc:842] Serialized 26 byte log entry
0811 16:05:01.078361 (+271268us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:01.078395 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.078462 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:01.393071 (+314609us) raft_consensus.cc:1671] finished
0811 16:05:01.393092 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:01.393244 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":85882,"raft.queue_time_us":20794,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7132,"thread_start_us":250533,"threads_started":1,"wal-append.queue_time_us":543181}
I20260811 16:05:01.398820 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.382306 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.384342 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:01.359336 17688 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.459343 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:01.364017 17553 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260811 16:05:01.460357 13905 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:01.461416 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 105598us
I20260811 16:05:01.465500 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:01.466672 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55185us
I20260811 16:05:01.469300 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.469513 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:01.470042 13741 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:01.470712 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.368928 17612 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260811 16:05:01.469624 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:01.475590 14578 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7.
I20260811 16:05:01.366245 13903 rpcz_store.cc:276] 0811 16:04:59.430467 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.502167 (+1071700us) service_pool.cc:227] Handling call
0811 16:05:00.519004 (+ 16837us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:00.598407 (+ 79403us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.598437 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:00.599071 (+   634us) log.cc:842] Serialized 52 byte log entry
0811 16:05:00.700558 (+101487us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:00.993442 (+292884us) log.cc:842] Serialized 14 byte log entry
0811 16:05:01.034801 (+ 41359us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:01.335437 (+300636us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.335532 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:01.335581 (+    49us) raft_consensus.cc:1671] finished
0811 16:05:01.362767 (+ 27186us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:01.362866 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":256083,"prepare.queue_time_us":629211,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":40864,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"spinlock_wait_cycles":141945088,"thread_start_us":442588,"threads_started":2,"wal-append.queue_time_us":232343}
I20260811 16:05:01.377079 17662 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.485028 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.381661 17637 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:01.487596 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:01.461490 17625 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:01.490729 13907 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:01.489398 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.493940 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:01.499558 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.506114 14583 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:01.501740 17662 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:01.461336 17392 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:01.507761 13905 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:01.510044 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.516631 13908 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:05:01.480525 17431 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:01.483752 17624 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:01.523591 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:01.531385 13821 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:01.532641 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.529457 13900 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:01.533680 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:01.542982 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58038.3us
I20260811 16:05:01.544138 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.548105 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.547818 17637 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.547847 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.549718 14581 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260811 16:05:01.550074 17624 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:01.566740 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.569885 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.565029 13738 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:05:01.573520 14574 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:01.522322 17688 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:01.576205 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:01.582127 14577 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:01.584352 17722 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.010s	sys 0.045s
W20260811 16:05:01.585103 17722 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.010s	sys 0.046s
W20260811 16:05:01.588889 13740 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.019s	sys 0.020s
W20260811 16:05:01.595837 13740 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.019s	sys 0.020s
W20260811 16:05:01.584313 14544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.690s (SENT) [suppressed 50 similar messages]
I20260811 16:05:01.602643 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:01.593616 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 568) took 2295 ms. Trace:
I20260811 16:05:01.609148 13906 rpcz_store.cc:276] 0811 16:04:59.297717 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.228852 (+931135us) service_pool.cc:227] Handling call
0811 16:05:01.296681 (+1067829us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.319659 (+ 22978us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:01.593254 (+273595us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000c7450. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:01.593488 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2444186368}
I20260811 16:05:01.599586 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:01.611593 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.617719 13737 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:01.622637 13738 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:01.619514 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:01.624073 14573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 821) took 2174 ms (client timeout 2246 ms). Trace:
W20260811 16:05:01.627172 14573 rpcz_store.cc:269] 0811 16:04:59.449181 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:59.544267 (+ 95086us) service_pool.cc:227] Handling call
0811 16:05:01.623796 (+2079529us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54007152d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:01.623992 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2057979648}
W20260811 16:05:01.622197 17595 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.000s
W20260811 16:05:01.627700 17618 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.005s
W20260811 16:05:01.634519 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55555.6us
I20260811 16:05:01.644793 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:01.650960 13904 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.014s	sys 0.035s
W20260811 16:05:01.654264 13904 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.014s	sys 0.035s
I20260811 16:05:01.655035 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.664742 13817 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:05:01.665522 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.674225 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.640566 17604 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:01.686993 13821 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:01.654384 17618 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:01.653540 17688 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:01.673195 17606 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:01.712391 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:01.717154 13743 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.031s	sys 0.048s
W20260811 16:05:01.723358 13743 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.032s	sys 0.048s
I20260811 16:05:01.723368 13740 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:01.719038 14583 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:01.679420 17595 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:01.717734 17648 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:01.687858 17619 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:01.692999 17380 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:01.749934 17648 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.714224 17604 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:01.751814 13738 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:01.753078 17384 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:01.753666 17604 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.753902 17384 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.756127 17624 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:01.756721 17384 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.684610 17392 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:01.756894 17624 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:01.758695 17731 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.823s	user 0.000s	sys 0.004s
I20260811 16:05:01.644879 17625 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.713420 17628 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260811 16:05:01.736505 17736 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260811 16:05:01.763743 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 182102us
I20260811 16:05:01.693167 17699 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260811 16:05:01.738178 17688 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:01.763404 17624 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.782881 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.791786 13738 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:05:01.793886 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:01.798388 13735 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.033s
W20260811 16:05:01.798913 13735 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.017s	sys 0.033s
I20260811 16:05:01.803227 17384 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:01.803835 17384 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:01.806562 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1306515709729865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260811 16:05:01.807121 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0694515708601102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260811 16:05:01.807500 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0433515709592029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260811 16:05:01.808045 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0154515709728003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260811 16:05:01.807170 17602 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:01.809032 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:01.811228 17747 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:01.811441 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:01.807379 17624 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:01.812440 17648 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.812825 17624 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:01.813423 17624 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:01.809046 17602 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:01.819700 17728 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.996s	user 0.006s	sys 0.004s
I20260811 16:05:01.805194 17384 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.827055 14583 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:01.760443 17705 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260811 16:05:01.835206 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:01.835788 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:01.760354 17619 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.765430 17595 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.768196 17618 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260811 16:05:01.797837 17380 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:01.830248 17699 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:01.778076 17232 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260811 16:05:01.853289 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:01.823366 17713 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:01.855827 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:01.872650 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 288484us
W20260811 16:05:01.885545 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76587.6us
I20260811 16:05:01.890952 16875 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:01.891650 16875 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:01.893028 16875 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.895926 16875 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:01.854931 17602 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.882893 17384 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:01.913385 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:01.916464 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 124724us
I20260811 16:05:01.872684 17755 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:01.925958 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:01.929306 13903 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:01.867832 17628 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
I20260811 16:05:01.902772 17232 consensus_queue.cc:1225] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260811 16:05:01.946686 13824 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:05:01.946866 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:01.942817 13741 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
W20260811 16:05:01.968367 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58687.2us
I20260811 16:05:01.904510 17713 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:01.916899 17699 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:01.978797 17596 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:01.982550 17759 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260811 16:05:01.943889 17628 consensus_queue.cc:1225] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260811 16:05:01.989192 17739 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.748s	user 0.001s	sys 0.004s
I20260811 16:05:01.989874 17713 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.990123 17722 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:01.990788 17722 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:01.991876 17595 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:01.992149 17722 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.993278 17619 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:01.994166 17722 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:01.904284 17688 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:01.999992 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:02.000643 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 570) took 2625 ms. Trace:
I20260811 16:05:02.001044 13736 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:02.001466 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:02.002547 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.003631 17747 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:02.003942 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 674) took 1472 ms. Trace:
I20260811 16:05:02.004083 17754 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:02.001268 17763 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260811 16:05:02.004703 13871 leader_election.cc:398] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:02.005179 13871 leader_election.cc:401] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260811 16:05:02.005815 17754 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:02.004107 17747 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:02.006387 17747 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:02.002092 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:01.930872 17602 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:02.004357 13744 rpcz_store.cc:276] 0811 16:05:00.531327 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.534281 (+  2954us) service_pool.cc:227] Handling call
0811 16:05:02.003760 (+1469479us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54000a9bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:02.003881 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1349421952}
I20260811 16:05:02.012624 13823 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:02.006989 13871 leader_election.cc:398] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:02.015654 13871 leader_election.cc:401] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260811 16:05:01.928427 17755 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:01.931623 17684 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:01.992187 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:01.977900 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.001252 13904 rpcz_store.cc:276] 0811 16:04:59.375614 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.484464 (+1108850us) service_pool.cc:227] Handling call
0811 16:05:00.517996 (+ 33532us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:00.599691 (+ 81695us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:00.599737 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:00.600487 (+   750us) log.cc:842] Serialized 52 byte log entry
0811 16:05:00.677246 (+ 76759us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:01.264516 (+587270us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:01.329805 (+ 65289us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b180036bbc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:01.655916 (+326111us) log.cc:842] Serialized 14 byte log entry
0811 16:05:01.676525 (+ 20609us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.000202 (+323677us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b54002ad0d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:02.000274 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:02.000346 (+    72us) raft_consensus.cc:1671] finished
0811 16:05:02.000363 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.000562 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27197,"prepare.queue_time_us":277108,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":15060,"raft.queue_time_us":55162,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":20072,"spinlock_wait_cycles":239025792,"thread_start_us":784230,"threads_started":2,"wal-append.queue_time_us":231770}
I20260811 16:05:01.913321 17380 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.024343 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.027817 13909 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:02.030153 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.031468 17684 raft_consensus.cc:2741] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260811 16:05:02.034417 17619 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:05:02.035259 17741 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:05:02.035382 17619 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:02.035996 17619 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:02.037302 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:02.038208 13744 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:02.039433 17751 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260811 16:05:02.041800 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2340) took 3349 ms. Trace:
I20260811 16:05:02.042349 13827 rpcz_store.cc:276] 0811 16:04:58.692556 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:00.616854 (+1924298us) service_pool.cc:227] Handling call
0811 16:05:00.617336 (+   482us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.481686 (+864350us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:01.481743 (+    57us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:01.481804 (+    61us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:01.484678 (+  2874us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.041481 (+556803us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b5400124654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:02.041549 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.041721 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1811679616}
I20260811 16:05:02.045969 17378 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:02.046495 17378 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:02.046612 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.046953 17552 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260811 16:05:02.047592 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.047964 17552 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:02.047458 17378 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.049284 13900 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260811 16:05:02.053547 17380 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.046787 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.054735 13908 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:02.056910 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:02.058125 17431 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.001s
W20260811 16:05:02.058506 17645 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.005s
I20260811 16:05:02.060312 17645 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.020058 17602 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.063054 17602 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:02.066504 13742 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:02.067214 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.067838 13906 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:02.075847 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.075706 17699 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.078413 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.079370 13901 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:02.048353 17552 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:02.080456 13737 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:02.074739 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:02.089514 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1954) took 1025 ms. Trace:
I20260811 16:05:02.090278 13743 rpcz_store.cc:276] 0811 16:05:01.064406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.064618 (+   212us) service_pool.cc:227] Handling call
0811 16:05:01.064985 (+   367us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.065269 (+   284us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:01.735417 (+670148us) log.cc:842] Serialized 14 byte log entry
0811 16:05:01.908597 (+173180us) log.cc:842] Serialized 14 byte log entry
0811 16:05:02.089132 (+180535us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:02.089185 (+    53us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:02.089250 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.089317 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.089458 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18774,"prepare.queue_time_us":654631,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":102,"raft.queue_time_us":53268,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":24806,"spinlock_wait_cycles":23317504,"thread_start_us":956069,"threads_started":3}
I20260811 16:05:02.096731 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:02.097812 13737 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:02.102814 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:02.113744 13824 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
W20260811 16:05:02.116441 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 109631us
I20260811 16:05:02.114529 13824 pending_rounds.cc:76] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 8
I20260811 16:05:02.140148 13824 pending_rounds.cc:97] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260811 16:05:02.140646 13824 raft_consensus.cc:2866] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:02.062736 17624 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.063078 17645 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.154512 13909 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:02.139365 13740 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:02.102039 17602 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:02.160950 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86339us
I20260811 16:05:02.162081 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.164199 13901 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:02.141683 17431 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:02.049325 17378 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:02.021303 17755 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:02.170258 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 260603us
W20260811 16:05:02.181522 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49243.5us
I20260811 16:05:02.187583 17431 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:02.187803 17458 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:02.189157 17458 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:02.188829 17431 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.189651 17458 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:02.139772 17643 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:02.205843 13904 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:02.169809 17602 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:02.212927 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.137670 16875 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260811 16:05:02.268600 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.216709 13909 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:02.200965 17648 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:02.184827 17754 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:02.264767 17751 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260811 16:05:02.265772 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:02.225061 17602 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:02.279886 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 982) took 1807 ms. Trace:
W20260811 16:05:02.280750 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 312612us
I20260811 16:05:02.282943 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:02.274441 17760 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:05:02.190752 17458 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.306679 14580 rpcz_store.cc:276] 0811 16:05:00.472737 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.331660 (+858923us) service_pool.cc:227] Handling call
0811 16:05:01.332050 (+   390us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.332341 (+   291us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:01.840321 (+507980us) log.cc:842] Serialized 14 byte log entry
0811 16:05:02.096363 (+256042us) log.cc:842] Serialized 14 byte log entry
0811 16:05:02.279361 (+182998us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:02.279437 (+    76us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:02.279515 (+    78us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.279610 (+    95us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.279792 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":475910,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":191087,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":17097,"thread_start_us":886233,"threads_started":3,"wal-append.queue_time_us":347291}
I20260811 16:05:02.266799 17477 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260811 16:05:02.322484 13901 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:05:02.325832 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 121779us
I20260811 16:05:02.336903 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.339334 13909 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:02.346366 13906 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:02.350622 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:02.287202 17643 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260811 16:05:02.315699 16875 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:02.356455 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.324222 17662 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:02.372007 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.365204 17590 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:05:02.386705 17786 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260811 16:05:02.387516 13627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 211) took 32592 ms (client timeout 15000 ms). Trace:
W20260811 16:05:02.391796 17772 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260811 16:05:02.394026 17777 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260811 16:05:02.366287 17756 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260811 16:05:02.396250 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45705.3us
W20260811 16:05:02.396481 17773 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260811 16:05:02.317477 17648 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.405002 17648 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.406030 17797 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:02.376755 17688 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:02.406636 17797 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.407495 17688 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:02.408057 17688 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:02.305768 17754 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.409037 17797 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:02.410236 17754 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.411384 17756 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:02.411573 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.414069 14575 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:02.414678 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.415210 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.416338 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.417768 17783 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:02.418418 17783 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:02.419654 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:02.420311 17775 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260811 16:05:02.424605 17552 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.425967 17552 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:02.429685 14578 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEARNER]: Advancing to term 6
I20260811 16:05:02.429760 13743 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:05:02.463423 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.470151 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:02.453006 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.475204 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.479447 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.377985 17458 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:02.488952 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:02.490432 14573 pending_rounds.cc:76] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 6
I20260811 16:05:02.492172 14573 pending_rounds.cc:97] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260811 16:05:02.492544 14573 raft_consensus.cc:2866] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:02.493276 14573 pending_rounds.cc:97] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260811 16:05:02.493752 14573 raft_consensus.cc:2866] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:02.500703 17684 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:02.435398 17705 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:02.512072 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:02.482326 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.515194 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.517423 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:02.520267 17790 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260811 16:05:02.521701 17781 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:02.522518 17781 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.523514 17392 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:02.524590 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1611) took 1369 ms. Trace:
I20260811 16:05:02.524398 17783 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.524969 13826 rpcz_store.cc:276] 0811 16:05:01.155315 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.160643 (+  5328us) service_pool.cc:227] Handling call
0811 16:05:01.233371 (+ 72728us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:01.408791 (+175420us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:01.458252 (+ 49461us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:01.996966 (+538714us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4800060cd8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:02.007399 (+ 10433us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:02.021577 (+ 14178us) log.cc:842] Serialized 26 byte log entry
0811 16:05:02.216789 (+195212us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:02.216827 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.216911 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:02.524338 (+307427us) raft_consensus.cc:1671] finished
0811 16:05:02.524366 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.524527 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48529,"raft.queue_time_us":141343,"raft.run_cpu_time_us":4043,"raft.run_wall_time_us":533439,"spinlock_wait_cycles":18939904,"thread_start_us":187100,"threads_started":1,"wal-append.queue_time_us":328933}
I20260811 16:05:02.528342 13909 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260811 16:05:02.509734 17624 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.530892 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.537421 14581 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:05:02.490954 17595 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:05:02.538909 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 182539us
I20260811 16:05:02.553195 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.556339 14575 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:02.560505 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.566233 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.567229 13906 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:02.569823 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:02.571118 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.574023 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.574870 13908 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
W20260811 16:05:02.581542 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 147099us
I20260811 16:05:02.534650 17781 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:02.552239 17392 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:02.589476 13904 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:02.591308 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160942us
I20260811 16:05:02.551687 17380 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260811 16:05:02.615301 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.617324 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.619625 13904 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:05:02.617877 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.621667 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.621603 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.625315 13901 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:02.564229 17705 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.629731 14575 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260811 16:05:02.582909 17384 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260811 16:05:02.612521 17643 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:02.632007 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.636457 13904 raft_consensus.cc:2396] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260811 16:05:02.633351 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 158043us
I20260811 16:05:02.638870 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.600095 17684 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260811 16:05:02.653769 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:02.660713 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:02.667793 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:02.671114 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 115383us
I20260811 16:05:02.672194 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.672394 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:02.673303 13741 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 7
I20260811 16:05:02.678783 13735 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 10 index: 3. (index mismatch)
I20260811 16:05:02.680111 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:02.681512 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1958368070190772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260811 16:05:02.682915 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:02.684270 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66508.5us
I20260811 16:05:02.685134 17705 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.685029 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.652393 17392 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:02.696110 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:02.691906 17784 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260811 16:05:02.692873 17808 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260811 16:05:02.693385 17780 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260811 16:05:02.693830 17796 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260811 16:05:02.704298 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.662122 17624 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:02.711182 13735 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260811 16:05:02.713168 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:02.717566 13823 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:02.707515 13737 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:02.723439 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:02.725497 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45480.2us
I20260811 16:05:02.726723 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.725626 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.727484 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.728155 14580 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:05:02.729310 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:02.729524 13901 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:02.730261 13871 leader_election.cc:398] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8.
I20260811 16:05:02.730309 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:02.706928 17662 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:02.731593 17662 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.731914 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:02.732373 17789 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260811 16:05:02.733414 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:02.733716 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1961) took 1208 ms. Trace:
I20260811 16:05:02.734360 17815 raft_consensus.cc:2741] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260811 16:05:02.734159 13739 rpcz_store.cc:276] 0811 16:05:01.525080 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.847705 (+322625us) service_pool.cc:227] Handling call
0811 16:05:01.866898 (+ 19193us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:01.867215 (+   317us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:01.867252 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:01.886578 (+ 19326us) log.cc:842] Serialized 26 byte log entry
0811 16:05:02.206654 (+320076us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:02.206696 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.206773 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:02.733514 (+526741us) raft_consensus.cc:1671] finished
0811 16:05:02.733536 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.733657 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":272151,"threads_started":1,"wal-append.queue_time_us":632362}
I20260811 16:05:02.736056 17232 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:02.724516 16849 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:02.737483 16849 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.730906 13904 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:02.689076 17754 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:02.682309 17795 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:02.708161 17380 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:02.686650 17643 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:02.792263 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57726.8us
I20260811 16:05:02.798259 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:02.760567 17808 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:02.758638 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:02.798853 13871 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7.
I20260811 16:05:02.761102 16849 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:02.667423 17781 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260811 16:05:02.772701 13741 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
W20260811 16:05:02.795512 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45961.8us
I20260811 16:05:02.796636 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:02.759691 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:02.800606 14578 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260811 16:05:02.690246 17481 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260811 16:05:02.690953 17688 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.707367 17392 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:02.865617 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1001) took 1012 ms. Trace:
W20260811 16:05:02.836607 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78053.2us
I20260811 16:05:02.847301 13820 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:05:02.863306 13823 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:02.868867 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:02.864100 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65405.6us
I20260811 16:05:02.875269 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:03.036542 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.032480 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:03.034572 13906 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:05:02.756904 17788 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260811 16:05:03.043365 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 373214us
I20260811 16:05:02.849401 13825 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:02.762382 17747 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.001s
I20260811 16:05:02.768090 17378 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260811 16:05:02.802731 17755 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.000s
I20260811 16:05:03.060030 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:02.844616 17705 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:05:02.847645 17810 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260811 16:05:02.863747 17602 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
W20260811 16:05:02.891927 17805 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260811 16:05:03.031471 14583 rpcz_store.cc:276] 0811 16:05:01.853123 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.853390 (+   267us) service_pool.cc:227] Handling call
0811 16:05:01.853810 (+   420us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:01.875122 (+ 21312us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:01.875195 (+    73us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:01.912464 (+ 37269us) log.cc:842] Serialized 26 byte log entry
0811 16:05:02.267294 (+354830us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:02.267355 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.267456 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:02.865378 (+597922us) raft_consensus.cc:1671] finished
0811 16:05:02.865404 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:02.865559 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6007,"raft.queue_time_us":16484,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17256,"thread_start_us":261655,"threads_started":1,"wal-append.queue_time_us":436298}
I20260811 16:05:02.733726 17662 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:02.888477 17619 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.852s	user 0.013s	sys 0.001s
I20260811 16:05:02.800093 17756 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260811 16:05:03.122339 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57173.3us
W20260811 16:05:03.170814 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 138437us
W20260811 16:05:02.880162 17812 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260811 16:05:02.792587 17574 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.063189 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:02.893363 17798 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260811 16:05:03.032420 17624 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:03.165400 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 43857.6us
I20260811 16:05:03.128321 17378 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:03.192898 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 507951us
I20260811 16:05:03.182592 13827 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:05:02.847846 17643 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:03.179553 17777 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260811 16:05:02.803632 17754 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:02.834291 17795 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.139038 17722 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260811 16:05:03.246497 17392 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:03.248208 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.260226 13741 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:03.261694 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:03.249096 17807 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:03.251176 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2296) took 1204 ms. Trace:
I20260811 16:05:03.139472 17755 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.263058 13900 rpcz_store.cc:276] 0811 16:05:02.051719 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.066285 (+ 14566us) service_pool.cc:227] Handling call
0811 16:05:02.066599 (+   314us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:02.191408 (+124809us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:02.419038 (+227630us) spinlock_profiling.cc:243] Waited 972 us on lock 0x7b48000603d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:02.449277 (+ 30239us) log.cc:842] Serialized 14 byte log entry
0811 16:05:02.627301 (+178024us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:02.633296 (+  5995us) log.cc:842] Serialized 26 byte log entry
0811 16:05:02.633440 (+   144us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:02.633472 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.633538 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:03.250862 (+617324us) raft_consensus.cc:1671] finished
0811 16:05:03.250971 (+   109us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:03.251092 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":146763,"prepare.queue_time_us":95470,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":124625,"raft.run_cpu_time_us":1188,"raft.run_wall_time_us":227637,"spinlock_wait_cycles":2236288,"thread_start_us":308815,"threads_started":2,"wal-append.queue_time_us":237616}
I20260811 16:05:03.158118 17602 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.128424 17747 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:03.267717 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 231255us
W20260811 16:05:03.271771 17823 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260811 16:05:03.273193 17807 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election won for term 7
W20260811 16:05:03.273602 17822 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260811 16:05:03.267649 17789 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260811 16:05:03.201560 17378 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:03.318958 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:03.177383 17619 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.209381 17574 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:03.276371 17431 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:03.268038 17810 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260811 16:05:03.331851 17688 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.332438 17807 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:03.334693 17648 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Stepping down as leader of term 5
W20260811 16:05:03.337007 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99395.1us
I20260811 16:05:03.368723 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:03.341878 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:03.349611 17747 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.350371 17481 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:03.353639 13905 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:03.199422 17624 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:03.364426 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46589.9us
I20260811 16:05:03.378229 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:03.364975 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46158.2us
I20260811 16:05:03.379662 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:03.375325 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1002) took 1450 ms. Trace:
I20260811 16:05:03.324604 17392 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:03.380975 14577 rpcz_store.cc:276] 0811 16:05:01.925360 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.925572 (+   212us) service_pool.cc:227] Handling call
0811 16:05:01.926010 (+   438us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:02.176837 (+250827us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:02.176869 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:02.188054 (+ 11185us) log.cc:842] Serialized 26 byte log entry
0811 16:05:02.443664 (+255610us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:02.443718 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.443829 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:03.374958 (+931129us) raft_consensus.cc:1671] finished
0811 16:05:03.374993 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:03.375228 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":123021,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"thread_start_us":483401,"threads_started":2,"wal-append.queue_time_us":396908}
W20260811 16:05:03.365629 17477 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.016s	sys 0.025s
W20260811 16:05:03.393173 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 333233us
I20260811 16:05:03.273864 17756 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260811 16:05:03.406615 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:03.376539 17648 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:03.397894 17458 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.898s	user 0.011s	sys 0.002s
I20260811 16:05:03.351766 17431 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.351529 17574 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.406615 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:03.400298 17840 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260811 16:05:03.388094 17392 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:03.395524 17477 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.016s	sys 0.025s
W20260811 16:05:03.449689 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62085.4us
I20260811 16:05:03.454542 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:03.449105 17552 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:03.460951 17552 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.417683 17795 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:03.463402 17792 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:03.463912 17792 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:03.464393 17792 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:03.464239 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:03.464745 17392 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:03.465116 13825 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:03.465953 17846 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:03.466622 17619 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:03.467249 17619 raft_consensus.cc:2741] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260811 16:05:03.463804 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57278.3us
W20260811 16:05:03.444964 17822 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:05:03.468483 13789 leader_election.cc:398] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:03.468822 13789 leader_election.cc:401] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260811 16:05:03.469033 17754 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.418183 17481 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:03.417991 17816 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:03.433867 17856 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.469957 17807 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.470155 17816 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.472263 17624 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.472806 17648 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.475823 17755 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:03.468497 17431 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.403529 17602 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.478624 17847 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:03.479257 17847 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.479981 17552 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.480114 17392 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.481096 17824 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:03.481685 17847 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:03.447570 17747 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260811 16:05:03.483107 17747 consensus_queue.cc:1225] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260811 16:05:03.484444 13902 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:05:03.486769 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:03.466521 17846 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:03.489068 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:03.497473 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.507269 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.514119 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:03.525905 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.528625 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:03.529861 13741 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:03.533499 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:03.533943 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:03.534767 13738 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:03.485239 17458 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:03.537235 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:03.538409 13817 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:03.554790 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:03.537533 17458 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:03.555770 17458 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:05:02.388062 13627 rpcz_store.cc:269] 0811 16:04:29.599646 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:29.642712 (+ 43066us) service_pool.cc:227] Handling call
0811 16:05:02.191993 (+32549281us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:04:58.387330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:04:58.436233 (+ 48903us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:04:58.436274 (+    41us) write_op.cc:435] Acquired schema lock
0811 16:04:58.436294 (+    20us) tablet.cc:660] Decoding operations
0811 16:04:58.437336 (+  1042us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:04:58.437417 (+    81us) write_op.cc:641] Partition lock acquired for write op
0811 16:04:58.437469 (+    52us) tablet.cc:683] Acquiring locks for 5 operations
0811 16:04:58.438147 (+   678us) tablet.cc:699] Row locks acquired
0811 16:04:58.438182 (+    35us) write_op.cc:260] PREPARE: finished
0811 16:04:58.438385 (+   203us) write_op.cc:270] Start()
0811 16:04:58.438530 (+   145us) write_op.cc:276] Timestamp: P: 1786464298438320 usec, L: 0
0811 16:04:58.438565 (+    35us) op_driver.cc:331] REPLICATION: starting
0811 16:04:58.584719 (+146154us) log.cc:842] Serialized 2069 byte log entry
0811 16:04:59.629884 (+1045165us) op_driver.cc:444] REPLICATION: finished
0811 16:04:59.909744 (+279860us) write_op.cc:301] APPLY: starting
0811 16:04:59.916743 (+  6999us) tablet.cc:1365] starting BulkCheckPresence
0811 16:04:59.929077 (+ 12334us) tablet.cc:1368] finished BulkCheckPresence
0811 16:04:59.929549 (+   472us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:04:59.933844 (+  4295us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:04:59.934195 (+   351us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0811 16:04:59.934263 (+    68us) write_op.cc:312] APPLY: finished
0811 16:04:59.934571 (+   308us) log.cc:842] Serialized 47 byte log entry
0811 16:04:59.935658 (+  1087us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:59.935798 (+   140us) write_op.cc:454] Released schema lock
0811 16:04:59.935868 (+    70us) write_op.cc:341] FINISH: Updating metrics
0811 16:04:59.936263 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:04:59.936302 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85937,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":250183,"apply.run_cpu_time_us":4398,"apply.run_wall_time_us":36531,"num_ops":5,"prepare.queue_time_us":969664,"prepare.run_cpu_time_us":24290,"prepare.run_wall_time_us":352718,"raft.queue_time_us":385876,"raft.run_cpu_time_us":8261,"raft.run_wall_time_us":287613,"replication_time_us":1169020,"thread_start_us":1571079,"threads_started":4,"wal-append.queue_time_us":305129,"wal-append.run_cpu_time_us":142410,"wal-append.run_wall_time_us":2103908}]]}
I20260811 16:05:03.556653 17378 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.502925 17747 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.562155 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.472353 17816 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:03.575035 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.500654 17754 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.571161 13737 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:05:03.387404 17817 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260811 16:05:03.505385 17755 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:03.573173 13738 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:03.542835 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 85286.4us
I20260811 16:05:03.513751 17847 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.559039 17378 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.525044 17856 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:03.608259 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:03.587041 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 172572us
I20260811 16:05:03.593379 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.593685 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:03.594692 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.609799 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.610141 13741 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:03.604537 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.609117 13817 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:03.615958 13743 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:03.615747 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.611359 13738 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:03.559733 17552 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260811 16:05:03.629695 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 243030us
I20260811 16:05:03.644968 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:03.558885 17844 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260811 16:05:03.651288 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:03.652801 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:03.661898 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86996.2us
W20260811 16:05:03.678134 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68413.7us
I20260811 16:05:03.683735 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.684095 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.685397 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:03.688720 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:03.689806 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.691854 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:03.687561 17481 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:03.694977 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:03.695631 14583 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:03.653553 17643 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.653414 17754 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:03.708051 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.708452 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:03.687297 17722 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:03.578105 17843 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260811 16:05:03.693645 17856 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.745012 17817 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:03.746421 17817 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:03.748142 17848 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.174s
I20260811 16:05:03.749650 17848 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:05:03.712174 17705 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260811 16:05:03.755769 17705 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:03.755399 17818 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.130s
I20260811 16:05:03.756686 13739 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:03.757814 17818 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:03.759534 17828 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260811 16:05:03.761224 17828 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:03.761667 17828 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:03.755390 17831 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
W20260811 16:05:03.769377 17829 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.283s	user 0.001s	sys 0.001s
I20260811 16:05:03.757889 17836 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:03.779695 17574 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:03.779975 17836 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:03.781467 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:03.720214 17662 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:03.725767 17643 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260811 16:05:03.790776 17834 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260811 16:05:03.800539 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1014) took 1074 ms. Trace:
I20260811 16:05:03.800930 14575 rpcz_store.cc:276] 0811 16:05:02.725990 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.726280 (+   290us) service_pool.cc:227] Handling call
0811 16:05:02.760205 (+ 33925us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:02.760556 (+   351us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:02.760584 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:02.761055 (+   471us) log.cc:842] Serialized 26 byte log entry
0811 16:05:03.061729 (+300674us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:03.061784 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:03.061878 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:03.800331 (+738453us) raft_consensus.cc:1671] finished
0811 16:05:03.800357 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:03.800484 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":114718,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4136,"thread_start_us":300215,"threads_started":1,"wal-append.queue_time_us":825409}
I20260811 16:05:03.693284 17481 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.803463 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:03.804724 17481 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:03.794713 17392 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:03.782975 17851 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:05:03.805747 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 675) took 2120 ms. Trace:
I20260811 16:05:03.806182 13824 rpcz_store.cc:276] 0811 16:05:01.685523 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.965944 (+280421us) service_pool.cc:227] Handling call
0811 16:05:02.015235 (+ 49291us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:02.141272 (+126037us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:03.805351 (+1664079us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b54002db4d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:03.805678 (+   327us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":225172352}
I20260811 16:05:03.824564 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2062) took 1183 ms. Trace:
I20260811 16:05:03.825193 13905 rpcz_store.cc:276] 0811 16:05:02.641038 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.641198 (+   160us) service_pool.cc:227] Handling call
0811 16:05:03.803125 (+1161927us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54002c1ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:03.824451 (+ 21326us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1607182080}
I20260811 16:05:03.797502 17846 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:03.798381 17779 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.514s	user 0.000s	sys 0.003s
I20260811 16:05:03.794801 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 834) took 1099 ms. Trace:
I20260811 16:05:03.781071 17836 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:03.762850 17828 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:04.066560 17836 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:04.090909 17859 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260811 16:05:04.096002 17868 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260811 16:05:04.116623 17848 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:05:04.307691 14583 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.004s
W20260811 16:05:04.308179 17458 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.752s	user 0.016s	sys 0.000s
I20260811 16:05:04.308231 14583 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:04.308876 17458 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:04.313501 17458 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:04.315018 17606 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.728s	user 0.003s	sys 0.003s
W20260811 16:05:04.315510 17606 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.004s	sys 0.003s
W20260811 16:05:04.335763 17792 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.871s	user 0.008s	sys 0.011s
I20260811 16:05:04.336284 17792 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:04.337036 14574 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.034s	sys 0.058s
W20260811 16:05:04.337471 14574 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.034s	sys 0.059s
I20260811 16:05:04.338848 17792 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:04.362936 17648 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:05:04.375101 17778 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.066s	user 0.009s	sys 0.006s
I20260811 16:05:04.444579 17802 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:04.445430 17795 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:04.445218 17802 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:04.446090 17795 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:04.005442 17779 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260811 16:05:04.448030 17802 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:04.448369 17795 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:04.460335 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.011s	sys 0.015s
W20260811 16:05:04.460821 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.011s	sys 0.015s
W20260811 16:05:04.461297 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 752909us
I20260811 16:05:04.461972 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:04.463107 17795 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:04.463557 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:04.463646 17795 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:04.464560 17795 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:04.465562 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:04.468686 17814 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:04.469142 17814 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:04.469542 17814 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:05:04.471108 17477 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.003s	sys 0.011s
W20260811 16:05:04.471582 17477 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.005s	sys 0.011s
I20260811 16:05:04.464783 17802 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:04.475025 17802 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:04.474324 17795 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:04.475740 17802 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:04.478165 17795 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:04.487460 17795 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260811 16:05:04.487473 17814 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:04.491421 17814 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:04.491437 17802 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:04.494429 17802 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:04.580564 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.012s	sys 0.025s
W20260811 16:05:04.581034 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.012s	sys 0.025s
W20260811 16:05:04.581314 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 868744us
I20260811 16:05:04.584900 17542 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:04.585534 17542 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:04.587522 17542 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:04.588825 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:04.590797 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:04.606746 14544 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.632s (SENT)
I20260811 16:05:04.607372 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:04.608204 17635 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260811 16:05:04.608263 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2288) took 2564 ms (client timeout 2035 ms). Trace:
W20260811 16:05:04.608753 13903 rpcz_store.cc:269] 0811 16:05:02.043706 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:04.608025 (+2564319us) service_pool.cc:214] Skipping call since client already timed out
0811 16:05:04.608169 (+   144us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260811 16:05:04.613034 14544 leader_election.cc:334] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.690s (SENT)
I20260811 16:05:04.613824 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:04.615419 17635 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:05.055101 13665 debug-util.cc:398] Leaking SignalData structure 0x7b0800131c80 after lost signal to thread 12388
W20260811 16:05:05.056777 13665 debug-util.cc:398] Leaking SignalData structure 0x7b0800348080 after lost signal to thread 13668
I20260811 16:05:05.890902 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 672) took 4317 ms. Trace:
I20260811 16:05:05.891710 13821 rpcz_store.cc:276] 0811 16:05:01.573406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:01.710967 (+137561us) service_pool.cc:227] Handling call
0811 16:05:01.711391 (+   424us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:01.760975 (+ 49584us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:01.781800 (+ 20825us) log.cc:842] Serialized 14 byte log entry
0811 16:05:02.083710 (+301910us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:02.083769 (+    59us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:02.083807 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:04.374443 (+2290636us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:05.890542 (+1516099us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54002dc8d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:05.890606 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:05.890789 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":21435,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":85,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":13786,"spinlock_wait_cycles":122231936,"thread_start_us":257840,"threads_started":1,"wal-append.queue_time_us":474102}
W20260811 16:05:06.000211 13665 debug-util.cc:398] Leaking SignalData structure 0x7b0800142a40 after lost signal to thread 13686
W20260811 16:05:06.000806 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080036cfa0 after lost signal to thread 13706
W20260811 16:05:06.001045 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08003844a0 after lost signal to thread 13707
W20260811 16:05:06.001328 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0fc0 after lost signal to thread 13709
W20260811 16:05:06.102749 14582 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.409s	user 0.021s	sys 0.010s
W20260811 16:05:06.103266 14582 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.410s	user 0.022s	sys 0.010s
W20260811 16:05:06.105531 17808 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.368s	user 0.016s	sys 0.018s
W20260811 16:05:06.106019 17808 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.380s	user 0.016s	sys 0.018s
I20260811 16:05:06.107931 17795 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.108647 17795 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.109114 17837 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.109742 17837 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.110462 17795 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:06.110994 17795 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.111467 17795 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.111964 17837 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.112560 17837 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.113070 17795 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.113029 17837 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.115417 17837 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.118032 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:06.124289 17869 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.028s	user 0.007s	sys 0.010s
I20260811 16:05:06.125655 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1627) took 2672 ms. Trace:
I20260811 16:05:06.126024 13822 rpcz_store.cc:276] 0811 16:05:03.453325 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.453480 (+   155us) service_pool.cc:227] Handling call
0811 16:05:03.460612 (+  7132us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:03.536752 (+ 76140us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:03.536794 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:03.537269 (+   475us) log.cc:842] Serialized 26 byte log entry
0811 16:05:03.685126 (+147857us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:03.685185 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:03.685289 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:06.123613 (+2438324us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:06.125342 (+  1729us) raft_consensus.cc:1671] finished
0811 16:05:06.125366 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.125590 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":72441,"raft.queue_time_us":98225,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":10807,"spinlock_wait_cycles":4657560960,"thread_start_us":126814,"threads_started":1,"wal-append.queue_time_us":538375}
I20260811 16:05:06.128270 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.128731 17637 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:06.131625 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.131934 13743 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:06.132371 13744 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:06.136234 13743 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260811 16:05:06.139739 13741 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260811 16:05:06.141144 17878 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.037s	user 0.011s	sys 0.007s
I20260811 16:05:06.141930 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:06.142699 14580 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:06.144119 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1017) took 2543 ms. Trace:
I20260811 16:05:06.144507 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:06.145255 14580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 904) took 2537 ms (client timeout 1647 ms). Trace:
W20260811 16:05:06.145555 14580 rpcz_store.cc:269] 0811 16:05:03.608048 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.609070 (+  1022us) service_pool.cc:227] Handling call
0811 16:05:06.145087 (+2536017us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:06.145179 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5664510208}
I20260811 16:05:06.144522 14582 rpcz_store.cc:276] 0811 16:05:03.600798 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.600952 (+   154us) service_pool.cc:227] Handling call
0811 16:05:03.634024 (+ 33072us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:03.689503 (+ 55479us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:03.689532 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:03.692902 (+  3370us) log.cc:842] Serialized 26 byte log entry
0811 16:05:06.103639 (+2410737us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:06.103678 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.103782 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:06.140504 (+ 36722us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:06.143784 (+  3280us) raft_consensus.cc:1671] finished
0811 16:05:06.143808 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.144033 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37325,"raft.queue_time_us":111641,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":4680992128,"thread_start_us":2410284,"threads_started":1,"wal-append.queue_time_us":410741}
I20260811 16:05:06.146883 17882 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.147545 17882 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.149454 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.151648 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:06.153648 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:06.169967 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:03.863065 14579 rpcz_store.cc:276] 0811 16:05:02.694956 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.695903 (+   947us) service_pool.cc:227] Handling call
0811 16:05:02.729877 (+ 33974us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:03.321473 (+591596us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:03.323387 (+  1914us) log.cc:842] Serialized 14 byte log entry
0811 16:05:03.608733 (+285346us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:03.608789 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:03.608835 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:03.794476 (+185641us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54006ae0d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:03.794550 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:03.794729 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30039,"prepare.queue_time_us":256,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":133924,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4900,"spinlock_wait_cycles":1305649536,"thread_start_us":226663,"threads_started":1,"wal-append.queue_time_us":758918}
I20260811 16:05:06.173544 13741 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:06.187163 17870 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.089s	user 0.006s	sys 0.011s
W20260811 16:05:06.208901 14542 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.714s (SENT)
I20260811 16:05:06.209509 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.210702 17860 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:06.220579 17384 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:05:06.226423 17776 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 3.942s	user 0.010s	sys 0.011s
W20260811 16:05:06.226686 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.124s (SENT)
I20260811 16:05:06.227183 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.227941 17612 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:06.228499 14544 connection.cc:232] RPC call timeout handler was delayed by -1.2109707300551236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260811 16:05:06.228417 17612 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.230775 17783 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.231323 17625 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:05:06.231473 17809 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.232008 17809 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.234023 17809 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:06.231338 17783 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.237030 17783 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:06.241701 17756 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:06.242003 17612 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.242302 17756 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:06.247346 17756 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.250053 17756 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:06.241734 17625 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:05:06.254556 17590 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:06.255082 17590 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:06.259744 17872 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 2.161s	user 0.011s	sys 0.004s
W20260811 16:05:06.260411 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001abea0 after lost signal to thread 12388
I20260811 16:05:06.270440 17625 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.271173 17625 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.273598 17625 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.274119 17625 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.274328 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.274590 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.275657 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.276377 13744 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:06.277115 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.277842 13743 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:06.284754 17882 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:06.286178 17882 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:06.287918 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:06.288769 17882 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:06.289294 17882 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:06.289752 17882 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:06.290331 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.292565 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.293665 13744 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:05:06.295287 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.300697 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.301445 13741 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:06.274566 17625 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:06.306020 17883 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.810s	user 0.004s	sys 0.009s
I20260811 16:05:06.307548 17625 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:06.309990 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.310947 13740 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260811 16:05:06.311476 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1743) took 2805 ms (client timeout 2217 ms). Trace:
W20260811 16:05:06.311820 13740 rpcz_store.cc:269] 0811 16:05:03.505818 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.505990 (+   172us) service_pool.cc:227] Handling call
0811 16:05:06.309822 (+2803832us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:05:06.311383 (+  1561us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9828096}
W20260811 16:05:06.317329 17881 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.037s	user 0.005s	sys 0.012s
I20260811 16:05:06.317652 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1979) took 3284 ms. Trace:
I20260811 16:05:06.318506 17882 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:06.322679 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08003457c0 after lost signal to thread 13771
W20260811 16:05:06.323467 13871 connection.cc:232] RPC call timeout handler was delayed by -1.360313464072533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260811 16:05:06.326794 17625 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260811 16:05:06.373481 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6980 after lost signal to thread 13772
W20260811 16:05:06.373903 13665 debug-util.cc:398] Leaking SignalData structure 0x7b0800386e40 after lost signal to thread 13789
I20260811 16:05:06.331877 17635 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.374840 17635 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.376300 17882 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.377126 17635 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.332404 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:06.334847 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 3.16298e+06us
I20260811 16:05:06.378144 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:06.378158 13740 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260811 16:05:06.337260 17807 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.555s	user 0.011s	sys 0.016s
W20260811 16:05:06.379781 17807 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.597s	user 0.012s	sys 0.016s
I20260811 16:05:06.321077 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:06.382040 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61023.3us
W20260811 16:05:06.338479 17876 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.240s	user 0.013s	sys 0.003s
I20260811 16:05:06.343686 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1977) took 3436 ms. Trace:
W20260811 16:05:06.373519 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1406084790360183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260811 16:05:06.386417 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0434084789594635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260811 16:05:06.385672 13742 rpcz_store.cc:276] 0811 16:05:02.907362 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.907569 (+   207us) service_pool.cc:227] Handling call
0811 16:05:02.908005 (+   436us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:02.908282 (+   277us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:05:03.030690 (+122408us) log.cc:842] Serialized 14 byte log entry
0811 16:05:06.213062 (+3182372us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b18004a2d20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:05:06.343321 (+130259us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:06.343379 (+    58us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:06.343424 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.343493 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.343625 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21042,"prepare.queue_time_us":111774,"prepare.run_cpu_time_us":8602,"prepare.run_wall_time_us":50969,"raft.queue_time_us":3182988,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"spinlock_wait_cycles":8440576,"thread_start_us":129976,"threads_started":1}
I20260811 16:05:06.344105 17645 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
W20260811 16:05:06.368997 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 2.72389e+06us
I20260811 16:05:06.350406 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 1980) took 3145 ms. Trace:
I20260811 16:05:06.387109 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.318130 13735 rpcz_store.cc:276] 0811 16:05:03.033367 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.033519 (+   152us) service_pool.cc:227] Handling call
0811 16:05:03.120300 (+ 86781us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:03.123677 (+  3377us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:03.164923 (+ 41246us) log.cc:842] Serialized 14 byte log entry
0811 16:05:06.317255 (+3152332us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:06.317322 (+    67us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:06.317375 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.317450 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.317587 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3051878,"prepare.queue_time_us":47382,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":100022,"threads_started":1}
I20260811 16:05:06.342304 17590 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.392941 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:06.397962 13743 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:06.389456 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:06.390229 13739 rpcz_store.cc:276] 0811 16:05:03.204933 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.205149 (+   216us) service_pool.cc:227] Handling call
0811 16:05:03.253577 (+ 48428us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:03.757190 (+503613us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.350074 (+2592884us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:06.350323 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1156556544}
I20260811 16:05:06.399755 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:06.401202 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:05:06.407295 14544 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.806s (SENT)
I20260811 16:05:06.408006 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.409452 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:06.410122 13740 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:06.414619 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:06.415616 14582 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:06.418336 14580 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:06.421496 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75736.1us
I20260811 16:05:06.387979 17645 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:06.422181 13709 connection.cc:232] RPC call timeout handler was delayed by -3.2068642870290205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260811 16:05:06.408370 17793 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:06.427740 13740 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
W20260811 16:05:06.423096 13709 connection.cc:232] RPC call timeout handler was delayed by -3.1814045270439237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260811 16:05:06.429783 13709 connection.cc:232] RPC call timeout handler was delayed by -3.1016057120868936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260811 16:05:06.417400 17625 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260811 16:05:06.430146 13709 connection.cc:232] RPC call timeout handler was delayed by -3.0998057121178135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260811 16:05:06.431818 13709 connection.cc:232] RPC call timeout handler was delayed by -2.6950120010878891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25520000000000004s for a response
W20260811 16:05:06.432287 13709 connection.cc:232] RPC call timeout handler was delayed by -2.3580066829454154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3272s for a response
W20260811 16:05:06.432631 13709 connection.cc:232] RPC call timeout handler was delayed by -2.1530057120835409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32360000000000005s for a response
W20260811 16:05:06.432926 13709 connection.cc:232] RPC call timeout handler was delayed by -2.1148471491178498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260811 16:05:06.433209 13709 connection.cc:232] RPC call timeout handler was delayed by -2.0746297881705686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260811 16:05:06.435933 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001abe80 after lost signal to thread 13668
W20260811 16:05:06.436806 13709 connection.cc:232] RPC call timeout handler was delayed by -2.0643230710411444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260811 16:05:06.437264 17827 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 3.418s	user 0.003s	sys 0.014s
I20260811 16:05:06.438205 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2057) took 3824 ms. Trace:
I20260811 16:05:06.439224 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1003) took 4007 ms. Trace:
W20260811 16:05:06.436827 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf7c0 after lost signal to thread 13686
W20260811 16:05:06.440167 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd6c0 after lost signal to thread 13706
W20260811 16:05:06.440470 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf580 after lost signal to thread 13707
W20260811 16:05:06.440718 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001abee0 after lost signal to thread 13709
I20260811 16:05:06.428556 17793 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:06.438628 13908 rpcz_store.cc:276] 0811 16:05:02.608998 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.609135 (+   137us) service_pool.cc:227] Handling call
0811 16:05:04.330325 (+1721190us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:04.330545 (+   220us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:06.430274 (+2099729us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:06.430307 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:06.433202 (+  2895us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:06.433250 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.433324 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.433459 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2099274,"spinlock_wait_cycles":3397504}
I20260811 16:05:06.441774 17793 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:06.442190 17590 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:06.442350 17863 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.346s	user 0.007s	sys 0.019s
I20260811 16:05:06.439589 14573 rpcz_store.cc:276] 0811 16:05:02.432352 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:02.449849 (+ 17497us) service_pool.cc:227] Handling call
0811 16:05:02.490140 (+ 40291us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:05:02.675477 (+185337us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:02.675528 (+    51us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:05:02.689202 (+ 13674us) log.cc:842] Serialized 78 byte log entry
0811 16:05:02.791788 (+102586us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:02.791841 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:02.791944 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:06.436672 (+3644728us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:06.438843 (+  2171us) raft_consensus.cc:1671] finished
0811 16:05:06.438864 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.439132 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24246,"raft.queue_time_us":76424,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":10102,"spinlock_wait_cycles":26657536,"thread_start_us":148942,"threads_started":2,"wal-append.queue_time_us":138143}
I20260811 16:05:06.442955 17645 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:06.444105 13709 connection.cc:232] RPC call timeout handler was delayed by -1.8852230710908771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260811 16:05:06.445176 13709 connection.cc:232] RPC call timeout handler was delayed by -1.883423071121797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260811 16:05:06.446676 13709 connection.cc:232] RPC call timeout handler was delayed by -1.7722158350516111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260811 16:05:06.444379 17645 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:05:06.428819 17850 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.409s	user 0.041s	sys 0.041s
W20260811 16:05:06.447592 13709 connection.cc:232] RPC call timeout handler was delayed by -1.668715835083276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260811 16:05:06.456532 13709 connection.cc:232] RPC call timeout handler was delayed by -1.6282158350804821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260811 16:05:06.457031 13709 connection.cc:232] RPC call timeout handler was delayed by -1.4118437580764294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260811 16:05:06.455127 17828 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:06.457538 13709 connection.cc:232] RPC call timeout handler was delayed by -1.4101376470644027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24980000000000002s for a response
W20260811 16:05:06.461673 13709 connection.cc:232] RPC call timeout handler was delayed by -1.0204921310069039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2537s for a response
I20260811 16:05:06.462111 13743 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:06.468858 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:06.456787 17850 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.450s	user 0.041s	sys 0.041s
I20260811 16:05:06.471370 17625 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:06.472013 17625 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:06.472510 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf1c0 after lost signal to thread 13735
W20260811 16:05:06.473328 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080017e760 after lost signal to thread 13771
W20260811 16:05:06.473615 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800180880 after lost signal to thread 13772
I20260811 16:05:06.473150 17625 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.454802 17793 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:06.475919 17873 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.378s	user 0.023s	sys 0.002s
I20260811 16:05:06.476207 17793 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:06.477262 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 840) took 2826 ms. Trace:
W20260811 16:05:06.475917 17857 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.379s	user 0.017s	sys 0.009s
W20260811 16:05:06.473870 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080005a9e0 after lost signal to thread 13789
W20260811 16:05:06.479342 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800388180 after lost signal to thread 13791
W20260811 16:05:06.480391 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001e14e0 after lost signal to thread 13856
W20260811 16:05:06.480675 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800262840 after lost signal to thread 13857
W20260811 16:05:06.481793 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800381280 after lost signal to thread 13941
I20260811 16:05:06.485015 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 899) took 3420 ms. Trace:
I20260811 16:05:06.486083 17477 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:06.486816 13791 connection.cc:232] RPC call timeout handler was delayed by -1.8854409630876034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260811 16:05:06.486903 17477 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.489210 17477 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.489336 16875 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:06.489850 16875 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:06.489928 17477 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.490288 16875 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:06.485111 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:06.491003 13743 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:06.490582 17477 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.491632 17552 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:06.485358 13665 debug-util.cc:398] Leaking SignalData structure 0x7b0800168980 after lost signal to thread 13856
I20260811 16:05:06.492179 17552 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.493255 17477 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.493609 17619 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.494253 17552 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.494144 17619 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.494791 17552 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.497505 17624 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:06.498155 17624 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.499809 17684 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:06.500201 17684 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:06.501250 17684 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.501891 17815 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.502622 17824 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:06.502836 13709 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.515s (SENT)
W20260811 16:05:06.503569 13709 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.555s (SENT)
I20260811 16:05:06.503784 17602 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.504031 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:06.504354 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 2.87272e+06us
I20260811 16:05:06.504588 17688 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:05:06.505566 17688 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:06.507200 17722 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:06.502492 17825 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:06.507711 17722 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:06.508716 17722 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:06.492672 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08002c62c0 after lost signal to thread 13857
W20260811 16:05:06.523464 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080026d320 after lost signal to thread 13941
W20260811 16:05:06.525252 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9000 after lost signal to thread 14610
W20260811 16:05:06.525514 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080039e4c0 after lost signal to thread 14611
I20260811 16:05:06.507962 17825 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.506877 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:06.502487 17815 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.503196 17824 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.477645 14574 rpcz_store.cc:276] 0811 16:05:03.651052 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.651197 (+   145us) service_pool.cc:227] Handling call
0811 16:05:03.651519 (+   322us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:03.651739 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:03.651762 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:03.652214 (+   452us) log.cc:842] Serialized 26 byte log entry
0811 16:05:04.337828 (+685614us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:04.337864 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:04.337934 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:06.475405 (+2137471us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:06.476936 (+  1531us) raft_consensus.cc:1671] finished
0811 16:05:06.476965 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.477195 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4336077696,"thread_start_us":657510,"threads_started":1,"wal-append.queue_time_us":417393}
I20260811 16:05:06.512583 13743 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
W20260811 16:05:06.525836 13665 debug-util.cc:398] Leaking SignalData structure 0x7b0800104920 after lost signal to thread 17380
I20260811 16:05:06.503341 17595 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.485821 14578 rpcz_store.cc:276] 0811 16:05:03.064500 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.121367 (+ 56867us) service_pool.cc:227] Handling call
0811 16:05:03.121729 (+   362us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:03.192255 (+ 70526us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:03.192288 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:03.207198 (+ 14910us) log.cc:842] Serialized 52 byte log entry
0811 16:05:03.321196 (+113998us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:03.321262 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:03.321358 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:06.475213 (+3153855us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:06.483300 (+  8087us) raft_consensus.cc:1671] finished
0811 16:05:06.483324 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.484926 (+  1602us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":65362,"raft.queue_time_us":137776,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":56606,"spinlock_wait_cycles":5097133952,"thread_start_us":44613,"threads_started":1,"wal-append.queue_time_us":811897}
I20260811 16:05:06.550639 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:06.552822 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7e00 after lost signal to thread 17760
W20260811 16:05:06.553612 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080003ddc0 after lost signal to thread 17766
I20260811 16:05:06.555873 17900 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:06.499363 17552 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.559784 17850 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:06.560447 17850 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:06.562726 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800264760 after lost signal to thread 14610
W20260811 16:05:06.563097 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003f5500 after lost signal to thread 14611
W20260811 16:05:06.563402 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecf80 after lost signal to thread 17232
W20260811 16:05:06.563649 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecfa0 after lost signal to thread 17378
W20260811 16:05:06.564121 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800366280 after lost signal to thread 17384
W20260811 16:05:06.564474 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003e11c0 after lost signal to thread 17392
W20260811 16:05:06.564884 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800351d00 after lost signal to thread 17552
W20260811 16:05:06.566231 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003559c0 after lost signal to thread 17561
W20260811 16:05:06.566525 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080013d3e0 after lost signal to thread 17601
W20260811 16:05:06.567036 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080041c260 after lost signal to thread 17619
W20260811 16:05:06.567792 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080041c240 after lost signal to thread 17624
W20260811 16:05:06.568219 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9500 after lost signal to thread 17638
I20260811 16:05:06.521263 17590 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.563620 17688 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.527179 17816 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:06.587616 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003db9a0 after lost signal to thread 17699
W20260811 16:05:06.587980 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080018d980 after lost signal to thread 17705
W20260811 16:05:06.588542 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee340 after lost signal to thread 17781
W20260811 16:05:06.569592 17831 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.316s	user 0.003s	sys 0.036s
W20260811 16:05:06.603070 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 96268.5us
I20260811 16:05:06.606115 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:06.504361 17602 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.583928 17722 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:06.558887 17595 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.601111 17754 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.601438 17574 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.601217 17755 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.632233 17552 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.632481 17808 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.557518 17824 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.646988 17853 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.644722 17574 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.647483 17824 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.647775 17853 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.648074 17824 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.649402 17574 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.650348 17824 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.650525 17853 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.632993 17481 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:06.633059 13822 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5f46150fac70458986206ec7af67a403"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:41626
I20260811 16:05:06.651810 13822 raft_consensus.cc:595] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:06.637027 17848 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.592789 17648 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:06.609064 17831 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.354s	user 0.003s	sys 0.036s
I20260811 16:05:06.641585 17879 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.637019 17844 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:06.644731 14542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.152s (SENT) [suppressed 29 similar messages]
W20260811 16:05:06.644873 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 257851us
I20260811 16:05:06.602721 17847 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.650648 17574 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.626883 17871 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.652184 13822 raft_consensus.cc:603] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:06.632818 17662 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.630769 14582 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:06.585197 17590 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.664252 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:06.584460 17688 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.601161 17816 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.650944 17824 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.735033 17892 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:06.735321 17828 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:06.735780 17892 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.736394 17828 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:06.736950 17828 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:06.738292 17892 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.739176 17891 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:06.740005 17561 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.739820 17891 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.740746 17561 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:06.742981 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 364949us
I20260811 16:05:06.743163 17232 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:06.743819 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:06.744392 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 240845us
W20260811 16:05:06.746865 13709 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.754s (SENT)
I20260811 16:05:06.744850 17889 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:06.752512 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:06.657076 17552 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:06.651501 17807 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.688207 17871 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.689534 13818 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:06.688370 13626 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 5, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:05:06.804968 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 198920us
I20260811 16:05:06.685839 17897 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.689961 17590 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.688133 17477 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:06.690397 17853 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.690253 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:06.836120 13824 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:06.676928 17843 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.685382 17747 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:06.841439 17747 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.603662 17850 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.692570 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 902) took 3293 ms. Trace:
I20260811 16:05:06.695839 17815 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.848021 17904 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.848492 17843 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.643457 17754 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.833341 17552 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260811 16:05:06.697190 17602 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.651324 17481 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.651738 17755 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.696645 17825 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.676467 17879 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.699162 13825 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:06.699729 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:06.698892 13817 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260811 16:05:06.700537 17684 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:06.685671 17856 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:06.682690 17643 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:06.683403 17847 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.702395 17900 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:06.705926 17816 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.711532 17624 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.713057 17662 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.714808 17838 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.884472 17747 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.678881 17848 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.676575 17756 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:06.685665 17619 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.659085 17808 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.686515 17574 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:06.727248 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1260 after lost signal to thread 17791
W20260811 16:05:06.776748 13709 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.756s (SENT)
I20260811 16:05:06.743842 17232 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:06.808677 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:06.895360 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 118675us
W20260811 16:05:06.819725 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 67281.5us
W20260811 16:05:06.896307 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.875s (SENT)
W20260811 16:05:06.900424 13709 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.990s (SENT)
W20260811 16:05:06.901248 13709 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.035s (SENT)
W20260811 16:05:06.832758 13787 connection.cc:232] RPC call timeout handler was delayed by -1.4038155250018463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260811 16:05:06.902092 13787 connection.cc:232] RPC call timeout handler was delayed by -1.4038155250018463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260811 16:05:06.902383 13787 connection.cc:232] RPC call timeout handler was delayed by -1.3201155249262229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260811 16:05:06.902770 13787 connection.cc:232] RPC call timeout handler was delayed by -1.2427155249752104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260811 16:05:06.835330 17590 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.848703 17904 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.660802 17648 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:06.859079 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 194914us
I20260811 16:05:06.839119 17477 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.904917 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.846921 14577 rpcz_store.cc:276] 0811 16:05:03.399483 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:03.399641 (+   158us) service_pool.cc:227] Handling call
0811 16:05:03.400031 (+   390us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:03.451979 (+ 51948us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:03.452055 (+    76us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:03.575396 (+123341us) log.cc:842] Serialized 26 byte log entry
0811 16:05:06.484102 (+2908706us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800349de0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:05:06.565376 (+ 81274us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:06.565430 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.565530 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:06.692161 (+126631us) raft_consensus.cc:1671] finished
0811 16:05:06.692198 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:06.692480 (+   282us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8881,"raft.queue_time_us":195456,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":53766,"spinlock_wait_cycles":36397312,"thread_start_us":126549,"threads_started":2,"wal-append.queue_time_us":3026071}
I20260811 16:05:06.857127 13826 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:05:06.832764 17595 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.803925 17699 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260811 16:05:06.853132 17688 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:06.877353 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 222801us
I20260811 16:05:06.808212 17824 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.884161 17838 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.679560 17844 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.818733 17807 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.865483 17781 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:06.898228 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:06.805574 13626 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 5, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 5 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:06.904114 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.911235 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:06.913232 13709 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.537s (SENT)
I20260811 16:05:06.923871 17477 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:06.837621 17897 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:06.918448 14577 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:06.853096 17853 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:06.979553 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 75498.4us
I20260811 16:05:06.879515 17643 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:07.013753 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 177117us
I20260811 16:05:06.906621 17232 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:06.894608 17891 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:06.918020 17747 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:06.872970 17856 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:06.959211 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46022.5us
W20260811 16:05:06.915309 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 106731us
I20260811 16:05:07.029978 13789 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:06.926054 17852 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:06.892002 17561 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:06.959862 17645 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.010s
I20260811 16:05:06.980203 13626 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 7, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:07.020296 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:07.014971 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:06.916671 17756 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.920233 17590 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:06.979118 17781 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:07.053184 13707 leader_election.cc:398] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:05:07.062022 13707 leader_election.cc:401] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:07.060298 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.060977 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.019990 17902 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:07.075572 17903 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:07.085588 17903 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:07.086078 17903 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:07.060140 17891 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:07.075819 13626 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:07.048916 17908 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:07.047446 17722 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:07.018976 17699 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.061s
I20260811 16:05:07.050992 17892 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:07.091758 17645 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:07.116761 13626 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 5, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:07.121371 17692 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:07.084735 17590 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:07.127669 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.128693 17879 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.129832 17781 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.132965 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.133677 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.133776 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.147187 13826 raft_consensus.cc:2396] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:07.147744 13823 raft_consensus.cc:2354] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8.
I20260811 16:05:07.148564 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.148751 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.149497 13820 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:07.149837 13823 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 2.
I20260811 16:05:07.150456 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.040793 17747 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.134593 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.159969 13818 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:05:07.160081 12390 debug-util.cc:398] Leaking SignalData structure 0x7b080038f380 after lost signal to thread 13789
I20260811 16:05:07.160390 17574 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.160290 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.161056 13820 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:07.161998 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.162556 13820 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:07.165784 17816 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:05:07.148938 17232 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.169860 13737 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:07.172962 17838 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.174021 17904 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.174100 17821 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:07.175689 17648 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.180356 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1748) took 1060 ms. Trace:
I20260811 16:05:07.151386 17856 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.026539 17643 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.137257 14577 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:07.107450 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:07.076749 17871 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.144054 13821 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:07.090174 17852 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:07.150916 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.195403 13823 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:07.134122 17903 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.145201 13825 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
W20260811 16:05:07.186563 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 221192us
I20260811 16:05:07.080418 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:07.117552 17639 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:05:07.184424 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:07.184643 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 273546us
I20260811 16:05:07.201685 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:07.187312 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 79997.6us
I20260811 16:05:07.202476 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.203133 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:07.180859 13738 rpcz_store.cc:276] 0811 16:05:06.119720 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:06.119833 (+   113us) service_pool.cc:227] Handling call
0811 16:05:06.120198 (+   365us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:06.723749 (+603551us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:06.723796 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:06.724519 (+   723us) log.cc:842] Serialized 26 byte log entry
0811 16:05:06.930218 (+205699us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:06.930265 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:06.930350 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:07.179978 (+249628us) raft_consensus.cc:1671] finished
0811 16:05:07.180012 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:07.180255 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":615548,"raft.queue_time_us":611111,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"thread_start_us":205101,"threads_started":1,"wal-append.queue_time_us":427524}
I20260811 16:05:07.188895 13626 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 7, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:07.203438 13817 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:07.142331 17908 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.208369 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.220980 13823 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:07.224299 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:07.191133 17481 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.247470 17871 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:07.247599 17481 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:07.247845 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46280.1us
I20260811 16:05:07.248128 17871 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.249775 17643 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.250197 17871 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.228528 17232 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:07.251876 13827 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:07.252854 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.253599 13908 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:07.253659 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.254904 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.255255 17648 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:07.255677 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:05:07.255903 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.256354 13905 raft_consensus.cc:595] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:07.256646 17648 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:07.257117 17648 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:07.257835 13900 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260811 16:05:07.191612 17384 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:07.231894 13825 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:07.268884 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.232211 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.190044 17848 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.217856 13626 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:07.233263 17722 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:05:07.236575 17754 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.239269 17915 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:07.239428 17755 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.239872 17756 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.241467 17903 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.225170 17808 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.243515 17638 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:07.256786 13905 raft_consensus.cc:603] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:05:07.258708 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54345.7us
I20260811 16:05:07.259724 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.320164 13827 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:07.228857 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 166315us
I20260811 16:05:07.320879 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.230124 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.322288 13823 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:07.261121 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.270526 13817 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:07.272866 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.275075 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.277889 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 4, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:07.324854 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.278937 13743 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260811 16:05:07.285014 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.287652 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.327597 13736 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:05:07.287957 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63761.2us
I20260811 16:05:07.288314 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.289254 13904 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:07.289752 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.294924 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.295101 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.296223 13909 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:07.296128 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.298528 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.332741 13908 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:07.241802 17662 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.299474 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.335814 13900 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:07.335887 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.268128 17384 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:07.344220 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.324473 14573 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:07.345157 14575 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:07.346868 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.347957 14580 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:07.255314 17856 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:07.314412 13824 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:07.337344 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.344389 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.334811 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.351920 13825 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:07.352108 13742 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:05:07.351971 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.355309 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.354506 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:07.364463 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.365701 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.366474 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.367100 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.367419 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.210387 17852 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.372670 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.373929 13825 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260811 16:05:07.294438 17601 raft_consensus.cc:2741] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260811 16:05:07.381485 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52612.3us
I20260811 16:05:07.392211 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:07.379060 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.379871 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.394558 13817 raft_consensus.cc:2354] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8.
I20260811 16:05:07.388056 13818 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:07.396416 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.395977 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.396004 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.403064 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.394888 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.405817 13823 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 2.
I20260811 16:05:07.407713 13824 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:07.408352 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.409822 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.413174 13741 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:07.409375 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.419342 13906 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:07.395414 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.421427 13827 raft_consensus.cc:2396] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:07.422338 13738 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260811 16:05:07.423797 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.424710 13905 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:07.283526 17692 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260811 16:05:07.318672 17638 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:07.432754 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.359102 17384 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:07.429333 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:07.385727 17913 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260811 16:05:07.258044 17648 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.305207 17821 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260811 16:05:07.434852 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.456737 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.435051 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.437244 13820 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:07.334831 17853 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.360273 17619 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:07.346230 17844 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:07.440598 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48523.3us
I20260811 16:05:07.374500 17856 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.453495 17897 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.479156 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.503351 13826 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:07.479990 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.480660 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.505319 14577 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:07.481027 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.507730 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.438805 13626 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 7, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:07.519106 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.519804 13741 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:07.519915 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:07.492087 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:07.419087 13900 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:07.428041 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.441823 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.443635 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.454767 13825 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 6: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:07.455902 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.456017 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.457867 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.394218 17915 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:07.527302 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.458837 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.383440 17793 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260811 16:05:07.530409 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.398905 17824 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:07.425287 17624 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:07.458258 13818 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:07.461941 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.462668 14581 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:07.463939 17782 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:07.467525 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.459524 17890 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:07.471922 16875 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.981s	user 0.014s	sys 0.002s
I20260811 16:05:07.473598 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.473620 13908 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:07.456792 17754 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:07.493294 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:07.486462 17852 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.575520 14580 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:07.528334 13820 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:07.585331 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.527093 13905 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:07.460891 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.587253 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.587697 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.588502 13818 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:07.588956 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.534932 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.536237 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.589964 13824 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:07.590409 13817 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 5.
I20260811 16:05:07.528406 13823 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:07.591866 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.593279 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:07.537890 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45888.6us
I20260811 16:05:07.501289 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:07.594926 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93734.2us
I20260811 16:05:07.595909 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:07.486725 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.567569 13906 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:07.548076 14574 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:07.470746 17843 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.467023 17807 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.544094 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.587059 13904 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:07.617170 13900 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:07.564666 13626 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:07.571754 13827 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7.
I20260811 16:05:07.487519 17908 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:07.572327 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.606379 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:07.489969 17684 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260811 16:05:07.575706 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.491444 17917 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:07.576892 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83681.9us
I20260811 16:05:07.439796 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.578225 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:37762 (request call id 822) took 1105 ms. Trace:
W20260811 16:05:07.582131 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 220468us
I20260811 16:05:07.440793 17639 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.129s
I20260811 16:05:07.569089 17782 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:07.659374 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.577064 17624 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:07.605329 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:07.667462 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62204.4us
I20260811 16:05:07.572379 14582 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:07.617957 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.672317 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.618610 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.619441 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:07.518394 17903 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:07.484647 17821 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.101s
I20260811 16:05:07.632881 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.677492 13820 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:07.633188 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.633944 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.678649 13904 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:07.496826 17856 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:07.569590 17808 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:07.637090 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:07.643370 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.679998 13906 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:07.660224 14580 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:07.572665 17890 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:07.681524 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.681746 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.682474 14579 raft_consensus.cc:2396] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260811 16:05:07.683032 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.645027 13825 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260811 16:05:07.496315 17828 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.000s
I20260811 16:05:07.645344 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.686985 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.687376 13905 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:07.645846 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.635375 13822 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:07.637648 13740 rpcz_store.cc:276] 0811 16:05:06.463627 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:06.463823 (+   196us) service_pool.cc:227] Handling call
0811 16:05:07.522040 (+1058217us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400281ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:07.569285 (+ 47245us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1456161024}
I20260811 16:05:07.688128 14574 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:07.640316 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:07.601763 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.603670 17378 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:07.603569 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.661947 13626 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:05:07.640591 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.665370 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:07.615996 17897 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:07.696043 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.680831 13823 raft_consensus.cc:2396] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:07.683192 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:07.699707 13827 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260811 16:05:07.699826 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:07.684837 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65494.8us
I20260811 16:05:07.701210 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:07.685606 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.644433 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.702792 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.686683 14575 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:07.634531 17927 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:07.638758 17601 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:07.709301 13626 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 9, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 9 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:07.712389 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.687665 13909 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 10
I20260811 16:05:07.659289 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.635352 17843 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:07.692678 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.700400 13827 pending_rounds.cc:76] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 7
I20260811 16:05:07.716638 13827 pending_rounds.cc:97] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260811 16:05:07.717013 13827 raft_consensus.cc:2866] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:07.706171 13906 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:07.707265 13825 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:07.538376 17915 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.606316 17754 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.603049 16875 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.726243 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:07.727018 13626 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 5, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 5 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:07.720672 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:07.722733 14574 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:05:07.681885 17808 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:07.688038 17890 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:07.740583 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:07.688584 17781 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:07.487944 17638 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.692421 17844 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:07.743908 13900 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:05:07.769718 13900 raft_consensus.cc:595] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:07.770272 13900 raft_consensus.cc:603] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:07.750110 14575 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:07.758397 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:07.760918 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.772141 13740 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:07.697364 17852 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:07.708335 17232 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:07.766887 13626 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 4, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 4 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:07.783879 13821 raft_consensus.cc:2354] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9.
I20260811 16:05:07.715787 17843 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:07.791733 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:07.791931 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.693084 17892 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260811 16:05:07.744355 17856 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:07.742626 17684 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:07.790930 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:07.689836 17903 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.720052 17897 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:07.744215 17808 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:07.752178 17755 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:07.769439 17844 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:07.815752 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.696677 17828 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.816645 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:07.813205 17793 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:07.828289 17684 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.829124 17648 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:07.782543 17781 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:07.817253 17856 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:07.788352 17232 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:07.839195 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.837951 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.842552 13626 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:07.801017 17843 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:07.850431 13905 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:07.661217 17917 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.866974 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:07.753829 17601 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.833525 17638 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:07.881150 13825 raft_consensus.cc:2362] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:05:07.908481 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:07.909478 13737 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:07.891227 13818 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6. Re-sending same reply.
I20260811 16:05:07.881258 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.882093 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:07.882033 13626 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 7, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:07.839097 17590 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:07.845706 17844 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:07.934947 13626 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 7, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:05:07.938057 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 237833us
I20260811 16:05:07.840255 17755 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:07.897253 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:07.939232 13905 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:07.847114 17793 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:07.753861 17782 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.920714 13820 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:07.868808 17645 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.000s
I20260811 16:05:07.883759 17232 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:07.841559 17852 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
W20260811 16:05:07.941198 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 188011us
I20260811 16:05:07.879273 17856 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:07.884425 17908 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:07.809304 17624 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:07.932907 17590 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:07.962229 13626 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 5, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:07.946101 17755 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:07.979446 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:07.980036 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 149707us
I20260811 16:05:07.897921 17824 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260811 16:05:07.982967 13826 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:07.964293 17897 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.989941 13905 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:08.002333 13909 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:08.004369 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.003654 13900 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:08.005880 17754 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:08.007023 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.007694 13900 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.004446 13626 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 7, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:05:08.016940 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 145569us
I20260811 16:05:08.038956 13900 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:08.059391 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.065474 13900 raft_consensus.cc:2354] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:08.069435 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:07.985215 17929 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260811 16:05:07.986037 17936 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260811 16:05:07.988787 17931 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260811 16:05:07.985998 17925 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:07.974110 17850 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.081730 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.003644 17590 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.081358 16875 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:07.984227 17821 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:07.964313 17645 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:08.077445 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59614.8us
I20260811 16:05:08.082587 13626 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 6, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:08.091468 13904 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:08.081866 17793 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:08.111578 17934 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260811 16:05:08.092199 13900 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:08.103125 17925 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:08.161669 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:08.087956 17932 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
I20260811 16:05:08.076493 17781 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:07.989063 17756 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:07.984983 17918 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260811 16:05:08.111307 17684 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.117519 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.122442 17821 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:08.135417 17828 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:08.151981 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:08.169545 17936 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260811 16:05:08.161700 13903 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:08.162540 13900 raft_consensus.cc:2362] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8. Re-sending same reply.
W20260811 16:05:08.180454 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63056.4us
I20260811 16:05:08.162956 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.165144 13626 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:08.192780 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.120493 17951 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:08.188062 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:07.985857 17920 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
I20260811 16:05:08.161029 17903 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.090880 17946 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260811 16:05:08.199667 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.208287 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.198421 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.194782 17793 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.180202 17960 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.039s
I20260811 16:05:08.213923 17890 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.206820 17897 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260811 16:05:08.215090 17892 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:08.181851 17915 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:08.225876 17891 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.138s	user 0.008s	sys 0.005s
I20260811 16:05:08.215031 17847 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:08.226370 17891 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:08.202775 17927 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:08.232674 13735 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:08.167608 17925 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.234732 17917 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.235455 17917 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.234830 17821 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.236083 17747 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.204250 17951 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:08.204377 17828 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.232580 17927 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.238147 17951 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.231667 13626 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:08.201063 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.186733 17645 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:08.244104 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2375) took 1072 ms. Trace:
I20260811 16:05:08.236353 17821 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:08.244553 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:08.248291 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47337.4us
I20260811 16:05:08.249363 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:08.251341 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 317869us
I20260811 16:05:08.255108 13626 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 8, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:08.261587 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.244575 13817 rpcz_store.cc:276] 0811 16:05:07.191522 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.615614 (+424092us) service_pool.cc:227] Handling call
0811 16:05:07.616069 (+   455us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:07.616440 (+   371us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:07.616467 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:07.616939 (+   472us) log.cc:842] Serialized 26 byte log entry
0811 16:05:07.870196 (+253257us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:08.243432 (+373236us) log.cc:842] Serialized 14 byte log entry
0811 16:05:08.243694 (+   262us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.243776 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:08.243818 (+    42us) raft_consensus.cc:1671] finished
0811 16:05:08.243828 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.244041 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23295,"prepare.queue_time_us":129247,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2087,"raft.queue_time_us":181,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":13640,"thread_start_us":477952,"threads_started":2,"wal-append.queue_time_us":351820}
I20260811 16:05:08.266506 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.269161 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.269986 13626 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:08.271214 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:08.176276 17940 consensus_queue.cc:1159] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f46150fac70458986206ec7af67a403" responder_term: 7 status { last_received { term: 7 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 9 } }
W20260811 16:05:08.279040 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 384315us
W20260811 16:05:08.271806 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.019s
I20260811 16:05:08.284252 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.286893 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.019s
W20260811 16:05:08.287526 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 647390us
I20260811 16:05:08.288412 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.293264 13823 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260811 16:05:08.261770 17853 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:08.299116 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.318816 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.025s	sys 0.042s
W20260811 16:05:08.319271 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.025s	sys 0.042s
I20260811 16:05:08.261654 17601 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.320013 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.281769 17595 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.013s	sys 0.017s
W20260811 16:05:08.267721 17378 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.011s	sys 0.015s
I20260811 16:05:08.311033 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.298539 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 359811us
I20260811 16:05:08.272683 17747 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.267864 17645 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:08.326256 13827 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:08.321090 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.334184 13820 raft_consensus.cc:2362] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8. Re-sending same reply.
W20260811 16:05:08.322093 17950 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260811 16:05:08.269694 17828 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.282531 13626 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 4, leader changed from <none> to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:08.330385 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.331588 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.295385 17847 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.346288 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.347024 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:08.325763 17906 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:08.332842 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.335192 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.357323 13820 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:08.321861 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.338305 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 151618us
I20260811 16:05:08.358294 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:08.358592 14544 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.527s (SENT)
I20260811 16:05:08.358927 13820 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.359179 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.359493 17890 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.361996 17892 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:08.362785 17892 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:05:08.329119 17595 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.017s
I20260811 16:05:08.344926 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.368212 13827 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:08.369171 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.369762 13827 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:08.370568 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.374902 17782 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.328840 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:08.376444 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47728us
I20260811 16:05:08.377199 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.378052 17856 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.379300 13909 raft_consensus.cc:2354] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9.
I20260811 16:05:08.271428 17824 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:08.379951 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 597) took 1127 ms. Trace:
I20260811 16:05:08.380335 13903 rpcz_store.cc:276] 0811 16:05:07.252217 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.254634 (+  2417us) service_pool.cc:227] Handling call
0811 16:05:07.254960 (+   326us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:08.192127 (+937167us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.379709 (+187582us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54003b06d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:08.379886 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2084837248}
I20260811 16:05:08.380450 17824 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.381780 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.382759 17824 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.383563 17975 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:08.384296 17975 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:08.378878 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.386600 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.389942 17975 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:08.391134 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:08.351295 17951 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:08.393664 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1768) took 1035 ms. Trace:
I20260811 16:05:08.394198 13735 rpcz_store.cc:276] 0811 16:05:07.357792 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.361564 (+  3772us) service_pool.cc:227] Handling call
0811 16:05:08.393360 (+1031796us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54000a91d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:08.393590 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1625428864}
I20260811 16:05:08.395195 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 607) took 1132 ms. Trace:
I20260811 16:05:08.395561 13908 rpcz_store.cc:276] 0811 16:05:07.263034 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.725714 (+462680us) service_pool.cc:227] Handling call
0811 16:05:07.785319 (+ 59605us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:07.822389 (+ 37070us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:07.822441 (+    52us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:07.866611 (+ 44170us) log.cc:842] Serialized 52 byte log entry
0811 16:05:08.189846 (+323235us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:08.208450 (+ 18604us) log.cc:842] Serialized 14 byte log entry
0811 16:05:08.208660 (+   210us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.208744 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:08.394929 (+186185us) raft_consensus.cc:1671] finished
0811 16:05:08.394951 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.395112 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37438,"prepare.queue_time_us":18350,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":68987,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":15614,"thread_start_us":254216,"threads_started":1,"wal-append.queue_time_us":468614}
I20260811 16:05:08.397854 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.398288 17232 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.400005 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.358505 13818 raft_consensus.cc:2354] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6.
I20260811 16:05:08.351022 17756 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:08.402097 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.402452 17756 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.403281 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.403872 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:08.403811 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.404831 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.405045 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.405433 13818 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:05:08.405607 13823 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
W20260811 16:05:08.406333 17930 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.921s	user 0.000s	sys 0.009s
I20260811 16:05:08.406277 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.406530 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.406919 13818 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:08.349464 13626 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:08.392146 17925 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.393427 17951 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.351773 17917 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:08.399085 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.400933 13741 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:08.279301 17843 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.387594 17828 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:08.448220 13901 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:08.408298 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2373) took 1197 ms. Trace:
I20260811 16:05:08.446033 17917 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.451913 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.410989 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66953us
I20260811 16:05:08.388664 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.453274 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.453547 13909 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:08.455492 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.459736 13789 leader_election.cc:398] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:08.460090 13789 leader_election.cc:401] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:05:08.326687 17384 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.824s	user 0.015s	sys 0.000s
I20260811 16:05:08.412921 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.327291 17378 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:08.282181 17755 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.461833 17976 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:08.417706 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:08.419826 13908 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:08.426172 17892 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.428750 17232 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:08.432768 17937 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.560s	user 0.000s	sys 0.001s
I20260811 16:05:08.432492 17756 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.495124 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.433037 17844 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.435436 17927 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.445469 17843 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:08.412582 17808 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260811 16:05:08.448971 13821 rpcz_store.cc:276] 0811 16:05:07.169515 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.190184 (+ 20669us) service_pool.cc:227] Handling call
0811 16:05:08.366836 (+1176652us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54000d5054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:08.367066 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1305734528}
I20260811 16:05:08.353746 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1653) took 1037 ms. Trace:
I20260811 16:05:08.449877 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:08.516290 13823 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:08.450311 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.517297 13825 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.464067 13817 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:08.516064 13824 rpcz_store.cc:276] 0811 16:05:07.316508 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.675528 (+359020us) service_pool.cc:227] Handling call
0811 16:05:07.675867 (+   339us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:07.869367 (+193500us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:07.893219 (+ 23852us) log.cc:842] Serialized 14 byte log entry
0811 16:05:08.261918 (+368699us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:08.261970 (+    52us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:08.262015 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.353401 (+ 91386us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400125a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:08.353471 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.353653 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":79960,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2908,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3401,"spinlock_wait_cycles":444324736,"thread_start_us":367528,"threads_started":1,"wal-append.queue_time_us":471487}
I20260811 16:05:08.471091 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:08.518693 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47739.2us
I20260811 16:05:08.465574 17976 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:08.479162 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88087.7us
I20260811 16:05:08.518705 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.484169 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.453568 13905 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:08.522075 13735 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:08.520121 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.491465 13820 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:08.506558 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:08.525090 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.470382 17925 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.508088 13900 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:08.502839 13818 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:08.508312 13626 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:08.506922 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.463385 17595 raft_consensus.cc:2741] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260811 16:05:08.590560 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:08.527969 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:05:08.595969 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 68124.8us
I20260811 16:05:08.595692 13626 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 5, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:08.597077 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.522670 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:08.507555 13903 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:08.562270 17951 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:08.599040 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76497.3us
I20260811 16:05:08.598484 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.603693 13823 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.604759 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:08.607331 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:08.608444 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.612686 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:08.613670 13743 raft_consensus.cc:2354] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:08.617677 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:08.541069 17692 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:08.575486 13906 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:08.522190 17976 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.537994 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.539456 17888 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:08.524740 17808 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.548076 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:08.549292 17953 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260811 16:05:08.633838 13824 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.537053 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.635751 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.556967 17378 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.537916 17816 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.588186 17625 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:08.506034 17747 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:08.560510 17756 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:08.518764 17973 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.058s	user 0.000s	sys 0.008s
I20260811 16:05:08.538269 17927 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.548408 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.543076 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.539314 17856 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.579465 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.650574 13820 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:08.615350 17595 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.539566 17926 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:08.549701 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.556315 17755 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:08.585345 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.723563 13904 raft_consensus.cc:2354] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:08.723672 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 623) took 1439 ms. Trace:
I20260811 16:05:08.724140 13901 rpcz_store.cc:276] 0811 16:05:07.284011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.763796 (+479785us) service_pool.cc:227] Handling call
0811 16:05:07.764078 (+   282us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:08.451169 (+687091us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.723463 (+272294us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54002ad5d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:08.723619 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1572655488}
I20260811 16:05:08.656560 14579 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:08.628396 17781 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:08.525009 17232 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:08.731976 17232 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:08.586436 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 921) took 1085 ms. Trace:
I20260811 16:05:08.467705 17384 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.602571 13626 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 8, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:08.666065 13820 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:08.617736 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.622654 13903 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260811 16:05:08.627604 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:08.536592 17590 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.630141 13735 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:08.600489 17561 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:08.628582 17692 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:08.632536 16875 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:08.638253 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:08.610973 17871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.011s	sys 0.013s
I20260811 16:05:08.640827 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:08.615814 17910 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.014s	sys 0.021s
I20260811 16:05:08.644747 13823 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:08.600445 17939 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:08.597903 17972 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:08.615060 17648 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.648149 13817 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.616830 17828 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:08.769802 17828 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:08.770265 17828 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:08.614836 17908 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:08.773133 17908 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:08.774065 17908 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:08.553305 17938 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.661s	user 0.000s	sys 0.001s
I20260811 16:05:08.722942 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:08.587044 13825 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:08.776077 17384 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.727015 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:08.749711 17871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.011s	sys 0.013s
I20260811 16:05:08.779870 14574 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:08.764961 17917 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.780311 17808 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.741585 17781 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:08.727072 13908 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:08.639430 17925 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:08.785130 17925 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.785423 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.722275 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 733) took 1538 ms. Trace:
I20260811 16:05:08.787245 13744 rpcz_store.cc:276] 0811 16:05:07.184013 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.184138 (+   125us) service_pool.cc:227] Handling call
0811 16:05:07.204168 (+ 20030us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:07.229823 (+ 25655us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:07.229859 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:07.277800 (+ 47941us) log.cc:842] Serialized 26 byte log entry
0811 16:05:07.571040 (+293240us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:07.571201 (+   161us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:07.571573 (+   372us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:08.432137 (+860564us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:08.646186 (+214049us) raft_consensus.cc:1671] finished
0811 16:05:08.646209 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.722177 (+ 75968us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25064,"raft.queue_time_us":46726,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":10192768,"thread_start_us":231951,"threads_started":1,"wal-append.queue_time_us":467488}
I20260811 16:05:08.789959 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.790638 13904 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:08.783598 17781 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.791177 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.789983 17925 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:08.791854 13900 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:08.792038 13817 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:08.792361 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.792719 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.793018 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:08.793424 13900 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:08.793844 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.648633 17625 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.794572 13908 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.794869 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.796448 13904 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:05:08.797775 13904 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d00255c500904da78a120b3431f1e31d"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:05:08.526000 13737 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:08.799954 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.800844 13737 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 8 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260811 16:05:08.733454 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.633385 17888 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:08.665517 13824 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:08.736763 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 109273us
I20260811 16:05:08.801144 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:08.802373 13789 leader_election.cc:398] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9.
I20260811 16:05:08.802670 13789 leader_election.cc:401] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260811 16:05:08.802618 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.738173 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:08.645644 17747 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:08.732722 14583 rpcz_store.cc:276] 0811 16:05:07.501336 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.702380 (+201044us) service_pool.cc:227] Handling call
0811 16:05:07.743207 (+ 40827us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:07.743508 (+   301us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:07.799621 (+ 56113us) log.cc:842] Serialized 14 byte log entry
0811 16:05:08.199769 (+400148us) log.cc:842] Serialized 14 byte log entry
0811 16:05:08.559896 (+360127us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b1800320e60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:08.585835 (+ 25939us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b1800320e60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:05:08.586001 (+   166us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:08.586064 (+    63us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:08.586126 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.586230 (+   104us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.586371 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":376144,"prepare.queue_time_us":103655,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":6289,"raft.queue_time_us":395515,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":44185,"spinlock_wait_cycles":30471168,"thread_start_us":396267,"threads_started":1,"wal-append.queue_time_us":423409}
I20260811 16:05:08.740538 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.741730 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.807924 13743 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:08.741904 13626 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:08.749716 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:08.737210 17953 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:05:08.750927 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.814534 13903 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:08.814597 13901 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:05:08.815263 13743 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:08.815771 13903 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260811 16:05:08.732708 17232 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:08.764652 13738 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:08.765605 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.819092 13908 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:08.766245 13826 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:08.763643 17595 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:08.752403 17910 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.014s	sys 0.021s
I20260811 16:05:08.798254 17590 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.824867 13742 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:05:08.826892 13742 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260811 16:05:08.804364 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:08.810413 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72323.2us
I20260811 16:05:08.831888 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.832767 13825 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:08.833679 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:08.834509 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:08.652311 17906 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:08.814291 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.823346 17808 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:08.736977 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.847461 13905 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.848519 13737 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:08.829087 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.849929 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:08.850883 13742 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:08.850994 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:08.853430 17684 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:08.853751 17983 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:08.854068 17684 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:08.854543 17983 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.855183 17684 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.854074 17808 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:08.858702 17968 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:08.847007 17871 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:08.859440 17808 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:08.860366 17871 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:08.861598 17871 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.864348 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1774) took 1167 ms. Trace:
I20260811 16:05:08.835220 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:08.844270 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:08.845449 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.866608 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:08.852764 13817 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:05:08.867164 13789 leader_election.cc:398] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:08.813887 17747 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:08.847295 17987 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:08.871770 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 610) took 1603 ms. Trace:
I20260811 16:05:08.872251 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:08.872135 13906 rpcz_store.cc:276] 0811 16:05:07.268804 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.726707 (+457903us) service_pool.cc:227] Handling call
0811 16:05:07.783008 (+ 56301us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:08.632935 (+849927us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.871526 (+238591us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54000348d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:08.871714 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1717494528}
I20260811 16:05:08.873356 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:08.873886 13908 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: [5.8-9.10]
I20260811 16:05:08.873957 17692 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.875067 17648 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:08.818302 17925 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:08.847103 17906 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:08.869576 13787 leader_election.cc:398] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:08.908526 13787 leader_election.cc:401] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260811 16:05:08.828001 17856 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:08.874786 13906 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260811 16:05:08.909636 13906 pending_rounds.cc:76] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 4
I20260811 16:05:08.876781 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 603) took 1622 ms. Trace:
I20260811 16:05:08.909853 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 598) took 1657 ms. Trace:
I20260811 16:05:08.880605 17625 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:08.877934 17639 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:08.881918 13740 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:08.883491 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.884608 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1770) took 1441 ms. Trace:
I20260811 16:05:08.868902 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.911546 13739 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:08.879870 17925 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:08.769057 17939 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:08.857491 17983 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.864923 13741 rpcz_store.cc:276] 0811 16:05:07.697126 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.699505 (+  2379us) service_pool.cc:227] Handling call
0811 16:05:08.864124 (+1164619us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400344ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:08.864271 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1610437376}
I20260811 16:05:08.957005 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:08.957170 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.846871 17590 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9.
I20260811 16:05:08.911485 13738 rpcz_store.cc:276] 0811 16:05:07.442882 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.443738 (+   856us) service_pool.cc:227] Handling call
0811 16:05:08.884411 (+1440673us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001045d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:08.884542 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2857800960}
I20260811 16:05:08.916069 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:08.918190 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.081s	sys 0.150s
W20260811 16:05:08.879104 17991 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:05:08.910013 13907 rpcz_store.cc:276] 0811 16:05:07.254156 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.259091 (+  4935us) service_pool.cc:227] Handling call
0811 16:05:07.299999 (+ 40908us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:07.345959 (+ 45960us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:07.484897 (+138938us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18002eedc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:05:07.703004 (+218107us) log.cc:842] Serialized 14 byte log entry
0811 16:05:07.947029 (+244025us) log.cc:842] Serialized 14 byte log entry
0811 16:05:07.948235 (+  1206us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:07.983799 (+ 35564us) log.cc:842] Serialized 26 byte log entry
0811 16:05:07.983979 (+   180us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:07.984026 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:07.984122 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:08.548642 (+564520us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:08.876570 (+327928us) raft_consensus.cc:1671] finished
0811 16:05:08.876597 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.876724 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45390,"prepare.queue_time_us":358284,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":106,"raft.queue_time_us":64481,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":47897,"spinlock_wait_cycles":33357312,"thread_start_us":400561,"threads_started":2,"wal-append.queue_time_us":370037}
I20260811 16:05:08.910409 13902 rpcz_store.cc:276] 0811 16:05:07.252530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.255185 (+  2655us) service_pool.cc:227] Handling call
0811 16:05:07.255482 (+   297us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:07.432453 (+176971us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:07.638961 (+206508us) log.cc:842] Serialized 14 byte log entry
0811 16:05:08.320066 (+681105us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:08.320135 (+    69us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:08.320182 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:08.813999 (+493817us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b180040cd20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:05:08.909595 (+ 95596us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002ac6d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:08.909655 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:08.909800 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":368807,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":14326,"raft.queue_time_us":534,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5577,"spinlock_wait_cycles":414817792,"thread_start_us":886583,"threads_started":2,"wal-append.queue_time_us":745782}
I20260811 16:05:08.923486 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:08.993849 13740 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:08.827654 17844 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:08.996788 13740 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:05:08.926292 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:08.929679 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62896.5us
I20260811 16:05:09.000201 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.907759 13905 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:08.909879 13906 pending_rounds.cc:97] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260811 16:05:08.878357 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:08.950178 17648 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:08.952016 17891 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:09.004608 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.953460 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.957958 13739 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:08.910208 13825 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
W20260811 16:05:08.983407 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.082s	sys 0.150s
I20260811 16:05:08.911355 17692 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:08.949366 17925 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:09.003818 13906 raft_consensus.cc:2894] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260811 16:05:09.019758 13906 raft_consensus.cc:2866] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:09.004297 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 126025us
I20260811 16:05:09.021000 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:09.006848 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 818840us
I20260811 16:05:09.021037 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:08.948849 17975 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:09.009676 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:08.947365 17958 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:09.005546 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.015753 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:08.949240 17987 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:08.991516 17948 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:09.028117 13902 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 9. Ops: []
I20260811 16:05:08.955713 17624 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:09.029168 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:09.024705 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:09.028088 13738 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:09.030821 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:08.955685 17639 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:09.022571 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:09.014977 14574 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260811 16:05:09.033174 14583 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260811 16:05:09.032006 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:09.036302 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:09.037866 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:09.040689 13907 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: [5.7-9.9]
I20260811 16:05:09.040966 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:09.009096 17968 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:09.004958 17850 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:09.018891 17915 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:09.042320 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:09.045202 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 194950us
I20260811 16:05:08.995379 17926 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260811 16:05:09.046185 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:09.056360 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.057790 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:09.010553 17972 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:09.023206 17590 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:09.035106 17699 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:09.035398 17903 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:09.029739 17958 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:09.050756 17722 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:09.059111 17915 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:09.031977 17619 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:09.070562 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:09.046165 17624 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:09.059962 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:09.072403 13907 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260811 16:05:09.072582 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 187963us
I20260811 16:05:09.041489 17705 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:09.041095 17595 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:09.080509 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:09.082999 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 920) took 1582 ms. Trace:
I20260811 16:05:09.128328 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:08.909343 17888 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.019109 17755 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260811 16:05:09.034492 17975 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:09.046996 17384 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:09.050738 17951 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:09.051467 17967 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:09.058965 17782 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:09.127507 14577 rpcz_store.cc:276] 0811 16:05:07.501025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.702369 (+201344us) service_pool.cc:227] Handling call
0811 16:05:07.745124 (+ 42755us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:07.745397 (+   273us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:07.841059 (+ 95662us) log.cc:842] Serialized 14 byte log entry
0811 16:05:09.082669 (+1241610us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:09.082723 (+    54us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:09.082765 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:09.082837 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:09.082943 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":638607,"prepare.queue_time_us":130334,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":4728,"raft.queue_time_us":689942,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11914,"thread_start_us":652339,"threads_started":2,"wal-append.queue_time_us":680929}
I20260811 16:05:09.019316 17891 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.106568 17722 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:09.108351 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 66121.2us
I20260811 16:05:09.072021 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033403
I20260811 16:05:09.073123 16875 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:09.116032 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 827670us
I20260811 16:05:09.058714 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.157444 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:09.129417 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:09.122617 17983 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:09.104535 17590 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:09.146248 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:09.147651 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:09.030771 17892 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:09.149989 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:09.151647 14581 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:05:09.110110 17915 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:09.077221 17917 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260811 16:05:09.154255 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:09.076033 17561 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260811 16:05:09.112299 17624 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:09.126118 17705 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:09.157626 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98998.3us
W20260811 16:05:09.110320 17989 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260811 16:05:09.154714 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:09.160591 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.164529 14575 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:09.201205 14579 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:09.142333 17595 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:09.167371 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:09.074568 17648 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:09.185272 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 231938us
I20260811 16:05:09.147822 17378 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:09.189426 14580 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:09.180460 17392 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:09.154740 17722 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:09.125936 17699 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260811 16:05:09.198861 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.142038 17970 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260811 16:05:09.147022 17955 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260811 16:05:09.180946 17964 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:09.206017 17595 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:09.204003 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:09.150844 17951 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.237812 13742 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
W20260811 16:05:09.216109 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55591.3us
I20260811 16:05:09.240803 14579 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:09.243121 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.244825 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:09.201295 17705 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:09.199208 17624 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:09.125672 17639 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.229903 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.185027 17958 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:09.270223 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 210320us
I20260811 16:05:09.273547 13825 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260811 16:05:09.232151 17392 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:09.219869 17999 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:09.187633 17824 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260811 16:05:09.144810 17987 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.241801 17939 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:09.279999 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 920432us
I20260811 16:05:09.231113 17964 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:09.266503 17946 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:09.251785 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:09.205852 17232 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:09.247720 17918 raft_consensus.cc:2741] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260811 16:05:09.292359 17392 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:09.266204 17942 raft_consensus.cc:2741] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260811 16:05:09.286466 17828 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.002s
W20260811 16:05:09.196048 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 81167.6us
I20260811 16:05:09.241122 17590 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260811 16:05:09.339035 13735 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:09.307301 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62576.3us
I20260811 16:05:09.247769 17619 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260811 16:05:09.318075 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 150486us
I20260811 16:05:09.277060 16875 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260811 16:05:09.288523 17844 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:05:09.295857 17998 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:05:09.340261 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.310708 14580 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:09.369026 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 117328us
I20260811 16:05:09.296433 17946 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:09.298436 17964 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:09.402074 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:09.419704 16875 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:05:09.423684 17958 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:09.233621 17975 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.341040 17392 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:09.432312 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 139152us
W20260811 16:05:09.469044 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 123626us
I20260811 16:05:09.432209 17892 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:09.332646 17824 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260811 16:05:09.482739 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:09.483273 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 75807us
W20260811 16:05:09.476456 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 136313us
I20260811 16:05:09.377296 17891 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:09.492880 14544 connection.cc:232] RPC call timeout handler was delayed by -1.277386546949856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260811 16:05:09.493829 14544 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.765s (SENT)
I20260811 16:05:09.494788 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:09.487586 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.534467 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1773) took 1893 ms. Trace:
I20260811 16:05:09.338745 17828 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.404559 17946 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:09.535086 13736 rpcz_store.cc:276] 0811 16:05:07.640934 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:07.641219 (+   285us) service_pool.cc:227] Handling call
0811 16:05:09.491670 (+1850451us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:09.534369 (+ 42699us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3341162880}
I20260811 16:05:09.334224 18009 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.191s
I20260811 16:05:09.482656 17844 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:09.400482 17910 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
W20260811 16:05:09.539345 17994 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
W20260811 16:05:09.497521 17976 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.004s
I20260811 16:05:09.404842 17942 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:09.493043 17625 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:09.567798 17968 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:09.578625 17747 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.698s	user 0.008s	sys 0.003s
I20260811 16:05:09.602931 13900 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:09.603770 13738 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:09.241514 17962 consensus_queue.cc:1159] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:05:09.609551 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:09.548043 17891 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:09.608227 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 107000us
I20260811 16:05:09.586611 17844 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:09.608196 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 206617us
I20260811 16:05:09.629581 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:09.645752 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:05:09.604843 18006 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260811 16:05:09.604043 18010 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260811 16:05:09.628752 17392 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.669301 17947 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:09.617043 17619 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260811 16:05:09.604592 17232 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:09.605334 17995 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
W20260811 16:05:09.652581 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 165068us
I20260811 16:05:09.677834 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.678103 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:09.624399 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 130582us
W20260811 16:05:09.663273 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 81576.7us
I20260811 16:05:09.629575 17892 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.579202 17972 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260811 16:05:09.671653 13906 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
W20260811 16:05:09.639894 18008 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260811 16:05:09.609117 17625 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:09.715380 17625 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:09.708673 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:09.716420 13907 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:09.707866 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:09.718156 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:09.651185 17844 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:09.643221 17927 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:09.747108 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:09.680977 13817 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260811 16:05:09.707105 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:09.721050 13826 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:09.722636 13906 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:05:09.606992 17976 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:09.724056 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 470413us
W20260811 16:05:09.724324 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77287.1us
I20260811 16:05:09.756367 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.637836 17891 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.658977 17960 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260811 16:05:09.661675 17948 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.006s
I20260811 16:05:09.751029 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:09.722316 14544 leader_election.cc:334] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.882s (SENT)
I20260811 16:05:09.659979 17951 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:09.760258 14544 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.906s (SENT)
I20260811 16:05:09.760990 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.708775 18032 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:09.629719 17747 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.721267 17947 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:09.751498 18006 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:05:09.613478 17942 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.751222 17871 raft_consensus.cc:2741] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260811 16:05:09.753546 17917 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:09.769456 17948 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:09.770846 17991 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260811 16:05:09.824432 13735 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:09.826907 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2310) took 1490 ms. Trace:
I20260811 16:05:09.827474 13908 rpcz_store.cc:276] 0811 16:05:08.336843 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.874724 (+537881us) service_pool.cc:227] Handling call
0811 16:05:08.875039 (+   315us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:08.950212 (+ 75173us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:08.950549 (+   337us) log.cc:842] Serialized 14 byte log entry
0811 16:05:09.192615 (+242066us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:09.203608 (+ 10993us) log.cc:842] Serialized 26 byte log entry
0811 16:05:09.203834 (+   226us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:09.348082 (+144248us) log.cc:842] Serialized 14 byte log entry
0811 16:05:09.484761 (+136679us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:09.484864 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:09.826645 (+341781us) raft_consensus.cc:1671] finished
0811 16:05:09.826677 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:09.826834 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":110010,"prepare.queue_time_us":48803,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":278798,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":22527,"spinlock_wait_cycles":1792,"thread_start_us":502522,"threads_started":3,"wal-append.queue_time_us":337511}
W20260811 16:05:09.830606 18007 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260811 16:05:09.763737 18005 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:09.831573 18005 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:09.832754 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2077) took 1748 ms. Trace:
I20260811 16:05:09.832530 18005 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:09.835546 18014 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260811 16:05:09.836458 17692 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.817s	user 0.012s	sys 0.000s
I20260811 16:05:09.837100 13741 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:09.837548 18030 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260811 16:05:09.780014 17947 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:09.839846 17947 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:09.780277 17378 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:09.767436 18025 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:09.763463 16875 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:09.745627 17619 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260811 16:05:09.802665 13904 raft_consensus.cc:595] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.871351 13904 raft_consensus.cc:603] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:09.802451 17917 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:09.767182 17945 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260811 16:05:09.806576 13826 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:09.799090 18003 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:09.810293 17624 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.002s
W20260811 16:05:09.887037 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 164999us
W20260811 16:05:09.814378 17782 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260811 16:05:09.772859 18032 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:09.820967 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:09.784183 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:09.892598 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108529us
I20260811 16:05:09.892889 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:09.894398 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.833278 13901 rpcz_store.cc:276] 0811 16:05:08.084220 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.818253 (+734033us) service_pool.cc:227] Handling call
0811 16:05:08.818565 (+   312us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:08.819057 (+   492us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:08.819087 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:08.844668 (+ 25581us) log.cc:842] Serialized 26 byte log entry
0811 16:05:09.254136 (+409468us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:09.284660 (+ 30524us) log.cc:842] Serialized 14 byte log entry
0811 16:05:09.284883 (+   223us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:09.284973 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:09.832489 (+547516us) raft_consensus.cc:1671] finished
0811 16:05:09.832517 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:09.832681 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15106,"prepare.queue_time_us":36388,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":103695,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":30761,"thread_start_us":268124,"threads_started":1,"wal-append.queue_time_us":566537}
I20260811 16:05:09.843814 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.783852 17392 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260811 16:05:09.862731 13741 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:09.868288 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 117312us
I20260811 16:05:09.866030 17590 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:09.807617 18018 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260811 16:05:09.868614 16875 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:09.885942 13823 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260811 16:05:09.767194 17984 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.087s
I20260811 16:05:09.810453 17747 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:09.770533 17927 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260811 16:05:09.869221 17705 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
W20260811 16:05:09.869699 17967 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.722s	user 0.005s	sys 0.007s
I20260811 16:05:09.848591 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.819424 17968 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:09.928293 13820 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:09.929231 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.903193 18014 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:09.902009 13742 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260811 16:05:09.782357 17960 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.091s
W20260811 16:05:09.903795 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 143628us
I20260811 16:05:09.872449 13909 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:09.906929 13901 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:09.907996 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.909132 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.874490 17972 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:09.912909 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:09.913751 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:09.916461 13905 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:05:09.869879 17378 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:09.879709 17917 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:09.880409 17828 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:09.920480 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:09.920938 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:09.890925 18040 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:09.979257 13740 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:09.902845 17782 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:09.989814 13824 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:09.933527 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:09.897635 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 147567us
I20260811 16:05:09.902987 18032 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:09.958420 13742 pending_rounds.cc:76] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 5
I20260811 16:05:09.963912 13818 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:09.967777 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:09.996057 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.936111 17967 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:09.963266 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:10.030529 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67440us
I20260811 16:05:09.980558 13908 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:10.034482 13908 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260811 16:05:09.900259 17624 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.982189 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:09.988178 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:10.036079 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54009.1us
I20260811 16:05:09.992394 13823 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:09.934839 17232 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:10.012010 13742 pending_rounds.cc:97] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260811 16:05:10.046002 13742 raft_consensus.cc:2866] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:10.046110 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48941.7us
I20260811 16:05:09.917024 17590 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:09.996670 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:09.969723 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:10.047899 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:10.051548 13827 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:09.891185 18025 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.091s
I20260811 16:05:10.018622 13735 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:10.020743 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.996789 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:10.022279 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:09.976812 18003 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.028098 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:10.064492 13740 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:10.056658 13739 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:10.062891 13817 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:10.067011 13817 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:10.056896 13906 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:10.061017 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:09.993774 17828 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:09.934794 18012 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260811 16:05:09.994545 17639 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:09.931895 17705 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.087378 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:10.098344 13823 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:10.028944 17782 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:10.080833 13827 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:10.093565 13817 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260811 16:05:10.088631 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 91918.8us
I20260811 16:05:10.048911 17891 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:09.995052 17945 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.087s
I20260811 16:05:09.937148 17968 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.104993 13738 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:10.055497 17987 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:10.112504 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:10.054016 17232 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:10.091293 17915 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.903s	user 0.012s	sys 0.000s
I20260811 16:05:10.116955 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:09.965993 17972 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.062418 17976 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:09.966197 18041 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.205s
I20260811 16:05:10.140313 13744 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:10.124010 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:10.101750 17384 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:10.164191 18033 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260811 16:05:10.166610 18033 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:10.168220 18051 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260811 16:05:10.014954 18034 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.143s
I20260811 16:05:10.114233 17942 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:10.180064 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 147617us
W20260811 16:05:10.198210 18039 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260811 16:05:10.206749 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 166986us
I20260811 16:05:10.199259 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36246 (request call id 50) took 2248 ms. Trace:
I20260811 16:05:10.207755 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:10.126045 17692 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:10.129606 17891 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:10.212980 13904 rpcz_store.cc:276] 0811 16:05:07.931886 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.797548 (+865662us) service_pool.cc:227] Handling call
0811 16:05:10.180499 (+1382951us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:10.180629 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2306936704}
I20260811 16:05:10.128611 17972 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.086932 17828 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.212944 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:10.174484 17781 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:10.220886 18052 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260811 16:05:10.267194 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:10.129308 17976 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260811 16:05:10.125758 17915 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:10.218763 17906 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.263s	user 0.015s	sys 0.000s
I20260811 16:05:09.994311 18040 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:10.275758 18015 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.391s	user 0.000s	sys 0.002s
I20260811 16:05:10.402873 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:10.277331 14573 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:10.278762 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:10.086411 18003 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.113916 17639 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.259656 14578 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260811 16:05:10.221163 17960 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:10.219758 17891 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:10.397369 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 401994us
I20260811 16:05:10.406531 14583 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:10.424600 14583 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:10.125301 17232 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:10.261662 17939 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:10.281769 17975 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.120750 18050 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.293s
I20260811 16:05:10.425536 14583 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.121928 17378 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:05:10.425755 18010 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260811 16:05:10.474242 14575 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:10.497434 14583 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:10.271207 17781 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:10.424232 17960 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:10.452211 17925 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.420s	user 0.001s	sys 0.017s
I20260811 16:05:10.433233 17891 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:10.440032 17939 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:10.403088 17906 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.491360 18001 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:05:10.506299 18043 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
I20260811 16:05:10.474948 17624 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:10.515430 18049 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.469s	user 0.000s	sys 0.002s
W20260811 16:05:10.543968 18044 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.482s	user 0.000s	sys 0.002s
I20260811 16:05:10.544070 17960 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.559412 14583 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260811 16:05:10.527524 17590 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.487918 17975 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.423535 18026 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.547s
I20260811 16:05:10.528575 17939 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:10.546257 17960 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:10.566085 17856 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.014s	sys 0.034s
I20260811 16:05:10.572275 17808 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:10.547034 17625 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.831s	user 0.002s	sys 0.011s
I20260811 16:05:10.543074 17705 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:10.582753 18042 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
W20260811 16:05:10.562824 18053 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
W20260811 16:05:10.557890 18055 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260811 16:05:10.556023 18001 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:10.591888 17828 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.592392 17975 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.592886 18074 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.522112 17925 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:10.576956 17844 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.001s
I20260811 16:05:10.586632 18050 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260811 16:05:10.584321 17856 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.014s	sys 0.034s
I20260811 16:05:10.593717 18074 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:10.277878 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62241.3us
I20260811 16:05:10.813983 18074 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:10.755157 13742 raft_consensus.cc:2396] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:10.750149 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 1995) took 2266 ms. Trace:
I20260811 16:05:10.781564 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1690) took 1178 ms. Trace:
W20260811 16:05:10.646301 18068 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260811 16:05:10.825855 13744 rpcz_store.cc:276] 0811 16:05:08.483885 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.055314 (+571429us) service_pool.cc:227] Handling call
0811 16:05:10.749496 (+1694182us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400346cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:10.749862 (+   366us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2288390528}
I20260811 16:05:10.592038 18001 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:10.830137 17639 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.749166 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2019) took 1025 ms. Trace:
I20260811 16:05:10.601344 18003 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.589972 17625 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.598551 17915 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.758858 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 746) took 1352 ms. Trace:
I20260811 16:05:10.840873 13739 rpcz_store.cc:276] 0811 16:05:09.406427 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.407284 (+   857us) service_pool.cc:227] Handling call
0811 16:05:09.475726 (+ 68442us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:10.086662 (+610936us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:10.754786 (+668124us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400311d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:10.758593 (+  3807us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1335566720}
I20260811 16:05:10.758244 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:10.764465 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.012s	sys 0.006s
W20260811 16:05:10.842944 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.014s	sys 0.013s
W20260811 16:05:10.597886 17964 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.132s	user 0.006s	sys 0.007s
I20260811 16:05:10.847440 17964 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.604759 17906 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.655731 17925 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:10.628304 17946 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.043s	user 0.010s	sys 0.005s
I20260811 16:05:10.853904 17946 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.590500 17808 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.858961 17844 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:10.662532 17947 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.000s
I20260811 16:05:10.862860 17947 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.584659 17968 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.831463 13825 rpcz_store.cc:276] 0811 16:05:09.603020 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.603219 (+   199us) service_pool.cc:227] Handling call
0811 16:05:09.603537 (+   318us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:09.630879 (+ 27342us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:09.630917 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:09.630956 (+    39us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:09.630987 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:10.781018 (+1150031us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5400125a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:10.781082 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:10.781345 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":62350720}
I20260811 16:05:10.872668 14574 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:10.745658 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.014s
W20260811 16:05:10.776345 13827 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.051s
I20260811 16:05:10.881548 17684 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:10.885440 17684 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:10.883865 17648 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.886940 17781 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:10.662572 18032 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260811 16:05:10.901922 13738 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:10.902156 18032 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:10.903071 17888 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:10.599298 18067 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.472s
I20260811 16:05:10.627686 18078 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:10.906880 18078 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:10.882433 17984 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.658161 17891 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.911188 17903 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:10.911860 17903 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:10.914460 17891 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:10.632122 17958 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.208s	user 0.009s	sys 0.007s
I20260811 16:05:10.915807 17984 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.917734 17824 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:10.917870 17958 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.918653 17824 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.918867 17958 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:10.919539 17722 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.689s	user 0.010s	sys 0.006s
I20260811 16:05:10.666631 17939 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:10.896826 13827 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.006s	sys 0.059s
I20260811 16:05:10.777642 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1786) took 1870 ms. Trace:
I20260811 16:05:10.614238 17705 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:10.937888 17705 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:10.940091 17705 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.941417 17824 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.897807 13904 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:05:10.942926 13904 raft_consensus.cc:595] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Received request to transfer leadership to TS cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:10.943405 18032 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:10.906204 13907 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:10.934542 13741 rpcz_store.cc:276] 0811 16:05:08.907428 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.956752 (+ 49324us) service_pool.cc:227] Handling call
0811 16:05:10.777184 (+1820432us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:10.777417 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2022465792}
I20260811 16:05:10.910151 17648 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:10.913868 17903 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:10.785830 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1689) took 1513 ms. Trace:
I20260811 16:05:10.970654 17939 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:10.948505 17984 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.921867 17952 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:10.971549 17939 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.971927 17952 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:10.972478 17939 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.924214 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:10.926756 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:10.928272 17947 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.979387 17903 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:10.970963 13821 rpcz_store.cc:276] 0811 16:05:09.272367 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.274598 (+  2231us) service_pool.cc:227] Handling call
0811 16:05:09.274974 (+   376us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:09.288636 (+ 13662us) raft_consensus.cc:1520] Early marking committed up to index 3
0811 16:05:09.552406 (+263770us) log.cc:842] Serialized 14 byte log entry
0811 16:05:09.561355 (+  8949us) log.cc:842] Serialized 14 byte log entry
0811 16:05:09.579279 (+ 17924us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:09.580925 (+  1646us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:09.581069 (+   144us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:10.785185 (+1204116us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540025f654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:10.785259 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:10.785606 (+   347us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30628,"prepare.queue_time_us":1192564,"prepare.run_cpu_time_us":4261,"prepare.run_wall_time_us":23084,"raft.queue_time_us":166070,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":20436,"spinlock_wait_cycles":30849280,"thread_start_us":248135,"threads_started":1}
I20260811 16:05:10.931093 17590 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:10.932943 17625 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:10.904848 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.003s	sys 0.015s
I20260811 16:05:10.981730 18078 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.586808 18040 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.832355 13736 rpcz_store.cc:276] 0811 16:05:09.723983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.724160 (+   177us) service_pool.cc:227] Handling call
0811 16:05:09.724523 (+   363us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:09.748622 (+ 24099us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:09.748649 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:09.749098 (+   449us) log.cc:842] Serialized 26 byte log entry
0811 16:05:09.871025 (+121927us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:09.871066 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:09.871154 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:10.748256 (+877102us) raft_consensus.cc:1671] finished
0811 16:05:10.748343 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:10.748837 (+   494us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24666,"raft.queue_time_us":26513,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5909,"thread_start_us":85740,"threads_started":1,"wal-append.queue_time_us":164475}
I20260811 16:05:10.944824 17705 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:10.962848 17964 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.963272 17958 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.964675 18082 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:10.965023 17844 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.946997 17722 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:10.968030 17917 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.981s	user 0.017s	sys 0.000s
I20260811 16:05:10.968428 17946 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:10.970381 17648 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:11.001530 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.014s	sys 0.009s
W20260811 16:05:11.002009 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.009s
I20260811 16:05:11.002362 14580 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:10.973942 17952 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:10.980471 17808 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:10.943451 13904 raft_consensus.cc:603] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:11.000681 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:11.000983 18012 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:11.003363 18078 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:11.006007 14578 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:10.995321 17232 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:11.006554 18012 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.003770 18082 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:11.007771 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1060) took 1333 ms. Trace:
I20260811 16:05:11.007803 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260811 16:05:11.008292 17996 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.659s	user 0.014s	sys 0.024s
I20260811 16:05:11.025596 14580 rpcz_store.cc:276] 0811 16:05:09.674096 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.674359 (+   263us) service_pool.cc:227] Handling call
0811 16:05:09.744585 (+ 70226us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:11.002924 (+1258339us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:11.007424 (+  4500us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540057fdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:11.007664 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2829211904}
W20260811 16:05:11.037432 17595 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.769s	user 0.012s	sys 0.008s
I20260811 16:05:11.038092 17595 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:11.039776 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2323) took 2610 ms (client timeout 1934 ms). Trace:
W20260811 16:05:11.040324 13909 rpcz_store.cc:269] 0811 16:05:08.429443 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.461536 (+ 32093us) service_pool.cc:227] Handling call
0811 16:05:11.039127 (+2577591us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:11.039425 (+   298us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3165132160}
I20260811 16:05:11.043352 14575 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:11.079811 13903 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:11.083494 18012 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:11.085559 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.016s	sys 0.033s
W20260811 16:05:11.085989 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.016s	sys 0.033s
I20260811 16:05:11.092141 18082 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.092885 17946 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:11.095916 17722 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.096982 17952 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:11.046409 13737 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.009s	sys 0.009s
W20260811 16:05:11.117136 13737 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.009s	sys 0.009s
I20260811 16:05:11.023581 17917 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.118444 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.119383 14575 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:11.120273 17917 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.121126 14580 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:11.121923 17917 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:11.123413 13743 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260811 16:05:11.123970 17595 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.125413 17939 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.017144 17590 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.130546 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 667) took 1212 ms. Trace:
I20260811 16:05:11.131078 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:11.141382 13820 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:11.138454 13905 rpcz_store.cc:276] 0811 16:05:09.917481 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.976660 (+ 59179us) service_pool.cc:227] Handling call
0811 16:05:11.129338 (+1152678us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002c1ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:11.130249 (+   911us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2024648064}
I20260811 16:05:11.131372 17908 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:11.143882 17962 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.147626 17962 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.143941 17908 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:11.162120 13790 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.018s	sys 0.011s
W20260811 16:05:11.181290 13790 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.020s	sys 0.011s
I20260811 16:05:11.238304 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:11.238339 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 427822us
I20260811 16:05:11.246909 17918 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260811 16:05:11.252719 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 94283.1us
I20260811 16:05:11.233954 17590 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.237742 17962 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.260931 17983 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:11.265578 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.007s	sys 0.012s
W20260811 16:05:11.266184 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.007s	sys 0.012s
I20260811 16:05:11.267958 17918 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:11.268447 17918 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:11.269534 17918 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:11.271263 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.020s	sys 0.027s
W20260811 16:05:11.271776 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.020s	sys 0.027s
I20260811 16:05:11.265602 17983 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:11.272411 17983 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:11.254673 17984 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:11.275255 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.003s	sys 0.019s
W20260811 16:05:11.275808 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.003s	sys 0.019s
I20260811 16:05:11.275699 17984 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.277959 18093 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:11.278231 18025 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:11.270918 17918 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:11.278849 18093 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.295758 18093 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.288929 17984 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.314682 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:11.315304 18088 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.279244 18025 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.291399 17962 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260811 16:05:11.315572 17747 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.326134 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.315970 17590 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:11.372702 13736 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260811 16:05:11.380654 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.019s	sys 0.019s
W20260811 16:05:11.382637 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.019s	sys 0.019s
W20260811 16:05:11.402172 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.013s	sys 0.005s
W20260811 16:05:11.402675 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.014s	sys 0.005s
I20260811 16:05:11.404690 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1796) took 1234 ms. Trace:
I20260811 16:05:11.408838 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:11.417336 17951 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.408048 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.405155 13740 rpcz_store.cc:276] 0811 16:05:10.169738 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:10.226554 (+ 56816us) service_pool.cc:227] Handling call
0811 16:05:10.750484 (+523930us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:10.751528 (+  1044us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:10.751597 (+    69us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:10.752941 (+  1344us) log.cc:842] Serialized 26 byte log entry
0811 16:05:11.179486 (+426545us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:11.179529 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:11.179623 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:11.404344 (+224721us) raft_consensus.cc:1671] finished
0811 16:05:11.404363 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:11.404494 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":106896,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":343,"thread_start_us":411358,"threads_started":1,"wal-append.queue_time_us":503680}
I20260811 16:05:11.429656 18040 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.430540 18040 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.423410 17958 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260811 16:05:11.439878 17958 consensus_queue.cc:1225] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:05:11.440847 17951 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.326803 17908 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.445034 17908 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:11.447418 13901 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.353s	user 0.034s	sys 0.049s
W20260811 16:05:11.447916 13901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.034s	sys 0.049s
I20260811 16:05:11.454057 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:11.425931 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 994414us
W20260811 16:05:11.421895 17888 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.518s	user 0.015s	sys 0.005s
I20260811 16:05:11.407717 18035 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.491564 17940 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:11.491843 17960 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.021s
I20260811 16:05:11.492300 17981 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:11.492825 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.493201 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.493372 18059 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.401885 17782 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.496433 14575 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:05:11.593401 14578 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.001s
I20260811 16:05:11.594096 14578 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:11.593325 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 99489.5us
I20260811 16:05:11.599092 17699 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:11.600073 17699 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.602284 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2023) took 1672 ms. Trace:
I20260811 16:05:11.382459 18088 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:11.600567 17952 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.006s
I20260811 16:05:11.638958 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:11.599076 17940 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.642376 17955 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.643047 17955 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.602771 13735 rpcz_store.cc:276] 0811 16:05:09.929253 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.929402 (+   149us) service_pool.cc:227] Handling call
0811 16:05:09.971981 (+ 42579us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:10.057261 (+ 85280us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:11.601715 (+1544454us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54002792d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:11.602073 (+   358us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":73486080}
I20260811 16:05:11.648633 17940 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.651404 17782 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.653887 17232 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.629401 18059 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.623901 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:11.654508 17232 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.654806 17960 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:11.655648 17960 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.656373 18059 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.656759 17232 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.657006 18059 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:11.657539 18088 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.657807 17960 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:11.657656 18059 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.658214 18088 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:11.654565 17939 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.659463 14578 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:11.659997 17939 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.662176 17939 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.646334 17958 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:11.664124 17958 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.647047 13741 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:11.668686 13739 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:11.643973 18067 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.677887 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.678531 18067 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.686055 18067 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.501981 17590 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.474617 17747 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.612985 18040 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.688310 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:11.649065 17906 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:11.715106 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:11.715637 17906 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.716650 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.717869 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.738521 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:11.739688 14580 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:11.740339 18096 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260811 16:05:11.746407 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.747071 14578 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:11.682921 17782 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.729229 17951 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.688011 17981 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:11.797300 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 208288us
I20260811 16:05:11.798336 14581 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:11.690200 18035 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.744135 17699 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.729733 18067 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.678969 17684 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.751508 17983 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:11.823202 17903 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.843s	user 0.016s	sys 0.004s
I20260811 16:05:11.779996 14578 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:11.817133 18025 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.908823 17983 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.888809 17619 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:11.855109 17705 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.013s
I20260811 16:05:11.936550 17619 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.927709 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:11.899287 18001 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.009s	user 0.016s	sys 0.003s
I20260811 16:05:11.940382 14580 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:11.902366 18088 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:11.857300 17747 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:11.858983 18059 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.902905 17755 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:11.953703 13739 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:11.974071 17590 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:11.929538 17906 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:11.943884 17903 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:11.903316 18067 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:11.958624 17958 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:12.022528 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 209222us
I20260811 16:05:11.955641 18001 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:11.909494 17908 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:11.976192 17705 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:11.963040 18025 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.043320 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2026) took 1890 ms. Trace:
I20260811 16:05:12.043915 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:11.971205 18088 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:11.974095 17755 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.056682 14581 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.060086 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.056542 13742 rpcz_store.cc:276] 0811 16:05:10.153062 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:10.153198 (+   136us) service_pool.cc:227] Handling call
0811 16:05:12.021185 (+1867987us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400278dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.043233 (+ 22048us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1238962432}
W20260811 16:05:12.056037 13820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2410) took 2194 ms (client timeout 2109 ms). Trace:
I20260811 16:05:12.071791 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2093) took 2144 ms. Trace:
I20260811 16:05:12.071988 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.072446 14582 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:12.067204 13820 rpcz_store.cc:269] 0811 16:05:09.845803 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.928966 (+ 83163us) service_pool.cc:227] Handling call
0811 16:05:12.025709 (+2096743us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.039665 (+ 13956us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2694282496}
I20260811 16:05:12.051976 17705 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:12.080745 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 585362us
I20260811 16:05:12.072209 13907 rpcz_store.cc:276] 0811 16:05:09.911964 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.912100 (+   136us) service_pool.cc:227] Handling call
0811 16:05:09.932633 (+ 20533us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:10.944760 (+1012127us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.024992 (+1080232us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54000884d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:12.055946 (+ 30954us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2235214720}
W20260811 16:05:12.089318 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2308) took 3749 ms (client timeout 4212 ms). Trace:
I20260811 16:05:12.089605 13902 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:12.089859 13900 rpcz_store.cc:269] 0811 16:05:08.333182 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.804170 (+470988us) service_pool.cc:227] Handling call
0811 16:05:12.049141 (+3244971us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54002c0bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.082364 (+ 33223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1756763008}
I20260811 16:05:12.090785 17378 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:12.091984 18035 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.091624 17378 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.092365 18067 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:12.094074 17918 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.003s
I20260811 16:05:12.058701 17782 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.095028 17782 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.096223 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:12.096930 14573 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:12.097254 17782 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:12.098237 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57778.6us
W20260811 16:05:12.097371 18081 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.251s	user 0.004s	sys 0.014s
I20260811 16:05:12.047187 17906 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:12.051976 17747 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.108881 18001 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:12.109290 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.615s (SENT)
I20260811 16:05:12.103837 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2075) took 4103 ms. Trace:
I20260811 16:05:12.101928 17705 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:12.116935 17981 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.118182 18025 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.118753 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2091) took 3482 ms. Trace:
I20260811 16:05:12.119659 17926 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:12.119905 18037 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:12.120647 18029 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.120436 17926 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.120976 18023 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.121327 18029 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.121681 18023 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.112120 13903 rpcz_store.cc:276] 0811 16:05:08.000170 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:08.818199 (+818029us) service_pool.cc:227] Handling call
0811 16:05:11.079076 (+2260877us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:11.080542 (+  1466us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.100562 (+1020020us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54000c7e50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.103729 (+  3167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5119161216}
I20260811 16:05:12.122764 17926 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:12.123790 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:12.123945 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 877) took 2980 ms (client timeout 1873 ms). Trace:
I20260811 16:05:12.124976 14579 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260811 16:05:12.136762 14574 rpcz_store.cc:269] 0811 16:05:09.143748 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.145962 (+  2214us) service_pool.cc:227] Handling call
0811 16:05:12.123681 (+2977719us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54007e04d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.123857 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3874522880}
I20260811 16:05:12.126699 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:12.128669 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 708) took 2285 ms. Trace:
I20260811 16:05:12.129382 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2024) took 2196 ms. Trace:
I20260811 16:05:12.129693 18047 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:12.130082 17619 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.119293 13902 rpcz_store.cc:276] 0811 16:05:08.636153 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.033037 (+396884us) service_pool.cc:227] Handling call
0811 16:05:12.089169 (+3056132us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:12.090210 (+  1041us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.118518 (+ 28308us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b54002c0bd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.118690 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6913244928}
I20260811 16:05:12.141535 13743 rpcz_store.cc:276] 0811 16:05:09.932659 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:10.015350 (+ 82691us) service_pool.cc:227] Handling call
0811 16:05:10.020199 (+  4849us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:11.123982 (+1103783us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.129038 (+1005056us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002819d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:12.129286 (+   248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2535663488}
I20260811 16:05:12.063314 17958 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.054839 17908 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.146502 13820 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:12.123976 18023 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:12.146324 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1054) took 2811 ms. Trace:
I20260811 16:05:12.101497 17983 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:12.155894 14579 rpcz_store.cc:276] 0811 16:05:09.334920 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.335942 (+  1022us) service_pool.cc:227] Handling call
0811 16:05:12.124483 (+2788541us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:12.145297 (+ 20814us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.146097 (+   800us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54007e04d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.146232 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6412022528}
I20260811 16:05:12.158378 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.089875 18088 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.141458 13822 rpcz_store.cc:276] 0811 16:05:09.843090 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.843264 (+   174us) service_pool.cc:227] Handling call
0811 16:05:09.875391 (+ 32127us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:10.398329 (+522938us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:10.398378 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:10.399191 (+   813us) log.cc:842] Serialized 26 byte log entry
0811 16:05:10.631060 (+231869us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b4800060cd8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:11.110861 (+479801us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:11.248356 (+137495us) log.cc:842] Serialized 14 byte log entry
0811 16:05:11.258176 (+  9820us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.128119 (+869943us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540004e054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:12.128184 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:12.128264 (+    80us) raft_consensus.cc:1671] finished
0811 16:05:12.128279 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:12.128468 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":274487,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":12973,"raft.queue_time_us":127447,"raft.run_cpu_time_us":3736,"raft.run_wall_time_us":431216,"spinlock_wait_cycles":591179264,"thread_start_us":560259,"threads_started":3,"wal-append.queue_time_us":511891}
I20260811 16:05:12.160352 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.081497 17903 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.145183 18029 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:12.174053 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 113333us
I20260811 16:05:12.172530 18038 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:12.172590 17983 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:12.177486 13827 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:12.163103 18089 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.783s	user 0.000s	sys 0.015s
I20260811 16:05:12.148571 18047 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:12.187464 14573 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:05:12.197983 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48501us
I20260811 16:05:12.146180 17755 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.167483 17378 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.208261 18046 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:12.209017 18046 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:12.208724 17983 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.209494 18046 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:12.213380 16875 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.201006 18029 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.220598 18112 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:12.200286 17619 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.173202 17747 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.186545 17958 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.144245 17906 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:12.239060 14544 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.752s (SENT)
I20260811 16:05:12.242390 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:12.239601 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 115935us
I20260811 16:05:12.243477 18109 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:12.244125 18109 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:12.245036 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.245360 18109 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:12.242602 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.826s (SENT)
I20260811 16:05:12.251020 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 880) took 2310 ms. Trace:
I20260811 16:05:12.256670 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:12.261106 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 102855us
I20260811 16:05:12.235499 17619 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.254510 18025 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.256601 17918 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:12.251681 14577 rpcz_store.cc:276] 0811 16:05:09.896170 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.896652 (+   482us) service_pool.cc:227] Handling call
0811 16:05:09.896952 (+   300us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:09.911205 (+ 14253us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:09.911239 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:09.927344 (+ 16105us) log.cc:842] Serialized 26 byte log entry
0811 16:05:11.044076 (+1116732us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800354d00. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:05:11.571394 (+527318us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:11.604358 (+ 32964us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:11.638706 (+ 34348us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:12.184692 (+545986us) raft_consensus.cc:1671] finished
0811 16:05:12.184724 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:12.205696 (+ 20972us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6161,"raft.queue_time_us":18704,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6329,"spinlock_wait_cycles":12562304,"thread_start_us":274675,"threads_started":1,"wal-append.queue_time_us":2009403}
I20260811 16:05:12.266371 18115 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.280102 17908 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.305188 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2408) took 2460 ms. Trace:
I20260811 16:05:12.282361 17903 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.273216 17926 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260811 16:05:12.293179 18088 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.301067 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.286773 18112 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:12.314523 17908 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:12.320286 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77738.8us
I20260811 16:05:12.285975 17918 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.311195 17378 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:12.274413 18029 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:12.288138 18113 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260811 16:05:12.305576 13826 rpcz_store.cc:276] 0811 16:05:09.845149 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:10.064663 (+219514us) service_pool.cc:227] Handling call
0811 16:05:10.105224 (+ 40561us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:10.105669 (+   445us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:10.105710 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:10.106316 (+   606us) log.cc:842] Serialized 26 byte log entry
0811 16:05:11.002784 (+896468us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:11.309820 (+307036us) log.cc:842] Serialized 14 byte log entry
0811 16:05:11.319447 (+  9627us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:11.332407 (+ 12960us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:12.109471 (+777064us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:12.290683 (+181212us) raft_consensus.cc:1671] finished
0811 16:05:12.301311 (+ 10628us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:12.305130 (+  3819us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":754,"prepare.queue_time_us":310209,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":49398,"raft.queue_time_us":70553,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":16113,"spinlock_wait_cycles":38550784,"thread_start_us":1065503,"threads_started":2,"wal-append.queue_time_us":1105196}
I20260811 16:05:12.327495 17619 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.327654 18025 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:12.326035 17908 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.328955 17958 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:12.318830 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.109s (SENT) [suppressed 18 similar messages]
I20260811 16:05:12.315600 17722 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:12.319499 17903 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.335309 17619 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.325728 18088 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.312353 18108 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260811 16:05:12.341641 17903 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.342227 18088 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:12.343693 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61682.4us
I20260811 16:05:12.345047 17903 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.345603 18029 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:12.345985 17722 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.300887 18047 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.349717 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.363941 13743 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:12.364969 17722 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.365832 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:12.366432 18116 consensus_queue.cc:1159] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)" } } last_received_current_leader { term: 6 index: 5 } }
I20260811 16:05:12.350178 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.367921 17958 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:12.368620 13822 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260811 16:05:12.368520 17958 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.366520 13826 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:12.352025 18054 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.063s	user 0.032s	sys 0.060s
I20260811 16:05:12.351508 17619 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.340284 16875 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:12.372066 13820 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:12.310542 18115 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.373483 14577 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEARNER]: Advancing to term 7
I20260811 16:05:12.374682 18082 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:12.370762 17958 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.368763 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.351341 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.375985 13742 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:12.367403 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.377075 13817 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:12.374928 18115 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:12.383279 18111 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.384371 18111 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.385207 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.389199 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:12.390764 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.923s (SENT)
I20260811 16:05:12.391355 13817 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:12.391450 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.392771 13903 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260811 16:05:12.393119 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.394078 13902 raft_consensus.cc:2354] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:12.394680 13903 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:12.394661 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.395496 13905 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:12.395905 13909 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260811 16:05:12.396982 18093 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:12.397584 18093 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.398423 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.399380 18045 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:12.399672 18051 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:12.399847 18045 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:12.400180 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:12.395830 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.397979 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:12.402237 18027 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:12.403298 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:12.404034 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.404675 14579 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:12.404775 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:12.405200 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2097) took 2475 ms. Trace:
I20260811 16:05:12.401065 13907 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:12.405678 13901 rpcz_store.cc:276] 0811 16:05:09.917153 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.959131 (+ 41978us) service_pool.cc:227] Handling call
0811 16:05:09.959463 (+   332us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:09.962703 (+  3240us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:09.962731 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:09.963190 (+   459us) log.cc:842] Serialized 26 byte log entry
0811 16:05:11.448470 (+1485280us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:11.778878 (+330408us) log.cc:842] Serialized 14 byte log entry
0811 16:05:12.392041 (+613163us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b180045e9e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:05:12.392192 (+   151us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:12.392307 (+   115us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:12.392371 (+    64us) raft_consensus.cc:1671] finished
0811 16:05:12.392475 (+   104us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:12.392644 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":600257,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3521,"raft.queue_time_us":140250,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":10075,"spinlock_wait_cycles":10844416,"thread_start_us":2022676,"threads_started":3,"wal-append.queue_time_us":1515031}
I20260811 16:05:12.407984 13904 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.330718 18112 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.409713 18115 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.410240 18115 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.410758 17561 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:12.411865 13827 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:12.412226 17561 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.412623 18040 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:12.413115 18040 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:12.413489 18040 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:12.414637 17561 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.415268 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.415573 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.416287 13740 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
W20260811 16:05:12.416844 18085 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.033s	user 0.000s	sys 0.015s
I20260811 16:05:12.417245 13742 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260811 16:05:12.417640 13742 pending_rounds.cc:76] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 6
I20260811 16:05:12.417932 13742 pending_rounds.cc:97] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260811 16:05:12.401088 18045 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.418236 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2020) took 2612 ms. Trace:
I20260811 16:05:12.361301 17747 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.418732 18045 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:12.424708 13740 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:12.426029 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1070) took 1502 ms (client timeout 1681 ms). Trace:
W20260811 16:05:12.426499 14582 rpcz_store.cc:269] 0811 16:05:10.923302 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:10.923634 (+   332us) service_pool.cc:227] Handling call
0811 16:05:12.425815 (+1502181us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540067eb54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.425949 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2513287040}
I20260811 16:05:12.428414 18088 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.456238 13907 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:12.428771 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.429864 14579 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:12.430608 18050 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:12.431316 13825 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.400413 18051 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.432858 17955 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.433421 17378 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:12.434500 14544 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.044s (SENT)
I20260811 16:05:12.402859 18027 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:12.420274 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.419945 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.437418 18116 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:12.438788 17918 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.442184 17781 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:12.443197 17384 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:12.503681 18116 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:12.444785 17619 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.504302 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.446561 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.505438 13826 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:12.505215 18116 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.506214 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.506341 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.503710 17781 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:12.507030 13826 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:05:12.507459 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.507970 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.447638 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.508563 13826 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:12.509248 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.509439 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.510432 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.510609 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.447335 17684 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:12.511556 13820 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.511817 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.512349 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.512959 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.513918 18093 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.514326 18027 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.423499 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.516103 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.426059 14573 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:12.418244 13742 raft_consensus.cc:2866] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:12.423954 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.386842 18111 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.470140 14577 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260811 16:05:12.471866 13827 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:12.475625 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.477173 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.522305 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.523085 14581 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:12.479883 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.524226 14582 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:12.487500 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.525337 13822 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:12.410972 18112 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.418638 13737 rpcz_store.cc:276] 0811 16:05:09.805777 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.820593 (+ 14816us) service_pool.cc:227] Handling call
0811 16:05:09.842571 (+ 21978us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:09.874593 (+ 32022us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:09.874627 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:09.875075 (+   448us) log.cc:842] Serialized 26 byte log entry
0811 16:05:11.190360 (+1315285us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:11.203041 (+ 12681us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:11.216070 (+ 13029us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:12.416056 (+1199986us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:12.417841 (+  1785us) raft_consensus.cc:1671] finished
0811 16:05:12.417862 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:12.418168 (+   306us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45837,"raft.queue_time_us":33965,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":29737,"spinlock_wait_cycles":93413248,"thread_start_us":1226725,"threads_started":1,"wal-append.queue_time_us":1366145}
I20260811 16:05:12.489480 18051 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.491823 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.491964 13904 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:05:12.492298 17595 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.492704 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.495515 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.496277 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.499490 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.500860 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.501585 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.503290 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.503851 17384 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:12.412770 17908 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:12.507640 17781 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.447911 13818 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:12.547521 13905 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.518610 14574 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:12.508577 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.553553 13744 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260811 16:05:12.521531 13735 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.527805 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.528311 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:12.529908 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.477720 18088 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.479220 17906 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.532152 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.532364 18115 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.566802 13827 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 3.
I20260811 16:05:12.534292 18051 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.539201 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.539549 13901 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:12.572361 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:12.539894 13743 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:12.540417 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.543717 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.570868 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.546727 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.571583 17781 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:12.575373 13904 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:12.575906 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.576035 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.576692 13908 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:12.469170 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.578874 18016 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.579128 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.579828 13817 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:05:12.551970 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 125507us
I20260811 16:05:12.580725 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.559825 13740 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:12.581483 13817 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.582168 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.562335 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.563372 13909 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.583073 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.574483 13737 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:12.576711 13901 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.582831 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.576701 13904 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260811 16:05:12.591972 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.590539 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.562141 13902 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:12.567545 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:12.585194 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150775us
I20260811 16:05:12.571172 13903 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:12.571028 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.594180 13827 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.539695 18047 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:12.582831 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.584452 13742 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:12.583019 13740 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:12.585740 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.570876 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.596566 13825 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.592162 14574 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:12.573450 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.582350 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.593044 14582 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:12.598148 13817 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:12.563971 13739 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:12.602239 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.551587 18111 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:12.619784 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:12.603936 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:12.608487 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 294371us
I20260811 16:05:12.478166 18050 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.603914 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.642319 13818 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.642554 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.571633 18001 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:05:12.642438 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.665769 13825 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:12.667534 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.668331 13901 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:12.669062 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.670176 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.621321 13905 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:12.647917 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.558314 17918 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:12.677024 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.651281 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.661474 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.682408 13736 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.684487 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.599836 17906 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:12.661667 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.586619 17378 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.675402 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.688795 13827 raft_consensus.cc:2396] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:12.689980 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.559314 17595 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.676152 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.691002 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.620157 17955 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.697181 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.698145 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:12.621448 18051 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.692001 14578 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
W20260811 16:05:12.704288 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 100473us
I20260811 16:05:12.648626 18029 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:12.715087 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.584257 17917 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260811 16:05:12.647828 17590 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:12.584725 18088 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.700981 14582 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:12.710300 13902 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:12.585764 17232 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260811 16:05:12.720700 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.690044 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.731387 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.732228 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.757537 14581 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260811 16:05:12.733907 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.735234 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.735383 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.758885 13742 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:12.735980 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.736289 17378 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.720687 18108 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:12.739420 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:12.716660 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.720757 18111 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.769539 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.741909 17892 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:12.770473 14580 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:12.771549 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.749531 13908 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260811 16:05:12.756345 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.773826 13736 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:05:12.752516 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.753389 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.774952 14574 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 3.
I20260811 16:05:12.721547 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:12.716353 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 112519us
I20260811 16:05:12.579442 18016 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.733136 17967 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.729195 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.757409 13905 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.761754 13826 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:12.751668 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:12.778271 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55044.4us
I20260811 16:05:12.779392 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.785102 13909 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:12.785540 13735 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260811 16:05:12.621271 17908 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260811 16:05:12.781275 13821 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:12.785351 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.786391 13906 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:12.694533 17906 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:12.787335 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.715611 18029 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:12.795089 14580 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:12.795680 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.799281 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.804229 14577 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:12.798018 13823 raft_consensus.cc:2362] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8. Re-sending same reply.
I20260811 16:05:12.807067 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.807298 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.809190 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.805920 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.777348 17892 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:12.813019 14574 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:12.810618 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.707124 17918 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.824545 13909 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:12.826174 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.810813 17619 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:12.829195 18014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.012s	sys 0.031s
I20260811 16:05:12.808044 17684 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260811 16:05:12.831014 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.905019 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:12.912786 13737 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:12.833891 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.833802 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.836967 14573 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:12.754887 18051 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.837386 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.838187 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.839876 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.842249 18045 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.843936 18040 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:12.917281 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 110112us
W20260811 16:05:12.923451 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 124548us
I20260811 16:05:12.926484 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.845120 17692 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:12.845054 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.808341 18029 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:12.846999 18016 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:12.916841 18014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.012s	sys 0.032s
I20260811 16:05:12.937052 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.950779 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.951792 13820 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:12.952036 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.952503 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.850698 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.850777 18025 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:12.852082 18088 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.953598 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:12.954536 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.954999 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.955346 13818 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:12.956259 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.777683 17384 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:12.957409 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.808183 18112 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:12.794238 17906 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:12.854684 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 125628us
I20260811 16:05:12.961341 18014 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:12.829509 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.961982 18014 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.963958 13902 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:12.912328 13821 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:12.911181 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:12.965371 13902 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:12.965574 13908 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:12.966877 13821 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:12.914950 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:12.968215 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.968493 13817 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:12.966789 18025 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260811 16:05:12.969906 13817 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:12.970381 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:12.970754 18072 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:05:12.971235 13817 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:12.971370 17232 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:12.971894 17232 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:12.949664 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:12.972272 17232 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:12.972985 18072 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:12.964847 18014 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:12.975564 18111 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:12.977564 18082 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260811 16:05:12.978272 14583 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:12.968267 13821 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:12.909509 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:12.854753 17705 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.737s	user 0.013s	sys 0.000s
I20260811 16:05:12.860528 17619 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:12.826973 17892 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:12.919835 14541 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:12.927444 13740 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:12.778865 17378 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:13.021446 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51153.4us
I20260811 16:05:13.022625 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:13.027525 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:12.785406 17955 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.034042 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.940894 18129 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:12.942509 18046 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.732s	user 0.004s	sys 0.008s
W20260811 16:05:12.943254 18125 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260811 16:05:12.943313 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:12.944002 17590 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:12.945153 18040 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.952678 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:12.916249 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:12.958705 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.060810 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:13.061255 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 145081us
I20260811 16:05:13.061546 13818 raft_consensus.cc:2396] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260811 16:05:12.979779 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 931) took 1604 ms (client timeout 1717 ms). Trace:
I20260811 16:05:12.988768 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:12.808254 18108 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:12.997160 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:12.979259 17952 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:13.071390 17952 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.072206 18108 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:13.071080 13827 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:13.072865 13743 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:13.073700 13827 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260811 16:05:13.073889 17952 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.930924 17917 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:13.074281 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.074743 17917 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.075189 17917 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.077798 17918 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:13.078637 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 129039us
I20260811 16:05:12.935107 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.079734 13826 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260811 16:05:13.080730 13789 leader_election.cc:398] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:13.028539 13821 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260811 16:05:13.081122 17903 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:13.081640 18088 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:13.082723 17903 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
W20260811 16:05:13.033701 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 113949us
I20260811 16:05:13.083972 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.000480 17705 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.035957 13822 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:13.036504 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.037935 13820 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260811 16:05:13.086586 17705 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:12.998564 17619 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:13.087646 17917 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:13.089670 17917 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:12.933737 17692 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:13.044634 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:13.047250 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.092188 14577 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:13.092231 17692 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.038709 17595 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:13.060169 13737 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:13.071108 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.095110 13741 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:13.094817 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.095959 13737 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:13.083105 17903 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:13.097404 13737 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:13.098255 17952 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:13.067587 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:13.068436 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.069022 18111 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:13.070324 18051 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:13.081094 13789 leader_election.cc:401] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260811 16:05:12.802201 17967 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.093565 17692 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:13.062026 14583 rpcz_store.cc:269] 0811 16:05:11.378289 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:11.384012 (+  5723us) service_pool.cc:227] Handling call
0811 16:05:12.979611 (+1595599us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:12.979721 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3395235584}
I20260811 16:05:13.103981 14579 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:13.105624 14581 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:13.108839 13738 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:13.110342 14574 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:13.111116 13743 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:13.080730 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.096004 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.034456 18038 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:12.929908 18045 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.049216 17962 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:13.122768 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.055698 18082 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:13.126509 13736 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260811 16:05:13.126734 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 90339.2us
I20260811 16:05:13.129311 17917 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:13.126768 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46094.3us
I20260811 16:05:13.131039 17967 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.131148 13740 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:13.080885 17378 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.060397 17590 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:13.160633 13737 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260811 16:05:13.162133 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.048815 17561 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260811 16:05:13.164732 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.168156 14583 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:13.170621 13901 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:13.159278 17917 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:13.064090 18046 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:13.180995 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 100451us
I20260811 16:05:13.160527 18111 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:13.196027 18111 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.196640 18111 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.116807 17684 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260811 16:05:13.235299 18045 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:13.166671 18040 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:13.240669 17955 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.248190 17590 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:13.249891 17590 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.182633 18116 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:13.251714 18116 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.252198 18116 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.138623 18082 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.127496 18050 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:13.145201 17918 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:13.139271 17962 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:13.191170 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.192294 13744 raft_consensus.cc:2354] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:13.193531 18046 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.300462 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:13.312341 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 126740us
I20260811 16:05:13.097415 17903 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:13.348927 18047 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.003s
I20260811 16:05:13.185041 17917 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:13.137337 17906 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.367340 13823 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260811 16:05:13.313500 18082 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:13.171096 17595 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260811 16:05:13.100468 18129 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:13.369771 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 409075us
I20260811 16:05:13.358362 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:13.373696 13900 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:13.318089 17918 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:13.371869 13735 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 9. Ops: []
I20260811 16:05:13.356685 17962 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:13.376888 13903 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.001s
I20260811 16:05:13.378196 13903 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:13.375977 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.380158 13905 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:13.366310 17684 consensus_queue.cc:1225] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260811 16:05:13.395385 18134 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260811 16:05:13.399114 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.400694 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:13.402240 18051 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:13.402401 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.402741 18051 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:13.403352 18051 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:13.403362 18050 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:13.406190 18050 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:13.406639 18050 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:13.414325 17384 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.416189 18016 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:13.423627 18016 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:13.424836 18016 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:13.428344 13630 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:13.431020 17903 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:13.431806 13630 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 6, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 6 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:13.434715 18088 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:13.442288 17906 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.427076 18016 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:13.443028 18047 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:05:13.445418 13817 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260811 16:05:13.445854 13817 pending_rounds.cc:76] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:05:13.434552 13630 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 3 to 7, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 7 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:13.446091 13817 pending_rounds.cc:97] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
W20260811 16:05:13.451987 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 366539us
W20260811 16:05:13.452764 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74984.8us
I20260811 16:05:13.377377 17918 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.446518 13817 raft_consensus.cc:2894] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260811 16:05:13.460026 13817 raft_consensus.cc:2866] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:13.452705 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77479us
I20260811 16:05:13.454274 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:13.458253 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55790us
I20260811 16:05:13.366314 17926 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
W20260811 16:05:13.463368 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 151673us
W20260811 16:05:13.472337 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 407555us
I20260811 16:05:13.474318 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.477710 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.487645 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:13.458027 17908 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:13.494911 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:13.466629 18045 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:13.498214 13630 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 8, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 8 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:05:13.503548 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49387.2us
I20260811 16:05:13.506759 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:13.527861 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50220.9us
I20260811 16:05:13.531112 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:13.535480 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 179279us
I20260811 16:05:13.498121 17684 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:13.495005 17908 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:13.536063 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61927.5us
I20260811 16:05:13.501041 17722 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260811 16:05:13.539736 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 551018us
I20260811 16:05:13.501331 17906 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:13.547199 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.547497 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.548283 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.553037 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:13.554283 14575 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.544727 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.556314 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.557040 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.557715 14580 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:13.525801 18088 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:13.559410 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:13.560277 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.561383 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.562458 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:13.560330 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.565021 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:13.565235 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.561997 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.564806 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:13.571447 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:13.545990 18040 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:05:13.541464 17908 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:13.571121 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.581851 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:13.564049 13823 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:13.576098 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:13.556953 13827 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:13.541667 18093 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:13.549598 17722 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.574771 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.585441 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.580343 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.585968 14579 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260811 16:05:13.586232 13735 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:13.586350 14578 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:13.550997 17906 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.588346 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.579355 18012 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:13.564975 18029 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.000s
I20260811 16:05:13.580945 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:13.525408 17967 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260811 16:05:13.600580 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:13.558681 17684 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:13.562422 18109 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:13.564724 18115 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:13.604034 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.605240 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.609845 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.570782 16875 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:13.612979 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.613241 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:13.581314 18112 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:13.612463 13744 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:13.615236 18072 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:13.587258 18040 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:13.552942 17927 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260811 16:05:13.600056 18047 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:13.623603 18148 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:13.594794 17906 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:13.638175 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 311868us
I20260811 16:05:13.599581 18012 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:13.597595 17722 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:13.641659 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70292.7us
I20260811 16:05:13.650976 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2440) took 1082 ms. Trace:
I20260811 16:05:13.610661 18109 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.616426 16875 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:13.662173 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.643590 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.615820 18025 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:13.614485 18115 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:13.623974 18113 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:13.663218 13817 rpcz_store.cc:276] 0811 16:05:12.568296 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:13.059072 (+490776us) service_pool.cc:227] Handling call
0811 16:05:13.444964 (+385892us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:13.473155 (+ 28191us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:13.636133 (+162978us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54002dcdd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:13.650891 (+ 14758us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":820429184}
I20260811 16:05:13.617980 18112 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:13.650547 17952 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.015s	sys 0.022s
I20260811 16:05:13.636144 17888 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:13.639384 18040 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:05:13.572271 18088 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.619788 17926 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:13.668567 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.585282 18144 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260811 16:05:13.661670 18012 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:13.635082 18129 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:13.641311 18047 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.670135 18109 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:13.670312 16875 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:13.606982 18029 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.677136 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.636006 18108 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:13.683197 13824 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:05:13.671917 17952 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.016s	sys 0.023s
I20260811 16:05:13.670457 18115 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:13.651859 18001 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260811 16:05:13.673870 18112 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:13.704110 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 171592us
I20260811 16:05:13.699355 17955 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:13.712862 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.690845 18047 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:05:13.717605 18150 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260811 16:05:13.696019 18108 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.699944 17926 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader election won for term 6
W20260811 16:05:13.735834 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 204819us
I20260811 16:05:13.696233 17952 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:13.703207 18129 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:13.695940 18046 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260811 16:05:13.754621 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.712603 17955 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:13.718791 17781 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260811 16:05:13.761320 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 201052us
I20260811 16:05:13.769562 13824 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:13.761730 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48988us
I20260811 16:05:13.739259 18108 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:13.742266 18093 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:13.758183 17619 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.671s	user 0.004s	sys 0.007s
I20260811 16:05:13.771049 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:13.776335 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 132878us
I20260811 16:05:13.770655 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.753504 17967 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:13.766398 17955 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:13.693383 17684 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:13.723738 17981 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260811 16:05:13.774230 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:13.756878 18129 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:13.769315 17781 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.790705 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.798602 13817 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:13.772028 17926 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:13.808590 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:13.738325 18152 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260811 16:05:13.803402 18146 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260811 16:05:13.818702 13871 leader_election.cc:398] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:13.787876 18144 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:13.811407 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:13.820030 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:05:13.817768 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62613.5us
I20260811 16:05:13.825529 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:13.829304 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:13.810760 18145 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260811 16:05:13.798874 17967 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:13.804330 18129 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:13.808060 17781 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:13.819391 17232 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.847s	user 0.011s	sys 0.003s
I20260811 16:05:13.788219 18001 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260811 16:05:13.855048 18051 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.876232 18001 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:13.876614 18001 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:13.877439 18001 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.878724 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:13.878911 18047 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.790684 17619 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:13.795650 17378 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260811 16:05:13.835794 17561 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260811 16:05:13.901422 18051 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:13.902204 18142 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.505s	user 0.006s	sys 0.000s
W20260811 16:05:13.858855 17892 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.001s
W20260811 16:05:13.860199 17692 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
I20260811 16:05:13.860596 18160 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:13.862607 18045 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:05:13.867643 18149 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:13.868053 18088 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:13.868985 18159 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260811 16:05:13.873216 18154 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:13.874545 17927 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:13.866968 14575 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:13.875183 18167 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:13.880067 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 631) took 1078 ms. Trace:
I20260811 16:05:13.880178 17926 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.821914 17917 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:13.887722 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 302900us
I20260811 16:05:13.858175 18082 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:13.900373 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65139.3us
I20260811 16:05:13.981945 13741 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:13.878065 18016 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:13.833868 18163 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:13.804755 18161 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
W20260811 16:05:13.908411 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79190.3us
I20260811 16:05:13.878762 18001 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:13.971467 13907 rpcz_store.cc:276] 0811 16:05:12.801174 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:12.954857 (+153683us) service_pool.cc:227] Handling call
0811 16:05:12.955191 (+   334us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:12.967595 (+ 12404us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:12.967634 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:12.968117 (+   483us) log.cc:842] Serialized 26 byte log entry
0811 16:05:13.368134 (+400017us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:13.452287 (+ 84153us) log.cc:842] Serialized 14 byte log entry
0811 16:05:13.458501 (+  6214us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:13.458578 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:13.879864 (+421286us) raft_consensus.cc:1671] finished
0811 16:05:13.879882 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:13.880010 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55334,"prepare.queue_time_us":83468,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4275,"raft.queue_time_us":20003,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":11686,"thread_start_us":399545,"threads_started":1,"wal-append.queue_time_us":568287}
W20260811 16:05:13.975244 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 163944us
I20260811 16:05:13.903084 18029 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.907512 17595 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:13.973291 17927 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:13.907344 18160 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:13.981452 17692 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:14.013170 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:14.013900 13824 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:14.013842 17692 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.013082 18160 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:14.015424 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:14.016234 13823 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:14.017058 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:14.018496 17722 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.019968 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:14.020614 13822 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:13.895900 17232 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.021940 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:14.022878 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:14.023408 13743 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260811 16:05:14.023633 13817 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:05:14.024868 13626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 324) took 22246 ms (client timeout 15000 ms). Trace:
I20260811 16:05:14.023430 13630 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 6 to 8, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 8 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:14.027659 13630 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:13.907536 17892 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.030853 13818 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:13.985505 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:13.852484 18165 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.161s
I20260811 16:05:13.968757 18149 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:13.989393 17917 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.903585 17908 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.003228 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.002735 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:14.043170 13630 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 8, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 8 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:13.927970 16875 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:13.973788 18167 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:14.009130 18116 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.004s
I20260811 16:05:14.012964 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:13.902822 18093 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:14.025301 13626 rpcz_store.cc:269] 0811 16:04:51.776693 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.883127 (+106434us) service_pool.cc:227] Handling call
0811 16:05:14.022983 (+22139856us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:05:09.617584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:05:09.920809 (+303225us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:05:09.932205 (+ 11396us) write_op.cc:435] Acquired schema lock
0811 16:05:09.932242 (+    37us) tablet.cc:660] Decoding operations
0811 16:05:10.593145 (+660903us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:05:10.593260 (+   115us) write_op.cc:641] Partition lock acquired for write op
0811 16:05:10.593312 (+    52us) tablet.cc:683] Acquiring locks for 31 operations
0811 16:05:10.656361 (+ 63049us) tablet.cc:699] Row locks acquired
0811 16:05:10.656433 (+    72us) write_op.cc:260] PREPARE: finished
0811 16:05:10.656662 (+   229us) write_op.cc:270] Start()
0811 16:05:10.656891 (+   229us) write_op.cc:276] Timestamp: P: 1786464310656565 usec, L: 0
0811 16:05:10.656948 (+    57us) op_driver.cc:331] REPLICATION: starting
0811 16:05:10.658130 (+  1182us) log.cc:842] Serialized 12277 byte log entry
0811 16:05:10.692739 (+ 34609us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18003fa120. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:10.813187 (+120448us) op_driver.cc:444] REPLICATION: finished
0811 16:05:11.310996 (+497809us) write_op.cc:301] APPLY: starting
0811 16:05:11.375678 (+ 64682us) tablet.cc:1365] starting BulkCheckPresence
0811 16:05:11.448844 (+ 73166us) tablet.cc:1368] finished BulkCheckPresence
0811 16:05:11.448908 (+    64us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:05:11.893666 (+444758us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:05:11.894387 (+   721us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=62
0811 16:05:11.894456 (+    69us) write_op.cc:312] APPLY: finished
0811 16:05:11.972709 (+ 78253us) log.cc:842] Serialized 206 byte log entry
0811 16:05:12.276857 (+304148us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:12.353492 (+ 76635us) write_op.cc:454] Released schema lock
0811 16:05:12.468583 (+115091us) write_op.cc:341] FINISH: Updating metrics
0811 16:05:12.527644 (+ 59061us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:12.527675 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":460,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":469574,"apply.run_cpu_time_us":88071,"apply.run_wall_time_us":1227203,"num_ops":31,"prepare.queue_time_us":401339,"prepare.run_cpu_time_us":17881,"prepare.run_wall_time_us":1089683,"raft.queue_time_us":2395,"raft.run_cpu_time_us":39385,"raft.run_wall_time_us":396053,"replication_time_us":155925,"spinlock_wait_cycles":2943744,"thread_start_us":772559,"threads_started":5,"wal-append.queue_time_us":349475,"wal-append.run_cpu_time_us":7373,"wal-append.run_wall_time_us":2070764}]]}
I20260811 16:05:14.022792 17232 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.020753 17722 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:13.847389 17952 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.067313 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:14.067749 18178 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:14.068313 18178 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:14.068711 18178 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
W20260811 16:05:14.069681 18139 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.623s	user 0.000s	sys 0.003s
I20260811 16:05:14.069945 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:14.046734 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61336.9us
I20260811 16:05:14.058492 13740 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:05:14.059170 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 56496.3us
I20260811 16:05:14.073743 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.040841 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:14.011547 18163 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:14.029484 18027 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:14.045040 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:14.091998 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47057.1us
I20260811 16:05:14.066684 18029 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:05:14.074484 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 249733us
I20260811 16:05:14.075450 13630 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 6, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:14.077356 13821 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:14.079123 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:13.998514 17781 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:14.108927 17590 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.858s	user 0.015s	sys 0.000s
W20260811 16:05:14.091616 17903 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.007s
I20260811 16:05:14.030330 17967 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.084965 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:14.061877 18154 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:14.089615 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.006211 18016 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.058320 18167 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:14.039602 17595 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:14.074309 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:14.094569 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.097995 18181 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:14.104112 18082 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.104542 17908 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:14.102818 18109 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.106429 17692 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.129731 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:14.157492 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:14.133313 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.060366 18148 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.032s
I20260811 16:05:14.156891 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:14.093353 18027 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:14.159967 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.091178 18045 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:14.180039 18045 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:14.166093 14574 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 10
I20260811 16:05:14.181044 13630 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:14.090803 18152 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:14.091068 17722 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:14.166123 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:14.168020 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:14.157480 13824 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:14.172698 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.199514 14575 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:14.136406 17888 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:14.180537 18045 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:14.208297 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:14.176100 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:14.177603 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:14.210695 13821 raft_consensus.cc:2396] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:14.185130 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:14.211623 13740 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:14.108999 17781 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:14.214879 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 121396us
I20260811 16:05:14.194609 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:14.066459 18116 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.203356 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:14.131047 17952 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:14.174546 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:14.196632 13706 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:14.279249 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.158689 18047 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:14.156814 17619 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.248805 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:14.208765 18040 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.003s
I20260811 16:05:14.246742 18169 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:14.147327 17917 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260811 16:05:14.249635 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:14.257517 13743 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:14.219684 14577 raft_consensus.cc:2354] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:14.189646 18027 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:14.156440 18154 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:14.359967 18154 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.295284 17232 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:14.363538 17595 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.277539 17781 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260811 16:05:14.365841 17962 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.919s	user 0.006s	sys 0.007s
I20260811 16:05:14.366281 17962 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:14.368956 17918 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.887s	user 0.003s	sys 0.008s
I20260811 16:05:14.196184 18152 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:14.369436 17918 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.370028 18152 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:14.305649 18040 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.374123 14574 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:14.374284 18040 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:14.377187 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.377961 13903 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:14.378479 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.379190 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:14.379444 18185 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260811 16:05:14.379746 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.204067 18148 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260811 16:05:14.282612 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:14.381057 14583 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:05:14.381235 18111 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.184s	user 0.015s	sys 0.000s
I20260811 16:05:14.202562 17903 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:14.381876 18111 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.178164 18173 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:14.284840 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 88290.6us
I20260811 16:05:14.274669 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:14.384423 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109922us
I20260811 16:05:14.385172 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.385316 13818 raft_consensus.cc:2362] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8. Re-sending same reply.
I20260811 16:05:14.386209 13827 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:05:14.387715 13824 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260811 16:05:14.381071 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.282506 17952 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:14.389873 13909 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260811 16:05:14.202597 17888 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:14.411464 17888 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:14.292342 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:14.246460 13630 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:14.417218 13630 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:14.419791 18160 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.420470 17918 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:14.303306 18012 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.003s
I20260811 16:05:14.418828 18181 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:14.342198 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:14.343468 18180 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260811 16:05:14.292414 17684 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:14.343274 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:14.344205 18186 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260811 16:05:14.346722 18157 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:14.260407 17908 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:14.350421 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:14.484899 13907 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:14.478305 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:14.283774 17384 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.007s
I20260811 16:05:14.263291 16875 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:14.499307 13739 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:14.093678 17927 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:14.353669 18108 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.001s
I20260811 16:05:14.358230 18109 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:14.366714 18112 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.000s
I20260811 16:05:14.377931 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.276772 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:14.203397 17722 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:14.518754 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:14.519439 17722 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:14.520429 18148 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:14.520982 18148 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.286130 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.524230 14577 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:14.286746 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:14.526716 13740 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:14.282392 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 79076.9us
I20260811 16:05:14.379539 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:14.528901 13743 raft_consensus.cc:2362] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12. Re-sending same reply.
I20260811 16:05:14.530378 13743 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:14.408794 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.409513 17926 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:14.531661 17926 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:14.532166 17926 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:14.410827 18116 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.221221 18171 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:14.424638 13825 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:14.160298 18149 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.418865 13630 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 3 to 5, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:05:14.536077 13630 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 7, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 7 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:05:14.474900 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 260050us
W20260811 16:05:14.410989 17906 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
I20260811 16:05:14.469936 13900 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:14.477567 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.478555 13736 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:14.501276 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.486774 18025 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:14.425482 17952 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:14.474160 18012 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.510788 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:14.511708 13739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1816) took 1910 ms (client timeout 2065 ms). Trace:
I20260811 16:05:14.475116 17684 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:14.514973 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:14.546561 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 275331us
I20260811 16:05:14.547024 13907 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:14.478319 18157 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:14.546562 13739 rpcz_store.cc:269] 0811 16:05:12.601681 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:12.601969 (+   288us) service_pool.cc:227] Handling call
0811 16:05:14.511526 (+1909557us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54002774d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:14.511643 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4361479424}
I20260811 16:05:14.484210 18016 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:14.545421 13901 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:14.502730 17981 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:14.549645 14541 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:14.553604 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:14.500483 17892 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:14.560608 13902 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:14.559983 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:14.569408 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.571511 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:14.572361 14582 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:14.572145 13630 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 5, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:14.549589 18046 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:05:14.537843 18176 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:14.575428 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.576254 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:14.590409 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:14.545310 18151 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
W20260811 16:05:14.574204 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55574.3us
I20260811 16:05:14.580262 13630 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 6, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 6 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:14.582768 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:14.561939 18001 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260811 16:05:14.584437 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:14.585418 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2442) took 1036 ms. Trace:
I20260811 16:05:14.591256 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:14.559571 18157 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:14.639816 13908 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: [6.5-6.6]
I20260811 16:05:14.589004 13904 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:14.470992 18169 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:14.551672 17684 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:14.578408 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37762
I20260811 16:05:14.572814 18016 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:14.567847 18025 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:14.647282 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 772) took 1083 ms. Trace:
I20260811 16:05:14.545987 18112 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:14.677201 14581 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.002s	sys 0.030s
I20260811 16:05:14.538991 18108 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:14.591053 18046 raft_consensus.cc:1054] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Illegal state: Leader has not yet committed an operation in its own term
W20260811 16:05:14.662700 18093 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.015s	sys 0.012s
I20260811 16:05:14.624289 17981 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:14.688109 13707 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.547s (SENT)
I20260811 16:05:14.710964 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:14.657666 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:14.671357 18115 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.003s
W20260811 16:05:14.677899 14581 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.002s	sys 0.030s
I20260811 16:05:14.678459 13630 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:14.687248 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:14.585144 18161 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:14.588022 17892 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:14.680704 13740 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Received request to transfer leadership
I20260811 16:05:14.550117 17906 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.677074 13736 rpcz_store.cc:276] 0811 16:05:13.563818 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:13.579708 (+ 15890us) service_pool.cc:227] Handling call
0811 16:05:13.606169 (+ 26461us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:14.559192 (+953023us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.646888 (+ 87696us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:14.647182 (+   294us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1999892864}
I20260811 16:05:14.593780 18195 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:14.673035 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67130us
I20260811 16:05:14.861301 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:14.706808 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54396.1us
I20260811 16:05:14.584776 18148 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:14.694343 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:14.869760 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 175559us
I20260811 16:05:14.648952 13820 rpcz_store.cc:276] 0811 16:05:13.549211 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:13.555810 (+  6599us) service_pool.cc:227] Handling call
0811 16:05:13.579918 (+ 24108us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:13.775423 (+195505us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:13.775454 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:13.795408 (+ 19954us) log.cc:842] Serialized 26 byte log entry
0811 16:05:13.908236 (+112828us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:14.160521 (+252285us) log.cc:842] Serialized 14 byte log entry
0811 16:05:14.167346 (+  6825us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.167452 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:14.585153 (+417701us) raft_consensus.cc:1671] finished
0811 16:05:14.585182 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:14.585342 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6561,"prepare.queue_time_us":342975,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":270865,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":42334,"spinlock_wait_cycles":8960,"thread_start_us":407075,"threads_started":3,"wal-append.queue_time_us":286741}
I20260811 16:05:14.819742 18001 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:14.600539 18151 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:14.754762 18115 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.679982 13900 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260811 16:05:14.716763 13824 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:14.721853 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:14.682927 18167 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.505s	user 0.016s	sys 0.003s
I20260811 16:05:14.677541 16875 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:14.651396 18173 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:14.708673 18093 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.016s	sys 0.013s
W20260811 16:05:14.794515 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 106435us
I20260811 16:05:14.678829 18111 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:14.678105 18174 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260811 16:05:14.715219 18160 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:14.815778 13630 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 1 to 4, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 4 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:05:14.791100 18180 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260811 16:05:14.599973 18176 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.764981 13735 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:14.837009 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 409723us
I20260811 16:05:14.829591 17384 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:14.788723 17962 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:14.806406 17892 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:14.594143 18082 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.115s
I20260811 16:05:14.683122 18025 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.679188 17232 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:05:14.908815 18016 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:14.885258 18045 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.001s
I20260811 16:05:14.811931 17918 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260811 16:05:14.791998 18179 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:14.969301 13905 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:14.976650 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.015s	sys 0.008s
W20260811 16:05:15.125876 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.015s	sys 0.009s
I20260811 16:05:15.126055 13871 leader_election.cc:398] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
W20260811 16:05:15.126224 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 733598us
I20260811 16:05:15.126461 13871 leader_election.cc:401] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260811 16:05:15.126938 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:14.839094 17903 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:14.884524 18171 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:15.016080 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:05:15.046334 17955 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.242s	user 0.018s	sys 0.006s
W20260811 16:05:15.051035 18050 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.631s	user 0.013s	sys 0.003s
W20260811 16:05:15.121023 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 247402us
I20260811 16:05:14.907266 18001 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:15.122376 18177 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.013s	sys 0.005s
I20260811 16:05:14.883774 18195 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:15.187402 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 158191us
I20260811 16:05:15.056005 18012 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:15.190799 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63950us
W20260811 16:05:15.173820 18152 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.803s	user 0.001s	sys 0.011s
I20260811 16:05:15.208750 18108 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:15.046561 18173 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.140746 18029 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:15.142314 18202 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.454s	user 0.002s	sys 0.000s
I20260811 16:05:15.036324 18167 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:14.910503 17981 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.142540 18171 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:15.135737 17232 raft_consensus.cc:1054] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Service unavailable: leader transfer in progress
I20260811 16:05:15.288287 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:15.293584 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:15.299623 18197 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:15.300597 18178 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.231s	user 0.024s	sys 0.005s
I20260811 16:05:15.185577 18016 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:15.035333 16875 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:15.194231 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 188024us
W20260811 16:05:15.208750 18177 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.014s	sys 0.010s
W20260811 16:05:15.217483 18189 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.540s	user 0.001s	sys 0.000s
I20260811 16:05:15.341638 18012 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:15.341846 18108 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:15.448639 18216 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:15.463680 18243 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:15.464067 18220 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260811 16:05:15.463999 18216 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:15.464242 18243 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.465832 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1823) took 1340 ms. Trace:
I20260811 16:05:15.466351 18216 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:15.439683 18197 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.466313 13737 rpcz_store.cc:276] 0811 16:05:14.125734 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.125918 (+   184us) service_pool.cc:227] Handling call
0811 16:05:14.165877 (+ 39959us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:14.503987 (+338110us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:14.504018 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:14.504593 (+   575us) log.cc:842] Serialized 26 byte log entry
0811 16:05:14.842587 (+337994us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:14.842640 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.842738 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:15.465532 (+622794us) raft_consensus.cc:1671] finished
0811 16:05:15.465563 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:15.465756 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":42976,"raft.queue_time_us":81391,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":12920,"thread_start_us":617720,"threads_started":2,"wal-append.queue_time_us":635385}
I20260811 16:05:15.468189 18243 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:15.468771 18243 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:15.469079 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:15.469424 18197 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:15.469220 18243 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:15.470146 13737 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:15.207690 18161 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:15.215528 18169 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:15.171852 17903 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:15.142867 18045 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.416832 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:15.430671 13823 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:15.435612 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 138726us
I20260811 16:05:15.328815 18182 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:15.438874 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:15.181633 17955 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.435356 14580 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:15.448028 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:15.368417 18200 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.663s	user 0.002s	sys 0.000s
I20260811 16:05:15.434152 18112 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:15.338666 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:15.326231 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:15.447363 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:15.451959 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:15.455577 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:15.453329 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:15.181018 18179 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.143771 18151 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.417742 18171 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:15.826097 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 241831us
W20260811 16:05:15.615741 14542 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.609s (SENT)
W20260811 16:05:15.974179 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 522273us
I20260811 16:05:15.324404 18152 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.332548 18050 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:15.453672 17888 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.042s	user 0.014s	sys 0.006s
I20260811 16:05:15.977202 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2461) took 1908 ms. Trace:
W20260811 16:05:15.455266 18203 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260811 16:05:15.978446 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:15.973388 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:15.975383 14582 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:15.371104 18029 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.987361 13818 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260811 16:05:15.976048 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.003s	sys 0.027s
I20260811 16:05:16.025104 14578 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:16.030411 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.003s	sys 0.027s
W20260811 16:05:15.626331 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 555419us
I20260811 16:05:15.999939 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:15.989683 18082 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:15.972483 18243 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:15.454986 18227 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:15.964933 18172 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.586s
I20260811 16:05:16.058143 18227 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.058707 18172 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.059378 18172 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.060385 18227 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.060949 18227 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:16.061280 18227 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:16.006740 18112 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:16.063470 18112 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:16.063987 18112 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:16.064462 18025 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:15.980563 18242 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260811 16:05:15.459658 18251 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.542s
I20260811 16:05:15.553179 18115 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:15.865653 18236 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:16.067092 18251 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:16.067432 18236 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:16.067600 18251 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:16.068454 18236 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.068717 18251 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.069876 18236 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:15.544021 17906 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:16.056672 17926 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.524s	user 0.008s	sys 0.005s
I20260811 16:05:16.076061 18173 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.075793 17926 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.077955 17926 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.062773 14583 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:16.014055 18151 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:16.062119 18227 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.080116 18227 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:16.084398 17955 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.087280 18045 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:16.088948 18179 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:16.089290 18144 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 2.260s	user 0.007s	sys 0.006s
I20260811 16:05:16.089828 18144 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:16.089968 18195 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.091723 18050 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:16.094019 13790 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.018s	sys 0.032s
W20260811 16:05:16.094354 13790 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.018s	sys 0.032s
W20260811 16:05:15.458487 18214 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.525s	user 0.000s	sys 0.001s
I20260811 16:05:15.453351 18217 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:16.114353 13823 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:15.597654 16875 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.010987 13817 rpcz_store.cc:276] 0811 16:05:14.069199 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.071870 (+  2671us) service_pool.cc:227] Handling call
0811 16:05:14.086867 (+ 14997us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:14.097473 (+ 10606us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:14.097523 (+    50us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:14.098214 (+   691us) log.cc:842] Serialized 52 byte log entry
0811 16:05:14.186298 (+ 88084us) raft_consensus.cc:1631] Marking committed up to 2
0811 16:05:14.186359 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.186464 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:15.472245 (+1285781us) raft_consensus.cc:1671] finished
0811 16:05:15.544505 (+ 72260us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:15.977110 (+432605us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2418,"raft.queue_time_us":14682,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":87340,"threads_started":1,"wal-append.queue_time_us":452099}
W20260811 16:05:15.456815 18215 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260811 16:05:15.459708 18222 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260811 16:05:15.457257 18204 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.645s	user 0.001s	sys 0.000s
W20260811 16:05:15.457895 18226 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.410s	user 0.000s	sys 0.000s
W20260811 16:05:16.130208 18027 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.777s	user 0.004s	sys 0.008s
I20260811 16:05:16.130769 18027 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.131610 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2059) took 2139 ms. Trace:
I20260811 16:05:16.132292 13904 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:16.022667 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:16.024598 13742 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:15.501459 18016 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:15.984375 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:16.038919 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 712736us
I20260811 16:05:16.140959 13739 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:16.040457 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.1712e+06us
W20260811 16:05:16.020360 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47078.9us
I20260811 16:05:16.042071 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:16.142437 13820 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:16.050236 18167 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.050487 18247 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:16.051549 17722 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.531s	user 0.013s	sys 0.000s
I20260811 16:05:15.552726 17892 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.052157 18051 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.053508 17903 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.054709 13737 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:15.471308 18161 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.175554 18027 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.056212 18029 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.056628 18082 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.179687 18195 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:05:16.180186 18082 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:16.057096 18001 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:16.057276 13741 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260811 16:05:16.057515 18243 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:16.181509 18243 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:16.181772 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 905) took 2044 ms. Trace:
I20260811 16:05:16.181941 18243 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:16.174760 18051 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.186067 18051 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:16.109383 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 78220.7us
I20260811 16:05:16.188278 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:16.189414 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:16.190472 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:16.121882 13736 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260811 16:05:16.125733 18144 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:16.191535 18217 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:16.191918 18217 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:16.192340 18217 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:16.191990 18144 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:16.128490 13907 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.007s	sys 0.015s
W20260811 16:05:16.195320 13907 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.008s	sys 0.015s
W20260811 16:05:16.128928 18224 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260811 16:05:16.031375 13825 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:16.095186 18165 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:16.197022 18027 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:16.197464 18027 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:16.197835 18027 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:16.194866 18144 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.198143 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.196430 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2131) took 1778 ms. Trace:
I20260811 16:05:16.199618 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:16.200542 13825 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:15.455616 18212 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:16.062690 18172 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.110229 18251 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:16.132028 13744 rpcz_store.cc:276] 0811 16:05:13.992108 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:13.992313 (+   205us) service_pool.cc:227] Handling call
0811 16:05:14.029886 (+ 37573us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:14.030257 (+   371us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:14.030290 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:14.030748 (+   458us) log.cc:842] Serialized 26 byte log entry
0811 16:05:14.521050 (+490302us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:14.521088 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.522356 (+  1268us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:16.131379 (+1609023us) raft_consensus.cc:1671] finished
0811 16:05:16.131402 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:16.131550 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":709,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":21934,"thread_start_us":455424,"threads_started":1,"wal-append.queue_time_us":639775}
W20260811 16:05:16.215502 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 599782us
I20260811 16:05:15.456082 18012 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:15.450891 18178 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:15.458966 18108 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.161929 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:16.172451 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2458) took 2170 ms. Trace:
I20260811 16:05:16.173128 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:16.174486 13827 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260811 16:05:16.196292 18177 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:16.195878 18252 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:16.199908 13907 rpcz_store.cc:276] 0811 16:05:14.417664 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.642128 (+224464us) service_pool.cc:227] Handling call
0811 16:05:14.711598 (+ 69470us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:05:14.756147 (+ 44549us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:14.756291 (+   144us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:05:14.790553 (+ 34262us) log.cc:842] Serialized 78 byte log entry
0811 16:05:15.125089 (+334536us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:15.186164 (+ 61075us) log.cc:842] Serialized 14 byte log entry
0811 16:05:16.195850 (+1009686us) log.cc:842] Serialized 14 byte log entry
0811 16:05:16.196054 (+   204us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:16.196146 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:16.196193 (+    47us) raft_consensus.cc:1671] finished
0811 16:05:16.196205 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:16.196349 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":136206,"prepare.queue_time_us":60064,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":4700,"raft.queue_time_us":587486,"raft.run_cpu_time_us":13025,"raft.run_wall_time_us":80750,"thread_start_us":1294485,"threads_started":2,"wal-append.queue_time_us":652892}
I20260811 16:05:16.208348 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.242774 13741 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:05:16.213523 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:16.213891 18016 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.182174 14579 rpcz_store.cc:276] 0811 16:05:14.137107 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.137327 (+   220us) service_pool.cc:227] Handling call
0811 16:05:14.205098 (+ 67771us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:14.205535 (+   437us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:14.205570 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:14.227265 (+ 21695us) log.cc:842] Serialized 26 byte log entry
0811 16:05:14.582182 (+354917us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:14.582237 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.582329 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:16.181546 (+1599217us) raft_consensus.cc:1671] finished
0811 16:05:16.181567 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:16.181709 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":81962,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":42878,"thread_start_us":278222,"threads_started":1,"wal-append.queue_time_us":705928}
W20260811 16:05:16.218060 14542 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.624s (SENT)
I20260811 16:05:16.249271 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:16.249949 14542 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.625s (SENT)
I20260811 16:05:16.250412 13908 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:16.250574 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:16.020534 17888 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:16.163689 17952 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.596s	user 0.006s	sys 0.007s
I20260811 16:05:16.254539 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:16.224298 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53075.9us
I20260811 16:05:16.159649 18050 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:16.230749 13822 rpcz_store.cc:276] 0811 16:05:14.002488 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.021266 (+ 18778us) service_pool.cc:227] Handling call
0811 16:05:14.021592 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:14.201655 (+180063us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:14.201717 (+    62us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:14.202205 (+   488us) log.cc:842] Serialized 26 byte log entry
0811 16:05:14.355655 (+153450us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:14.355743 (+    88us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.499724 (+143981us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002dcdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:14.499796 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:16.166293 (+1666497us) raft_consensus.cc:1671] finished
0811 16:05:16.166315 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:16.172380 (+  6065us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":800,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":40901,"spinlock_wait_cycles":382014208,"thread_start_us":66470,"threads_started":1,"wal-append.queue_time_us":315505}
I20260811 16:05:16.237846 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.241372 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:16.215065 18243 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.162490 17722 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.258831 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.268798 13827 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:16.220784 18152 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.259394 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.259747 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.270217 13739 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:16.259879 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.258852 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.260680 14580 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260811 16:05:16.237375 17684 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.561s	user 0.005s	sys 0.009s
W20260811 16:05:16.271056 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 109214us
I20260811 16:05:16.273437 14580 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260811 16:05:16.284086 13901 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:16.271355 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.284801 13900 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:16.287093 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.297134 13741 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:16.297818 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 298276us
I20260811 16:05:16.288589 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.238060 18172 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.303542 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.303648 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.304234 13741 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:16.300726 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.304464 14579 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:16.303054 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.304275 13736 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:16.305462 13739 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:16.306787 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.307565 13741 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:16.241822 18051 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.313088 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.304457 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 743) took 2142 ms. Trace:
I20260811 16:05:16.248090 18250 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.318632 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.318534 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.319123 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:16.331458 13825 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 8
I20260811 16:05:16.332064 13822 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:16.316990 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:16.326961 13818 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:16.315888 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.333366 14580 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:16.333658 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:16.328213 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.329758 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:16.268817 18001 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:16.342401 18108 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.224943 18212 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.321568 17962 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:16.298218 17903 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.344142 17903 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.344980 18212 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.345589 18255 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260811 16:05:16.346402 17903 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.347548 18012 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.348857 18243 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.348515 18250 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.298583 17926 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:16.330034 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.336927 18016 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:16.337915 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.297686 16875 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:16.297518 17684 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.324939 18172 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.344393 18242 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:16.336231 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.350955 13827 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260811 16:05:16.335989 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.323025 13826 rpcz_store.cc:276] 0811 16:05:14.162500 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.387243 (+224743us) service_pool.cc:227] Handling call
0811 16:05:14.387598 (+   355us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:14.387989 (+   391us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:14.388019 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:14.388523 (+   504us) log.cc:842] Serialized 26 byte log entry
0811 16:05:14.672169 (+283646us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:14.672210 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:14.673609 (+  1399us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:16.304248 (+1630639us) raft_consensus.cc:1671] finished
0811 16:05:16.304272 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:16.304397 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12318,"raft.queue_time_us":3345,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":283275,"threads_started":1,"wal-append.queue_time_us":517272}
I20260811 16:05:16.335980 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.354833 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.356282 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:16.310290 18113 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 2.638s	user 0.013s	sys 0.003s
I20260811 16:05:16.162699 18247 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.363224 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:16.321549 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0474554370157421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260811 16:05:16.367085 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0375554370693862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260811 16:05:16.362005 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:16.378763 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.379690 13907 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:16.319872 18082 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.332315 18154 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.329568 18050 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:16.397960 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.398880 13909 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:16.385272 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.401858 13820 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:16.388442 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:16.408618 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.409396 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.269899 17952 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.360762 16875 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:16.349761 17926 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.419413 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.413591 17561 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:16.413961 18212 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.005s
I20260811 16:05:16.414263 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1121) took 1893 ms. Trace:
I20260811 16:05:16.447768 14580 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:16.453852 14574 rpcz_store.cc:276] 0811 16:05:14.520692 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.520855 (+   163us) service_pool.cc:227] Handling call
0811 16:05:14.521171 (+   316us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.024103 (+1502932us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:16.024142 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:16.024180 (+    38us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:16.024220 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:16.414025 (+389805us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540056ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:16.414077 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:16.414201 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3456010624}
I20260811 16:05:16.415256 18154 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.416007 18250 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.416998 18172 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:16.465438 14575 raft_consensus.cc:2354] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:16.418932 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.410055 13900 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:16.418860 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.344049 17962 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.381246 18113 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:16.400852 18243 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:16.452162 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.476590 13827 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:16.476739 13787 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.717s (SENT)
I20260811 16:05:16.477288 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:16.452986 14542 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.557s (SENT)
I20260811 16:05:16.351794 18051 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.463593 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.464366 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.465257 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.465354 13908 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:16.419605 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.447835 17561 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:16.361136 18112 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.466257 13739 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:16.494632 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:16.418447 18255 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:16.474795 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:16.425500 16875 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:16.478358 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 187062us
W20260811 16:05:16.478888 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 209732us
I20260811 16:05:16.637640 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.479599 14579 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:16.479948 14542 leader_election.cc:334] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.644s (SENT)
I20260811 16:05:16.480047 14574 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:16.480988 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:16.639923 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:16.640574 13744 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:16.636520 13707 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.918s (SENT)
I20260811 16:05:16.482986 17888 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.484632 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.644623 14582 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:16.645038 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.490455 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.608270 13741 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:16.609436 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.641517 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:16.642400 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 246625us
I20260811 16:05:16.452225 18242 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:16.648639 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 169586us
I20260811 16:05:16.476224 18243 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:16.656157 14542 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.879s (SENT)
I20260811 16:05:16.667194 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:16.612855 18157 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.963s	user 0.016s	sys 0.000s
I20260811 16:05:16.686169 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.489271 18016 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:16.406998 18082 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.660872 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:16.665198 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59336.8us
W20260811 16:05:16.626869 18129 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 2.728s	user 0.014s	sys 0.003s
I20260811 16:05:16.419080 18050 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.690985 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:16.722963 13744 raft_consensus.cc:595] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:16.690419 14580 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:16.723662 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.724246 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.725015 14580 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:16.705899 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49792.5us
W20260811 16:05:16.725692 14542 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.892s (SENT)
I20260811 16:05:16.726003 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.468667 18252 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.189s
W20260811 16:05:16.726646 14542 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.961s (SENT)
I20260811 16:05:16.731691 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:16.722878 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.734139 14582 raft_consensus.cc:2396] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260811 16:05:16.654635 17906 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.743907 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.745832 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.738247 16875 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.738919 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.754390 13901 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:16.754630 13826 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:16.668450 18172 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:16.724822 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:16.743907 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.766304 13900 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:16.769229 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.770152 14580 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:16.679809 18243 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:16.781013 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.719695 18178 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.727901 18016 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:16.789366 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64623.7us
W20260811 16:05:16.789989 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80349.8us
I20260811 16:05:16.756982 13907 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:16.795919 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:16.751350 18151 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.003s
I20260811 16:05:16.816035 14582 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:16.821066 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1120) took 2705 ms. Trace:
I20260811 16:05:16.741753 18252 consensus_queue.cc:1225] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260811 16:05:16.741966 17722 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:16.829026 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 192553us
I20260811 16:05:16.802162 13909 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:16.829496 14580 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:16.802811 13901 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:16.793628 14574 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:16.830701 13707 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.163s (SENT)
I20260811 16:05:16.674305 18242 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.804190 13827 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:16.840644 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.841373 13827 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:16.821542 14578 rpcz_store.cc:276] 0811 16:05:14.116093 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.116294 (+   201us) service_pool.cc:227] Handling call
0811 16:05:14.156909 (+ 40615us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.030132 (+1873223us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:16.820820 (+790688us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540052b7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:16.821002 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4296083200}
I20260811 16:05:16.717813 18256 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:16.800164 13900 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:05:16.831596 13707 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.670s (SENT)
I20260811 16:05:16.702296 18161 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260811 16:05:16.844332 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:16.867990 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.868736 13909 raft_consensus.cc:2362] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:05:16.869669 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.870275 13909 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:16.871111 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.872547 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:16.873065 14582 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:16.876020 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:16.876844 18227 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.000s
I20260811 16:05:16.877795 18154 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:16.879468 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:16.879791 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:16.880074 13901 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:16.881053 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:16.714229 18157 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.813670 18108 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:16.871121 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.914428 13909 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:05:16.888496 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56918.7us
W20260811 16:05:16.915781 13707 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.957s (SENT)
I20260811 16:05:16.882625 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:16.732759 18129 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.881917 14574 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:16.904129 14579 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:16.906181 13743 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:16.822997 18172 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.928393 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.929314 13907 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:16.831382 18257 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:16.765499 17906 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:16.950474 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:16.952262 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:16.953035 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:16.879479 18280 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:16.958257 14573 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:16.965350 14579 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260811 16:05:16.967954 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 147901us
I20260811 16:05:16.951300 14574 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:16.990116 14580 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:16.990816 14577 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:16.880728 17952 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.010284 13903 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:16.933943 17888 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:16.926211 18144 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260811 16:05:17.017527 13825 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.005s
I20260811 16:05:16.927402 18154 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:17.036510 13825 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:17.036897 13900 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:16.932653 18169 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:17.013449 13827 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:17.035835 17888 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:16.760905 17561 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.039386 18082 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:16.952473 17684 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.039729 18129 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.041196 18242 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:17.042124 13901 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:17.085134 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.085937 13901 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:17.045509 18221 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.873s	user 0.004s	sys 0.019s
I20260811 16:05:17.047556 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.099519 13909 raft_consensus.cc:2362] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10. Re-sending same reply.
I20260811 16:05:17.048251 18112 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:17.052119 13908 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.000s
I20260811 16:05:17.052536 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.054281 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:17.103425 13907 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:17.056672 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:16.993714 18280 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:17.018142 18259 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.602s	user 0.000s	sys 0.001s
W20260811 16:05:17.069855 18027 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.000s
I20260811 16:05:17.063858 17962 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.056140 18163 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:17.079361 17561 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:16.930099 18113 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260811 16:05:17.056808 18267 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.592s	user 0.000s	sys 0.001s
I20260811 16:05:17.097664 13901 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:17.103471 13825 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:16.909801 18236 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260811 16:05:17.056344 18038 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:17.106426 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 379780us
I20260811 16:05:17.050597 18108 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260811 16:05:17.109843 13908 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:16.950630 18172 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.135949 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.136863 13909 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:17.122349 14582 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:17.063740 17926 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:17.107405 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.024s	sys 0.049s
W20260811 16:05:17.106671 18251 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.892s	user 0.003s	sys 0.009s
I20260811 16:05:17.154763 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 773) took 3282 ms. Trace:
I20260811 16:05:17.107360 18247 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:17.155879 14542 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.131s (SENT)
W20260811 16:05:17.156088 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.029s	sys 0.051s
I20260811 16:05:17.156504 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:17.164004 14542 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.145s (SENT)
I20260811 16:05:17.164209 13825 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:17.164453 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:17.165612 13825 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:17.172516 18157 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.158609 13742 rpcz_store.cc:276] 0811 16:05:13.872774 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:13.873244 (+   470us) service_pool.cc:227] Handling call
0811 16:05:13.873603 (+   359us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.136705 (+2263102us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.154481 (+1017776us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400278dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:17.154686 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4946450304}
I20260811 16:05:17.173734 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.175012 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.175305 14579 pending_rounds.cc:76] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 7
I20260811 16:05:17.175700 14579 pending_rounds.cc:97] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260811 16:05:17.175958 14579 raft_consensus.cc:2866] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:17.100062 18051 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.176383 18172 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.107213 18280 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:17.120306 18027 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.161324 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:17.178499 13827 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:17.154763 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.179304 13907 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:17.180231 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.181069 13907 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:17.181890 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.184677 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37762 (request call id 825) took 3036 ms. Trace:
I20260811 16:05:17.185141 13740 rpcz_store.cc:276] 0811 16:05:14.148109 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.566841 (+418732us) service_pool.cc:227] Handling call
0811 16:05:17.184491 (+2617650us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5400281ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:17.184578 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":87623040}
I20260811 16:05:17.186422 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.189499 18050 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.191179 18256 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:05:17.191648 14542 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.198s (SENT)
I20260811 16:05:17.172417 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.192157 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:17.176273 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:17.193094 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 310538us
I20260811 16:05:17.196157 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:17.137928 18163 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:17.197535 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.204244 13827 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:17.204138 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.207240 18148 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:17.208895 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:17.209385 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1736) took 1008 ms. Trace:
I20260811 16:05:17.210878 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.215281 13902 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:05:17.215718 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:17.210889 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
W20260811 16:05:17.212289 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 283839us
I20260811 16:05:17.217245 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.214444 13827 rpcz_store.cc:276] 0811 16:05:16.200689 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.193968 (+993279us) service_pool.cc:227] Handling call
0811 16:05:17.204063 (+ 10095us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.209124 (+  5061us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.209327 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:17.217229 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.159312 18038 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.222332 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.226516 13740 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:17.208627 18113 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:17.228902 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.230289 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.211943 17906 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.232978 13902 raft_consensus.cc:2362] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:05:17.233945 13901 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:17.235391 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.243939 14582 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:17.247756 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.202730 18157 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260811 16:05:17.223413 18178 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:17.250595 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:17.267654 13707 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.542s (SENT)
W20260811 16:05:17.273038 13707 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.989s (SENT)
I20260811 16:05:17.224437 18247 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:17.244989 18169 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260811 16:05:17.283569 17906 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:17.284389 18169 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:17.284904 18169 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:17.286044 18169 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.287798 18027 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:17.282646 18178 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:17.229960 18160 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:17.318881 18169 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:17.277596 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2385) took 1013 ms. Trace:
I20260811 16:05:17.303550 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.320551 13902 raft_consensus.cc:2362] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:05:17.320290 13901 rpcz_store.cc:276] 0811 16:05:16.261765 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.230015 (+968250us) service_pool.cc:227] Handling call
0811 16:05:17.274780 (+ 44765us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:17.296911 14542 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.657s (SENT)
I20260811 16:05:17.321846 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:17.295857 13740 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:17.323035 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1836) took 1114 ms. Trace:
W20260811 16:05:17.296176 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45711.8us
I20260811 16:05:17.307971 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.323522 13740 rpcz_store.cc:276] 0811 16:05:16.208694 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.235134 (+1026440us) service_pool.cc:227] Handling call
0811 16:05:17.295572 (+ 60438us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.322747 (+ 27175us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.322967 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:17.321995 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.329902 13909 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:17.331231 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.332232 13901 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:17.332793 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1134) took 1015 ms. Trace:
I20260811 16:05:17.333134 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.333276 14578 rpcz_store.cc:276] 0811 16:05:16.317843 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.881707 (+563864us) service_pool.cc:227] Handling call
0811 16:05:16.926638 (+ 44931us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.926914 (+   276us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:17.203882 (+276968us) log.cc:842] Serialized 14 byte log entry
0811 16:05:17.332488 (+128606us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:17.332542 (+    54us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:17.332585 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.332645 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:17.332743 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":382064,"thread_start_us":313562,"threads_started":2}
I20260811 16:05:17.335999 13742 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:17.336232 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.336750 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 789) took 1112 ms. Trace:
I20260811 16:05:17.284403 17906 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:17.337157 13742 rpcz_store.cc:276] 0811 16:05:16.224671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.307978 (+1083307us) service_pool.cc:227] Handling call
0811 16:05:17.335824 (+ 27846us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.336483 (+   659us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.336693 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:17.337673 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60551.7us
I20260811 16:05:17.348485 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.348616 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.349900 13902 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:17.315054 18160 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:17.333070 18016 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:17.316192 18296 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260811 16:05:17.316404 18163 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:17.544973 14542 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.052s (SENT)
W20260811 16:05:17.424130 13707 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.581s (SENT)
I20260811 16:05:17.548467 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:17.344066 18243 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260811 16:05:17.384704 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:17.550544 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.513413 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2148) took 1246 ms. Trace:
I20260811 16:05:17.557022 13901 rpcz_store.cc:276] 0811 16:05:16.266618 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.347638 (+1081020us) service_pool.cc:227] Handling call
0811 16:05:17.513323 (+165685us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1296640}
W20260811 16:05:17.550642 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 203288us
I20260811 16:05:17.403844 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:17.335093 18157 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:17.419930 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.568055 14580 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:17.459295 18154 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:17.457304 18182 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.438s	user 0.012s	sys 0.001s
I20260811 16:05:17.558279 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:17.385991 18217 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.190s	user 0.013s	sys 0.002s
W20260811 16:05:17.444056 18171 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.424s	user 0.003s	sys 0.012s
W20260811 16:05:17.460136 18287 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260811 16:05:17.496992 17781 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:05:17.540045 18038 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.579090 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.578341 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.581609 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:17.592736 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 168656us
I20260811 16:05:17.592587 13909 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:17.589972 13901 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:17.405599 18289 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.218s
W20260811 16:05:17.594955 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.747s (SENT) [suppressed 70 similar messages]
I20260811 16:05:17.595577 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.590601 13742 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 6.
I20260811 16:05:17.581864 18182 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:17.598129 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.513581 18280 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.563453 18243 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.613581 13909 raft_consensus.cc:2354] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8.
I20260811 16:05:17.581015 18217 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.430802 18178 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:17.597252 13707 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.984s (SENT)
I20260811 16:05:17.616868 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.618644 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.616219 18247 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:17.596146 18296 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:17.453238 17906 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.614930 13901 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:17.634584 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2077) took 1189 ms. Trace:
I20260811 16:05:17.629072 13739 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:17.646060 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:17.657488 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.651038 13907 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:17.654013 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56801us
I20260811 16:05:17.654302 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1114) took 3904 ms. Trace:
I20260811 16:05:17.583451 18171 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.590914 17781 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:17.649803 17561 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.520s	user 0.016s	sys 0.000s
I20260811 16:05:17.595736 18038 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:17.657068 13740 rpcz_store.cc:276] 0811 16:05:16.445278 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.344881 (+899603us) service_pool.cc:227] Handling call
0811 16:05:17.408286 (+ 63405us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:17.408635 (+   349us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:17.408665 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:17.409115 (+   450us) log.cc:842] Serialized 26 byte log entry
0811 16:05:17.595245 (+186130us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:17.595283 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.595349 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:17.634394 (+ 39045us) raft_consensus.cc:1671] finished
0811 16:05:17.634413 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:17.634529 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3880,"raft.queue_time_us":163212,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5055,"thread_start_us":143542,"threads_started":1,"wal-append.queue_time_us":202526}
I20260811 16:05:17.663921 13909 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:17.627885 17981 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:17.670627 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.671885 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2071) took 1378 ms. Trace:
I20260811 16:05:17.676998 13739 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:17.683717 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:17.659485 14581 rpcz_store.cc:276] 0811 16:05:13.749739 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:13.749876 (+   137us) service_pool.cc:227] Handling call
0811 16:05:13.764415 (+ 14539us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:13.897901 (+133486us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:14.715877 (+817976us) log.cc:842] Serialized 14 byte log entry
0811 16:05:17.499088 (+2783211us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18002cb420. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:05:17.566090 (+ 67002us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:17.566928 (+   838us) log.cc:842] Serialized 26 byte log entry
0811 16:05:17.567065 (+   137us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:17.567099 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.567190 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:17.637651 (+ 70461us) raft_consensus.cc:1671] finished
0811 16:05:17.654084 (+ 16433us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:17.654239 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12151,"prepare.queue_time_us":807044,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":68731,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":16482,"spinlock_wait_cycles":27780480,"thread_start_us":948441,"threads_started":3,"wal-append.queue_time_us":2803300}
I20260811 16:05:17.773617 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.727813 14580 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:17.679183 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.775337 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.776302 13909 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:17.777225 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.778098 13909 raft_consensus.cc:2354] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:17.754942 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1731) took 1591 ms. Trace:
I20260811 16:05:17.780326 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2076) took 1367 ms. Trace:
I20260811 16:05:17.780370 13822 rpcz_store.cc:276] 0811 16:05:16.163969 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.338904 (+174935us) service_pool.cc:227] Handling call
0811 16:05:16.339292 (+   388us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:16.359782 (+ 20490us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:16.359835 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:16.393494 (+ 33659us) log.cc:842] Serialized 26 byte log entry
0811 16:05:17.163658 (+770164us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:17.163696 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.163777 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:17.754582 (+590805us) raft_consensus.cc:1671] finished
0811 16:05:17.754641 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:17.754858 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11969,"raft.queue_time_us":12120,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":10164,"thread_start_us":694255,"threads_started":1,"wal-append.queue_time_us":795381}
I20260811 16:05:17.779505 13901 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:17.780929 13739 rpcz_store.cc:276] 0811 16:05:16.412583 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.494232 (+ 81649us) service_pool.cc:227] Handling call
0811 16:05:17.628863 (+1134631us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540020a728. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57885434 00007f5c5684e437 00007f5c5684dbc8 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:17.780250 (+151387us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":257346432}
W20260811 16:05:17.783285 13707 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 4.212s (SENT)
I20260811 16:05:17.782843 13741 rpcz_store.cc:276] 0811 16:05:16.293903 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.327853 (+ 33950us) service_pool.cc:227] Handling call
0811 16:05:17.669588 (+1341735us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54000302d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:17.671803 (+  2215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":628093184}
I20260811 16:05:17.784920 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:17.787701 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:17.751579 18306 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260811 16:05:17.778992 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.788467 13739 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:17.789410 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:17.790030 13902 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260811 16:05:17.792675 14581 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:17.792860 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2372) took 1558 ms. Trace:
I20260811 16:05:17.793303 13902 rpcz_store.cc:276] 0811 16:05:16.234680 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.787130 (+1552450us) service_pool.cc:227] Handling call
0811 16:05:17.787477 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.792621 (+  5144us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.792808 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:17.794075 13741 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:05:17.690145 18217 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.692001 18280 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:17.758231 18149 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:17.806963 13822 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:17.795949 13739 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:17.750563 18243 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.807911 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:17.822808 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1742) took 1610 ms. Trace:
I20260811 16:05:17.823397 13822 rpcz_store.cc:276] 0811 16:05:16.212310 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.786653 (+1574343us) service_pool.cc:227] Handling call
0811 16:05:17.806808 (+ 20155us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.822435 (+ 15627us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.822732 (+   297us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:17.809782 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.811853 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.814649 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:17.827330 13740 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:17.828096 13902 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:17.784590 17981 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:17.815471 13707 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.563s (SENT)
I20260811 16:05:17.829000 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.839821 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:17.841090 13707 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.579s (SENT)
I20260811 16:05:17.841976 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:17.816512 18314 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:05:17.817801 18171 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.813149 18311 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260811 16:05:17.805884 18275 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:17.662004 18247 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.829731 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2151) took 1181 ms. Trace:
I20260811 16:05:17.827580 18217 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:17.721890 17781 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.836225 13822 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:17.842950 13707 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.164s (SENT)
I20260811 16:05:17.853376 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:17.844272 17981 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.847922 18217 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.844691 18311 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:17.855037 18275 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:17.848670 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2468) took 1480 ms. Trace:
I20260811 16:05:17.849555 13901 rpcz_store.cc:276] 0811 16:05:16.647861 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.668413 (+1020552us) service_pool.cc:227] Handling call
0811 16:05:17.829651 (+161238us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:17.855770 13822 rpcz_store.cc:276] 0811 16:05:16.367966 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.824368 (+1456402us) service_pool.cc:227] Handling call
0811 16:05:17.835974 (+ 11606us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.848385 (+ 12411us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.848602 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:17.849684 18247 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.856540 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 912) took 1615 ms. Trace:
I20260811 16:05:17.857096 13822 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:17.857714 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2470) took 1489 ms. Trace:
I20260811 16:05:17.845667 13909 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:17.842643 13902 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:17.856943 14577 rpcz_store.cc:276] 0811 16:05:16.241416 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.269440 (+ 28024us) service_pool.cc:227] Handling call
0811 16:05:16.269708 (+   268us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.008898 (+739190us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.856296 (+847398us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:17.856483 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1657837312}
I20260811 16:05:17.858003 13822 rpcz_store.cc:276] 0811 16:05:16.368305 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.856566 (+1488261us) service_pool.cc:227] Handling call
0811 16:05:17.856917 (+   351us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.857468 (+   551us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.857661 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:17.859498 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65368.1us
I20260811 16:05:17.858289 18217 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.786736 18038 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.872412 18169 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:17.901387 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:17.888280 18169 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:17.904748 18217 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:05:17.905345 18169 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:17.904894 17908 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:17.895344 18165 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:17.881735 18247 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
W20260811 16:05:17.919904 13707 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.643s (SENT)
W20260811 16:05:17.906313 18301 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260811 16:05:17.921981 18165 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.906095 18176 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:17.927917 18165 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:17.929243 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:17.929742 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2132) took 3511 ms. Trace:
I20260811 16:05:17.930104 14580 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:17.930212 13904 rpcz_store.cc:276] 0811 16:05:14.417951 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.655829 (+237878us) service_pool.cc:227] Handling call
0811 16:05:14.705961 (+ 50132us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.132758 (+1426797us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.929431 (+1796673us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:17.929651 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3279853312}
I20260811 16:05:17.931972 13740 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
W20260811 16:05:17.934731 13707 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.716s (SENT)
W20260811 16:05:17.946305 13707 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.721s (SENT)
I20260811 16:05:17.915360 17908 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:17.931689 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.957798 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:17.942520 18318 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260811 16:05:17.963569 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.981266 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2374) took 1746 ms. Trace:
I20260811 16:05:17.981657 13907 rpcz_store.cc:276] 0811 16:05:16.234988 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.181582 (+946594us) service_pool.cc:227] Handling call
0811 16:05:17.981008 (+799426us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400321254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:17.981169 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1019635968}
I20260811 16:05:17.982436 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:17.982635 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:17.983072 13740 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:17.983001 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:17.984105 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1828) took 1778 ms. Trace:
I20260811 16:05:17.984483 13736 rpcz_store.cc:276] 0811 16:05:16.205569 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.208907 (+  3338us) service_pool.cc:227] Handling call
0811 16:05:16.214357 (+  5450us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.305432 (+ 91075us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.983880 (+1678448us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:17.984046 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":206353664}
I20260811 16:05:17.985522 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:17.986490 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:17.987612 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 954) took 3825 ms (client timeout 1717 ms). Trace:
I20260811 16:05:17.965296 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:17.988001 14575 rpcz_store.cc:269] 0811 16:05:14.162622 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.200513 (+ 37891us) service_pool.cc:227] Handling call
0811 16:05:17.987430 (+3786917us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:17.987543 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4997955840}
I20260811 16:05:17.971204 18174 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:17.988909 18174 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:17.991398 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.992748 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.993352 14574 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260811 16:05:17.993439 13904 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:17.993834 14574 pending_rounds.cc:76] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 7
I20260811 16:05:17.994062 14574 pending_rounds.cc:97] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260811 16:05:17.994292 14574 raft_consensus.cc:2866] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:17.994360 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.995468 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.996481 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:17.997172 13904 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:17.980419 18038 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:17.997860 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 741) took 3836 ms. Trace:
I20260811 16:05:17.958523 17908 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:17.961921 18194 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260811 16:05:18.014623 18250 raft_consensus.cc:979] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:05:17.998134 18174 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:17.999364 18178 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:05:18.015795 18174 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:18.016346 18328 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:18.016804 18328 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:18.000178 13907 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:18.001291 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2120) took 3623 ms (client timeout 1902 ms). Trace:
I20260811 16:05:18.017874 18294 raft_consensus.cc:1067] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
W20260811 16:05:18.017992 13903 rpcz_store.cc:269] 0811 16:05:14.378208 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.378915 (+   707us) service_pool.cc:227] Handling call
0811 16:05:18.001102 (+3622187us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:18.001223 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6049183104}
I20260811 16:05:17.997860 18176 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260811 16:05:18.001325 13736 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:18.005573 18268 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.317s	user 0.005s	sys 0.000s
I20260811 16:05:18.005369 13740 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:18.005899 18169 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:17.904773 18157 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260811 16:05:17.998865 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.039685 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.040638 13903 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:18.035945 14581 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:18.032235 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:18.016343 18174 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.011742 13821 rpcz_store.cc:276] 0811 16:05:14.161681 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.255089 (+ 93408us) service_pool.cc:227] Handling call
0811 16:05:14.255538 (+   449us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:14.534788 (+279250us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:14.535242 (+   454us) log.cc:842] Serialized 14 byte log entry
0811 16:05:14.754243 (+219001us) log.cc:842] Serialized 14 byte log entry
0811 16:05:14.792023 (+ 37780us) log.cc:842] Serialized 14 byte log entry
0811 16:05:14.793656 (+  1633us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:14.793728 (+    72us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:14.793804 (+    76us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:17.928661 (+3134857us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b1800093580. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:17.997146 (+ 68485us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b1800093580. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:05:17.997635 (+   489us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54000e1fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:17.997679 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:17.997797 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36464,"prepare.queue_time_us":3214125,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":118,"raft.queue_time_us":1969,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":52582,"spinlock_wait_cycles":684248576,"thread_start_us":189479,"threads_started":1,"wal-append.queue_time_us":322634,"wal-append.run_cpu_time_us":20964,"wal-append.run_wall_time_us":2269940}
I20260811 16:05:18.022121 13742 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:18.037531 18164 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.554s	user 0.023s	sys 0.038s
I20260811 16:05:18.053301 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:18.049396 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:18.051469 14542 leader_election.cc:398] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:18.079617 14542 leader_election.cc:401] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:18.085613 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:18.084065 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:18.055701 18038 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:18.042970 18247 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:18.047891 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:18.053840 13903 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:18.048514 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.017822 18328 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.052529 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.117059 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2375) took 1881 ms. Trace:
I20260811 16:05:18.117268 13904 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:18.119282 13903 rpcz_store.cc:276] 0811 16:05:16.235204 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.041339 (+1806135us) service_pool.cc:227] Handling call
0811 16:05:18.053390 (+ 12051us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:18.116664 (+ 63274us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.116979 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:18.075457 18164 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.592s	user 0.024s	sys 0.039s
W20260811 16:05:18.124332 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72997us
I20260811 16:05:18.086853 17967 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:18.137526 13903 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260811 16:05:18.139389 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.116389 18275 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:18.159103 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2140) took 1894 ms. Trace:
I20260811 16:05:18.166358 16875 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.165395 13903 rpcz_store.cc:276] 0811 16:05:16.264179 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.127655 (+1863476us) service_pool.cc:227] Handling call
0811 16:05:18.137138 (+  9483us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:18.158677 (+ 21539us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.159015 (+   338us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:18.166870 13904 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:18.125663 18038 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:18.168056 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2392) took 1680 ms. Trace:
I20260811 16:05:18.170750 13904 rpcz_store.cc:276] 0811 16:05:16.487777 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.131297 (+1643520us) service_pool.cc:227] Handling call
0811 16:05:18.166527 (+ 35230us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:18.167713 (+  1186us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.167982 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:18.130753 18149 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:18.090937 18046 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260811 16:05:18.044306 18289 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260811 16:05:18.165892 18247 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:18.163502 18328 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:18.175902 13742 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:18.175005 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1839) took 1043 ms. Trace:
I20260811 16:05:18.174273 17967 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:18.183854 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 131371us
I20260811 16:05:18.168246 18275 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:18.170400 18157 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:18.192430 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 144528us
I20260811 16:05:18.193198 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:18.194725 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.185825 13741 rpcz_store.cc:276] 0811 16:05:17.129800 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.810305 (+680505us) service_pool.cc:227] Handling call
0811 16:05:17.810586 (+   281us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.810739 (+   153us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:17.887624 (+ 76885us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.165121 (+277497us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:18.172398 (+  7277us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:18.172480 (+    82us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.172571 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.172743 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":60055,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"raft.queue_time_us":203,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6140,"thread_start_us":348487,"threads_started":2}
I20260811 16:05:18.202059 18320 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:18.202647 18320 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:18.203040 18320 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:18.210371 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:18.190842 18297 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:18.226799 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.194218 18275 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:18.203653 18324 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260811 16:05:18.241868 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.203414 18323 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:18.247732 14578 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:18.213833 18217 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:18.255692 14575 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:18.203799 18149 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260811 16:05:18.256932 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1824) took 4122 ms (client timeout 1922 ms). Trace:
W20260811 16:05:18.258090 18329 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260811 16:05:18.244079 18311 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:18.268386 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:18.259430 13738 rpcz_store.cc:269] 0811 16:05:14.129098 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.129343 (+   245us) service_pool.cc:227] Handling call
0811 16:05:18.250812 (+4121469us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002094d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:18.250949 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1542141312}
I20260811 16:05:18.271446 17918 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:18.246709 18169 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:18.295662 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.298492 18181 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:18.310184 18368 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:18.271916 18283 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260811 16:05:18.315667 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54336.8us
W20260811 16:05:18.323802 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62851.9us
I20260811 16:05:18.251248 18338 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:18.335834 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62593.8us
I20260811 16:05:18.263950 18339 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:18.339321 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 43761.6us
I20260811 16:05:18.380640 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.384690 13742 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:18.248939 18333 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260811 16:05:18.316509 18368 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:18.329682 18149 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:18.252254 18038 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.289130 18311 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.263510 17967 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.396564 18363 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:18.325858 18046 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260811 16:05:18.409993 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2373) took 2175 ms. Trace:
W20260811 16:05:18.402195 18340 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260811 16:05:18.401125 18345 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260811 16:05:18.419160 13907 rpcz_store.cc:276] 0811 16:05:16.234840 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.022121 (+1787281us) service_pool.cc:227] Handling call
0811 16:05:18.045901 (+ 23780us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:18.199257 (+153356us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:18.199310 (+    53us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:18.200082 (+   772us) log.cc:842] Serialized 52 byte log entry
0811 16:05:18.378210 (+178128us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:18.409150 (+ 30940us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.409427 (+   277us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.409526 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:18.409562 (+    36us) raft_consensus.cc:1671] finished
0811 16:05:18.409577 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.409918 (+   341us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":31930,"raft.queue_time_us":69374,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":10215,"thread_start_us":259038,"threads_started":2,"wal-append.queue_time_us":154321}
I20260811 16:05:18.394157 18368 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:18.410632 18182 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:18.439860 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.441598 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1732) took 2277 ms. Trace:
I20260811 16:05:18.442027 13826 rpcz_store.cc:276] 0811 16:05:16.164643 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.363870 (+199227us) service_pool.cc:227] Handling call
0811 16:05:16.364193 (+   323us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.754992 (+390799us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.441244 (+1686252us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002dd2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:18.441524 (+   280us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":897523456}
W20260811 16:05:18.436586 18342 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260811 16:05:18.437618 18335 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260811 16:05:18.427028 18326 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260811 16:05:18.395443 18157 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260811 16:05:18.420711 18174 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:18.460882 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.431821 18217 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:18.461652 13907 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:18.441290 18311 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.449157 18297 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:18.463953 17908 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:18.470252 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 131150us
I20260811 16:05:18.473428 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 911) took 4047 ms. Trace:
I20260811 16:05:18.473834 14583 rpcz_store.cc:276] 0811 16:05:14.426094 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.426268 (+   174us) service_pool.cc:227] Handling call
0811 16:05:14.487619 (+ 61351us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.078992 (+1591373us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.473180 (+2394188us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:18.473365 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3577653504}
I20260811 16:05:18.475765 18297 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.479475 18217 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.480448 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:18.473145 18343 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260811 16:05:18.531970 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48244 (request call id 16) took 2174 ms. Trace:
I20260811 16:05:18.532651 13744 rpcz_store.cc:276] 0811 16:05:16.339404 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.641382 (+301978us) service_pool.cc:227] Handling call
0811 16:05:18.484821 (+1843439us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54003a6220. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a1dc0 00007f5c519069c2 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:18.513271 (+ 28450us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":365188352}
I20260811 16:05:18.567482 17908 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:18.572145 18323 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:18.572778 18323 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:18.588811 13907 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:18.592896 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.593815 13907 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:18.595206 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.595577 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.597277 13907 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:05:18.598551 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:18.599778 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.601557 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.608778 17927 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:18.611451 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:05:18.612157 18336 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260811 16:05:18.612303 13744 raft_consensus.cc:595] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:18.612677 13744 raft_consensus.cc:603] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:18.612929 18112 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:18.616183 18375 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:18.618306 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2471) took 2249 ms. Trace:
I20260811 16:05:18.602331 13907 raft_consensus.cc:2362] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11. Re-sending same reply.
I20260811 16:05:18.620370 18375 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:18.624742 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:18.622216 18375 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.590507 18323 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.602803 18149 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:18.624387 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.618814 13822 rpcz_store.cc:276] 0811 16:05:16.368475 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.863187 (+1494712us) service_pool.cc:227] Handling call
0811 16:05:17.867964 (+  4777us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.868179 (+   215us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:17.882741 (+ 14562us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.617907 (+735166us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:18.617972 (+    65us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:18.618024 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.618099 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.618244 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":699968,"prepare.queue_time_us":16217,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"thread_start_us":34533,"threads_started":1,"wal-append.queue_time_us":163548}
I20260811 16:05:18.630183 18378 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:18.635394 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2472) took 2266 ms. Trace:
W20260811 16:05:18.636234 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 784) took 4031 ms (client timeout 1575 ms). Trace:
I20260811 16:05:18.637022 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1728) took 2480 ms. Trace:
I20260811 16:05:18.606669 17684 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:05:18.640635 13735 rpcz_store.cc:269] 0811 16:05:14.605040 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.605311 (+   271us) service_pool.cc:227] Handling call
0811 16:05:18.636020 (+4030709us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5400311d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:18.636160 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24233216}
I20260811 16:05:18.640002 13821 rpcz_store.cc:276] 0811 16:05:16.368688 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.054689 (+1686001us) service_pool.cc:227] Handling call
0811 16:05:18.054934 (+   245us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:18.055073 (+   139us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:18.089994 (+ 34921us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.634988 (+544994us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:18.635050 (+    62us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:18.635092 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.635190 (+    98us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.635329 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":370546,"prepare.queue_time_us":34888,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":373042,"thread_start_us":68011,"threads_started":1,"wal-append.queue_time_us":75196}
I20260811 16:05:18.638774 13907 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:18.640702 13818 rpcz_store.cc:276] 0811 16:05:16.157090 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.157251 (+   161us) service_pool.cc:227] Handling call
0811 16:05:16.157598 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.338354 (+180756us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.636787 (+2298433us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540025f654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:18.636959 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":389053312}
I20260811 16:05:18.646519 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:18.649719 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2110) took 4370 ms (client timeout 3242 ms). Trace:
W20260811 16:05:18.650293 13905 rpcz_store.cc:269] 0811 16:05:14.274172 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.274340 (+   168us) service_pool.cc:227] Handling call
0811 16:05:18.644081 (+4369741us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54003b06d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:18.644268 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":881476992}
I20260811 16:05:18.652453 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1740) took 2440 ms. Trace:
I20260811 16:05:18.635161 18149 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:18.657346 17917 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:18.657569 18149 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:18.657887 17917 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:18.658385 17917 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:18.659631 18169 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
W20260811 16:05:18.660025 18232 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 3.055s	user 0.008s	sys 0.008s
I20260811 16:05:18.660673 18187 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:18.661073 18187 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:18.661185 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9315a4a479754517bd121148cf017615"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:18.661815 13735 raft_consensus.cc:595] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:18.662194 13735 raft_consensus.cc:603] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:18.662413 18047 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:18.662614 13823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2465) took 4013 ms (client timeout 2239 ms). Trace:
I20260811 16:05:18.663427 13824 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:18.664487 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.660037 18169 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:18.665115 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.675886 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.701762 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.704785 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.704986 17917 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.640266 18255 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:18.707291 13907 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:18.653005 13827 rpcz_store.cc:276] 0811 16:05:16.211775 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.225476 (+1013701us) service_pool.cc:227] Handling call
0811 16:05:17.249966 (+ 24490us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:17.250245 (+   279us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:17.525191 (+274946us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.017002 (+491811us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b1800294d60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b
0811 16:05:18.646548 (+629546us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.652099 (+  5551us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:18.652150 (+    51us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:18.652197 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.652274 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.652396 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":629068,"prepare.queue_time_us":350941,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1012,"spinlock_wait_cycles":12953472,"thread_start_us":347361,"threads_started":2,"wal-append.queue_time_us":124723}
W20260811 16:05:18.663022 13823 rpcz_store.cc:269] 0811 16:05:14.649243 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.693205 (+ 43962us) service_pool.cc:227] Handling call
0811 16:05:18.662443 (+3969238us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400240c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:18.662539 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":970313600}
I20260811 16:05:18.708014 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:18.680275 13709 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.505s (SENT)
I20260811 16:05:18.718478 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:18.718080 13909 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:18.718763 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.715394 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.618384 18275 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.721082 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:18.722319 13907 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:18.720688 13905 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11. Re-sending same reply.
I20260811 16:05:18.727438 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:18.726117 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.665302 13901 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:18.731577 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.716907 18255 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:18.729187 18311 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:18.651351 18378 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:18.732856 17955 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:18.738356 18272 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:18.662964 18047 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.739962 18323 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.740163 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:18.781288 14575 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:18.742084 18169 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.743441 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:18.732522 17917 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.782519 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:18.783308 14583 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:18.783914 18169 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:18.733253 13909 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:18.755527 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:18.785223 13905 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:18.785436 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:18.788491 13909 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:18.759811 17888 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.793037 13907 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:18.768986 18272 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:18.770807 14573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1128) took 2533 ms (client timeout 1747 ms). Trace:
I20260811 16:05:18.790436 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:18.666184 18368 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.809166 13909 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:18.810289 13909 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:18.811496 13909 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260811 16:05:18.811878 13909 pending_rounds.cc:76] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 7
I20260811 16:05:18.812140 13909 pending_rounds.cc:97] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260811 16:05:18.812412 13909 raft_consensus.cc:2866] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:18.795783 14573 rpcz_store.cc:269] 0811 16:05:16.237533 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.238647 (+  1114us) service_pool.cc:227] Handling call
0811 16:05:18.770561 (+2531914us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54004e02d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:18.770696 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1331341568}
I20260811 16:05:18.815204 13907 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:18.816215 13905 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:18.823897 14581 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:18.821467 18320 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.003s
I20260811 16:05:18.831368 18320 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.833606 18320 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:18.835956 18272 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.836925 18368 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:18.840023 13741 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:18.840265 18149 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:18.841610 18228 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 3.654s	user 0.014s	sys 0.014s
W20260811 16:05:18.844053 18260 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 2.500s	user 0.005s	sys 0.008s
I20260811 16:05:18.845428 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1830) took 2639 ms. Trace:
I20260811 16:05:18.848163 18047 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.850108 17781 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:05:18.852205 18275 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:18.852730 17955 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:18.818802 17888 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:18.853416 17888 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:18.853814 17888 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:18.854562 18029 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:18.855078 18029 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.845875 13737 rpcz_store.cc:276] 0811 16:05:16.206240 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.212795 (+  6555us) service_pool.cc:227] Handling call
0811 16:05:16.213116 (+   321us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.426970 (+213854us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:16.427017 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:16.427078 (+    61us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:16.427120 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.845156 (+2418036us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:18.845214 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.845363 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59313,"raft.queue_time_us":84108,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":91234176,"thread_start_us":114331,"threads_started":1}
W20260811 16:05:18.867018 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 2.15634e+06us
I20260811 16:05:18.868824 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:18.874953 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1735) took 2706 ms. Trace:
I20260811 16:05:18.875550 13825 rpcz_store.cc:276] 0811 16:05:16.168530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.166556 (+998026us) service_pool.cc:227] Handling call
0811 16:05:17.166903 (+   347us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:18.615745 (+1448842us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:18.615777 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:18.623926 (+  8149us) log.cc:842] Serialized 26 byte log entry
0811 16:05:18.860026 (+236100us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:18.860083 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.860190 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:18.874603 (+ 14413us) raft_consensus.cc:1671] finished
0811 16:05:18.874635 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.874847 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1447258,"raft.queue_time_us":1448770,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":232167,"threads_started":1,"wal-append.queue_time_us":237931}
I20260811 16:05:18.863968 14575 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:18.879525 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:18.883523 18244 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:18.884372 18244 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:18.885702 18244 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.893462 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.862879 18165 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:18.860249 18243 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:18.906212 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:18.908138 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.895947 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2404) took 1637 ms. Trace:
I20260811 16:05:18.917732 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:18.919483 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.920924 13823 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260811 16:05:18.921998 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.922595 13825 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:18.923481 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.924135 13825 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:18.924726 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:18.917570 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:18.926941 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.928620 13818 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260811 16:05:18.930567 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 684614us
I20260811 16:05:18.934832 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:18.936123 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.937426 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:18.938247 13818 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:18.911193 13903 rpcz_store.cc:276] 0811 16:05:17.258669 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.167500 (+908831us) service_pool.cc:227] Handling call
0811 16:05:18.181901 (+ 14401us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:18.186777 (+  4876us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:18.186828 (+    51us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:18.188673 (+  1845us) log.cc:842] Serialized 52 byte log entry
0811 16:05:18.296939 (+108266us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:18.297419 (+   480us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.335468 (+ 38049us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.335604 (+   136us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:18.854623 (+519019us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c8740 00007f5c515bb578 00007f5c515bbcd8 00007f5c515936e8 00007f5c5158eaea 00007f5c5158df36
0811 16:05:18.895584 (+ 40961us) raft_consensus.cc:1671] finished
0811 16:05:18.895706 (+   122us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.895884 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":683,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":51113,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":2620,"spinlock_wait_cycles":98791680,"thread_start_us":114243,"threads_started":2,"wal-append.queue_time_us":125743}
I20260811 16:05:18.942804 13818 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:18.943221 13818 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:18.944052 13818 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.945494 13818 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:18.948040 13827 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:18.952427 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44363.7us
I20260811 16:05:18.952574 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1726) took 2807 ms. Trace:
I20260811 16:05:18.953336 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.784060 18378 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.957940 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.958921 13823 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:18.963339 17684 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:18.963733 18388 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:18.964123 18173 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:18.964002 17684 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.965386 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:18.966312 13822 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:18.964890 18173 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:18.971385 18391 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:18.971777 18173 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.973099 17684 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:18.973189 18173 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:18.939002 18243 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.905035 18165 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:18.981664 18160 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.978727 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:18.989084 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:18.953128 13817 rpcz_store.cc:276] 0811 16:05:16.145018 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.145196 (+   178us) service_pool.cc:227] Handling call
0811 16:05:16.153033 (+  7837us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:16.153266 (+   233us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:16.377525 (+224259us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.580141 (+2202616us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b18002ab5c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:05:18.872139 (+291998us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.952234 (+ 80095us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:18.952285 (+    51us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:18.952326 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:18.952387 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:18.952516 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":118231,"prepare.queue_time_us":408590,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":4398,"raft.queue_time_us":2132498,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8642,"spinlock_wait_cycles":2348416,"thread_start_us":587784,"threads_started":5,"wal-append.queue_time_us":455496,"wal-append.run_cpu_time_us":1546,"wal-append.run_wall_time_us":1199819}
I20260811 16:05:18.897199 18255 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:18.934456 17888 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:18.949368 18149 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:18.979683 18251 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:18.977674 18388 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:18.994454 18171 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:18.957963 18047 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:18.996793 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.000136 18251 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:18.993605 18111 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:19.011300 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.013959 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.014967 13825 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:18.959131 17955 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260811 16:05:19.016736 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.017191 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.011785 18111 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:19.012580 18171 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:19.020028 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.028868 13906 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:19.029366 13823 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.019897 18241 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:05:19.012072 18251 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:19.018416 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.036729 13827 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:19.026551 14581 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:19.038339 13826 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.039072 13821 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.040297 18111 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.045436 13818 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260811 16:05:19.045974 13818 pending_rounds.cc:76] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 7
I20260811 16:05:19.046244 13818 pending_rounds.cc:97] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260811 16:05:19.046530 13818 raft_consensus.cc:2866] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:19.001529 18236 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:19.058488 18236 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.049748 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.059955 13823 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:19.052765 17888 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.061439 18236 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:18.982937 18165 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.053805 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.068133 13822 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:19.056697 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.068921 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.070075 13826 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:19.071641 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.071660 13825 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.072598 13818 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:05:19.075062 18165 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.076784 18255 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:19.075098 18390 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:19.001322 18388 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:19.079454 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.080258 13817 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.081365 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.082162 13825 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:19.086592 18382 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260811 16:05:19.086261 17967 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:19.088999 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.092521 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:19.093290 14574 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:19.094597 13823 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:19.097450 13820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1727) took 2944 ms (client timeout 1916 ms). Trace:
W20260811 16:05:19.097972 13820 rpcz_store.cc:269] 0811 16:05:16.152929 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.166678 (+ 13749us) service_pool.cc:227] Handling call
0811 16:05:19.097196 (+2930518us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000d5a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:19.097364 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":373659904}
I20260811 16:05:19.089515 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.099671 13826 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:05:19.100940 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.575s (SENT)
I20260811 16:05:19.101365 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.100708 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.104637 13817 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:19.202373 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2109) took 4928 ms (client timeout 1694 ms). Trace:
I20260811 16:05:19.213851 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:19.212296 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2150) took 2564 ms (client timeout 1607 ms). Trace:
W20260811 16:05:19.219798 13906 rpcz_store.cc:269] 0811 16:05:14.273793 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:14.273988 (+   195us) service_pool.cc:227] Handling call
0811 16:05:19.202107 (+4928119us) spinlock_profiling.cc:243] Waited 4.46 s on lock 0x7b5400322154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:19.202273 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10264889216}
W20260811 16:05:19.121312 14544 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.732s (SENT)
I20260811 16:05:19.221621 18148 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:19.221886 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.222199 18148 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:19.112947 18111 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:19.220203 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:19.220489 13900 rpcz_store.cc:269] 0811 16:05:16.647608 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.843932 (+196324us) service_pool.cc:227] Handling call
0811 16:05:19.212027 (+2368095us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:19.212197 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":368264960}
I20260811 16:05:19.224490 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:19.224082 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 102837us
I20260811 16:05:19.105214 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.213810 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.226222 13825 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:19.143294 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.077s	sys 0.110s
I20260811 16:05:19.115958 14581 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
W20260811 16:05:19.227033 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.082s	sys 0.137s
I20260811 16:05:19.227437 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:19.227842 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 2.75093e+06us
I20260811 16:05:19.225984 13826 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:19.223357 18299 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:19.137529 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.230517 13825 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.230741 13820 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.230883 13821 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 4: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.233282 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.234985 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:19.237010 14574 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:19.238327 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.240060 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.244270 13738 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:19.244366 13908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2378) took 3008 ms (client timeout 1563 ms). Trace:
I20260811 16:05:19.241180 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.242918 13737 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:19.247293 13741 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:19.250456 13787 connection.cc:232] RPC call timeout handler was delayed by -2.0363987940363586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260811 16:05:19.251736 13740 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:19.254037 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.254817 13741 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 8
I20260811 16:05:19.257643 14573 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:19.250131 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:19.258718 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:19.244961 13908 rpcz_store.cc:269] 0811 16:05:16.235714 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:16.297800 (+ 62086us) service_pool.cc:227] Handling call
0811 16:05:19.244053 (+2946253us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400320d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:19.244264 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":263822592}
I20260811 16:05:19.211390 18281 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.260812 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.261547 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:19.262642 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 673) took 1429 ms (client timeout 1567 ms). Trace:
I20260811 16:05:19.247241 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.103785 18194 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:19.264678 13739 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:19.251407 13787 connection.cc:232] RPC call timeout handler was delayed by -1.5730909979902208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260811 16:05:19.369303 13743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2063) took 3944 ms (client timeout 2122 ms). Trace:
I20260811 16:05:19.264322 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:19.291550 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.271632 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:19.397097 13742 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:19.396306 13743 rpcz_store.cc:269] 0811 16:05:15.414852 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:15.415008 (+   156us) service_pool.cc:227] Handling call
0811 16:05:19.358963 (+3943955us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002783d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:19.359102 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1964793728}
I20260811 16:05:19.397500 13736 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:19.258766 13737 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
W20260811 16:05:19.384996 13787 connection.cc:232] RPC call timeout handler was delayed by -1.5568909980356693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260811 16:05:19.319180 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 668) took 1964 ms. Trace:
I20260811 16:05:19.291882 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:19.400647 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 136467us
I20260811 16:05:19.397837 13817 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
W20260811 16:05:19.401355 13787 connection.cc:232] RPC call timeout handler was delayed by -1.083490998018533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260811 16:05:19.406569 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0231909980066121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260811 16:05:19.398645 13902 rpcz_store.cc:269] 0811 16:05:17.833289 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.238039 (+1404750us) service_pool.cc:227] Handling call
0811 16:05:19.262558 (+ 24519us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:19.408869 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.282908 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.414844 13820 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:19.417026 14544 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.529s (SENT)
I20260811 16:05:19.417764 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.398407 13821 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 5.
I20260811 16:05:19.423031 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.424664 18389 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260811 16:05:19.400367 18404 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260811 16:05:19.402089 13906 rpcz_store.cc:276] 0811 16:05:17.346151 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.221244 (+1875093us) service_pool.cc:227] Handling call
0811 16:05:19.310163 (+ 88919us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:19.428570 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.567s (SENT)
I20260811 16:05:19.365550 18160 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.400064 18299 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.434749 13735 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:19.361430 18243 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.426333 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.368544 18111 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:19.404556 13738 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:19.412801 18108 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
W20260811 16:05:19.425755 18377 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.721s	user 0.000s	sys 0.002s
I20260811 16:05:19.426431 18194 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.465534 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.467571 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.429450 18174 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:19.263432 18197 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.168s
I20260811 16:05:19.478680 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.443881 13821 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:19.449685 18403 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260811 16:05:19.438688 18374 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260811 16:05:19.452383 18111 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.453194 18243 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.519439 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.519568 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:19.453645 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5830591911217198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260811 16:05:19.456737 18187 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:19.458604 18320 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:19.463657 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1139) took 2569 ms. Trace:
I20260811 16:05:19.525381 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:19.283689 18281 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.420655 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.528676 13736 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
W20260811 16:05:19.529414 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 108857us
I20260811 16:05:19.530392 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.429039 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:19.481753 13902 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:19.481951 18108 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:19.525326 14579 rpcz_store.cc:276] 0811 16:05:16.894487 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:17.037776 (+143289us) service_pool.cc:227] Handling call
0811 16:05:17.064756 (+ 26980us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:17.200242 (+135486us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:17.200283 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:17.206497 (+  6214us) log.cc:842] Serialized 52 byte log entry
0811 16:05:17.463168 (+256671us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:17.463230 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:19.463129 (+1999899us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540067eb54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:19.463216 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:19.463273 (+    57us) raft_consensus.cc:1671] finished
0811 16:05:19.463288 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:19.463588 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17801,"raft.queue_time_us":17995,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":3930,"spinlock_wait_cycles":253587328,"thread_start_us":218429,"threads_started":1,"wal-append.queue_time_us":364373,"wal-append.run_cpu_time_us":2346,"wal-append.run_wall_time_us":1051034}
I20260811 16:05:19.482090 18370 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.492010 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:19.537693 13743 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:19.480636 18378 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.013s
I20260811 16:05:19.498688 13742 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:19.539027 13817 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:19.517097 18111 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.272994 18148 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.521672 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.543959 13826 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.518770 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.523887 13818 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:19.545500 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.522519 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.522377 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.546402 13825 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:19.527784 13908 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:19.547088 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.532021 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:19.539898 13735 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:19.541474 18378 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.013s
I20260811 16:05:19.537663 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.545809 13738 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.517182 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.557452 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.547874 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.559361 13908 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260811 16:05:19.436686 18299 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.547127 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.560516 13825 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:05:19.561829 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.555348 14582 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:19.547885 13821 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9. Re-sending same reply.
I20260811 16:05:19.563366 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.528267 18272 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:19.525076 18320 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:19.572615 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.573611 13903 raft_consensus.cc:2396] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260811 16:05:19.573475 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.479313 18194 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.565727 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.582545 13817 raft_consensus.cc:2362] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8. Re-sending same reply.
I20260811 16:05:19.583851 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.585153 13902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:05:19.585717 13902 raft_consensus.cc:595] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:19.586038 13902 raft_consensus.cc:603] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:19.564570 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.569617 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.570515 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.571209 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2424) took 1312 ms. Trace:
I20260811 16:05:19.575258 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:19.557958 13709 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.239s (SENT)
I20260811 16:05:19.591390 13825 raft_consensus.cc:2354] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9.
I20260811 16:05:19.591625 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.537612 18388 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:19.551409 18242 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:19.590020 13906 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:19.595534 13821 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.596501 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.592597 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.560261 18187 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:19.602545 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.599599 13825 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:19.590914 13826 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:19.524788 18174 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260811 16:05:19.613642 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.615095 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.616382 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.617213 13821 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.618049 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.618842 13821 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.619807 18388 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:19.620340 18388 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:19.575034 18390 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:19.621389 18390 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:19.628891 18299 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:19.576015 18272 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:19.629706 18272 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.601738 18109 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260811 16:05:19.608891 18280 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260811 16:05:19.601289 18149 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260811 16:05:19.638466 18108 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:19.649597 18409 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260811 16:05:19.651293 18353 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:19.651841 18353 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:19.652869 18353 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.654366 18353 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.609546 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:19.655606 13817 raft_consensus.cc:2354] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9.
I20260811 16:05:19.656592 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.657334 13817 raft_consensus.cc:2362] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:05:19.658231 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:19.661140 18362 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.661737 18362 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.537242 18286 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260811 16:05:19.529318 18243 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.574846 18148 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:19.620849 18388 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.658972 13817 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:19.607028 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:19.605942 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48034.8us
W20260811 16:05:19.685310 13709 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.632s (SENT)
I20260811 16:05:19.579792 18012 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:19.556236 18370 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.671752 13741 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:19.579622 18374 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:19.598804 18242 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:19.601760 18337 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:19.688550 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 92172.9us
I20260811 16:05:19.695881 13821 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:19.688900 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.690155 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.603621 18050 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:19.691461 18210 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:19.699254 13820 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 3. Current term is 4. Ops: []
I20260811 16:05:19.674044 18291 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260811 16:05:19.688226 18407 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260811 16:05:19.701215 18242 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:19.680131 18280 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:19.710954 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.712214 13902 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260811 16:05:19.706925 13822 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:05:19.690830 13817 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:19.707562 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:19.703943 18337 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.622501 18390 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.692808 17908 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:19.698122 18012 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:19.728211 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.741245 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.709184 18280 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:19.775074 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.708930 18050 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:19.771497 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 675) took 1937 ms. Trace:
I20260811 16:05:19.718508 18210 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:19.702018 18378 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260811 16:05:19.743885 17908 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.689677 18320 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.721957 18247 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260811 16:05:19.783456 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.818725 13908 raft_consensus.cc:2354] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:19.789880 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.791426 18210 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.792284 18370 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.768929 18372 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260811 16:05:19.773442 18251 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.719s	user 0.014s	sys 0.000s
I20260811 16:05:19.721768 18169 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260811 16:05:19.846783 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.783334 13900 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:19.771320 18297 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:19.850739 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.772738 18373 raft_consensus.cc:2741] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260811 16:05:19.792662 13904 rpcz_store.cc:276] 0811 16:05:17.834350 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.171655 (+337305us) service_pool.cc:227] Handling call
0811 16:05:18.188738 (+ 17083us) raft_consensus.cc:1457] Updating replica for 4 ops
0811 16:05:18.189276 (+   538us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:18.189317 (+    41us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0811 16:05:18.207119 (+ 17802us) log.cc:842] Serialized 104 byte log entry
0811 16:05:18.292238 (+ 85119us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:18.292623 (+   385us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.293032 (+   409us) log.cc:842] Serialized 14 byte log entry
0811 16:05:18.948527 (+655495us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18003c61c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:05:19.318879 (+370352us) log.cc:842] Serialized 14 byte log entry
0811 16:05:19.359778 (+ 40899us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18003c61c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:19.771097 (+411319us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:19.771214 (+   117us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:19.771263 (+    49us) raft_consensus.cc:1671] finished
0811 16:05:19.771277 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:19.771433 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":341766,"prepare.queue_time_us":161409,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":92,"raft.queue_time_us":67048,"raft.run_cpu_time_us":612,"raft.run_wall_time_us":22431,"spinlock_wait_cycles":18771968,"thread_start_us":893292,"threads_started":4,"wal-append.queue_time_us":47718,"wal-append.run_cpu_time_us":3657,"wal-append.run_wall_time_us":1014899}
W20260811 16:05:19.837292 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62309.3us
I20260811 16:05:19.790571 18050 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:19.824869 18299 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:19.817765 18111 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.817764 18281 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.849952 18251 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:05:19.858582 18173 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.885s	user 0.016s	sys 0.001s
I20260811 16:05:19.844296 18362 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.859016 18050 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.860108 18373 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:05:19.860993 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.862550 13903 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:19.864002 18297 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.867130 13902 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:19.831800 18178 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:19.863744 13906 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:19.868098 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.850350 18320 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:19.867623 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.893939 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.900286 13822 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:19.868204 18299 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:19.871762 18194 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:19.865417 18169 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260811 16:05:19.910368 13822 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.914568 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.920166 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.904945 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.922302 13906 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:19.910554 13908 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:19.923728 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 495163us
I20260811 16:05:19.868002 18280 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:19.925279 18280 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:19.925879 17908 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.920261 18247 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:19.910382 18362 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:19.931922 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.932627 13904 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:19.904582 18243 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.913241 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:19.943948 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.945755 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.845747 18012 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:19.948668 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.902781 18337 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.954465 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.936012 18357 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:19.955296 18050 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:19.966713 18250 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:05:19.966895 18322 raft_consensus.cc:1050] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:05:19.968312 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:19.974458 14580 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 6: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:19.975543 13908 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260811 16:05:19.978838 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:19.980278 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:19.986040 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81227.1us
I20260811 16:05:19.986768 13906 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:19.987453 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.932919 18194 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:19.995638 16875 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:19.995777 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.997813 16875 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:19.999120 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:19.998835 16875 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.007021 18242 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.009038 13818 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:20.010082 18242 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:19.956843 18111 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:19.957561 18243 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260811 16:05:19.972379 18173 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:20.017772 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:20.023181 13817 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260811 16:05:20.028551 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 458134us
I20260811 16:05:20.029336 13906 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:20.032510 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:20.033391 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:20.035259 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:20.036193 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.036374 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:20.036423 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.036841 14574 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:20.037642 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:20.038053 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:20.038537 13906 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
W20260811 16:05:20.040555 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 441154us
I20260811 16:05:20.043291 13817 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:20.048019 13825 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:20.048142 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.048435 13825 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:20.048990 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.039527 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:19.989974 18389 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:19.996147 18333 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:20.062472 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:20.026001 18362 raft_consensus.cc:2741] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260811 16:05:20.049139 13825 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.068512 13825 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:19.990828 18247 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260811 16:05:20.041368 18391 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:20.061273 13900 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:20.061359 14574 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:20.063195 13741 raft_consensus.cc:595] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.053412 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.071920 13822 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:20.050150 18242 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:20.081621 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:20.060506 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.089239 13906 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:20.156872 13906 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:05:20.075423 18389 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:20.097442 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260811 16:05:20.158375 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 97960.4us
I20260811 16:05:20.159365 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.024857 18194 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.168970 18242 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.169576 18242 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.170331 18194 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:20.100654 14574 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:20.171875 14579 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:20.172714 18242 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:20.173669 18242 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:20.174221 18242 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:20.175455 18242 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.176952 18362 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:20.178033 18362 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:20.178382 18362 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:20.104498 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:20.057096 18243 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260811 16:05:20.180868 18243 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:20.181339 18243 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:20.182178 18243 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.097775 18391 raft_consensus.cc:2741] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260811 16:05:20.183743 18391 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:20.184082 18391 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:20.184870 18391 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.160642 18389 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:20.187103 18389 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:20.186154 18391 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:20.062249 17888 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260811 16:05:20.110064 18160 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.001s
I20260811 16:05:20.126861 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.061785 18299 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.133889 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.135891 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.215885 14577 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:20.136811 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.118445 18251 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:20.027880 18349 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260811 16:05:20.165637 13904 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
W20260811 16:05:20.149472 18108 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.013s
I20260811 16:05:20.179966 18418 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.161051 18236 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260811 16:05:20.096501 18272 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:20.124272 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 437747us
I20260811 16:05:20.198928 14579 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:20.207371 13908 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260811 16:05:20.163878 18353 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
W20260811 16:05:20.212915 13909 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.024s
W20260811 16:05:20.245771 13909 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.004s	sys 0.024s
I20260811 16:05:20.170950 18194 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:20.218127 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:20.219547 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.018s	sys 0.012s
W20260811 16:05:20.248980 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.018s	sys 0.012s
I20260811 16:05:20.242478 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.252956 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:20.254938 13741 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 9
W20260811 16:05:20.230926 18108 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.013s
I20260811 16:05:20.220932 18363 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:20.249898 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 250853us
I20260811 16:05:20.261952 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.263523 13737 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:20.264926 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.271548 18129 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260811 16:05:20.281212 18307 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:20.271813 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.282755 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.278084 13742 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
W20260811 16:05:20.250589 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 662275us
I20260811 16:05:20.278030 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.285992 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:20.284279 13735 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:20.287683 13741 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:20.282905 13738 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:20.289274 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:20.289644 18307 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:20.290926 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:20.249558 18418 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.302009 18418 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:20.218645 18362 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.303822 18362 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:20.259873 18154 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.311036 18154 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.245111 18419 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:20.313405 18419 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:20.313941 18419 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:20.279497 13739 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:20.332525 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:20.335294 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57337.2us
I20260811 16:05:20.337261 13789 leader_election.cc:398] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:20.337791 13789 leader_election.cc:401] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260811 16:05:20.341126 18029 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:20.346628 13826 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:20.349285 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.350242 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:20.352743 14578 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:20.353931 14582 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:20.355695 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:20.286389 18281 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.073s
I20260811 16:05:20.359840 18281 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:20.360245 18281 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:20.361032 18281 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.362313 18281 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:20.259958 18178 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:20.363365 18178 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:20.363818 18178 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:20.285368 18299 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:20.368381 18108 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:20.369413 18181 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:20.369817 18181 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:20.317118 18363 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.375242 18029 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:20.375741 18029 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:20.376179 18029 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:20.375792 18337 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:05:20.385620 18251 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:20.386473 18251 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:20.388022 18251 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.394644 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:20.396138 18371 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:20.399868 14581 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:20.426003 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141437us
I20260811 16:05:20.426878 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.432770 13825 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:20.435283 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:20.426993 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.436987 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.438913 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:20.443926 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:20.446112 13825 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:20.448433 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111348us
I20260811 16:05:20.449636 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.459935 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.475097 13739 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:20.478899 18388 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.002s
I20260811 16:05:20.439893 18421 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:20.482450 13739 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:20.483568 13905 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.018s	sys 0.029s
W20260811 16:05:20.490257 13905 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.018s	sys 0.029s
I20260811 16:05:20.492568 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:20.493077 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.493242 13900 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:20.488807 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61904.2us
I20260811 16:05:20.495812 18353 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:05:19.590149 13901 rpcz_store.cc:276] 0811 16:05:18.264757 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.817045 (+552288us) service_pool.cc:227] Handling call
0811 16:05:18.817425 (+   380us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:18.817700 (+   275us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:05:19.010655 (+192955us) log.cc:842] Serialized 14 byte log entry
0811 16:05:19.570675 (+560020us) log.cc:842] Serialized 14 byte log entry
0811 16:05:19.570839 (+   164us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:19.570882 (+    43us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:19.570932 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:19.571004 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:19.571119 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":157186,"prepare.queue_time_us":274431,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":160302,"spinlock_wait_cycles":1594752,"thread_start_us":584518,"threads_started":2}
I20260811 16:05:20.497628 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:20.498018 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:20.498776 18108 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:20.499205 18108 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:20.499567 18108 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:20.479524 18320 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.500735 18320 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:20.451821 18390 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.015s	sys 0.030s
W20260811 16:05:20.503551 18390 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.015s	sys 0.030s
I20260811 16:05:20.504230 18390 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Leader election lost for term 7. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 7. Current term is 8.
I20260811 16:05:20.504415 17888 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:20.504824 17908 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:20.505136 18390 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:20.505277 17908 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:20.506125 17908 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.507045 18178 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.508245 13908 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:20.504830 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 744) took 4520 ms. Trace:
I20260811 16:05:20.509471 13824 rpcz_store.cc:276] 0811 16:05:15.984785 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:15.984916 (+   131us) service_pool.cc:227] Handling call
0811 16:05:18.663245 (+2678329us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:18.663851 (+   606us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:20.504611 (+1840760us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b5400240c50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:20.504747 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6123727104}
I20260811 16:05:20.458071 18160 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:20.511451 18160 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:20.511835 18160 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:20.470407 18194 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:20.515858 18194 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:20.440442 18418 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:20.523567 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2427) took 2065 ms. Trace:
I20260811 16:05:20.370657 18181 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.476928 18163 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:20.477241 18154 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:20.521247 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.473382 18050 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:20.535580 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.502962 18320 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:20.540419 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.540419 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.517099 18194 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.479923 18272 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:20.524770 17908 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:20.521344 18328 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.562088 18328 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:20.565337 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44212.9us
I20260811 16:05:20.566411 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:20.571733 13903 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.018s
W20260811 16:05:20.573659 13903 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.015s	sys 0.018s
I20260811 16:05:20.581977 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:20.587280 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2426) took 2194 ms. Trace:
I20260811 16:05:20.595729 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:20.593845 13907 rpcz_store.cc:276] 0811 16:05:18.393204 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.822965 (+429761us) service_pool.cc:227] Handling call
0811 16:05:18.823365 (+   400us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:19.528235 (+704870us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:19.528268 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:19.564013 (+ 35745us) log.cc:842] Serialized 26 byte log entry
0811 16:05:20.083925 (+519912us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:20.581360 (+497435us) log.cc:842] Serialized 14 byte log entry
0811 16:05:20.586954 (+  5594us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:20.587028 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:20.587078 (+    50us) raft_consensus.cc:1671] finished
0811 16:05:20.587088 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:20.587223 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":848588,"raft.queue_time_us":709578,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6106,"thread_start_us":826146,"threads_started":2,"wal-append.queue_time_us":829552}
I20260811 16:05:20.597942 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.491228 18388 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.525985 17962 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260811 16:05:20.570061 18363 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:20.604102 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.571404 18154 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:20.545038 18182 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260811 16:05:20.569222 18367 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260811 16:05:20.547318 18163 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:20.607586 13739 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260811 16:05:20.610474 13821 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.016s	sys 0.023s
I20260811 16:05:20.611563 18169 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:20.598080 18337 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260811 16:05:20.609242 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.615020 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.582186 18297 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:20.580444 18320 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:20.594049 13900 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:20.635125 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.783553 13736 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:20.784407 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 175275us
I20260811 16:05:20.693269 13902 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260811 16:05:20.785400 13902 pending_rounds.cc:76] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 8
I20260811 16:05:20.785362 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:20.786023 13902 pending_rounds.cc:97] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260811 16:05:20.780819 13821 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.020s	sys 0.030s
I20260811 16:05:20.786599 13902 raft_consensus.cc:2866] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:20.680310 13743 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260811 16:05:20.729384 18169 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:20.629509 16875 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.018s	sys 0.029s
W20260811 16:05:20.727427 18389 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.001s
W20260811 16:05:20.692255 18210 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.012s
W20260811 16:05:20.631322 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.017s	sys 0.021s
W20260811 16:05:20.852159 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.020s	sys 0.028s
W20260811 16:05:20.852918 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 799571us
I20260811 16:05:20.853781 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:20.858377 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:20.860288 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:20.607080 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.014s	sys 0.030s
W20260811 16:05:20.705154 18173 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.004s
I20260811 16:05:20.608995 13709 leader_election.cc:398] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9.
I20260811 16:05:20.861654 13709 leader_election.cc:401] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:05:20.861678 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.020s	sys 0.043s
W20260811 16:05:20.676080 18426 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260811 16:05:20.710984 18148 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.031s	user 0.008s	sys 0.010s
I20260811 16:05:20.798157 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:20.801940 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.006s	sys 0.021s
W20260811 16:05:20.783389 18333 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.001s
W20260811 16:05:20.841099 16875 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.022s	sys 0.045s
W20260811 16:05:20.843215 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 228262us
W20260811 16:05:20.878119 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.011s	sys 0.024s
I20260811 16:05:20.747759 18178 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:20.781746 18429 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:20.850677 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:20.692449 18242 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.013s
W20260811 16:05:20.781543 18012 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.017s
W20260811 16:05:20.720613 18111 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.043s
I20260811 16:05:20.649833 18363 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:20.615437 18421 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260811 16:05:20.871949 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:05:20.871802 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 300813us
I20260811 16:05:20.940858 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:20.684331 18328 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:20.790464 18297 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.695030 18419 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.886389 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:20.891605 18242 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.017s	sys 0.013s
W20260811 16:05:20.887992 14582 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.025s
W20260811 16:05:20.980792 14582 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.013s	sys 0.026s
W20260811 16:05:20.852085 18210 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.012s	sys 0.022s
I20260811 16:05:20.889153 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:20.984998 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:20.891528 18050 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.880926 16875 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:20.733170 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:20.935460 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:20.994814 13741 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:20.936096 14574 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:05:20.960702 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:20.889151 18262 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9.
I20260811 16:05:20.631111 18437 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.275s
W20260811 16:05:20.891454 18012 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.013s	sys 0.018s
I20260811 16:05:20.888891 18149 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:05:20.891455 18333 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:05:20.900161 18243 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.001s	sys 0.038s
W20260811 16:05:20.935352 18111 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.009s	sys 0.052s
I20260811 16:05:20.872061 18427 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:20.886821 18163 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:21.008257 18424 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
I20260811 16:05:20.799985 18169 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:20.880802 18418 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:21.009852 18388 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:20.968879 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:21.007349 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:21.007529 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:20.958046 18421 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:20.952466 18148 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:20.854568 18389 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.936090 18362 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260811 16:05:20.976433 18438 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:20.982120 18174 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:20.882352 18425 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260811 16:05:20.999639 18378 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:20.991467 18154 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:21.014195 18210 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:21.051345 18163 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:21.008857 18050 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:21.038403 18430 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260811 16:05:21.022929 18367 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:20.880885 18173 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:21.031250 18437 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.979570 18297 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:20.956156 18178 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:20.680745 18390 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.207s
I20260811 16:05:21.042490 18427 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:20.969831 18429 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:21.029078 18243 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.005s	sys 0.041s
I20260811 16:05:21.070999 18421 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:05:21.098503 18174 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.086318 18438 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:21.099282 18418 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:21.102594 18251 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:21.121855 18431 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260811 16:05:21.122766 17981 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:21.106482 18210 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:21.143239 18435 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260811 16:05:21.144004 18169 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:21.120048 18178 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:21.095341 18148 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.158689 18429 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:21.134397 18333 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:21.146426 18251 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:21.123546 18427 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:21.144847 18187 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:21.178041 18187 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:21.178205 18169 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:21.180145 18178 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:21.178980 18187 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.181226 18187 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:21.183573 18250 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.186232 18427 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.132519 18418 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:21.187358 18418 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:21.187481 18297 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:21.187772 18181 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:21.188408 18427 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:21.189617 18210 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:21.190245 18419 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:21.108026 18163 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.191036 18109 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:21.191498 18109 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:21.192334 18109 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.193061 18163 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:21.132272 18438 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:21.193632 18109 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:21.119647 18437 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:21.197773 18437 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:21.198320 18333 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.200996 18333 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:21.202859 18174 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:21.171840 18429 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:21.203740 18429 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.206312 18429 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:21.172384 18251 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:21.206861 18299 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.000s
I20260811 16:05:21.208498 18148 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:21.307485 13738 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.017s	sys 0.039s
W20260811 16:05:21.355979 13738 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.018s	sys 0.040s
I20260811 16:05:21.356529 18111 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:21.356721 18112 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:21.357183 18111 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:20.939919 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:20.997816 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:21.523329 18465 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:22.192669 18465 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.194864 18038 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:22.195497 18465 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:21.660058 18479 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:21.312176 13817 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:21.323683 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.225068 18502 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:21.628880 13822 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:21.316167 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 766) took 2219 ms. Trace:
I20260811 16:05:22.228314 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40896 (request call id 2492) took 2702 ms. Trace:
I20260811 16:05:21.313529 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1763) took 1283 ms. Trace:
W20260811 16:05:21.523926 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.024s	sys 0.015s
W20260811 16:05:21.313565 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.008s	sys 0.002s
W20260811 16:05:22.233901 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.783s	user 0.009s	sys 0.003s
I20260811 16:05:21.362351 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:22.268944 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 907034us
W20260811 16:05:21.315304 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 771) took 1909 ms (client timeout 1861 ms). Trace:
I20260811 16:05:21.602345 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:22.273165 13827 rpcz_store.cc:269] 0811 16:05:19.151393 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.151563 (+   170us) service_pool.cc:227] Handling call
0811 16:05:20.968617 (+1817054us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:05:21.060565 (+ 91948us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5007232}
W20260811 16:05:22.274644 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 672560us
I20260811 16:05:22.274775 18165 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:21.086440 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:21.551968 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2439) took 1060 ms. Trace:
I20260811 16:05:22.283242 13902 rpcz_store.cc:276] 0811 16:05:20.491041 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.491210 (+   169us) service_pool.cc:227] Handling call
0811 16:05:20.491579 (+   369us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:20.787310 (+295731us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.508882 (+721572us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:21.551576 (+ 42694us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":462681984}
I20260811 16:05:21.334661 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2176) took 1472 ms. Trace:
I20260811 16:05:22.287748 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:22.288870 13824 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:22.290472 18322 raft_consensus.cc:1054] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }.
  Pending config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.295928 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.297173 13825 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:21.600096 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2437) took 1109 ms. Trace:
I20260811 16:05:21.336174 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2428) took 2877 ms. Trace:
I20260811 16:05:22.303818 13908 rpcz_store.cc:276] 0811 16:05:20.490032 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.490204 (+   172us) service_pool.cc:227] Handling call
0811 16:05:20.503639 (+ 13435us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:20.508612 (+  4973us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.599275 (+1090663us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b54002c06d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:21.599747 (+   472us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10202368}
W20260811 16:05:21.340433 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 362291us
W20260811 16:05:21.456925 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 567631us
I20260811 16:05:21.512435 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 937) took 2055 ms. Trace:
I20260811 16:05:21.673772 14574 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:22.338649 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:21.528003 14580 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:22.340560 18322 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:22.341177 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.342096 13737 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:22.323995 14573 rpcz_store.cc:276] 0811 16:05:19.457236 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.459253 (+  2017us) service_pool.cc:227] Handling call
0811 16:05:19.459614 (+   361us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:19.598093 (+138479us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:19.598141 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:19.598203 (+    62us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:19.598252 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.511816 (+1913564us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54005c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:21.511901 (+    85us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:21.512218 (+   317us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8937,"raft.queue_time_us":83619,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11881,"spinlock_wait_cycles":296901376}
I20260811 16:05:21.513854 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 941) took 1412 ms. Trace:
I20260811 16:05:21.640105 17384 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:22.345569 14573 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:22.346197 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:21.578027 17908 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.017s	user 0.012s	sys 0.016s
I20260811 16:05:22.349181 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.350225 13737 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
W20260811 16:05:21.358786 18108 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.004s
I20260811 16:05:22.372777 18108 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.368554 18111 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:21.470273 18149 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:05:22.389245 18149 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:22.389865 18149 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.568032 18151 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.393131 18322 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:22.394172 18151 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:21.369975 18163 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.428319 18163 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.430799 18163 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:21.210089 18160 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.001s
I20260811 16:05:22.449461 18160 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.450088 18515 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:22.450582 18515 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:21.368105 18181 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:22.451797 18515 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.453411 18515 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:22.452768 18181 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:05:21.369129 18182 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:21.684528 18236 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:21.663789 18050 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.470927 18236 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:21.211387 18281 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.003s
I20260811 16:05:21.521088 18286 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:21.684521 18251 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:21.482507 18363 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.008s
I20260811 16:05:22.480551 18363 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:21.596143 18320 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.802s	user 0.000s	sys 0.023s
I20260811 16:05:22.482034 18320 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:21.625326 18391 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.424s	user 0.012s	sys 0.013s
I20260811 16:05:21.181226 18389 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:21.634838 18418 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:22.485075 13630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 308) took 31257 ms (client timeout 15000 ms). Trace:
I20260811 16:05:21.511193 18420 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:21.574085 18438 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.489452 18418 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:21.177300 18440 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260811 16:05:21.928885 13735 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:22.039187 17955 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.060057 18280 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.084239 18496 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.092159 18497 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.100299 18498 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:22.501956 17955 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.502274 18496 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.503083 18498 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.504885 18496 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.504923 17955 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.505270 18498 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.101694 18499 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.506000 18497 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.506138 18499 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.508484 18497 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.509124 18499 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.111799 18112 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:22.115996 18490 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.495s	user 0.001s	sys 0.003s
I20260811 16:05:22.510120 18112 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:22.120831 13617 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.014s	sys 0.014s
I20260811 16:05:22.512436 18112 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.145368 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 695) took 1055 ms. Trace:
I20260811 16:05:22.141651 17927 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.148499 18372 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.513489 18280 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.514034 18372 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.513000 13907 rpcz_store.cc:276] 0811 16:05:21.089950 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.633910 (+543960us) service_pool.cc:227] Handling call
0811 16:05:21.634667 (+   757us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:21.635081 (+   414us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:05:21.635761 (+   680us) log.cc:842] Serialized 14 byte log entry
0811 16:05:22.144823 (+509062us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:22.144889 (+    66us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:22.144950 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.145025 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:22.145172 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":461352,"prepare.queue_time_us":190,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":462572,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":46885,"threads_started":1,"wal-append.queue_time_us":277257}
I20260811 16:05:22.515511 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:22.147593 18210 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.515949 18280 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:22.485786 13630 rpcz_store.cc:269] 0811 16:04:51.249837 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:51.279490 (+ 29653us) service_pool.cc:227] Handling call
0811 16:05:22.484707 (+31205217us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:05:16.880029 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:05:17.075966 (+195937us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:05:17.076026 (+    60us) write_op.cc:435] Acquired schema lock
0811 16:05:17.076039 (+    13us) tablet.cc:660] Decoding operations
0811 16:05:17.077651 (+  1612us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:05:17.077767 (+   116us) write_op.cc:641] Partition lock acquired for write op
0811 16:05:17.077804 (+    37us) tablet.cc:683] Acquiring locks for 17 operations
0811 16:05:17.100482 (+ 22678us) tablet.cc:699] Row locks acquired
0811 16:05:17.109546 (+  9064us) write_op.cc:260] PREPARE: finished
0811 16:05:17.161595 (+ 52049us) write_op.cc:270] Start()
0811 16:05:17.205682 (+ 44087us) write_op.cc:276] Timestamp: P: 1786464317136729 usec, L: 0
0811 16:05:17.208062 (+  2380us) op_driver.cc:331] REPLICATION: starting
0811 16:05:17.318810 (+110748us) log.cc:842] Serialized 6749 byte log entry
0811 16:05:18.180532 (+861722us) op_driver.cc:444] REPLICATION: finished
0811 16:05:18.461034 (+280502us) write_op.cc:301] APPLY: starting
0811 16:05:18.462497 (+  1463us) tablet.cc:1365] starting BulkCheckPresence
0811 16:05:18.549644 (+ 87147us) tablet.cc:1368] finished BulkCheckPresence
0811 16:05:18.549775 (+   131us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:05:18.604568 (+ 54793us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:05:18.623745 (+ 19177us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0811 16:05:18.628743 (+  4998us) write_op.cc:312] APPLY: finished
0811 16:05:18.631069 (+  2326us) log.cc:842] Serialized 119 byte log entry
0811 16:05:18.631368 (+   299us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:18.631673 (+   305us) write_op.cc:454] Released schema lock
0811 16:05:18.631749 (+    76us) write_op.cc:341] FINISH: Updating metrics
0811 16:05:18.632207 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:18.632238 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":876801,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":267986,"apply.run_cpu_time_us":7140,"apply.run_wall_time_us":180133,"num_ops":17,"prepare.queue_time_us":405848,"prepare.run_cpu_time_us":43910,"prepare.run_wall_time_us":641463,"raft.queue_time_us":261099,"raft.run_cpu_time_us":78686,"raft.run_wall_time_us":210025,"replication_time_us":972341,"thread_start_us":609236,"threads_started":4,"wal-append.queue_time_us":301315,"wal-append.run_cpu_time_us":50883,"wal-append.run_wall_time_us":2006434}]]}
I20260811 16:05:22.516454 18372 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.176681 17781 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.516390 18210 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:22.196846 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.19895e+06us
I20260811 16:05:22.196537 18479 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.518651 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.518513 17781 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.519918 18210 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.520103 18479 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.520838 17781 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.208020 18439 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:22.522457 18439 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.523567 13741 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:22.524129 18225 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.513233 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2442) took 1427 ms. Trace:
I20260811 16:05:22.524967 18439 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.524817 18225 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.212594 18328 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.525144 13904 rpcz_store.cc:276] 0811 16:05:21.085356 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.085512 (+   156us) service_pool.cc:227] Handling call
0811 16:05:21.104175 (+ 18663us) raft_consensus.cc:1457] Updating replica for 4 ops
0811 16:05:21.603709 (+499534us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:21.603792 (+    83us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0811 16:05:21.605462 (+  1670us) log.cc:842] Serialized 104 byte log entry
0811 16:05:21.611283 (+  5821us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:21.616088 (+  4805us) log.cc:842] Serialized 14 byte log entry
0811 16:05:21.617974 (+  1886us) log.cc:842] Serialized 14 byte log entry
0811 16:05:21.618567 (+   593us) log.cc:842] Serialized 14 byte log entry
0811 16:05:21.622837 (+  4270us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.624092 (+  1255us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:22.094289 (+470197us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b1800471ee0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c557b4bcf 00007f5c4e9e47b6 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d
0811 16:05:22.115285 (+ 20996us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:22.277865 (+162580us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b1800471ee0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:22.512830 (+234965us) raft_consensus.cc:1671] finished
0811 16:05:22.512853 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:22.513051 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12675,"prepare.queue_time_us":10091,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":119,"raft.queue_time_us":514345,"raft.run_cpu_time_us":549,"raft.run_wall_time_us":14335,"spinlock_wait_cycles":16758912,"thread_start_us":481495,"threads_started":2,"wal-append.queue_time_us":14705}
I20260811 16:05:22.526674 18328 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.527666 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:22.528445 13904 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:22.528844 18328 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.526907 18225 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.529789 17927 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.532142 17927 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.217069 18247 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.217772 17906 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.513227 13818 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.223424 18038 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.225934 18502 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.228708 13822 rpcz_store.cc:276] 0811 16:05:19.534635 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.688610 (+153975us) service_pool.cc:227] Handling call
0811 16:05:21.626471 (+1937861us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002dcdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51903da7 00007f5c5684fee0 00007f5c4ff41784 00007f5c4ff41712 00007f5c4ff41641 00007f5c4ff415bc 00007f5c4ff40872 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.228146 (+601675us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":425743744}
I20260811 16:05:22.229490 13821 rpcz_store.cc:276] 0811 16:05:20.030088 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.030255 (+   167us) service_pool.cc:227] Handling call
0811 16:05:20.065770 (+ 35515us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:20.786837 (+721067us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:20.786868 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:20.787395 (+   527us) log.cc:842] Serialized 26 byte log entry
0811 16:05:21.312385 (+524990us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:21.312532 (+   147us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.312758 (+   226us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:21.312871 (+   113us) raft_consensus.cc:1671] finished
0811 16:05:21.312895 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:21.313265 (+   370us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":81348,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":1175160,"threads_started":2,"wal-append.queue_time_us":434108}
I20260811 16:05:22.228482 13823 rpcz_store.cc:276] 0811 16:05:19.096789 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.102336 (+  5547us) service_pool.cc:227] Handling call
0811 16:05:19.526265 (+423929us) spinlock_profiling.cc:243] Waited 963 us on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:19.526475 (+   210us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:19.526703 (+   228us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:05:19.997329 (+470626us) log.cc:842] Serialized 14 byte log entry
0811 16:05:21.315226 (+1317897us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:21.315380 (+   154us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:21.315513 (+   133us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.315645 (+   132us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:21.315928 (+   283us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":679736,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2947,"raft.queue_time_us":172868,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10317,"spinlock_wait_cycles":2215808,"thread_start_us":1785902,"threads_started":3,"wal-append.queue_time_us":1122257,"wal-append.run_cpu_time_us":3828,"wal-append.run_wall_time_us":1042122}
W20260811 16:05:22.239995 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.79031e+06us
I20260811 16:05:22.248486 18297 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:22.540571 18502 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.262415 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1189) took 1345 ms. Trace:
I20260811 16:05:22.541374 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:22.541474 14577 rpcz_store.cc:276] 0811 16:05:20.917049 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.917376 (+   327us) service_pool.cc:227] Handling call
0811 16:05:20.957398 (+ 40022us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:21.346655 (+389257us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:21.346717 (+    62us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:21.346804 (+    87us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:21.346887 (+    83us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.261979 (+915092us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54006603d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:22.262036 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:22.262238 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":893112576}
I20260811 16:05:22.543160 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.543937 14577 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:22.545017 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.545840 14577 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:21.067657 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:22.275532 18485 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:22.276144 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.279856 18148 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.556499 13900 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:22.557097 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2441) took 1502 ms. Trace:
I20260811 16:05:22.556907 18148 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.557489 13900 rpcz_store.cc:276] 0811 16:05:21.054345 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.067242 (+ 12897us) service_pool.cc:227] Handling call
0811 16:05:22.557009 (+1489767us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:22.557396 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.558717 13738 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.281334 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1768) took 1836 ms. Trace:
I20260811 16:05:22.287846 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:21.337675 13906 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:05:22.583628 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2445) took 1494 ms. Trace:
I20260811 16:05:22.583904 13906 rpcz_store.cc:276] 0811 16:05:21.089031 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.335939 (+246908us) service_pool.cc:227] Handling call
0811 16:05:21.336740 (+   801us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.583387 (+1246647us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.583575 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:22.298700 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.304464 13909 rpcz_store.cc:276] 0811 16:05:18.458124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.826246 (+368122us) service_pool.cc:227] Handling call
0811 16:05:18.862877 (+ 36631us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:19.659353 (+796476us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:19.659384 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:19.659857 (+   473us) log.cc:842] Serialized 26 byte log entry
0811 16:05:20.246170 (+586313us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:20.246240 (+    70us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:20.246311 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:21.335542 (+1089231us) raft_consensus.cc:1671] finished
0811 16:05:21.335583 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:21.335961 (+   378us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":754358,"raft.queue_time_us":810405,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11179,"thread_start_us":585898,"threads_started":1,"wal-append.queue_time_us":908794,"wal-append.run_cpu_time_us":13560,"wal-append.run_wall_time_us":1660326}
I20260811 16:05:22.285485 13903 rpcz_store.cc:276] 0811 16:05:19.861808 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.940124 (+ 78316us) service_pool.cc:227] Handling call
0811 16:05:19.940591 (+   467us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:19.955005 (+ 14414us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:19.955054 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:20.011343 (+ 56289us) log.cc:842] Serialized 52 byte log entry
0811 16:05:20.575547 (+564204us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:21.042346 (+466799us) log.cc:842] Serialized 14 byte log entry
0811 16:05:21.077672 (+ 35326us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.077803 (+   131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:21.333575 (+255772us) raft_consensus.cc:1671] finished
0811 16:05:21.333668 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:21.334206 (+   538us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":65251,"prepare.queue_time_us":314201,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":93627,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":25087,"thread_start_us":1015556,"threads_started":2,"wal-append.queue_time_us":968183,"wal-append.run_cpu_time_us":5577,"wal-append.run_wall_time_us":1190997}
I20260811 16:05:22.327219 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:22.331512 18504 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:22.331822 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:22.332712 13625 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 7 to 8, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 8 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:22.334717 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.337713 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:22.338079 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.339195 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:21.349725 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:22.339937 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:22.233151 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.028s	sys 0.015s
I20260811 16:05:22.342388 17981 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:22.343672 14581 rpcz_store.cc:276] 0811 16:05:20.101335 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.101482 (+   147us) service_pool.cc:227] Handling call
0811 16:05:20.399683 (+298201us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:20.400378 (+   695us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:21.513371 (+1112993us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54005401d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:21.513620 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":656277376}
I20260811 16:05:21.351500 14583 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:21.574029 16875 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.004s
W20260811 16:05:22.640250 16875 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.646s	user 0.008s	sys 0.007s
I20260811 16:05:22.640555 16875 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:22.641662 16875 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.347527 14573 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260811 16:05:21.352883 18029 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.976s	user 0.016s	sys 0.008s
I20260811 16:05:22.645706 18029 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.342274 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 971) took 2308 ms. Trace:
I20260811 16:05:22.354718 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:22.647339 13740 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:22.646950 18479 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.648274 18479 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.355370 18459 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.343012 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:22.366647 13824 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:22.367995 17384 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:22.368525 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:22.646922 14580 rpcz_store.cc:276] 0811 16:05:20.033345 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.035001 (+  1656us) service_pool.cc:227] Handling call
0811 16:05:21.527346 (+1492345us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.340910 (+813564us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.342026 (+  1116us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54005c7e50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.342183 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3431140736}
I20260811 16:05:22.385422 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.391935 14575 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 4.
I20260811 16:05:22.395993 13744 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:22.427175 18151 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:21.360807 18178 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.688256 18178 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.431465 13901 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:22.693053 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2443) took 1607 ms. Trace:
I20260811 16:05:22.693504 13901 rpcz_store.cc:276] 0811 16:05:21.085913 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.086056 (+   143us) service_pool.cc:227] Handling call
0811 16:05:22.692799 (+1606743us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400034dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.692975 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":356040448}
I20260811 16:05:22.436625 18149 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.419492 17908 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.438261 18514 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:22.440559 18463 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:22.441140 18510 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:22.442071 18111 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:22.698158 18510 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.701004 18510 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.701808 17908 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.438661 18500 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.703536 18500 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.704717 17908 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.442713 18108 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.450914 14578 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:22.706269 18500 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.470021 18182 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.708946 18182 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.474522 18236 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.474718 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:22.476994 18286 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:22.710738 18286 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.712232 18286 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:22.477749 18050 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.715502 18050 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.717535 18050 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.478632 18160 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.481485 18251 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:21.227347 18421 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.720508 18050 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:22.720985 18050 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:22.721330 18050 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:22.722486 18421 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.487687 14582 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
W20260811 16:05:22.489435 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 75725.4us
I20260811 16:05:22.724356 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 955) took 1766 ms. Trace:
I20260811 16:05:22.492529 18181 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.464318 18163 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:22.487660 18420 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.495167 18438 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.502271 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 826) took 1752 ms. Trace:
W20260811 16:05:22.512499 13617 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.015s	sys 0.014s
W20260811 16:05:22.730217 13617 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 1.454s	user 0.015s	sys 0.014s
I20260811 16:05:20.526896 13905 rpcz_store.cc:276] 0811 16:05:18.457791 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:18.823917 (+366126us) service_pool.cc:227] Handling call
0811 16:05:18.858307 (+ 34390us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:19.533343 (+675036us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:19.533378 (+    35us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:19.559476 (+ 26098us) log.cc:842] Serialized 52 byte log entry
0811 16:05:19.906266 (+346790us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:20.490979 (+584713us) log.cc:842] Serialized 14 byte log entry
0811 16:05:20.521610 (+ 30631us) log.cc:842] Serialized 14 byte log entry
0811 16:05:20.523254 (+  1644us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:20.523330 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:20.523372 (+    42us) raft_consensus.cc:1671] finished
0811 16:05:20.523387 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:20.523511 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":699878,"raft.queue_time_us":716092,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8706,"thread_start_us":865968,"threads_started":2,"wal-append.queue_time_us":564626}
I20260811 16:05:22.728343 18160 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.533711 18247 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.732867 18247 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.731168 17384 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.539983 18297 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.250906 18503 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.731235 18160 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.546376 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.547132 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.547132 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.548306 18502 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:22.540522 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.554385 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1774) took 1235 ms. Trace:
I20260811 16:05:22.564388 13820 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:22.559497 13817 rpcz_store.cc:276] 0811 16:05:20.445314 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.445510 (+   196us) service_pool.cc:227] Handling call
0811 16:05:20.445950 (+   440us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.198717 (+1752767us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.280953 (+ 82236us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54000d5554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:22.281243 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1990053120}
I20260811 16:05:22.567595 13900 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:05:22.573328 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.734578 17384 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.735960 18297 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.735656 13818 rpcz_store.cc:276] 0811 16:05:21.321664 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.323102 (+  1438us) service_pool.cc:227] Handling call
0811 16:05:22.554147 (+1231045us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.554301 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":661251328}
I20260811 16:05:22.736562 13741 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:22.545951 18038 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.737154 18420 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.737576 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.738269 13741 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.572669 18439 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:22.739558 18439 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.562561 18148 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.593242 18418 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:22.594348 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.597033 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:22.599655 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 268031us
I20260811 16:05:22.600443 13906 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:05:22.602195 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.605433 18187 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:22.606845 18504 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.607571 18497 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:22.603173 13871 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 2.502s (SENT) [suppressed 27 similar messages]
I20260811 16:05:22.745115 14577 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.615054 13742 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:22.617812 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:22.609040 13625 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 3 to 4, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:22.629626 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.624507 17981 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:22.630255 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 943) took 2512 ms (client timeout 2502 ms). Trace:
W20260811 16:05:22.637507 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.78684e+06us
I20260811 16:05:22.643658 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1200) took 1252 ms. Trace:
I20260811 16:05:22.651921 18479 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.652809 14579 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:22.755225 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 137532us
I20260811 16:05:22.750851 14581 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.757728 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1199) took 1409 ms. Trace:
I20260811 16:05:22.656430 13737 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260811 16:05:22.666919 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2081) took 3432 ms (client timeout 1764 ms). Trace:
W20260811 16:05:22.759430 13744 rpcz_store.cc:269] 0811 16:05:19.234436 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:19.234644 (+   208us) service_pool.cc:227] Handling call
0811 16:05:22.666646 (+3432002us) spinlock_profiling.cc:243] Waited 3.16 s on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.666807 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7267405184}
I20260811 16:05:22.659078 18029 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:22.751667 14583 rpcz_store.cc:269] 0811 16:05:20.117617 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.117878 (+   261us) service_pool.cc:227] Handling call
0811 16:05:22.628909 (+2511031us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.630173 (+  1264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2611258752}
I20260811 16:05:22.756644 18187 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.761396 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.671414 17927 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260811 16:05:22.673468 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1191) took 1754 ms (client timeout 1698 ms). Trace:
I20260811 16:05:22.677953 18485 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.761487 17981 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.758728 18504 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.764840 18485 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.766345 18187 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.766763 18504 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.767892 18485 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.657263 18459 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.695339 18514 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.695508 18463 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:22.719280 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 244749us
I20260811 16:05:22.706902 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1188) took 1790 ms. Trace:
I20260811 16:05:22.485129 18449 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.724678 14582 rpcz_store.cc:276] 0811 16:05:20.957913 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.351748 (+393835us) service_pool.cc:227] Handling call
0811 16:05:21.352525 (+   777us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.723251 (+1370726us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.724114 (+   863us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54005703d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:22.724295 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2608626560}
I20260811 16:05:22.538475 17906 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.726747 18163 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.736393 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.812105 13738 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:22.529790 18280 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260811 16:05:22.737818 18503 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.740273 17384 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.591078 18129 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.826889 17906 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.811094 18439 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.827435 18129 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.828179 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.828936 14582 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:22.830205 18129 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.740828 13821 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.830390 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:22.734615 13823 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.730014 13735 rpcz_store.cc:276] 0811 16:05:20.750095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.750339 (+   244us) service_pool.cc:227] Handling call
0811 16:05:20.750809 (+   470us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.497741 (+1746932us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.500024 (+  2283us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:22.502170 (+  2146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1265354112}
I20260811 16:05:22.742882 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.832231 13741 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:22.751852 14573 rpcz_store.cc:276] 0811 16:05:21.393634 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:22.346673 (+953039us) service_pool.cc:227] Handling call
0811 16:05:22.347037 (+   364us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.643320 (+296283us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.643566 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:22.755203 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:22.755376 18111 raft_consensus.cc:2741] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260811 16:05:22.755878 13739 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.755959 18038 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:22.659961 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 291597us
I20260811 16:05:22.758785 14579 rpcz_store.cc:276] 0811 16:05:21.348413 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:21.348928 (+   515us) service_pool.cc:227] Handling call
0811 16:05:22.757675 (+1408747us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:22.680035 13740 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:22.681351 18151 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:22.841701 18151 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:22.843216 14579 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:05:22.844103 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.843874 18151 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.845335 18151 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:22.762389 14575 rpcz_store.cc:269] 0811 16:05:20.917935 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.976411 (+ 58476us) service_pool.cc:227] Handling call
0811 16:05:22.670262 (+1693851us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540056ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:22.672130 (+  1868us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3060303232}
I20260811 16:05:22.777788 14583 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:22.780875 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:22.846845 14581 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:22.845767 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.782517 18514 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.784997 13625 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 1 to 5, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 5 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:22.788621 18459 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.789264 18502 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:05:22.779630 14578 rpcz_store.cc:276] 0811 16:05:20.916511 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:20.916700 (+   189us) service_pool.cc:227] Handling call
0811 16:05:20.976305 (+ 59605us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.705852 (+1729547us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.706558 (+   706us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54004e02d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:22.706829 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3390479744}
I20260811 16:05:22.743502 18178 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.821437 18438 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:22.858328 18438 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.758926 18497 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.859043 18439 raft_consensus.cc:2741] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260811 16:05:22.859372 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.860863 18497 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.861122 14583 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:22.862150 13817 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
W20260811 16:05:22.863284 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47792.1us
W20260811 16:05:22.863570 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 108577us
I20260811 16:05:22.864409 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:22.863731 13625 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:22.864912 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:22.849896 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:22.857605 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.867293 18050 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.868146 13818 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:22.869329 18463 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.870040 18463 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:22.832856 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:22.867324 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53344.7us
I20260811 16:05:22.872457 14582 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:22.874199 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1202) took 1200 ms. Trace:
W20260811 16:05:22.840845 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 237704us
I20260811 16:05:22.767212 17927 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:22.781436 17981 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:22.781917 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:22.876705 14577 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 9
I20260811 16:05:22.831571 18504 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:22.834231 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:22.881597 13825 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.852269 13823 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:22.853029 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1201) took 1377 ms. Trace:
I20260811 16:05:22.847937 13907 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:22.857549 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.874670 14580 rpcz_store.cc:276] 0811 16:05:21.673448 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:22.654439 (+980991us) service_pool.cc:227] Handling call
0811 16:05:22.665969 (+ 11530us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.667606 (+  1637us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:22.669768 (+  2162us) log.cc:842] Serialized 14 byte log entry
0811 16:05:22.873872 (+204104us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:22.873921 (+    49us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:22.873973 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.874035 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:22.874145 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8674,"prepare.queue_time_us":1815,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":170415,"threads_started":1}
I20260811 16:05:22.814155 18449 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:22.885948 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:22.889564 18499 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:22.891469 13820 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:22.895874 18438 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:22.866432 13625 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:22.898070 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:22.899367 18363 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:22.899822 18363 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:22.900183 18363 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:22.903378 18148 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election won for term 9
W20260811 16:05:22.903573 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 124075us
I20260811 16:05:22.904034 18148 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:22.904174 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:22.905077 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:22.905531 18178 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:22.905285 18148 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:22.908144 18149 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:22.908624 18149 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:22.908998 18149 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:22.908864 18250 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:22.869377 18050 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:22.913789 14577 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:22.907021 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:22.930967 13768 debug-util.cc:398] Leaking SignalData structure 0x7b08001e13a0 after lost signal to thread 12388
W20260811 16:05:22.932329 13768 debug-util.cc:398] Leaking SignalData structure 0x7b08000dcce0 after lost signal to thread 13668
W20260811 16:05:22.932744 13768 debug-util.cc:398] Leaking SignalData structure 0x7b080010a9a0 after lost signal to thread 13686
I20260811 16:05:22.932925 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:22.934072 13768 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7340 after lost signal to thread 13771
I20260811 16:05:22.933920 14582 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:22.876314 18502 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:22.939119 18502 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:22.939817 18502 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:22.939921 13625 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 3 to 4, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 4 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:22.943778 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:22.946574 13768 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8480 after lost signal to thread 13856
I20260811 16:05:22.881705 17927 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:22.954456 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:22.881924 18504 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:22.955199 13740 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:22.956187 13768 debug-util.cc:398] Leaking SignalData structure 0x7b0800325600 after lost signal to thread 13941
I20260811 16:05:22.956761 13706 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:22.919325 18163 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:22.927748 18439 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:05:22.965508 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67543.3us
W20260811 16:05:23.016072 13768 debug-util.cc:398] Leaking SignalData structure 0x7b08003989c0 after lost signal to thread 13942
W20260811 16:05:23.024528 13768 debug-util.cc:398] Leaking SignalData structure 0x7b0800345ce0 after lost signal to thread 14610
I20260811 16:05:23.017331 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.018364 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.018585 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.020012 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.017961 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:22.957038 18038 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:22.882758 14574 rpcz_store.cc:276] 0811 16:05:21.471722 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:22.630538 (+1158816us) service_pool.cc:227] Handling call
0811 16:05:22.630870 (+   332us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:22.631178 (+   308us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:22.657080 (+ 25902us) log.cc:842] Serialized 14 byte log entry
0811 16:05:22.848228 (+191148us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:22.848278 (+    50us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:22.848327 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:22.848386 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:22.848488 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22550,"prepare.queue_time_us":35615,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":20012,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3355,"thread_start_us":187008,"threads_started":2,"wal-append.queue_time_us":199616}
I20260811 16:05:23.055960 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:23.025604 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 118655us
I20260811 16:05:23.056916 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:23.055661 13768 debug-util.cc:398] Leaking SignalData structure 0x7b0800368a80 after lost signal to thread 18174
W20260811 16:05:23.059347 13768 debug-util.cc:398] Leaking SignalData structure 0x7b0800406c00 after lost signal to thread 18374
W20260811 16:05:23.060321 13768 debug-util.cc:398] Leaking SignalData structure 0x7b08003b92e0 after lost signal to thread 18390
W20260811 16:05:23.021350 13787 connection.cc:232] RPC call timeout handler was delayed by -2.257530502974987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260811 16:05:23.060750 13768 debug-util.cc:398] Leaking SignalData structure 0x7b0800224380 after lost signal to thread 18406
W20260811 16:05:23.061209 13768 debug-util.cc:398] Leaking SignalData structure 0x7b080009aae0 after lost signal to thread 18427
W20260811 16:05:23.061458 13768 debug-util.cc:398] Leaking SignalData structure 0x7b0800344320 after lost signal to thread 18429
I20260811 16:05:23.061789 13741 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:23.057734 13738 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:23.060613 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:23.064170 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 136506us
I20260811 16:05:23.064291 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.021792 18504 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:23.062155 13741 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:23.060066 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.070439 13743 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:23.071461 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58530.6us
I20260811 16:05:23.072008 18503 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:23.072665 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.075673 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.076623 13823 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 5: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:23.076979 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.077697 13742 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:05:23.080318 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.083855 17781 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:23.084304 17781 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:23.084656 17781 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:23.087590 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.089190 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.089917 13736 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 8
I20260811 16:05:23.069470 13817 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:23.077702 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:23.092747 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:23.058167 18160 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:23.012264 18499 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
W20260811 16:05:23.115798 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45860us
I20260811 16:05:23.057438 18038 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:23.068320 18050 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:23.069463 18497 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:23.148695 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.148969 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.143539 13821 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:23.149642 13744 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:23.115906 13741 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.150508 13741 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 9
I20260811 16:05:23.127272 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.149921 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.127184 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.152125 13817 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:23.145913 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:23.127498 18539 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260811 16:05:23.148701 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.095741 18421 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:23.149547 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.158890 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.155295 13822 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:23.154819 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.160885 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.166025 13825 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:23.167541 13902 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:05:23.162595 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58454.9us
I20260811 16:05:23.117339 18418 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:23.164685 13907 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:23.167575 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.163902 13906 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:23.169450 13744 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:23.171463 13827 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 9. Ops: []
I20260811 16:05:23.167585 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.104075 18479 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:23.177342 13787 connection.cc:232] RPC call timeout handler was delayed by -1.839030502946116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260811 16:05:23.184625 13740 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:23.187193 13901 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:23.203672 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.203845 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.188575 13900 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:23.204566 13904 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:23.155807 18459 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:23.171931 18250 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:23.191620 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.186503 18463 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:23.200333 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62556.8us
I20260811 16:05:23.205297 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:23.191288 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 124073us
I20260811 16:05:23.172575 18050 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:23.213193 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:23.221135 14577 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:23.213536 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:23.221201 13818 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:23.224453 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.225069 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:23.226042 14575 raft_consensus.cc:2396] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260811 16:05:23.213227 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 132980us
I20260811 16:05:23.212832 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.214502 13743 raft_consensus.cc:2354] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9.
I20260811 16:05:23.215830 13825 raft_consensus.cc:2396] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260811 16:05:23.212802 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:23.219563 13787 connection.cc:232] RPC call timeout handler was delayed by -1.2661272080149502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260811 16:05:23.171375 18497 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:23.227830 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:23.226105 13742 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:05:23.228416 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:23.236238 14581 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:23.236918 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:23.237771 14580 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:23.228518 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.228605 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.220003 18250 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:23.234514 13744 raft_consensus.cc:2396] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260811 16:05:23.234427 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:23.239375 13823 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:05:23.240758 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.242916 13904 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:23.239531 13900 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:23.249753 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.233843 18463 raft_consensus.cc:465] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260811 16:05:23.256443 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.222234 18438 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:23.248657 18280 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260811 16:05:23.269656 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.245327 18151 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:23.217783 18421 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.289386 18151 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:23.292804 18421 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:23.294072 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.265698 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:23.294787 13743 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:23.275403 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.258831 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.258528 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.276998 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.268011 13825 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 9. Ops: []
I20260811 16:05:23.259171 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:23.297330 13906 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:23.272975 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.276520 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.283624 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.284548 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.284269 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:23.292202 13738 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:23.296497 13902 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:23.275982 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.294787 14578 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:23.327687 14577 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:23.267797 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.304806 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.306533 13904 raft_consensus.cc:2354] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 7. Current term is 8.
I20260811 16:05:23.305425 13903 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:23.292459 18151 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:23.351048 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.245410 18250 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:23.355463 13736 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:23.358001 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.354146 13905 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:23.362987 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.363757 13736 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:23.365119 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:23.258181 13740 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:23.366576 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.404273 13825 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:23.406329 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.216383 18479 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.236258 18459 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:23.327437 18108 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:23.389905 13827 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:23.329334 18449 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:23.401382 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.403306 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.408231 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.400821 13817 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:23.438267 13821 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:23.409116 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.419252 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.424252 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.230435 18038 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.444164 13741 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:23.415729 13737 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:23.445070 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.447216 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.329548 18438 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.451731 14541 leader_election.cc:398] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9.
I20260811 16:05:23.453552 14541 leader_election.cc:401] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:23.453537 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:23.452895 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.414331 18280 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
W20260811 16:05:23.455770 18534 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260811 16:05:23.467743 13901 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:23.468444 13900 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:23.459395 18544 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:23.471182 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:23.281656 18502 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.462658 13905 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:23.472393 13738 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:23.467754 13740 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260811 16:05:23.474546 13743 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:23.457999 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 14.178s	user 0.259s	sys 0.081s Metrics: {"bytes_written":31358,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":238004,"dirs.run_cpu_time_us":589,"dirs.run_wall_time_us":31448,"drs_written":1,"lbm_read_time_us":11746,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":256462,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":11,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":1598947,"threads_started":2,"update_count":48,"wal-append.queue_time_us":308691,"wal-append.run_cpu_time_us":858,"wal-append.run_wall_time_us":1010053}
I20260811 16:05:23.274142 18050 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.479947 13908 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260811 16:05:23.273605 18497 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.483671 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:23.486824 13818 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260811 16:05:23.155618 18420 consensus_queue.cc:1159] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 7 status { last_received { term: 7 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)" } } last_received_current_leader { term: 7 index: 6 } }
I20260811 16:05:23.489395 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:23.492810 13823 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:23.441170 18108 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:23.496603 13905 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:05:23.476011 18544 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:23.476437 18439 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:23.507941 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.480626 18280 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:23.532071 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9186 bytes on disk
I20260811 16:05:23.535458 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":684,"lbm_reads_lt_1ms":4}
I20260811 16:05:23.536070 18459 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:23.537413 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:23.539310 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.539368 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:23.540234 18479 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:23.542156 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.543541 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:23.545967 18149 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.006s
I20260811 16:05:23.546461 18149 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.551533 18514 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:23.552067 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.552464 18514 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9.
I20260811 16:05:23.552788 13904 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:23.551698 18250 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:23.522480 18538 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260811 16:05:23.540508 13903 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:23.519516 18439 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:23.519122 18544 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:23.582422 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.591768 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:23.594882 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 163473us
W20260811 16:05:23.588034 17981 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.000s
I20260811 16:05:23.525971 18504 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.613016 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.613811 13740 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:23.626176 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 278766us
I20260811 16:05:23.579629 17781 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.638834 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:23.642587 13903 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:23.617627 18542 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260811 16:05:23.636616 18149 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:23.658124 13742 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:23.676687 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 371931us
I20260811 16:05:23.677841 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.681396 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:23.711670 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:23.717393 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68225us
I20260811 16:05:23.742362 13740 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:23.744776 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.744808 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.750748 14578 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260811 16:05:23.752375 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 208879us
I20260811 16:05:23.752908 14577 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:05:23.763639 18250 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:23.768935 18543 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260811 16:05:23.771930 18547 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260811 16:05:23.773838 18546 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260811 16:05:23.776181 18438 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:23.719343 18553 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 16:05:23.785148 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.785967 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.715579 18502 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:23.748299 18542 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260811 16:05:23.814468 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.014s	sys 0.042s
W20260811 16:05:23.817420 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.042s
I20260811 16:05:23.784556 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.755506 18149 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:23.762650 17384 raft_consensus.cc:2741] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260811 16:05:23.780458 18504 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:23.834795 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.835598 13905 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
W20260811 16:05:23.830628 18549 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260811 16:05:23.778708 17927 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.000s
I20260811 16:05:23.644480 18280 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:23.839028 18363 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.938s	user 0.014s	sys 0.000s
I20260811 16:05:23.832305 18108 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:23.836633 18149 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:23.880645 18149 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.883613 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1777) took 1599 ms. Trace:
I20260811 16:05:23.884033 13826 rpcz_store.cc:276] 0811 16:05:22.284502 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:22.286573 (+  2071us) service_pool.cc:227] Handling call
0811 16:05:22.287035 (+   462us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:22.852191 (+565156us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:22.852220 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:22.871660 (+ 19440us) log.cc:842] Serialized 26 byte log entry
0811 16:05:23.061370 (+189710us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:23.075107 (+ 13737us) log.cc:842] Serialized 14 byte log entry
0811 16:05:23.094498 (+ 19391us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:23.480773 (+386275us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:23.480823 (+    50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:23.822027 (+341204us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b1800404440. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:23.883248 (+ 61221us) raft_consensus.cc:1671] finished
0811 16:05:23.883272 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:23.883436 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12486,"prepare.queue_time_us":12780,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":70787,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":3419,"spinlock_wait_cycles":1301846144,"thread_start_us":149772,"threads_started":1,"wal-append.queue_time_us":260307}
I20260811 16:05:23.852676 18363 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.887677 18363 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:23.889259 18038 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:23.889532 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:23.890341 13742 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:23.891357 17781 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:23.896660 18151 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.898268 13736 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:23.901227 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.902179 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.911360 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.912504 13901 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:23.912748 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.913754 13909 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:05:23.914079 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.914918 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:23.917464 13904 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:23.923194 13743 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:23.924659 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:23.817811 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 564312us
W20260811 16:05:23.923334 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 199521us
I20260811 16:05:23.783543 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:23.927805 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:23.925729 18418 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.002s
I20260811 16:05:23.846652 17927 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:23.918546 18163 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:23.940833 13903 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:23.974236 18418 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260811 16:05:23.993108 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65416.1us
W20260811 16:05:23.987567 18547 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260811 16:05:23.951670 18050 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:23.945061 18363 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:23.944093 18564 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:23.957265 18163 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:23.993108 18151 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:24.016669 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.028332 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.010s	sys 0.027s
W20260811 16:05:24.030620 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.011s	sys 0.027s
I20260811 16:05:23.998934 18050 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:24.043620 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1207) took 1691 ms. Trace:
I20260811 16:05:24.009940 18363 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:24.002909 18564 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.044193 14579 rpcz_store.cc:276] 0811 16:05:22.352622 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:22.844019 (+491397us) service_pool.cc:227] Handling call
0811 16:05:22.844344 (+   325us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:22.881734 (+ 37390us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:23.007621 (+125887us) log.cc:842] Serialized 14 byte log entry
0811 16:05:23.185226 (+177605us) log.cc:842] Serialized 14 byte log entry
0811 16:05:23.202522 (+ 17296us) log.cc:842] Serialized 14 byte log entry
0811 16:05:23.202678 (+   156us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:23.304648 (+101970us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18002cbc60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:23.779298 (+474650us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b18002cbc60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:23.805155 (+ 25857us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b18002cbc60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a
0811 16:05:23.805348 (+   193us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b18002cbc60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:23.819053 (+ 13705us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:23.825839 (+  6786us) log.cc:842] Serialized 26 byte log entry
0811 16:05:23.825997 (+   158us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:23.826025 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:23.826090 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:24.043323 (+217233us) raft_consensus.cc:1671] finished
0811 16:05:24.043353 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:24.043542 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":127808,"prepare.queue_time_us":131816,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":115,"raft.queue_time_us":54031,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":21125,"spinlock_wait_cycles":81112704,"thread_start_us":101906,"threads_started":1,"wal-append.queue_time_us":168423}
I20260811 16:05:24.035578 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.029362 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 490137us
I20260811 16:05:24.008666 18163 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.061513 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.062655 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.019s	sys 0.020s
W20260811 16:05:24.063740 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.019s	sys 0.020s
I20260811 16:05:24.046623 18050 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:24.046337 18502 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:24.067540 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.075947 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 315767us
I20260811 16:05:24.053252 18564 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.067566 18438 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Leader election won for term 5
I20260811 16:05:24.069456 18449 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:24.096148 18363 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.084229 18439 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.116197 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.195350 14577 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:24.118163 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.196267 14578 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:24.121627 18565 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:24.092221 18479 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.138324 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.202783 14579 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:24.202519 18479 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:24.140094 18129 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:24.203788 18129 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.204185 18129 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:24.147586 13741 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:24.152482 18463 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:24.166158 18151 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260811 16:05:24.174496 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 260903us
I20260811 16:05:24.210883 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.175524 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 891320us
W20260811 16:05:24.178311 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 126142us
I20260811 16:05:24.181025 18572 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:24.181881 17927 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:24.186148 18544 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.003s
I20260811 16:05:24.188840 18163 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.196710 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:24.199385 17781 raft_consensus.cc:979] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:05:24.212518 18479 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:24.212646 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:24.213231 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:24.216396 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2459) took 1029 ms. Trace:
I20260811 16:05:24.215986 18149 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260811 16:05:24.255810 18587 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:05:24.259357 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.267696 13907 rpcz_store.cc:276] 0811 16:05:23.187063 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:23.202979 (+ 15916us) service_pool.cc:227] Handling call
0811 16:05:23.217078 (+ 14099us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:23.235263 (+ 18185us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:23.235301 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:23.277366 (+ 42065us) log.cc:842] Serialized 26 byte log entry
0811 16:05:23.482099 (+204733us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:23.993301 (+511202us) log.cc:842] Serialized 14 byte log entry
0811 16:05:24.215917 (+222616us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:24.215998 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:24.216044 (+    46us) raft_consensus.cc:1671] finished
0811 16:05:24.216054 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:24.216331 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":354741,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":172521,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":18568,"thread_start_us":901322,"threads_started":3,"wal-append.queue_time_us":249564}
I20260811 16:05:24.258586 18038 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.258960 18585 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:24.258167 17781 raft_consensus.cc:1067] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:05:24.259442 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:24.258625 18050 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.205471 18565 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.260752 17927 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:24.261384 18439 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:24.258359 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63858.2us
I20260811 16:05:24.258139 18564 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:24.223470 18544 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.227105 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:24.281657 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.344509 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 159923us
W20260811 16:05:24.348057 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 280578us
I20260811 16:05:24.349409 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.350334 14577 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:24.214110 18463 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:24.352444 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73321.1us
I20260811 16:05:24.353499 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:24.360458 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 147898us
I20260811 16:05:24.361545 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.272084 18449 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:24.280527 18585 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:24.280203 18459 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:24.224385 18438 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:24.369578 13743 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:24.282904 18565 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:24.280922 18280 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:24.283099 17927 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.362741 18479 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:24.274699 18038 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.340129 18561 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:24.338310 18502 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:24.372550 18593 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260811 16:05:24.384397 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:24.384114 18449 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:24.384804 18038 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:24.377044 18479 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.380749 13741 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:24.344647 18590 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:24.385571 18151 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260811 16:05:24.391480 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 132124us
I20260811 16:05:24.389961 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.390771 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.392038 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.390208 14578 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:24.393940 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.368444 18586 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:24.369554 18459 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.398231 14577 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:24.373713 17781 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:24.381435 17927 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.413044 18597 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:24.413666 18163 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:24.413789 18597 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:24.413970 18463 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:24.415189 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.399973 18459 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:24.406747 18280 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:24.419272 17781 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:24.420464 17781 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.423533 18572 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:24.423641 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.423424 18585 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:24.424108 18572 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.424454 18280 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:24.424978 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:24.426299 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.393608 18590 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.426582 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:24.391743 18479 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:24.392036 18497 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:24.430012 18280 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.431125 18562 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:24.393940 18148 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260811 16:05:24.435743 18050 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:24.436517 18438 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.437551 18149 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:24.437608 18038 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:24.459510 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:24.459824 18038 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.460266 18038 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:24.460537 13743 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:24.397225 18586 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.463394 18497 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.400684 18561 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:24.441819 18459 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:24.442800 18577 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:24.475857 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:24.443324 18544 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:24.443490 18163 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:24.426021 18584 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:24.424492 18572 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.444998 18564 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:24.445214 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.445514 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.445640 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:24.446650 18502 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:24.454960 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88001.5us
I20260811 16:05:24.455562 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.477027 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:24.463601 18586 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:24.428674 18590 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.452766 18562 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.494150 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.453699 14574 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:05:24.504016 14574 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:24.504427 14574 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:24.527464 14575 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10.
I20260811 16:05:24.414948 18597 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.484517 18163 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.485019 18584 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:24.500473 18050 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.552033 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.552969 14578 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:24.559815 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.560457 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.503415 18561 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:24.562258 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 189156us
I20260811 16:05:24.561343 14575 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 4.
I20260811 16:05:24.564478 14581 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:24.521364 18562 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.478078 18497 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:24.544356 18280 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.549377 18163 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:24.549170 18584 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:24.581890 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.585856 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.593103 18497 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:24.595520 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 110325us
I20260811 16:05:24.599851 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.563838 18050 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:24.610314 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 269183us
I20260811 16:05:24.567801 18129 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.616997 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:24.609107 14577 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:24.627674 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:24.734860 13826 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:24.738816 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:24.739529 13826 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:24.739378 18561 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.741859 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:24.742489 13826 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:24.625748 18449 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.744136 18449 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:24.748375 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 122317us
I20260811 16:05:24.750516 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:24.599114 18504 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:24.577821 18280 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.750588 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:24.728565 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 116276us
I20260811 16:05:24.729470 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:24.764127 14578 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:24.754297 14575 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:24.765772 13825 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:24.793030 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:24.801373 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.802296 14578 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:24.699180 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9315a4a479754517bd121148cf017615"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:24.803685 13826 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:24.802942 13741 raft_consensus.cc:595] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:24.812111 13741 raft_consensus.cc:603] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:24.814458 13738 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:24.779131 18449 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:24.818976 13738 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260811 16:05:24.828605 13825 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:24.831753 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:24.801244 18459 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:24.837075 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:24.858640 18151 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:24.819574 18579 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.454s	user 0.004s	sys 0.010s
I20260811 16:05:24.861212 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:24.861692 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:24.814076 18463 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:24.863720 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:24.864480 13742 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:05:24.911027 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:24.895792 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:24.903900 18601 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:05:24.784041 18504 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.861416 18544 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:24.863420 18148 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:24.916447 13739 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:24.880582 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:24.865939 18108 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.885833 14573 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260811 16:05:24.837393 13744 raft_consensus.cc:2354] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:24.918897 13820 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:24.915843 14581 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:24.926470 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:24.945878 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:24.998973 13737 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:24.945147 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:24.959549 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.000559 13822 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 6.
I20260811 16:05:24.961887 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:24.951370 14578 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:24.955515 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 91871.6us
I20260811 16:05:24.959976 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.001525 13817 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 9
I20260811 16:05:24.912511 14575 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:24.960804 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.005740 13824 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:24.961465 13827 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:24.960390 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.010011 13821 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:25.020397 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52832us
I20260811 16:05:24.946836 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.025924 13823 raft_consensus.cc:2354] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9.
I20260811 16:05:24.914218 18594 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:24.909576 18603 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:24.996340 14574 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.039036 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:25.039943 13743 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:24.918103 18449 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:24.946115 18479 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260811 16:05:25.094666 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.034155 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.095440 13820 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:25.096700 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:25.097506 13743 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:25.098067 13743 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:24.947708 18604 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:05:24.962380 18565 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
W20260811 16:05:24.956400 17927 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.001s
I20260811 16:05:25.091044 14577 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:24.964649 18610 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:24.944762 18576 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:24.955483 18504 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:24.955902 18129 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.102874 14574 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.103112 13739 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:24.948230 18050 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.113476 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.131784 13822 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:25.099033 13743 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.917914 18151 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.132706 13743 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:25.122864 13824 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:25.123325 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.134132 14578 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 7: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:25.034198 18621 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:24.939658 18463 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.097478 18577 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:24.950753 18038 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.973480 18148 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:24.945540 18544 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.102561 18604 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:24.963294 18108 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.101111 18603 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.160586 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:25.169762 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 534914us
I20260811 16:05:25.179500 18564 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:25.180437 18564 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.102190 18479 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.090022 18594 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.181010 18564 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.102348 18449 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.124456 17927 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.153764 18577 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:25.117270 18565 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.149533 18607 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:25.208367 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 59930.4us
I20260811 16:05:25.159978 18604 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.149219 18129 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260811 16:05:25.211877 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:25.235594 14578 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 4 FOLLOWER]: Advancing to term 5
I20260811 16:05:25.214454 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.237537 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.215708 13743 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:25.218259 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.167924 18418 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260811 16:05:25.219792 18622 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260811 16:05:25.220786 18148 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.221140 18108 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.222549 18594 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.223311 18438 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:25.141487 18621 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.170800 18280 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.224771 18603 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.225262 13818 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:25.225392 18565 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.228237 18038 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.227908 18577 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.322778 18621 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.130080 18576 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.240605 14541 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.243183 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.337365 14574 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260811 16:05:25.226897 18151 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.251088 13820 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:25.257265 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.218004 18628 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:25.357921 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.358063 18628 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.358649 14581 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:25.359285 13824 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.359647 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.360481 18628 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.360885 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:25.361462 14581 raft_consensus.cc:2362] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7. Re-sending same reply.
I20260811 16:05:25.362318 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.362344 18038 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:25.363543 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.363775 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.364287 14573 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9.
W20260811 16:05:25.244913 18586 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.001s
I20260811 16:05:25.365075 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.365427 18586 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.366317 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:25.143949 18610 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.366897 14582 raft_consensus.cc:2362] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8. Re-sending same reply.
I20260811 16:05:25.368191 17927 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.368304 18610 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.310400 14575 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:05:25.319779 18438 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.301568 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.229480 18463 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:25.296547 18163 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.003s
W20260811 16:05:25.336133 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 95635.7us
I20260811 16:05:25.340234 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.343271 18148 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:25.343511 18544 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:25.344486 18590 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.001s
I20260811 16:05:25.237635 18607 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.346534 18479 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:25.347788 18623 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260811 16:05:25.348335 18609 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260811 16:05:25.351356 18151 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:25.353682 18621 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:25.356460 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.356707 18449 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.357326 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:25.363307 18038 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:25.323953 18605 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.458s	user 0.002s	sys 0.000s
W20260811 16:05:25.407688 18572 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.864s	user 0.007s	sys 0.003s
I20260811 16:05:25.363034 14581 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:25.339821 13825 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:25.427194 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:25.387347 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 85931.8us
I20260811 16:05:25.428328 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.429755 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.388104 13817 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
W20260811 16:05:25.388712 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 502229us
I20260811 16:05:25.397348 13820 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:25.392975 13822 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:25.400108 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:25.438334 13744 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:25.407639 18148 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:25.400750 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 361817us
I20260811 16:05:25.440891 13787 leader_election.cc:398] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:25.441236 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.441380 13787 leader_election.cc:401] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260811 16:05:25.443807 13825 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:05:25.403250 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84581.2us
I20260811 16:05:25.446877 13742 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260811 16:05:25.442878 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.451632 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.452631 14581 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:25.456385 13738 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260811 16:05:25.458266 13822 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:25.370577 13824 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:25.407704 18584 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
I20260811 16:05:25.397339 18610 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:25.423803 14583 raft_consensus.cc:2354] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:25.424661 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:25.431782 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.397456 18163 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.474815 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:25.459610 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:25.476079 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46400.5us
I20260811 16:05:25.382830 14578 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 5.
I20260811 16:05:25.460633 14577 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:25.472214 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.477553 13820 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:25.477922 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:25.472661 14575 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:25.472844 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.411176 18463 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260811 16:05:25.424153 18568 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:25.439455 18438 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.439338 18629 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:25.480829 13744 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:25.400365 18590 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.480753 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.503651 14581 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:25.483567 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.482685 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.505780 18438 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:25.506394 18438 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.506855 18438 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:25.519025 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.520478 18631 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260811 16:05:25.520624 14542 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.514s (SENT)
I20260811 16:05:25.521061 18631 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.521363 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.427573 18502 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260811 16:05:25.521559 18631 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:25.522913 14542 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.521s (SENT)
I20260811 16:05:25.459766 18479 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 6. Current term is 7.
I20260811 16:05:25.525247 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.421466 18151 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:25.527669 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54907.5us
I20260811 16:05:25.528425 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.505820 14578 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:25.424329 18621 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:25.531934 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 132682us
I20260811 16:05:25.533038 18151 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.535389 18607 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.535071 18148 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.558708 18611 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260811 16:05:25.459795 18636 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260811 16:05:25.481098 18584 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.563803 18584 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.546948 18646 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:25.565237 18646 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:25.565624 18646 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.428233 18572 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.555083 18630 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:25.568970 18572 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.573345 18038 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.574095 18638 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:25.525861 18497 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260811 16:05:25.536062 18610 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:25.536672 18576 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.537150 18590 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.502168 18629 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:25.523422 18050 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:25.523996 18568 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.595196 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.596120 18568 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.538496 18604 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.539860 18597 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:25.437397 18449 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260811 16:05:25.544437 13820 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:25.553799 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.496016 18628 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:25.556818 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.600091 14583 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:25.557143 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:05:25.567807 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44930.4us
I20260811 16:05:25.606632 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.590772 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:25.607684 14580 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:25.591881 13735 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:25.555721 18418 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:25.605191 14581 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:25.557416 18479 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260811 16:05:25.611287 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68571.2us
I20260811 16:05:25.558000 18463 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260811 16:05:25.578953 18640 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:25.598055 18629 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:25.623363 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:25.626063 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.629942 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.618414 18108 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:25.677135 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:25.678102 14578 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 5.
I20260811 16:05:25.624972 18640 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:25.610613 18038 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260811 16:05:25.663534 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:25.616197 18603 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260811 16:05:25.657529 18645 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:25.616761 18151 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260811 16:05:25.657819 18611 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:25.660447 18108 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.659835 18050 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:25.696420 18586 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.686266 18604 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:25.698455 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83358us
I20260811 16:05:25.734853 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.699559 18621 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:25.700119 18627 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.489s	user 0.004s	sys 0.011s
W20260811 16:05:25.743214 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 265468us
I20260811 16:05:25.744108 13874 leader_election.cc:398] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:25.744407 13874 leader_election.cc:401] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:25.746197 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.701607 18564 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.685570 18640 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:25.706736 14580 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:25.708804 18438 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.715992 18641 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:25.747583 18641 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:25.749066 18438 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:25.748773 18641 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:25.750341 18641 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:25.690171 18645 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:25.756170 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 227811us
W20260811 16:05:25.758680 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 299179us
I20260811 16:05:25.732852 18108 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:25.722697 18611 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:25.754987 18599 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:05:25.767706 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.753485 18163 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.765288 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.786372 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:25.777352 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 254976us
I20260811 16:05:25.755394 18604 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.780125 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:25.777133 18562 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.201s	user 0.007s	sys 0.007s
I20260811 16:05:25.775918 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.764897 18645 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.770795 18586 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:25.795296 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.777942 18611 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:25.780107 18479 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:25.816097 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:25.817916 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 149645us
I20260811 16:05:25.819398 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.830940 14583 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:25.827057 13822 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260811 16:05:25.822423 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.823297 13706 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.793500 18163 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:25.836812 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.795042 18637 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:25.796825 18459 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:25.849479 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.850153 13818 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:25.850991 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.851666 13818 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:25.852348 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.838959 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.854502 13824 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:25.840092 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:25.858251 14577 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:25.841395 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.835837 18129 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:25.843281 18621 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260811 16:05:25.843600 17781 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:25.844518 18564 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.848228 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:25.892376 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52389.9us
I20260811 16:05:25.784379 18631 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.875828 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:25.885020 13827 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:25.893945 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:25.836450 18497 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260811 16:05:25.886457 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.895766 13817 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.897516 18603 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:25.897926 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:25.819116 18652 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:25.904592 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:25.905474 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 136294us
I20260811 16:05:25.907882 13740 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:25.839834 18163 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:25.796000 18562 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:25.867555 18129 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.827749 18607 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260811 16:05:25.941563 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206819us
I20260811 16:05:25.887984 18572 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
W20260811 16:05:25.918308 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 85269.2us
I20260811 16:05:25.819341 18590 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260811 16:05:25.952061 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.929949 13826 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:25.932122 13821 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:25.888394 18621 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.890542 17781 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.888700 18479 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260811 16:05:25.933480 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57766.8us
W20260811 16:05:25.922271 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 240187us
I20260811 16:05:25.934401 13739 raft_consensus.cc:595] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:05:25.934180 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58486.1us
I20260811 16:05:25.943269 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:25.943766 13817 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:25.933046 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:25.954938 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.956529 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.979380 13818 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:25.979528 13824 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:25.979422 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:25.956877 18497 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:25.888234 18544 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260811 16:05:25.965912 18629 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:26.009879 18629 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:25.967650 18646 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.010749 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:25.976039 18621 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:26.011464 13743 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:26.012588 18646 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:25.954151 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:05:26.013664 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59616.1us
I20260811 16:05:25.917495 18652 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:25.940357 18129 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:26.019363 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:25.921473 18463 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:25.983507 13736 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:25.924360 18163 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:25.985713 13789 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.517s (SENT)
I20260811 16:05:25.987295 18572 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:25.991989 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:25.959010 18655 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260811 16:05:26.022905 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89984.4us
I20260811 16:05:26.040730 13871 leader_election.cc:398] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10.
I20260811 16:05:26.041100 13871 leader_election.cc:401] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260811 16:05:26.023523 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:26.024072 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72145.1us
I20260811 16:05:25.969195 18149 raft_consensus.cc:2741] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260811 16:05:26.026378 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:26.030828 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45153.5us
I20260811 16:05:26.035645 13743 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:26.037376 13817 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:26.049408 13824 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:26.050539 13826 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260811 16:05:25.924620 18636 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260811 16:05:25.983055 17781 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:26.053611 13744 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260811 16:05:26.057113 13818 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:26.022431 18607 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:26.021166 18652 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:26.062127 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.058418 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:26.067065 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 123931us
I20260811 16:05:26.027560 18497 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:26.038637 18564 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:26.064388 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.097187 13824 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:26.071596 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.070104 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.109020 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.109480 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.052881 18148 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:26.053417 18050 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:26.110872 13901 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260811 16:05:26.062690 18459 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:26.120242 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.110293 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.120702 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:26.132625 13787 leader_election.cc:334] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.550s (SENT)
I20260811 16:05:26.133141 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:26.133417 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.066318 18646 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:26.111267 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.125463 13908 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:26.093930 18653 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:26.111681 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.135900 13909 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.136346 13827 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:26.137331 13735 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.001s
I20260811 16:05:26.090137 18607 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:26.138973 18631 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:26.143945 18678 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260811 16:05:26.146458 13942 heartbeater.cc:644] Failed to heartbeat to 127.12.23.254:34613 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.23.254:34613 timed out after 15.000s (SENT)
I20260811 16:05:26.147419 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.089979 18637 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:26.148769 14544 leader_election.cc:398] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9.
W20260811 16:05:26.267019 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 118452us
I20260811 16:05:26.267915 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.268187 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:26.149379 18687 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:26.149677 18640 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.149995 18050 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260811 16:05:26.147423 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50464.5us
W20260811 16:05:26.156038 18674 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260811 16:05:26.156911 18108 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.157825 18418 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:26.155006 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.058945 18684 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260811 16:05:26.126299 18673 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:26.138983 18562 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:26.165172 18636 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:26.147678 18657 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:05:26.172057 13735 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:26.172552 13901 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:26.170948 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 179058us
I20260811 16:05:26.179996 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.094691 18149 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260811 16:05:26.181337 13787 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.611s (SENT)
I20260811 16:05:26.387599 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:26.273841 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.274050 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.277491 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.278234 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1896) took 1795 ms. Trace:
I20260811 16:05:26.134353 18626 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:26.279397 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.280869 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.396775 13738 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:26.396895 13909 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:26.282776 13824 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:26.283897 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.346220 13904 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260811 16:05:26.346028 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.297040 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.273855 18687 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:26.135535 18148 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.281805 18637 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:26.389150 13736 rpcz_store.cc:276] 0811 16:05:24.476498 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:24.476716 (+   218us) service_pool.cc:227] Handling call
0811 16:05:26.271535 (+1794819us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:26.271677 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3405542784}
W20260811 16:05:26.401332 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 220019us
I20260811 16:05:26.423024 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.423615 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.167182 18459 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:26.397648 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.407030 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:26.264185 18621 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.408416 13818 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:26.416131 18674 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.119s	user 0.007s	sys 0.000s
I20260811 16:05:26.263329 18646 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:26.421582 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 405492us
I20260811 16:05:26.423902 13904 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.407361 13902 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.187247 18653 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:26.412261 18641 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.658s	user 0.014s	sys 0.001s
I20260811 16:05:26.416757 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.342944 18038 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:26.452009 13901 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.387526 18149 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:26.456861 13743 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:26.459923 13824 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:26.460134 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.188230 18572 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.462113 18633 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:26.411741 18636 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:26.467639 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.299216 18611 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.418109 18687 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:26.475468 13738 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:26.476703 13906 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:26.480955 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.478767 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.494249 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.453790 18479 raft_consensus.cc:2741] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260811 16:05:26.492924 13739 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260811 16:05:26.490918 13743 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260811 16:05:26.496606 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:26.497530 13904 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.499419 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.500034 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.500937 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.501979 13736 raft_consensus.cc:595] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:26.507812 13736 raft_consensus.cc:603] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:26.506664 13901 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:26.472369 18149 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:26.466764 18038 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:26.483768 18682 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
W20260811 16:05:26.499323 18688 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260811 16:05:26.512729 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.343640 18673 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:26.517714 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.519368 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.483238 18633 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:26.396898 18497 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:26.498350 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44352.3us
I20260811 16:05:26.545284 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.499552 18696 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:26.540490 13902 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:26.547289 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 496103us
I20260811 16:05:26.547761 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.550531 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:26.580574 13909 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.580641 13904 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.574951 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2131) took 1162 ms. Trace:
I20260811 16:05:26.573269 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.582033 13900 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:26.583379 14583 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:26.585729 13735 rpcz_store.cc:276] 0811 16:05:25.412969 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:25.413215 (+   246us) service_pool.cc:227] Handling call
0811 16:05:26.571337 (+1158122us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002779d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:26.574875 (+  3538us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":270919040}
I20260811 16:05:26.587604 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:26.587905 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.588994 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.503240 18631 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260811 16:05:26.522248 18038 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:26.591777 14542 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.624s (SENT)
I20260811 16:05:26.595608 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:26.595947 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.591157 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:26.596935 13901 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.592084 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:05:26.604473 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.605456 13902 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.600497 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:26.604000 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.611251 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.575572 18682 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:26.612798 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:26.624750 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 2.015s (SENT)
I20260811 16:05:26.625160 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.629467 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.655340 14577 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:26.655532 13902 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.631034 18696 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:26.644279 13818 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:26.646310 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.615609 18108 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:26.604717 18657 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:26.648870 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.613595 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.614969 18633 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.654865 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.668799 14583 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:26.660338 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:26.669839 13740 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:26.665103 13900 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:26.671399 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.660917 13904 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.672547 13900 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:26.663162 13820 raft_consensus.cc:2354] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:26.664700 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.618368 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.675230 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.676009 13902 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:26.676973 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.678184 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:26.678493 18652 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.000s
I20260811 16:05:26.660218 18640 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:26.678791 13902 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:26.680415 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:05:26.629369 17781 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260811 16:05:26.683696 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.683632 17781 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.684595 13901 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.684937 18621 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:26.685484 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.686192 13901 raft_consensus.cc:2354] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:26.686393 17781 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:26.687439 18633 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:26.691502 18607 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:26.691829 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.692816 18626 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10.
I20260811 16:05:26.679219 18686 raft_consensus.cc:979] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:05:26.693832 18686 raft_consensus.cc:1067] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:05:26.694742 18646 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:26.684142 18611 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:26.699637 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.699869 18149 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.686959 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.700547 13909 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:26.700933 13901 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:26.701082 14574 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:26.701711 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.702243 13741 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:26.702312 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:26.693081 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.703384 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:26.703995 13827 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:26.706048 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.597774 18636 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:26.707320 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:26.707945 13740 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:26.708891 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.709069 13903 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:26.703359 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.715314 13735 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:26.709445 13740 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:26.706431 18657 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:05:26.724893 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.726296 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.727857 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.650151 18653 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:26.717391 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 92693.4us
I20260811 16:05:26.733604 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:26.740106 14578 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:26.718580 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:26.718966 14583 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:26.702872 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.732581 13827 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:26.752545 13902 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:26.745533 14577 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:26.754180 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.770766 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.772460 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.781287 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.782106 14583 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 5 FOLLOWER]: Advancing to term 6
I20260811 16:05:26.609139 18637 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:26.735106 18682 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:26.728003 18693 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260811 16:05:26.812029 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:26.733251 18597 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.129s	user 0.009s	sys 0.003s
I20260811 16:05:26.791245 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:26.814446 14583 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 6.
I20260811 16:05:26.731220 18620 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:26.826545 18620 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.831737 13738 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:26.777853 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.834043 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:26.834399 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:26.834856 13909 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:26.812747 13900 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:26.787088 13787 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 2.141s (SENT)
I20260811 16:05:26.786561 14575 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260811 16:05:26.731129 18679 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260811 16:05:26.808293 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:26.852754 14578 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:26.730289 18459 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:26.753087 18636 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:26.551473 18692 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260811 16:05:26.838119 13706 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:26.789893 14542 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.076s (SENT)
I20260811 16:05:26.868501 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:26.868956 13740 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:26.730316 18675 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:26.835471 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:26.913713 13739 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:26.852159 18163 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.001s
W20260811 16:05:26.871619 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 101260us
I20260811 16:05:26.679049 18652 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:26.852245 18611 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:26.883591 14578 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:26.854058 18597 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:26.917826 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 127974us
I20260811 16:05:26.921082 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:26.927366 14542 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.942s (SENT)
I20260811 16:05:26.928153 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:26.932987 13907 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:26.937624 13787 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 2.222s (SENT)
I20260811 16:05:26.938253 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:26.850517 13735 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:26.948518 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:26.956008 13908 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12.
I20260811 16:05:26.920740 18616 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Leader election won for term 6
I20260811 16:05:26.958779 13900 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:26.868515 13738 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:26.916932 18675 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:26.960652 18657 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:26.956388 18479 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260811 16:05:26.987624 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1250) took 1356 ms. Trace:
I20260811 16:05:26.988613 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2136) took 1082 ms. Trace:
I20260811 16:05:26.932361 18607 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:26.932986 18691 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:26.988229 14581 rpcz_store.cc:276] 0811 16:05:25.631486 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:25.631685 (+   199us) service_pool.cc:227] Handling call
0811 16:05:25.662773 (+ 31088us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:25.808535 (+145762us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:25.808582 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:25.809188 (+   606us) log.cc:842] Serialized 26 byte log entry
0811 16:05:25.944944 (+135756us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:25.944971 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:25.945022 (+    51us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:26.987361 (+1042339us) raft_consensus.cc:1671] finished
0811 16:05:26.987389 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:26.987550 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":67396,"raft.queue_time_us":190214,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2711,"thread_start_us":240043,"threads_started":2,"wal-append.queue_time_us":450425}
I20260811 16:05:26.930090 18148 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:26.989141 13737 rpcz_store.cc:276] 0811 16:05:25.906098 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:25.906309 (+   211us) service_pool.cc:227] Handling call
0811 16:05:25.932288 (+ 25979us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:25.947559 (+ 15271us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:25.947605 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:26.025771 (+ 78166us) log.cc:842] Serialized 26 byte log entry
0811 16:05:26.265875 (+240104us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:26.267085 (+  1210us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:26.267204 (+   119us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:26.988361 (+721157us) raft_consensus.cc:1671] finished
0811 16:05:26.988391 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:26.988540 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":531,"raft.queue_time_us":61620,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"thread_start_us":196649,"threads_started":1,"wal-append.queue_time_us":412538}
I20260811 16:05:26.996830 18149 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:26.941133 18611 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:27.002507 13907 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:26.928062 18163 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:26.960767 18621 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election won for term 8
W20260811 16:05:27.035943 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 98343.6us
I20260811 16:05:26.989903 18616 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:26.984131 18675 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:26.992792 18673 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:27.035277 18645 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.215s	user 0.013s	sys 0.000s
I20260811 16:05:27.034013 18607 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:27.071429 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.009s	sys 0.017s
W20260811 16:05:27.071918 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.009s	sys 0.017s
I20260811 16:05:27.072834 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1805) took 1121 ms. Trace:
I20260811 16:05:27.050820 13908 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260811 16:05:27.069913 13909 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:26.929589 18636 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:27.028127 18463 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260811 16:05:27.075066 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.012s	sys 0.015s
W20260811 16:05:27.075640 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.012s	sys 0.015s
W20260811 16:05:27.076016 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 805888us
W20260811 16:05:27.078569 13825 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.014s	sys 0.012s
W20260811 16:05:27.079109 13825 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.014s	sys 0.012s
I20260811 16:05:27.088392 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1806) took 1135 ms. Trace:
I20260811 16:05:27.053928 18628 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Stepping down as leader of term 5
I20260811 16:05:27.090821 13743 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260811 16:05:26.924952 18696 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:27.073318 13822 rpcz_store.cc:276] 0811 16:05:25.951733 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:25.951846 (+   113us) service_pool.cc:227] Handling call
0811 16:05:25.952133 (+   287us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:25.952285 (+   152us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:26.026962 (+ 74677us) log.cc:842] Serialized 14 byte log entry
0811 16:05:26.351659 (+324697us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18003cdea0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:05:27.072392 (+720733us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:27.072445 (+    53us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:27.072568 (+   123us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.072643 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:27.072775 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":110322,"prepare.run_cpu_time_us":2146,"prepare.run_wall_time_us":36006,"raft.queue_time_us":245,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11809,"spinlock_wait_cycles":4417792,"thread_start_us":684557,"threads_started":1}
I20260811 16:05:27.104298 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:27.074558 18621 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:27.110093 13827 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:27.089113 13825 rpcz_store.cc:276] 0811 16:05:25.952822 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:25.953024 (+   202us) service_pool.cc:227] Handling call
0811 16:05:25.953414 (+   390us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:25.953658 (+   244us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:26.447418 (+493760us) log.cc:842] Serialized 14 byte log entry
0811 16:05:27.088014 (+640596us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:27.088064 (+    50us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:27.088107 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.088181 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:27.088315 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":76037,"prepare.queue_time_us":249347,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2261,"thread_start_us":1020399,"threads_started":2}
W20260811 16:05:27.098771 18676 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.002s	sys 0.026s
I20260811 16:05:27.116815 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:27.124076 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:27.109638 18050 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.014s	sys 0.025s
W20260811 16:05:27.126013 13707 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.002s	sys 0.028s
I20260811 16:05:27.097126 18628 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:27.107519 18620 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:27.125566 18676 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.002s	sys 0.026s
W20260811 16:05:27.130488 18050 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.015s	sys 0.025s
W20260811 16:05:27.130555 13707 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.002s	sys 0.028s
I20260811 16:05:27.131912 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:27.147040 13824 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:27.132892 13818 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
W20260811 16:05:27.130935 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.000s	sys 0.030s
W20260811 16:05:27.149995 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.000s	sys 0.030s
W20260811 16:05:27.150522 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 882350us
W20260811 16:05:27.151252 14579 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.003s	sys 0.028s
W20260811 16:05:27.151185 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 685540us
W20260811 16:05:27.152601 14579 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.003s	sys 0.028s
I20260811 16:05:27.120839 18463 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:27.153745 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:27.135309 18604 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.343s	user 0.015s	sys 0.000s
I20260811 16:05:27.128098 13825 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:27.161829 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:27.162775 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:27.073655 18645 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.170305 13901 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:27.173375 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:27.175025 13901 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260811 16:05:27.185120 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:27.182471 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:27.123685 18038 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:27.193035 13901 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260811 16:05:27.195847 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2470) took 1029 ms. Trace:
I20260811 16:05:27.196238 13909 rpcz_store.cc:276] 0811 16:05:26.166183 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.854688 (+688505us) service_pool.cc:227] Handling call
0811 16:05:26.868516 (+ 13828us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:27.078449 (+209933us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.195579 (+117130us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002acbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:27.195776 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":455311232}
I20260811 16:05:27.198086 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:27.160178 18652 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:27.205416 13901 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:27.196038 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 2.581s (SENT)
I20260811 16:05:27.206429 13821 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:27.169072 18604 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
W20260811 16:05:27.259804 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63798.9us
I20260811 16:05:27.259069 13739 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:27.111016 18611 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:27.259027 14582 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.015s	sys 0.038s
I20260811 16:05:27.183408 18149 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260811 16:05:27.208963 13707 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.595s (SENT)
I20260811 16:05:27.264061 13744 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:27.264647 14582 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.015s	sys 0.038s
I20260811 16:05:27.266007 13901 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:27.269145 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60219.2us
W20260811 16:05:27.270469 13707 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.603s (SENT)
I20260811 16:05:27.171353 18594 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:27.271499 13707 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.676s (SENT)
I20260811 16:05:27.203982 18628 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.277801 13905 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9.
I20260811 16:05:27.183128 18148 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:27.285228 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:27.293953 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:27.287442 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:27.168077 18463 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:27.289489 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:27.303963 13738 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:27.289605 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:27.289986 13901 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260811 16:05:27.287631 13707 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.899s (SENT)
I20260811 16:05:27.175302 18631 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260811 16:05:27.291833 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:27.289047 13909 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260811 16:05:27.262184 18050 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:27.193706 18657 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:27.342466 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:27.345307 14574 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEARNER]: Advancing to term 10
I20260811 16:05:27.345152 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:27.345124 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48125.4us
I20260811 16:05:27.277331 18163 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:27.268723 18149 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:27.343057 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:27.352626 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65089us
I20260811 16:05:27.278890 18561 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:27.381201 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:27.384167 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:27.361158 13907 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:27.364516 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:27.367180 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75435.5us
I20260811 16:05:27.397594 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:27.152750 18607 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:27.269061 18497 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:27.345415 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:27.343065 18713 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260811 16:05:27.204600 18479 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.167s
I20260811 16:05:27.284397 18594 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:27.368336 18564 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:27.374675 18628 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 5 FOLLOWER]: Advancing to term 6
W20260811 16:05:27.502890 18712 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260811 16:05:27.385593 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2488) took 1110 ms. Trace:
I20260811 16:05:27.199281 18685 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.181s
W20260811 16:05:27.381197 18711 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260811 16:05:27.411974 13901 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:27.379992 18280 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:27.382658 18149 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:27.003012 18691 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.204274 18621 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.388784 18163 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:27.380300 18561 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:27.553160 18561 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:27.446815 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.035s
I20260811 16:05:27.133210 18616 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:27.555367 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.035s
W20260811 16:05:27.557374 18687 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.039s	user 0.004s	sys 0.010s
I20260811 16:05:27.372685 18584 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260811 16:05:27.558368 18584 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Stepping down as leader of term 6
I20260811 16:05:27.558764 18584 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:27.559661 18584 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.560952 18584 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:27.501281 18723 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:05:27.458014 18479 consensus_queue.cc:1225] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260811 16:05:27.389915 18050 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260811 16:05:27.458516 18129 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.419s	user 0.016s	sys 0.000s
I20260811 16:05:27.563470 18129 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.566541 18129 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:27.567289 13904 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:27.568876 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2482) took 1396 ms. Trace:
I20260811 16:05:27.569041 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2141) took 1548 ms. Trace:
I20260811 16:05:27.569425 13742 rpcz_store.cc:276] 0811 16:05:26.020698 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.021554 (+   856us) service_pool.cc:227] Handling call
0811 16:05:26.038021 (+ 16467us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:26.283759 (+245738us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:26.409819 (+126060us) log.cc:842] Serialized 14 byte log entry
0811 16:05:26.636127 (+226308us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b1800460180. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:26.706431 (+ 70304us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b1800460180. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:26.813142 (+106711us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:26.813666 (+   524us) log.cc:842] Serialized 26 byte log entry
0811 16:05:26.813836 (+   170us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:26.813879 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:26.813967 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:27.568830 (+754863us) raft_consensus.cc:1671] finished
0811 16:05:27.568873 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:27.568986 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29705,"prepare.queue_time_us":125949,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":415521,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":75410,"spinlock_wait_cycles":27064576,"thread_start_us":538153,"threads_started":2,"wal-append.queue_time_us":521765}
I20260811 16:05:27.573382 18691 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:27.504760 13907 rpcz_store.cc:276] 0811 16:05:26.275345 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.001951 (+726606us) service_pool.cc:227] Handling call
0811 16:05:27.002372 (+   421us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:27.385271 (+382899us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.385515 (+   244us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:27.459465 18594 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:27.577292 18709 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260811 16:05:27.536394 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1259) took 1711 ms. Trace:
I20260811 16:05:27.578794 14579 rpcz_store.cc:276] 0811 16:05:25.824467 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:25.834681 (+ 10214us) service_pool.cc:227] Handling call
0811 16:05:25.880632 (+ 45951us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:26.007780 (+127148us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:26.016953 (+  9173us) log.cc:842] Serialized 14 byte log entry
0811 16:05:26.350609 (+333656us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18002cba20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:05:27.153104 (+802495us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:27.191000 (+ 37896us) log.cc:842] Serialized 26 byte log entry
0811 16:05:27.191213 (+   213us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:27.191260 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.191354 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:27.535933 (+344579us) raft_consensus.cc:1671] finished
0811 16:05:27.536080 (+   147us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:27.536288 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62229,"prepare.queue_time_us":8912,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":86196,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11386,"spinlock_wait_cycles":5975296,"thread_start_us":824463,"threads_started":2,"wal-append.queue_time_us":1455018}
I20260811 16:05:27.491879 18604 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260811 16:05:27.546103 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2206) took 1475 ms (client timeout 1639 ms). Trace:
W20260811 16:05:27.583352 13905 rpcz_store.cc:269] 0811 16:05:26.070957 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.071067 (+   110us) service_pool.cc:227] Handling call
0811 16:05:27.545868 (+1474801us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:27.546027 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2619896192}
I20260811 16:05:27.557927 18687 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.562842 18723 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:27.584671 18723 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:27.586016 18687 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:27.585848 18723 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.587239 18463 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:27.587651 18723 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:27.588546 18561 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.589757 14578 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:27.590721 18561 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:27.587817 18463 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:27.591682 18702 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:27.591570 18463 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:27.593190 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 183283us
I20260811 16:05:27.596366 18463 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:27.597157 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:27.599442 18645 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:27.606070 18594 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.608448 18594 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:27.608526 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 224443us
I20260811 16:05:27.496752 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEARNER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:27.612615 18568 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:27.569253 13904 rpcz_store.cc:276] 0811 16:05:26.171977 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.861030 (+689053us) service_pool.cc:227] Handling call
0811 16:05:26.873176 (+ 12146us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:27.567774 (+694598us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.568613 (+   839us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400088ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:27.568814 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1595722496}
I20260811 16:05:27.623859 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:27.662688 13825 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:27.505796 18564 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:27.464974 18652 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260811 16:05:27.422736 18497 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:27.677568 13903 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.017s	sys 0.023s
W20260811 16:05:27.678514 13903 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.017s	sys 0.023s
W20260811 16:05:27.671644 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47936.8us
I20260811 16:05:27.676896 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:27.683746 14574 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:27.684839 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:27.686662 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:27.689036 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:27.702615 14583 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.019s	sys 0.043s
W20260811 16:05:27.703066 14583 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.019s	sys 0.043s
W20260811 16:05:27.710121 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.761s (SENT) [suppressed 50 similar messages]
I20260811 16:05:27.658797 18568 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:27.712024 13735 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.023s
W20260811 16:05:27.716223 13735 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.011s	sys 0.024s
I20260811 16:05:27.669827 18564 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:27.714861 13900 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.005s	sys 0.029s
W20260811 16:05:27.717519 13900 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.006s	sys 0.029s
I20260811 16:05:27.695689 18710 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:27.695039 18690 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:27.722738 18690 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:27.616665 18280 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.699400 18692 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:27.712448 18572 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:27.755870 14575 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.009s	sys 0.029s
W20260811 16:05:27.751720 13908 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.025s
W20260811 16:05:27.756453 14575 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.029s
I20260811 16:05:27.725543 18690 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:27.756635 13908 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.026s
I20260811 16:05:27.767916 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:27.787465 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.017s	sys 0.025s
W20260811 16:05:27.788579 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.018s	sys 0.026s
I20260811 16:05:27.815229 13827 raft_consensus.cc:2396] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:05:27.816217 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2468) took 1695 ms. Trace:
I20260811 16:05:27.816689 13902 rpcz_store.cc:276] 0811 16:05:26.136674 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.815922 (+679248us) service_pool.cc:227] Handling call
0811 16:05:26.816285 (+   363us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:26.816664 (+   379us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:26.816690 (+    26us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:26.854177 (+ 37487us) log.cc:842] Serialized 52 byte log entry
0811 16:05:27.555772 (+701595us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:27.555813 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.555881 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:27.815900 (+260019us) raft_consensus.cc:1671] finished
0811 16:05:27.815931 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:27.816138 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10360,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":624639,"threads_started":1,"wal-append.queue_time_us":950035}
W20260811 16:05:27.828109 18633 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.140s	user 0.011s	sys 0.002s
I20260811 16:05:27.828889 18280 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:27.830241 18497 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:27.787441 18637 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.016s	sys 0.054s
W20260811 16:05:27.836959 18675 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.003s
W20260811 16:05:27.851241 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.005s	sys 0.027s
W20260811 16:05:27.851653 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.005s	sys 0.027s
I20260811 16:05:27.858706 13818 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:27.859320 13818 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:27.839025 18637 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.016s	sys 0.054s
W20260811 16:05:27.870378 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.006s	sys 0.031s
W20260811 16:05:27.875797 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.006s	sys 0.031s
W20260811 16:05:27.870736 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.018s	sys 0.026s
W20260811 16:05:27.877116 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.018s	sys 0.026s
W20260811 16:05:27.877938 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 950575us
W20260811 16:05:27.878839 14542 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.066s (SENT)
W20260811 16:05:27.876228 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 687163us
I20260811 16:05:27.779708 18568 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:27.918639 13906 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:27.889958 13818 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:27.923694 13817 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.005s	sys 0.050s
I20260811 16:05:27.867559 18675 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:27.924202 13817 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.005s	sys 0.050s
W20260811 16:05:27.924574 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.019s	sys 0.018s
I20260811 16:05:27.921128 18717 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:27.933068 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.019s	sys 0.018s
W20260811 16:05:27.934870 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 765148us
I20260811 16:05:27.936966 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:27.940972 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:27.944442 13740 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:27.946585 18715 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.391s	user 0.001s	sys 0.001s
I20260811 16:05:27.947448 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 721) took 1308 ms. Trace:
W20260811 16:05:27.952216 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.001s	sys 0.018s
W20260811 16:05:27.952517 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.012s
W20260811 16:05:27.956185 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.005s	sys 0.037s
W20260811 16:05:28.014127 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.008s	sys 0.012s
W20260811 16:05:28.014235 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.006s	sys 0.037s
I20260811 16:05:28.013669 13906 rpcz_store.cc:276] 0811 16:05:26.639099 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.727568 (+ 88469us) service_pool.cc:227] Handling call
0811 16:05:27.947261 (+1219693us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002ad0d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:27.947387 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2551391488}
W20260811 16:05:28.014503 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 615332us
I20260811 16:05:28.015558 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.016549 18633 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:27.974052 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.012s	sys 0.008s
I20260811 16:05:28.017036 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:27.951932 18148 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.014s
W20260811 16:05:28.017997 18148 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.006s	sys 0.014s
I20260811 16:05:27.961848 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.018347 18148 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:27.933151 18149 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.014648 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 726065us
W20260811 16:05:28.026525 13787 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.517s (SENT)
I20260811 16:05:28.028478 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:28.029121 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:28.019694 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.032424 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:27.972298 18682 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.009s
I20260811 16:05:28.019495 18148 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.033527 18682 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.010s
I20260811 16:05:28.022864 18149 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:28.034327 14573 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:27.950845 18594 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:28.017593 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.012s	sys 0.008s
I20260811 16:05:28.035473 14578 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6. Ops: []
I20260811 16:05:28.037305 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.038094 14577 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:28.027025 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:28.013801 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.001s	sys 0.018s
W20260811 16:05:28.038789 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 665837us
I20260811 16:05:28.038856 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:28.016484 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 75598.5us
I20260811 16:05:27.966205 18685 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:28.042219 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:27.966926 18710 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:28.041522 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.045522 14581 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:28.046274 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.001s	sys 0.022s
I20260811 16:05:28.013373 18637 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:28.045367 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.057336 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:28.058228 14577 raft_consensus.cc:2354] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6.
I20260811 16:05:28.060310 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.048915 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:27.945043 18717 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:28.052655 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.061635 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.047917 18584 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
W20260811 16:05:28.054344 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.001s	sys 0.022s
I20260811 16:05:28.067890 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.067560 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:28.130002 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62589.6us
I20260811 16:05:28.091886 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.133076 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:28.130988 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.128091 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:28.050956 18633 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260811 16:05:28.136118 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70089.1us
I20260811 16:05:28.138536 14580 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260811 16:05:28.048611 18685 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:28.140939 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:28.073141 18603 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.044s	sys 0.049s
I20260811 16:05:28.144693 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:28.064112 18611 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.012s	sys 0.012s
I20260811 16:05:28.162781 13817 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:28.063390 18636 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260811 16:05:28.066606 18628 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:28.132490 18710 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:28.134769 18640 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
W20260811 16:05:28.156038 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 443113us
I20260811 16:05:28.165740 13817 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260811 16:05:28.178319 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.004s	sys 0.012s
W20260811 16:05:28.178695 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.004s	sys 0.013s
W20260811 16:05:28.071240 18616 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.010s
I20260811 16:05:28.170688 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.178488 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:28.171037 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:28.158682 18603 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.044s	sys 0.049s
I20260811 16:05:28.172300 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:28.188308 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:28.188759 13825 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:28.173759 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:28.157810 18697 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:28.142920 18577 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:28.181742 13817 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:28.071060 18595 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
W20260811 16:05:28.163117 18611 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.013s	sys 0.013s
I20260811 16:05:28.290239 13825 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260811 16:05:28.187783 14578 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:28.062165 18604 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260811 16:05:28.190093 13824 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:28.179762 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 261560us
W20260811 16:05:28.294672 14542 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.951s (SENT)
I20260811 16:05:28.294783 13820 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [9.10-10.11]
W20260811 16:05:28.297313 14542 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.958s (SENT)
I20260811 16:05:28.296253 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:28.298486 13821 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:28.237578 18038 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:28.249622 18717 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:28.263764 18568 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:28.265694 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2554) took 1142 ms. Trace:
W20260811 16:05:28.271584 18738 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260811 16:05:28.275588 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 983) took 1724 ms. Trace:
I20260811 16:05:28.304975 14573 rpcz_store.cc:276] 0811 16:05:26.551678 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.551917 (+   239us) service_pool.cc:227] Handling call
0811 16:05:26.552309 (+   392us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:28.034693 (+1482384us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.275270 (+240577us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54005703d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:28.275516 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3407761280}
W20260811 16:05:28.311568 14542 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.204s (SENT)
I20260811 16:05:28.317184 13820 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:28.180512 18675 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:28.165681 18621 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.010s	sys 0.018s
I20260811 16:05:28.289746 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.301218 13827 rpcz_store.cc:276] 0811 16:05:27.123713 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.129871 (+  6158us) service_pool.cc:227] Handling call
0811 16:05:28.265383 (+1135512us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400124654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:28.265609 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1194319104}
W20260811 16:05:28.181311 18616 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.017s	sys 0.010s
I20260811 16:05:28.181998 18163 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:28.329631 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:28.289654 18636 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:28.313014 18697 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:28.335057 14581 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:28.337777 13817 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:28.163093 18741 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.194s
I20260811 16:05:28.287446 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:28.381568 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94243.8us
I20260811 16:05:28.383028 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.341722 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:28.384251 13820 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:28.351660 13824 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
W20260811 16:05:28.357064 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 295028us
I20260811 16:05:28.385744 18595 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:28.386883 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:28.330942 13789 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.639s (SENT)
I20260811 16:05:28.182672 18710 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:28.388197 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:28.338086 18621 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.010s	sys 0.019s
I20260811 16:05:28.397286 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 869) took 1106 ms. Trace:
I20260811 16:05:28.399909 13818 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:28.296872 18716 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260811 16:05:28.338788 18717 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:28.299466 18050 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.074s
W20260811 16:05:28.422379 13707 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.866s (SENT)
I20260811 16:05:28.418453 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40896 (request call id 2556) took 1268 ms. Trace:
I20260811 16:05:28.439793 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:28.439873 13818 rpcz_store.cc:276] 0811 16:05:27.132627 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.132772 (+   145us) service_pool.cc:227] Handling call
0811 16:05:28.398326 (+1265554us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400355054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51903da7 00007f5c5684fee0 00007f5c4ff41784 00007f5c4ff41712 00007f5c4ff41641 00007f5c4ff415bc 00007f5c4ff40872 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:28.400837 (+  2511us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":199,"spinlock_wait_cycles":1632956160}
I20260811 16:05:28.438115 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:05:28.443907 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60867.9us
I20260811 16:05:28.295395 18577 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:28.386268 18595 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.450415 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 322584us
I20260811 16:05:28.400086 13739 rpcz_store.cc:276] 0811 16:05:27.291023 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.381673 (+ 90650us) service_pool.cc:227] Handling call
0811 16:05:27.381965 (+   292us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:27.574099 (+192134us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:27.574425 (+   326us) log.cc:842] Serialized 14 byte log entry
0811 16:05:28.063580 (+489155us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:28.063651 (+    71us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:28.063717 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.396968 (+333251us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:28.397022 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.397193 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":763,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":135,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4341,"spinlock_wait_cycles":441382656,"thread_start_us":488766,"threads_started":1}
W20260811 16:05:28.465507 14542 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.659s (SENT)
I20260811 16:05:28.471896 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.407706 18723 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:28.409682 18628 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:28.477470 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 346569us
I20260811 16:05:28.467835 13874 leader_election.cc:398] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
I20260811 16:05:28.463974 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1907) took 1787 ms. Trace:
I20260811 16:05:28.495286 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.495926 13874 leader_election.cc:401] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260811 16:05:28.410725 18163 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260811 16:05:28.441141 18702 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.849s	user 0.014s	sys 0.003s
I20260811 16:05:28.418856 18719 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:28.428643 18697 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:28.496017 13740 rpcz_store.cc:276] 0811 16:05:26.676288 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.874781 (+198493us) service_pool.cc:227] Handling call
0811 16:05:26.875134 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:28.011017 (+1135883us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.463592 (+452575us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003430d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:28.463888 (+   296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2458603264}
W20260811 16:05:28.466336 18727 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260811 16:05:28.498450 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:28.553925 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58777us
I20260811 16:05:28.555089 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.471261 18741 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:28.466058 18621 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:28.517355 18735 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.455s	user 0.001s	sys 0.001s
W20260811 16:05:28.518115 18564 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.001s
I20260811 16:05:28.463178 18584 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:28.516706 18607 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.003s	sys 0.003s
W20260811 16:05:28.527839 18733 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
I20260811 16:05:28.487710 18717 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:28.447463 18637 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260811 16:05:28.479014 18723 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:28.399299 18636 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.563952 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 233173us
I20260811 16:05:28.607978 13820 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
W20260811 16:05:28.575325 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 188516us
I20260811 16:05:28.582682 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2150) took 1844 ms. Trace:
I20260811 16:05:28.622000 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2221) took 2212 ms. Trace:
W20260811 16:05:28.570399 18743 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
W20260811 16:05:28.568257 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69917.4us
I20260811 16:05:28.612066 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:28.638789 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 867) took 1348 ms. Trace:
I20260811 16:05:28.618134 13735 rpcz_store.cc:276] 0811 16:05:26.738748 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.991455 (+252707us) service_pool.cc:227] Handling call
0811 16:05:27.041585 (+ 50130us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:27.075556 (+ 33971us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:27.075588 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:27.087988 (+ 12400us) log.cc:842] Serialized 26 byte log entry
0811 16:05:27.719558 (+631570us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:27.719615 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.719691 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:28.582429 (+862738us) raft_consensus.cc:1671] finished
0811 16:05:28.582451 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.582610 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":28520,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2785,"thread_start_us":602007,"threads_started":1,"wal-append.queue_time_us":877011}
W20260811 16:05:28.563123 18690 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.003s
W20260811 16:05:28.576035 18736 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260811 16:05:28.600678 18718 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.000s	user 0.000s	sys 0.013s
I20260811 16:05:28.659950 13741 rpcz_store.cc:276] 0811 16:05:27.290549 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.378343 (+ 87794us) service_pool.cc:227] Handling call
0811 16:05:27.378771 (+   428us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:27.763195 (+384424us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:27.763235 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:27.763661 (+   426us) log.cc:842] Serialized 26 byte log entry
0811 16:05:28.080688 (+317027us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:28.080747 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.591447 (+510700us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400277ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:28.591501 (+    54us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:28.610537 (+ 19036us) raft_consensus.cc:1671] finished
0811 16:05:28.610567 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.638673 (+ 28106us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2469,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10704,"spinlock_wait_cycles":882914048,"thread_start_us":316657,"threads_started":1,"wal-append.queue_time_us":835809}
I20260811 16:05:28.596374 18697 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.581458 18734 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.512s	user 0.000s	sys 0.011s
W20260811 16:05:28.588382 18607 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.004s	sys 0.003s
I20260811 16:05:28.592708 18577 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:28.563297 18702 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:28.677265 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 231581us
I20260811 16:05:28.576155 18729 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:28.592394 13821 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:28.583707 18755 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:28.578198 18710 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:28.583204 18751 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9.
W20260811 16:05:28.701824 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 236353us
W20260811 16:05:28.668097 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 488697us
I20260811 16:05:28.577994 18149 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:28.517894 18628 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:28.596984 18685 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:28.581694 18780 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:28.587179 18753 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:28.580224 18741 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:28.582459 18652 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:28.598881 18636 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:28.593214 18717 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:28.622455 13908 rpcz_store.cc:276] 0811 16:05:26.409688 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.074944 (+665256us) service_pool.cc:227] Handling call
0811 16:05:27.098451 (+ 23507us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:27.110562 (+ 12111us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:27.110611 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:27.121349 (+ 10738us) log.cc:842] Serialized 52 byte log entry
0811 16:05:27.763609 (+642260us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:28.171110 (+407501us) log.cc:842] Serialized 14 byte log entry
0811 16:05:28.592656 (+421546us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:28.611611 (+ 18955us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.611777 (+   166us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:28.611823 (+    46us) raft_consensus.cc:1671] finished
0811 16:05:28.621745 (+  9922us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.621930 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":683357,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":60,"raft.queue_time_us":423177,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":16829,"spinlock_wait_cycles":46547840,"thread_start_us":1394459,"threads_started":3,"wal-append.queue_time_us":1440734}
I20260811 16:05:28.731350 13906 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:28.730990 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.733120 13904 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:28.733304 13908 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:28.733158 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.734476 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:28.736069 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:28.589773 18783 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:28.588887 18584 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.616228 18463 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.012s	sys 0.003s
W20260811 16:05:28.689661 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.014s
I20260811 16:05:28.611857 18719 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260811 16:05:28.691215 13821 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:28.675945 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:28.693358 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:28.595536 18723 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:28.740114 18753 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:28.576989 18742 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.110s
I20260811 16:05:28.706986 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:28.673102 18640 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:28.709215 14542 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.829s (SENT)
I20260811 16:05:28.714032 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:28.723893 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:28.767315 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.583303 18564 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:28.704270 18755 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:28.726693 13817 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:28.714776 18780 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.760274 18696 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.152s	user 0.015s	sys 0.021s
I20260811 16:05:28.583578 18595 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:28.704644 18607 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:28.675800 18690 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:28.789139 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 82255.2us
I20260811 16:05:28.789862 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:28.790293 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76344.6us
I20260811 16:05:28.791253 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:28.791682 13741 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260811 16:05:28.741752 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 186763us
I20260811 16:05:28.793949 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:28.710907 18631 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:28.749298 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.014s
I20260811 16:05:28.753917 13906 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
W20260811 16:05:28.797578 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 613303us
I20260811 16:05:28.758278 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:28.704924 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:28.759763 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:28.758844 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1267) took 2041 ms. Trace:
I20260811 16:05:28.742319 18751 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:28.753082 18763 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.188s	user 0.000s	sys 0.003s
I20260811 16:05:28.804584 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:28.804898 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 979) took 2287 ms. Trace:
I20260811 16:05:28.764757 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.702200 18729 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:28.767351 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58175.7us
W20260811 16:05:28.769102 13903 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.006s	sys 0.005s
I20260811 16:05:28.765383 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.724745 18685 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260811 16:05:28.778373 18604 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:28.773854 13827 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:28.724742 13824 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:28.777698 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:28.738757 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:28.760636 13820 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:28.798979 14575 rpcz_store.cc:276] 0811 16:05:26.717415 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.838144 (+120729us) service_pool.cc:227] Handling call
0811 16:05:26.859979 (+ 21835us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:26.860434 (+   455us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:26.860477 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:26.864699 (+  4222us) log.cc:842] Serialized 26 byte log entry
0811 16:05:27.084978 (+220279us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b180044e540. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:05:27.757122 (+672144us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:27.757187 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.757299 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:28.580688 (+823389us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:28.758629 (+177941us) raft_consensus.cc:1671] finished
0811 16:05:28.758650 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.758784 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3470,"raft.queue_time_us":78743,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":18213,"spinlock_wait_cycles":140579968,"thread_start_us":671865,"threads_started":1,"wal-append.queue_time_us":1093517}
I20260811 16:05:28.798368 13823 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 7.
I20260811 16:05:28.772199 18784 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:28.807317 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:28.804090 18752 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:28.836737 13909 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12.
I20260811 16:05:28.808583 18148 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:28.809120 18561 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:05:28.809924 18742 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:28.809998 18690 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:28.810890 18761 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260811 16:05:28.811805 18628 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:28.796736 18607 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:28.820756 18564 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:28.822211 18640 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:28.775081 18652 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:28.825012 18732 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260811 16:05:28.824386 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:28.826509 13908 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:28.830184 13903 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.006s	sys 0.005s
I20260811 16:05:28.830963 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:28.788156 18696 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.015s	sys 0.021s
W20260811 16:05:28.754105 18463 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.013s	sys 0.003s
W20260811 16:05:28.796173 18677 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.014s	sys 0.014s
I20260811 16:05:28.903446 13902 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:28.836066 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:28.903472 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67950.4us
I20260811 16:05:29.044911 13817 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:29.045346 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.807899 18753 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.050884 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.051501 13902 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12. Re-sending same reply.
I20260811 16:05:28.855737 13901 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:29.052351 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.906268 13907 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
W20260811 16:05:29.050711 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 246190us
I20260811 16:05:29.056005 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:28.829290 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2218) took 2558 ms. Trace:
I20260811 16:05:28.918939 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:28.805297 14582 rpcz_store.cc:276] 0811 16:05:26.517702 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.517908 (+   206us) service_pool.cc:227] Handling call
0811 16:05:26.577192 (+ 59284us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:26.589524 (+ 12332us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:26.589570 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:26.600618 (+ 11048us) log.cc:842] Serialized 26 byte log entry
0811 16:05:27.269732 (+669114us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:27.273374 (+  3642us) log.cc:842] Serialized 14 byte log entry
0811 16:05:27.273642 (+   268us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.273748 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:27.533631 (+259883us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b48000606d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:28.599658 (+1066027us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:28.804695 (+205037us) raft_consensus.cc:1671] finished
0811 16:05:28.804719 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.804843 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":3041,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":148363,"raft.run_cpu_time_us":2942,"raft.run_wall_time_us":106916,"spinlock_wait_cycles":193413888,"thread_start_us":543172,"threads_started":1,"wal-append.queue_time_us":932626}
I20260811 16:05:28.939599 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:28.941864 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 110006us
W20260811 16:05:28.977636 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 272832us
W20260811 16:05:28.856755 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58592.4us
I20260811 16:05:28.907999 13904 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:28.976073 18736 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260811 16:05:29.062474 13827 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:05:29.025777 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.069792 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.071002 13908 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:29.027189 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 196277us
I20260811 16:05:29.073017 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.016090 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2217) took 2750 ms. Trace:
I20260811 16:05:28.836448 18163 raft_consensus.cc:2741] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260811 16:05:28.824246 18799 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:05:29.053246 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.055958 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.054898 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:29.054981 13902 raft_consensus.cc:2362] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
W20260811 16:05:29.050199 18677 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.015s	sys 0.014s
I20260811 16:05:29.098709 13909 raft_consensus.cc:2362] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11. Re-sending same reply.
I20260811 16:05:28.836609 18280 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:29.056941 13900 rpcz_store.cc:276] 0811 16:05:26.271122 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.985377 (+714255us) service_pool.cc:227] Handling call
0811 16:05:27.005795 (+ 20418us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:27.052829 (+ 47034us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:27.052899 (+    70us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:27.088175 (+ 35276us) log.cc:842] Serialized 52 byte log entry
0811 16:05:27.718094 (+629919us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:28.136322 (+418228us) log.cc:842] Serialized 14 byte log entry
0811 16:05:28.473739 (+337417us) log.cc:842] Serialized 14 byte log entry
0811 16:05:28.476625 (+  2886us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.478193 (+  1568us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:28.829024 (+350831us) raft_consensus.cc:1671] finished
0811 16:05:28.829059 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:28.829216 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2598,"prepare.queue_time_us":729402,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":16860,"raft.queue_time_us":566919,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":41515,"thread_start_us":1312367,"threads_started":3,"wal-append.queue_time_us":1249345}
I20260811 16:05:29.076450 13817 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:29.073961 13903 rpcz_store.cc:276] 0811 16:05:26.265624 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.922519 (+656895us) service_pool.cc:227] Handling call
0811 16:05:26.946944 (+ 24425us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:26.947280 (+   336us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:26.947317 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:26.982024 (+ 34707us) log.cc:842] Serialized 26 byte log entry
0811 16:05:27.678996 (+696972us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:28.184841 (+505845us) log.cc:842] Serialized 14 byte log entry
0811 16:05:29.015619 (+830778us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:29.015734 (+   115us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:29.015806 (+    72us) raft_consensus.cc:1671] finished
0811 16:05:29.015824 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:29.016010 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":738549,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":67,"raft.queue_time_us":395473,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":1943422,"threads_started":3,"wal-append.queue_time_us":982054}
I20260811 16:05:29.100936 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.080899 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:28.988487 18692 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:29.086320 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.101725 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.102010 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:28.977880 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 366816us
I20260811 16:05:29.093894 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:28.922588 18572 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.138s
I20260811 16:05:29.017612 18129 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:29.108598 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:29.109406 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.104674 13787 leader_election.cc:398] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 5 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 5. Current term is 6.
I20260811 16:05:29.111119 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:28.971673 18604 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.095405 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.105540 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:29.106248 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:29.106289 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:28.830952 18751 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.112291 18789 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260811 16:05:29.107412 13823 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260811 16:05:29.085512 18752 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:29.130813 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:28.918286 18784 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.078569 18463 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:28.904331 18717 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.134560 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:29.135246 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77246.1us
I20260811 16:05:29.136606 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.137468 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:29.018088 18652 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.250818 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:29.134064 18148 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:29.097090 18798 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:29.053460 18564 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260811 16:05:29.113102 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 132184us
I20260811 16:05:29.113346 18793 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:29.193605 18692 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:29.156786 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:29.154824 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:29.096251 18597 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:29.147902 18577 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.118s
I20260811 16:05:29.201578 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1266) took 2485 ms. Trace:
I20260811 16:05:29.306512 14583 rpcz_store.cc:276] 0811 16:05:26.716436 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:26.833339 (+116903us) service_pool.cc:227] Handling call
0811 16:05:26.834587 (+  1248us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:26.834878 (+   291us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:26.834911 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:26.923569 (+ 88658us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:26.924072 (+   503us) log.cc:842] Serialized 26 byte log entry
0811 16:05:27.703797 (+779725us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:27.703853 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:27.703948 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:29.195577 (+1491629us) raft_consensus.cc:1671] finished
0811 16:05:29.195603 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:29.201501 (+  5898us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8677760,"thread_start_us":710898,"threads_started":1,"wal-append.queue_time_us":1715130}
I20260811 16:05:29.203459 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:29.308369 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:29.138819 18776 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260811 16:05:29.130232 18603 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:29.260115 18637 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:29.356266 13817 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260811 16:05:29.251489 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 114094us
I20260811 16:05:29.358009 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.360162 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:29.110014 13901 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:29.251555 13823 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:29.190027 18628 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:29.104249 18280 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:29.190682 13902 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:29.132019 18163 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260811 16:05:29.290405 13905 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:29.201649 18463 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:29.154438 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:29.371690 13820 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:29.305109 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 211289us
I20260811 16:05:29.308503 13818 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 7.
I20260811 16:05:29.153824 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:29.241703 18755 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:29.235991 13907 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
I20260811 16:05:29.135772 18129 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.284946 18793 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:29.379633 18793 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:29.381282 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.382542 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.375497 18818 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:29.376072 18784 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:29.383713 18784 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:29.383553 18818 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.286964 18780 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:29.388286 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.287235 18801 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:29.267290 18785 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:29.352885 18603 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:29.329573 18807 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader election won for term 7
I20260811 16:05:29.406468 18818 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:29.406219 18628 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260811 16:05:29.416070 18780 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:29.417220 18163 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:29.287587 18611 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.107s
W20260811 16:05:29.396098 18723 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
I20260811 16:05:29.421547 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.370702 18280 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:29.423682 13905 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:29.284341 18798 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.449267 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.417708 18800 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:29.453963 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.455642 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:29.425483 18607 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:29.440415 18801 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:29.447795 18702 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:29.443970 18163 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:29.469177 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:29.422406 18815 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:29.407550 18785 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:29.475904 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.484820 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.487833 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.488897 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.472770 18800 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:29.462791 18463 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.494915 18463 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:29.495229 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.496049 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.496352 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.496968 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.497154 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.497908 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:29.498456 13900 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:29.498728 13906 pending_rounds.cc:76] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 3
I20260811 16:05:29.499056 13906 pending_rounds.cc:97] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260811 16:05:29.499346 13906 raft_consensus.cc:2866] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:29.500388 18808 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:29.501266 18810 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:29.501976 18814 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:29.502573 18814 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.459815 18803 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.366s
I20260811 16:05:29.459404 18729 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:29.441637 18148 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:29.506042 18805 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260811 16:05:29.506717 18806 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:29.507850 18751 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:29.457866 18807 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:29.494932 18800 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.509616 18807 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.407328 18752 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.496004 13903 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:29.531381 13900 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
W20260811 16:05:29.528705 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53334.8us
I20260811 16:05:29.794646 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.755257 13902 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260811 16:05:29.793097 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.812136 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.821859 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.824404 13740 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:29.489396 18702 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.588382 13900 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260811 16:05:29.828480 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:29.829113 13900 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:29.829173 18702 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:29.748059 18806 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:29.831882 18806 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.462303 18692 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.457273 18603 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:29.456976 18780 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260811 16:05:29.470486 18604 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:29.457136 18723 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:29.505424 18814 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:29.837823 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 476332us
W20260811 16:05:30.183833 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.034s	sys 0.092s
I20260811 16:05:29.844267 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:29.592950 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:30.242550 13742 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260811 16:05:30.032373 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:30.241514 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.038s	sys 0.098s
W20260811 16:05:30.161239 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.032s	sys 0.091s
I20260811 16:05:29.967381 13824 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:29.845754 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:29.855870 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.241561 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:30.288079 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.035s	sys 0.103s
I20260811 16:05:29.851806 14578 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260811 16:05:29.845364 13903 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260811 16:05:29.846757 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 730) took 1076 ms. Trace:
I20260811 16:05:29.910653 13902 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:30.289927 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48591.7us
I20260811 16:05:29.840498 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2518) took 1073 ms. Trace:
I20260811 16:05:30.290704 13905 rpcz_store.cc:276] 0811 16:05:28.766659 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.025130 (+258471us) service_pool.cc:227] Handling call
0811 16:05:29.840262 (+815132us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:29.840416 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":507747072}
W20260811 16:05:30.163080 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 351003us
I20260811 16:05:29.868834 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:30.292968 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:30.289552 13909 rpcz_store.cc:276] 0811 16:05:28.770356 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:28.939186 (+168830us) service_pool.cc:227] Handling call
0811 16:05:29.846593 (+907407us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b54002c10d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:29.846694 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":94160768}
I20260811 16:05:30.268626 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:30.290923 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:29.848272 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:30.296838 14577 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:30.050925 18633 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.879s	user 0.041s	sys 0.122s
W20260811 16:05:30.008976 18812 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.719s	user 0.001s	sys 0.000s
W20260811 16:05:29.846187 18745 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.280s	user 0.000s	sys 0.011s
I20260811 16:05:29.748119 18645 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.007294 18820 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260811 16:05:30.317555 13907 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.011s	sys 0.003s
I20260811 16:05:29.513343 18785 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:29.851285 18794 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.702s	user 0.000s	sys 0.001s
W20260811 16:05:30.194777 18568 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.885s	user 0.015s	sys 0.001s
W20260811 16:05:30.306267 18148 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.013s	sys 0.005s
I20260811 16:05:30.166869 18675 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:29.835004 18806 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:30.194386 18607 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.320302 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 818) took 1256 ms. Trace:
I20260811 16:05:30.325109 14575 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
W20260811 16:05:30.194619 18793 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.003s
I20260811 16:05:29.837244 18594 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:29.568560 18804 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:29.835829 18716 raft_consensus.cc:465] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Not starting pre-election -- already a leader
I20260811 16:05:29.789230 18149 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.326993 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:29.845609 18798 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:29.852870 18129 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:30.310207 18753 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.009s	sys 0.015s
I20260811 16:05:30.330673 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:29.567885 18729 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.040055 18652 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:30.244925 18603 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:30.193604 18828 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:30.336136 13907 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.011s	sys 0.003s
I20260811 16:05:29.844699 18719 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Stepping down as leader of term 9
W20260811 16:05:30.317085 18800 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.004s	sys 0.011s
I20260811 16:05:30.341285 13742 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:05:30.318426 18633 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.149s	user 0.048s	sys 0.151s
I20260811 16:05:30.306257 18631 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:30.348554 13827 rpcz_store.cc:276] 0811 16:05:29.064094 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.064242 (+   148us) service_pool.cc:227] Handling call
0811 16:05:29.064558 (+   316us) raft_consensus.cc:1457] Updating replica for 4 ops
0811 16:05:29.096078 (+ 31520us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:29.096117 (+    39us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0811 16:05:29.112946 (+ 16829us) log.cc:842] Serialized 104 byte log entry
0811 16:05:29.466426 (+353480us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:29.789561 (+323135us) log.cc:842] Serialized 14 byte log entry
0811 16:05:29.857993 (+ 68432us) log.cc:842] Serialized 14 byte log entry
0811 16:05:29.957396 (+ 99403us) log.cc:842] Serialized 14 byte log entry
0811 16:05:29.968165 (+ 10769us) log.cc:842] Serialized 14 byte log entry
0811 16:05:29.968428 (+   263us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:29.968523 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:30.319981 (+351458us) raft_consensus.cc:1671] finished
0811 16:05:30.320010 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:30.320217 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36362,"prepare.queue_time_us":323388,"prepare.run_wall_time_us":9382,"raft.queue_time_us":229401,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":26355,"spinlock_wait_cycles":172679424,"thread_start_us":276326,"threads_started":1,"wal-append.queue_time_us":1062075}
I20260811 16:05:30.028049 18163 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.344436 14577 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:30.319640 18702 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.322789 17781 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:30.360070 14579 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
W20260811 16:05:30.341845 18148 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.014s	sys 0.006s
W20260811 16:05:30.362810 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.003s	sys 0.028s
W20260811 16:05:30.407917 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.003s	sys 0.028s
W20260811 16:05:30.408144 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.571s	user 0.012s	sys 0.008s
I20260811 16:05:30.370266 18804 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:30.329493 18604 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260811 16:05:30.374075 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.004s	sys 0.028s
I20260811 16:05:30.346271 18675 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:29.569788 18815 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.352078 18594 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:30.360078 18806 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:30.390295 13742 raft_consensus.cc:595] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:30.421627 13742 raft_consensus.cc:603] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:30.360898 18790 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:30.326352 18645 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:30.377604 18753 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.009s	sys 0.015s
I20260811 16:05:30.358763 18716 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:29.569109 18801 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.839s
W20260811 16:05:30.409037 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.012s	sys 0.008s
I20260811 16:05:30.448690 18716 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.391533 18729 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.450214 18801 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.450773 18801 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:30.451237 18729 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.451725 18752 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:05:30.452528 18729 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:05:30.453074 18801 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:30.453508 18798 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260811 16:05:30.414757 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.004s	sys 0.028s
I20260811 16:05:30.454407 18804 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.455303 18682 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.455823 18682 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.387512 18719 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:30.457938 18682 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.458541 18719 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.460417 18719 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:30.389729 18800 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.004s	sys 0.012s
I20260811 16:05:30.419296 14583 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:30.462236 18568 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.462926 18568 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.465365 18568 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:30.465966 18568 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:30.406047 18717 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.009s	sys 0.010s
W20260811 16:05:30.467478 18717 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.009s	sys 0.010s
I20260811 16:05:30.355244 18793 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.468066 18675 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.469888 18793 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:30.427174 13906 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.017s	sys 0.008s
W20260811 16:05:30.428551 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.082s	sys 0.087s
I20260811 16:05:30.356866 18607 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:05:30.470805 13906 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.017s	sys 0.008s
I20260811 16:05:30.471475 18148 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:30.472592 18607 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.473160 18607 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:30.473853 18607 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.412717 14574 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:30.474792 18816 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.443593 18561 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
W20260811 16:05:30.470902 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.082s	sys 0.087s
W20260811 16:05:30.475531 18772 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.892s	user 0.004s	sys 0.015s
W20260811 16:05:30.475739 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.22991e+06us
I20260811 16:05:30.475414 18816 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.410297 18631 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:30.444978 18723 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.470239 18675 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:30.451327 14573 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:30.371737 18149 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.474865 18645 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.433632 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2559) took 3275 ms. Trace:
I20260811 16:05:30.499487 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.453751 18801 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:30.478368 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:30.470870 13904 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:30.475392 18561 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:30.488546 18149 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.476486 18594 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.421990 18783 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260811 16:05:30.492188 18038 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260811 16:05:30.494278 18463 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.999s	user 0.011s	sys 0.000s
I20260811 16:05:30.434841 18806 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:30.414351 18702 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.495625 18825 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:30.498335 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.518620 13735 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:30.498785 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.466444 18568 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.500469 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.506179 18723 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:30.441962 18784 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.058s	user 0.009s	sys 0.001s
I20260811 16:05:30.505262 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:30.490219 13873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.008s
W20260811 16:05:30.530272 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.006s	sys 0.009s
I20260811 16:05:30.422868 18633 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.427114 18790 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:30.451049 18716 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:30.414122 17781 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.520902 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:30.499933 13826 rpcz_store.cc:276] 0811 16:05:27.158170 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.158321 (+   151us) service_pool.cc:227] Handling call
0811 16:05:27.158679 (+   358us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:27.159038 (+   359us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:27.159069 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:27.164699 (+  5630us) log.cc:842] Serialized 26 byte log entry
0811 16:05:28.037292 (+872593us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:28.037353 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.037446 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:29.845545 (+1808099us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:30.426318 (+580773us) raft_consensus.cc:1671] finished
0811 16:05:30.426353 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:30.433535 (+  7182us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1307,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11018,"spinlock_wait_cycles":67154176,"thread_start_us":777806,"threads_started":1,"wal-append.queue_time_us":1226135}
I20260811 16:05:30.503750 18801 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:30.571496 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50671us
I20260811 16:05:30.524325 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 814) took 2231 ms. Trace:
I20260811 16:05:30.527976 18781 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
W20260811 16:05:30.528512 18754 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.939s	user 0.024s	sys 0.036s
I20260811 16:05:30.520282 18561 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.533427 18149 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:30.523054 18594 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:30.536005 18769 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.957s	user 0.017s	sys 0.017s
I20260811 16:05:30.534942 18786 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:30.569547 18682 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:30.517848 18640 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.038s	sys 0.028s
I20260811 16:05:30.518235 18584 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.538343 18790 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:30.576208 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 285346us
I20260811 16:05:30.573122 13825 rpcz_store.cc:276] 0811 16:05:28.293229 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:28.301726 (+  8497us) service_pool.cc:227] Handling call
0811 16:05:28.302110 (+   384us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:28.307740 (+  5630us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:28.307786 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:28.320064 (+ 12278us) log.cc:842] Serialized 26 byte log entry
0811 16:05:28.642641 (+322577us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:28.677507 (+ 34866us) log.cc:842] Serialized 14 byte log entry
0811 16:05:28.920602 (+243095us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.920673 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:30.524048 (+1603375us) raft_consensus.cc:1671] finished
0811 16:05:30.524077 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:30.524248 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7899,"prepare.queue_time_us":40616,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":37,"raft.queue_time_us":45629,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":22504,"thread_start_us":484774,"threads_started":2,"wal-append.queue_time_us":717793}
I20260811 16:05:30.575093 18781 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:30.540141 18784 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260811 16:05:30.539906 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.015s	sys 0.016s
I20260811 16:05:30.572991 18148 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.541375 18633 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:30.579854 18716 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.711520 13820 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260811 16:05:30.722321 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.015s	sys 0.026s
I20260811 16:05:30.727267 13901 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260811 16:05:30.728571 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 935547us
I20260811 16:05:30.578613 18752 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:30.624624 18640 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.038s	sys 0.028s
I20260811 16:05:30.574535 18723 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:30.740834 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 414179us
I20260811 16:05:30.742188 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:30.739275 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:30.616937 18463 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.616629 18808 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.725695 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:30.705919 18607 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:30.778775 13736 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260811 16:05:30.617836 18786 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:30.786015 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:30.768255 13741 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.008s	sys 0.015s
I20260811 16:05:30.766510 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:30.772094 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:30.787725 13741 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.008s	sys 0.016s
I20260811 16:05:30.787967 13818 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:30.772289 13824 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260811 16:05:30.788844 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:30.789069 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.789254 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.790086 13905 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:30.678807 18631 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.738410 13825 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:30.724233 18843 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.781754 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.732124 18752 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:30.791199 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.789999 13902 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:30.748687 18832 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:30.796968 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:30.798779 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:30.802587 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:30.888806 13735 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:30.890946 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:30.891782 13824 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 7.
W20260811 16:05:30.890857 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76043.3us
I20260811 16:05:30.804401 13817 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:30.807878 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 488427us
I20260811 16:05:30.680698 18682 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.811424 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.813244 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:30.819926 13821 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260811 16:05:30.783093 18790 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:30.827839 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.783849 18849 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.835556 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:30.924155 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111030us
I20260811 16:05:30.926380 13909 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:30.926981 13825 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:30.734923 18716 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.735795 18584 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:30.795821 18692 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:30.890427 13900 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:30.813706 18848 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.923067 13903 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:30.843559 13736 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:30.887539 18807 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:30.818049 18780 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:30.940779 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:30.941403 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.942091 13909 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:30.729769 18801 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:30.843636 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:30.731307 18148 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:30.934711 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 142511us
W20260811 16:05:30.935107 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 173995us
I20260811 16:05:30.725955 18806 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.923467 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.946162 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:30.924647 13818 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:30.783193 18723 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.817425 18640 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.145s
I20260811 16:05:30.786530 18463 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.930579 18752 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:31.050928 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:30.890689 18843 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:30.971031 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 245462us
I20260811 16:05:30.842129 18789 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:30.940483 18692 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.042151 18807 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.834839 18744 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.787009 18808 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:30.952180 18848 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:31.058660 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 164649us
I20260811 16:05:31.060822 13817 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260811 16:05:30.889009 18753 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.895154 18800 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:31.066373 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111245us
I20260811 16:05:31.150342 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:30.821911 18729 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:30.936751 18568 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:31.042479 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:31.166291 13821 raft_consensus.cc:2396] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260811 16:05:31.072382 13825 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:30.843053 18841 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:30.935659 18280 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.464s	user 0.010s	sys 0.005s
I20260811 16:05:31.077539 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:31.080570 18038 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:31.081847 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:30.892825 18832 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:30.936090 18702 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:30.829592 18781 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:30.931345 18784 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.159s
I20260811 16:05:31.063349 18786 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:31.131359 18842 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260811 16:05:31.132124 18887 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:31.132964 18723 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.134287 18463 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:31.093725 17781 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:31.138316 18868 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:30.944516 18849 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.140055 18780 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:05:31.136776 18603 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.001s
I20260811 16:05:30.859704 18631 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:31.157917 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 224165us
I20260811 16:05:31.168598 13825 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260811 16:05:31.168486 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:31.181897 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 104437us
I20260811 16:05:31.111805 18744 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:31.131441 18716 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.214381 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:31.317402 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.006s
W20260811 16:05:31.585826 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.040s	sys 0.090s
W20260811 16:05:31.432602 14573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1001) took 1586 ms (client timeout 1778 ms). Trace:
W20260811 16:05:31.243372 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 161632us
W20260811 16:05:31.350780 18757 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.746s	user 0.007s	sys 0.014s
I20260811 16:05:31.563917 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1288) took 2505 ms. Trace:
W20260811 16:05:31.643855 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.040s	sys 0.098s
W20260811 16:05:31.664546 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 820990us
I20260811 16:05:31.359719 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 878) took 1940 ms. Trace:
I20260811 16:05:31.667110 13741 rpcz_store.cc:276] 0811 16:05:29.419792 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.419907 (+   115us) service_pool.cc:227] Handling call
0811 16:05:29.420197 (+   290us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:29.439111 (+ 18914us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:29.439201 (+    90us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:29.447554 (+  8353us) log.cc:842] Serialized 26 byte log entry
0811 16:05:30.788239 (+1340685us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:30.788277 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:30.788343 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:31.359420 (+571077us) raft_consensus.cc:1671] finished
0811 16:05:31.359451 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:31.359643 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7561,"raft.queue_time_us":283,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":18444,"thread_start_us":1274593,"threads_started":1,"wal-append.queue_time_us":1846216}
I20260811 16:05:31.580732 13908 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:31.670298 13908 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:31.644047 14573 rpcz_store.cc:269] 0811 16:05:29.846192 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:30.268195 (+422003us) service_pool.cc:227] Handling call
0811 16:05:31.432357 (+1164162us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54006603d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:31.432525 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":358369152}
W20260811 16:05:31.639578 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.005s	sys 0.006s
W20260811 16:05:31.348043 18594 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.722s	user 0.007s	sys 0.004s
W20260811 16:05:31.351285 18845 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.506s	user 0.001s	sys 0.000s
W20260811 16:05:31.564147 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1006) took 3560 ms (client timeout 1610 ms). Trace:
W20260811 16:05:31.696540 14574 rpcz_store.cc:269] 0811 16:05:28.003332 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:28.032123 (+ 28791us) service_pool.cc:227] Handling call
0811 16:05:31.563946 (+3531823us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5400571054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:31.564057 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5320927616}
W20260811 16:05:31.311589 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76905.4us
I20260811 16:05:31.698526 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:31.348825 18692 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.671561 13908 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.4, Last appended by leader: 4, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.355705 18808 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:31.468152 18675 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.967s	user 0.006s	sys 0.007s
I20260811 16:05:31.666342 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:31.347648 18785 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.007s
I20260811 16:05:31.539642 18755 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:31.213747 18280 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.351744 18148 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:31.468868 18719 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.008s	user 0.013s	sys 0.000s
I20260811 16:05:31.249397 18793 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.464s
I20260811 16:05:31.708775 18880 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:31.674876 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:31.699122 14578 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260811 16:05:31.539325 18717 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:31.699761 13827 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260811 16:05:31.429901 18862 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260811 16:05:31.248286 18844 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.464s	user 0.000s	sys 0.001s
I20260811 16:05:31.348851 18807 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.437794 18815 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:31.357218 18758 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 2.771s	user 0.004s	sys 0.019s
W20260811 16:05:31.247638 18837 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.569s	user 0.000s	sys 0.001s
I20260811 16:05:31.249511 18702 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:31.216588 18633 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:31.576356 18839 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.949s	user 0.003s	sys 0.000s
I20260811 16:05:31.644320 18637 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:31.214191 18038 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:31.716745 18716 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260811 16:05:31.352960 18857 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260811 16:05:31.563249 18163 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:31.361467 18843 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:31.247390 18870 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:31.509057 18828 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:31.360445 18797 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:31.528985 18830 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:31.629544 18848 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:31.352061 18789 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:31.351454 18851 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:31.786442 18797 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:31.788122 18851 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:31.788810 18851 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:31.789376 18797 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:31.791131 18797 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:31.692960 18858 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260811 16:05:31.365010 18584 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:31.340657 18856 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:31.791501 18789 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:31.355237 18682 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.221324 18841 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.795315 18789 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:31.795559 18826 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.949s	user 0.005s	sys 0.003s
I20260811 16:05:31.674854 18806 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260811 16:05:31.798971 18806 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:31.799523 18806 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:31.794545 18816 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:31.718307 18780 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:31.800554 18841 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:31.801017 18780 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:31.710516 18855 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:31.802977 18855 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.807255 18786 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:31.693361 18787 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260811 16:05:31.183470 18800 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:31.753180 18742 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.736s	user 0.012s	sys 0.040s
I20260811 16:05:31.411399 18832 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:31.765518 18637 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.819473 18744 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:31.801659 18780 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:31.820928 18637 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.786197 18830 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:31.844075 18800 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:31.800606 18806 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.883999 18806 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:31.831866 18830 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:31.892478 18830 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:31.902698 18801 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:31.902102 18851 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.909951 18868 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:31.912320 18851 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:31.969257 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 257227us
W20260811 16:05:31.971541 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.494s	user 0.000s	sys 0.042s
W20260811 16:05:31.972373 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.495s	user 0.000s	sys 0.043s
W20260811 16:05:31.972971 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.49576e+06us
I20260811 16:05:31.975687 13738 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:31.975447 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:31.977069 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:31.978684 13741 raft_consensus.cc:595] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:31.723526 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2552) took 4600 ms. Trace:
I20260811 16:05:32.011773 18645 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:32.013335 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2226) took 2525 ms. Trace:
I20260811 16:05:32.011512 13822 rpcz_store.cc:276] 0811 16:05:27.114819 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:27.117389 (+  2570us) service_pool.cc:227] Handling call
0811 16:05:27.118097 (+   708us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:27.128797 (+ 10700us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:27.128843 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:27.136221 (+  7378us) log.cc:842] Serialized 26 byte log entry
0811 16:05:28.068073 (+931852us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:28.068145 (+    72us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:28.068275 (+   130us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:31.311118 (+3242843us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:31.714544 (+403426us) raft_consensus.cc:1671] finished
0811 16:05:31.714573 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:31.714842 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8543,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6618,"spinlock_wait_cycles":45519104,"thread_start_us":895711,"threads_started":1,"wal-append.queue_time_us":1448279}
I20260811 16:05:31.703711 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:31.709579 13826 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260811 16:05:32.016005 13826 pending_rounds.cc:76] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:05:32.016146 13824 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:32.016534 13826 pending_rounds.cc:97] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260811 16:05:32.017009 13826 raft_consensus.cc:2866] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:31.712965 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46742.2us
I20260811 16:05:32.019356 13707 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12.
I20260811 16:05:31.253226 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 738) took 2472 ms. Trace:
I20260811 16:05:31.704058 13908 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:31.752118 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.018s	sys 0.035s
W20260811 16:05:32.043758 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.018s	sys 0.036s
I20260811 16:05:31.705583 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:31.673789 14573 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:05:31.753957 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.050237 14574 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:31.704020 14577 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:31.726352 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:32.056875 17781 consensus_queue.cc:1159] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 9 } }
I20260811 16:05:32.057888 14577 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:31.765482 18038 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:32.062505 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 391405us
I20260811 16:05:31.772413 18280 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.775784 18631 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:31.434154 18710 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:32.065138 18710 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:31.744376 18717 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.066779 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:31.814239 18742 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.799s	user 0.012s	sys 0.040s
I20260811 16:05:32.082583 18742 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:32.083917 18810 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:31.794389 18752 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.000s
I20260811 16:05:32.084597 18885 raft_consensus.cc:979] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:05:32.085587 18894 raft_consensus.cc:1067] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:05:31.156484 18753 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:31.726037 18755 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:31.721171 18785 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:31.774497 18790 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.834s	user 0.004s	sys 0.010s
I20260811 16:05:32.114977 18050 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:31.791647 18828 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.116264 18149 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.116566 18753 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.117069 18755 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.118359 18828 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:31.777947 18849 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.805809 18855 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:31.784274 18870 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:32.120332 18870 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:32.113022 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.123301 18741 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:32.124146 13818 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:32.008158 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:31.755818 13909 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.026s	sys 0.058s
W20260811 16:05:32.125116 13909 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.027s	sys 0.058s
W20260811 16:05:32.125240 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 883) took 2239 ms (client timeout 1950 ms). Trace:
W20260811 16:05:32.125752 13740 rpcz_store.cc:269] 0811 16:05:29.886188 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.938311 (+ 52123us) service_pool.cc:227] Handling call
0811 16:05:32.007571 (+2069260us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:05:32.125089 (+117518us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35202816}
I20260811 16:05:32.010680 13823 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260811 16:05:32.030537 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 823) took 1232 ms. Trace:
I20260811 16:05:32.021900 13904 rpcz_store.cc:276] 0811 16:05:28.781113 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.109034 (+327921us) service_pool.cc:227] Handling call
0811 16:05:29.136881 (+ 27847us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:30.504051 (+1367170us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:31.252948 (+748897us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002ad0d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:31.253149 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3067477376}
I20260811 16:05:32.009902 18620 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:32.037511 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.021384 18789 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.033445 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:31.663492 14582 rpcz_store.cc:276] 0811 16:05:29.058500 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.084644 (+ 26144us) service_pool.cc:227] Handling call
0811 16:05:29.107049 (+ 22405us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:29.467170 (+360121us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:29.467218 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:29.467276 (+    58us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:29.467321 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:31.563660 (+2096339us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540057fdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:31.563717 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:31.563853 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":827555200}
I20260811 16:05:32.058492 18851 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:31.178196 18729 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.074601 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1292) took 2974 ms. Trace:
I20260811 16:05:32.134765 13903 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:32.079366 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.080117 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2232) took 2588 ms. Trace:
I20260811 16:05:32.079658 18710 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.072165 18856 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.085515 18752 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.154271 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.154634 18785 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.155224 13903 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:32.134213 18789 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.137885 18851 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.156765 18752 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.158408 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.013815 13907 rpcz_store.cc:276] 0811 16:05:29.488120 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.488270 (+   150us) service_pool.cc:227] Handling call
0811 16:05:29.488726 (+   456us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:30.391996 (+903270us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:30.392048 (+    52us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:30.405903 (+ 13855us) log.cc:842] Serialized 52 byte log entry
0811 16:05:30.792067 (+386164us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:31.158464 (+366397us) log.cc:842] Serialized 14 byte log entry
0811 16:05:31.193935 (+ 35471us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:31.194043 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:32.012536 (+818493us) raft_consensus.cc:1671] finished
0811 16:05:32.012573 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.012963 (+   390us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":103615,"prepare.queue_time_us":633318,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":114446,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":21198,"thread_start_us":1471980,"threads_started":3,"wal-append.queue_time_us":1161540}
I20260811 16:05:32.115646 18050 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:31.749686 18880 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.123943 18803 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.124563 18741 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.040225 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 993) took 2565 ms. Trace:
I20260811 16:05:32.021445 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 824) took 1223 ms. Trace:
I20260811 16:05:32.084635 18742 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.131167 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:32.138094 18637 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:32.130208 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.127130 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 750) took 1323 ms. Trace:
I20260811 16:05:32.136967 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:32.104511 18751 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:32.019431 18675 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260811 16:05:32.131946 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.128607 13827 rpcz_store.cc:276] 0811 16:05:30.797864 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:30.798457 (+   593us) service_pool.cc:227] Handling call
0811 16:05:32.029958 (+1231501us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:32.030273 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1852406016}
W20260811 16:05:32.143049 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 437412us
I20260811 16:05:32.117105 18149 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.135543 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.086797 18717 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.166225 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:32.149679 14580 rpcz_store.cc:276] 0811 16:05:29.100042 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.100381 (+   339us) service_pool.cc:227] Handling call
0811 16:05:29.112860 (+ 12479us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:29.113093 (+   233us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:29.113116 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:29.199480 (+ 86364us) log.cc:842] Serialized 26 byte log entry
0811 16:05:29.422241 (+222761us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:29.422273 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:29.422519 (+   246us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:31.794988 (+2372469us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:32.044511 (+249523us) raft_consensus.cc:1671] finished
0811 16:05:32.047454 (+  2943us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.074392 (+ 26938us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23346432,"thread_start_us":130779,"threads_started":1,"wal-append.queue_time_us":250989}
I20260811 16:05:32.163048 18050 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
W20260811 16:05:32.183130 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104159us
I20260811 16:05:32.175885 13903 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:32.158478 18856 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.180133 14583 rpcz_store.cc:276] 0811 16:05:29.474254 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.474407 (+   153us) service_pool.cc:227] Handling call
0811 16:05:29.474774 (+   367us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:30.462642 (+987868us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.039413 (+1576771us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400490554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:32.039856 (+   443us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2171655424}
W20260811 16:05:32.189625 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 167561us
I20260811 16:05:32.195502 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.195830 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:32.196405 13904 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:32.197335 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.181564 13909 rpcz_store.cc:276] 0811 16:05:30.803683 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:30.942711 (+139028us) service_pool.cc:227] Handling call
0811 16:05:30.943132 (+   421us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:30.943610 (+   478us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:30.943649 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:30.944868 (+  1219us) log.cc:842] Serialized 26 byte log entry
0811 16:05:31.143245 (+198377us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:32.125752 (+982507us) log.cc:842] Serialized 14 byte log entry
0811 16:05:32.126334 (+   582us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.126510 (+   176us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:32.126630 (+   120us) raft_consensus.cc:1671] finished
0811 16:05:32.126651 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.126999 (+   348us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":282363,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":38,"raft.queue_time_us":192060,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":238,"thread_start_us":1178658,"threads_started":2,"wal-append.queue_time_us":612878}
I20260811 16:05:32.197358 18880 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.199936 18869 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election won for term 9
W20260811 16:05:32.200464 18910 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260811 16:05:32.200662 18869 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:32.202169 18868 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:32.203521 13825 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:32.204349 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.204679 18803 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.210271 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.211346 13739 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260811 16:05:32.213908 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.214848 13742 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:32.216496 13741 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260811 16:05:32.208967 13904 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260811 16:05:32.176331 18851 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.150074 13906 rpcz_store.cc:276] 0811 16:05:29.491702 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.491835 (+   133us) service_pool.cc:227] Handling call
0811 16:05:29.498505 (+  6670us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:30.471396 (+972891us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:30.471446 (+    50us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:30.472148 (+   702us) log.cc:842] Serialized 52 byte log entry
0811 16:05:30.747967 (+275819us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:30.890762 (+142795us) log.cc:842] Serialized 14 byte log entry
0811 16:05:31.425078 (+534316us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18002f8a20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:31.465687 (+ 40609us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b18002f8a20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:05:31.466037 (+   350us) log.cc:842] Serialized 14 byte log entry
0811 16:05:31.475649 (+  9612us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:31.475755 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:32.034250 (+558495us) raft_consensus.cc:1671] finished
0811 16:05:32.036239 (+  1989us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.079893 (+ 43654us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9314,"prepare.queue_time_us":326868,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":110,"raft.queue_time_us":224028,"raft.run_cpu_time_us":698,"raft.run_wall_time_us":37586,"spinlock_wait_cycles":22844544,"thread_start_us":1501839,"threads_started":4,"wal-append.queue_time_us":591595}
I20260811 16:05:32.233374 13907 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:32.233440 14579 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:32.231781 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.202255 18869 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:32.243647 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 157431us
I20260811 16:05:32.180462 13820 rpcz_store.cc:276] 0811 16:05:30.798248 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:30.799500 (+  1252us) service_pool.cc:227] Handling call
0811 16:05:30.799911 (+   411us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:30.821404 (+ 21493us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:30.821433 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:30.821900 (+   467us) log.cc:842] Serialized 26 byte log entry
0811 16:05:31.329363 (+507463us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:32.019833 (+690470us) log.cc:842] Serialized 14 byte log entry
0811 16:05:32.020492 (+   659us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.020655 (+   163us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:32.020797 (+   142us) raft_consensus.cc:1671] finished
0811 16:05:32.020817 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.021147 (+   330us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16113,"prepare.queue_time_us":446346,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":155945,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":90456,"thread_start_us":820999,"threads_started":2,"wal-append.queue_time_us":602915}
I20260811 16:05:32.231294 18894 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:32.250416 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.253906 13903 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:32.259099 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.257385 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.252343 18645 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.254496 18894 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:32.278303 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2235) took 2785 ms. Trace:
I20260811 16:05:32.269819 18894 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:32.300169 18729 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.301120 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 746) took 1509 ms. Trace:
I20260811 16:05:32.301533 13905 rpcz_store.cc:276] 0811 16:05:30.791131 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:30.791399 (+   268us) service_pool.cc:227] Handling call
0811 16:05:30.791672 (+   273us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:32.212996 (+1421324us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:32.213047 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:32.213113 (+    66us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:32.213150 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.300699 (+ 87549us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:32.300767 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.300922 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4965,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":8587,"spinlock_wait_cycles":3267597056}
I20260811 16:05:32.304450 13908 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 4. Preceding OpId from leader: term: 13 index: 4. (term mismatch)
I20260811 16:05:32.304906 13908 pending_rounds.cc:76] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 3
I20260811 16:05:32.305151 13908 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 12.4
I20260811 16:05:32.305070 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:32.309069 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1946350870421156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260811 16:05:32.309649 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1190350870601833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260811 16:05:32.309721 18841 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.310600 18841 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.280947 18909 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260811 16:05:32.285341 13739 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260811 16:05:32.285148 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:32.313081 18841 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.314054 14573 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260811 16:05:32.314496 14573 pending_rounds.cc:76] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 10
I20260811 16:05:32.314800 14573 pending_rounds.cc:97] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260811 16:05:32.289040 18280 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:32.291361 18645 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.305639 13908 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:32.278926 13901 rpcz_store.cc:276] 0811 16:05:29.493083 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.498077 (+  4994us) service_pool.cc:227] Handling call
0811 16:05:29.498359 (+   282us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:30.729248 (+1230889us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.277602 (+1548354us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002c15d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:32.277969 (+   367us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2825148288}
I20260811 16:05:32.315639 14579 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260811 16:05:32.315900 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83650.3us
I20260811 16:05:32.266039 18751 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.287648 18814 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:32.317121 14573 raft_consensus.cc:2866] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:32.282945 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:32.306243 14580 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:32.342845 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.343220 18645 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.345104 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2233) took 2852 ms. Trace:
I20260811 16:05:32.345588 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.345963 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.346594 18710 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:32.347615 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84947.5us
W20260811 16:05:32.348585 18782 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260811 16:05:32.347644 18640 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:32.346872 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.345597 13908 rpcz_store.cc:276] 0811 16:05:29.492490 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.497209 (+  4719us) service_pool.cc:227] Handling call
0811 16:05:29.497512 (+   303us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:31.580598 (+2083086us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54003e2ea0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190e300 00007f5c5190f371 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc
0811 16:05:32.344590 (+763992us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.344949 (+   359us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2109269376}
W20260811 16:05:32.349820 18797 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.003s
I20260811 16:05:32.351550 18751 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.339655 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:32.355469 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 218734us
I20260811 16:05:32.337484 18741 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.329651 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.357403 14579 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260811 16:05:32.358287 18856 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.331502 18050 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.364171 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 829) took 1363 ms. Trace:
I20260811 16:05:32.367178 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:32.368938 18702 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.007s
I20260811 16:05:32.369230 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.370199 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.374560 13907 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:32.382560 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:32.434310 14573 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:32.383474 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:32.320101 18280 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:32.326699 18851 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:32.386687 18781 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:32.383049 18786 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.010s
I20260811 16:05:32.356369 18814 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.419342 18789 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
W20260811 16:05:32.436338 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 162209us
I20260811 16:05:32.362527 18038 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.342036 18804 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.089s
I20260811 16:05:32.440647 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.430851 13817 rpcz_store.cc:276] 0811 16:05:30.953030 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:30.953199 (+   169us) service_pool.cc:227] Handling call
0811 16:05:31.060515 (+107316us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:31.148855 (+ 88340us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.315873 (+1167018us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400125f50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:32.316098 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":245843840}
I20260811 16:05:32.447371 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.448756 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:32.449577 14579 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:32.449466 13744 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:32.450055 13744 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:32.450639 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.451056 13744 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.451972 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.453629 14579 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260811 16:05:32.453635 13744 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:32.454087 18702 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:32.442910 18645 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:32.448782 18814 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.456964 13902 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:32.456398 18851 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:32.456347 18913 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.113s	user 0.004s	sys 0.000s
I20260811 16:05:32.444223 18789 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:32.441851 18280 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:32.467264 13742 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:32.477406 14580 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:32.469369 18645 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:32.480216 18645 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:32.480742 18909 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260811 16:05:32.482879 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 145389us
I20260811 16:05:32.478113 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.483448 13736 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:32.479343 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.487972 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:05:32.488085 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 142729us
I20260811 16:05:32.488682 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:32.483109 18912 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.114s	user 0.000s	sys 0.003s
I20260811 16:05:32.495414 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.497771 18702 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:32.483614 18640 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:32.503731 18851 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.501051 18825 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.505151 18050 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.508836 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 999) took 2649 ms. Trace:
I20260811 16:05:32.510355 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.496884 18786 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:32.501801 18790 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.501690 18751 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:32.515741 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:32.500385 18803 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.515657 18690 raft_consensus.cc:2741] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260811 16:05:32.512765 14575 rpcz_store.cc:276] 0811 16:05:29.788968 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.789612 (+   644us) service_pool.cc:227] Handling call
0811 16:05:29.789930 (+   318us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:30.348770 (+558840us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.387456 (+2038686us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:32.437783 (+ 50327us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1230244096}
I20260811 16:05:32.486696 18894 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:32.525905 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1922) took 3038 ms (client timeout 1694 ms). Trace:
I20260811 16:05:32.526419 13735 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260811 16:05:32.526391 13738 rpcz_store.cc:269] 0811 16:05:29.487333 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.487495 (+   162us) service_pool.cc:227] Handling call
0811 16:05:32.525654 (+3038159us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:32.525828 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5708981504}
I20260811 16:05:32.528331 13738 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 13 index: 4. (index mismatch)
I20260811 16:05:32.528705 13735 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:32.524277 13744 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
W20260811 16:05:32.519047 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 205543us
I20260811 16:05:32.514484 18786 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:32.540406 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.540856 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.545125 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.548346 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.535445 18786 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:32.544836 18880 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260811 16:05:32.555434 14581 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:32.530704 18751 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.532487 18870 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.520473 18825 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.564459 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:32.572909 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 85125.8us
I20260811 16:05:32.558415 18803 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:32.573838 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:32.575493 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60930.2us
I20260811 16:05:32.530488 18790 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.574947 18830 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260811 16:05:32.585287 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.571738 18038 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.587329 18869 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:32.571161 18050 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:32.586150 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.575459 18804 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.576417 18803 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:32.597085 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:32.598173 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:32.557976 18789 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.584945 18894 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.606915 13735 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:32.601336 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.592921 18050 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:32.599038 18803 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:32.594301 18742 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.609568 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.606755 18870 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.626107 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 994) took 3151 ms. Trace:
I20260811 16:05:32.615456 13738 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:32.617358 13902 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:32.616282 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.620441 13823 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:32.618834 18742 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.614818 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.626561 14581 rpcz_store.cc:276] 0811 16:05:29.474584 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:29.474723 (+   139us) service_pool.cc:227] Handling call
0811 16:05:29.495606 (+ 20883us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:32.560204 (+3064598us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.625843 (+ 65639us) spinlock_profiling.cc:243] Waited 3.05 s on lock 0x7b54003dcf54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:32.626043 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7018765696}
I20260811 16:05:32.613655 18050 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:32.618070 18789 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:32.646615 18780 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.775s	user 0.006s	sys 0.014s
W20260811 16:05:32.650503 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94077.9us
I20260811 16:05:32.658569 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:32.643119 18810 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.006s
I20260811 16:05:32.672049 13738 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:32.664335 13740 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:32.617403 18804 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.686353 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.687525 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.691234 18690 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:32.691979 18690 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.694327 18690 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.695560 13817 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: [12.4-12.4]
I20260811 16:05:32.699321 18463 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.700268 18463 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.655575 18797 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:05:32.707302 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 120807us
I20260811 16:05:32.711473 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.716630 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.717320 13738 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:32.666409 18810 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:32.719417 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 116327us
I20260811 16:05:32.676026 18702 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:32.722918 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.709126 18797 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:32.731081 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.731202 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.732133 13824 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:32.733458 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.658437 18780 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.742343 18780 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.729223 18797 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:32.730091 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.750789 13817 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260811 16:05:32.751072 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.716149 18870 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:32.749668 13823 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:32.751418 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.758670 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.761718 13741 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:32.743947 18874 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.766999 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:32.743104 18780 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.747346 18463 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.777767 18742 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.781646 18149 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:32.782968 18690 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:32.783874 18690 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.788187 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.793190 18640 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:32.794436 18790 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.769024 18870 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.796777 18870 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.798116 13827 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:32.805135 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:32.809906 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61609.5us
I20260811 16:05:32.810643 13744 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:32.813923 13827 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:05:32.824828 18790 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.824533 18780 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.825851 18790 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.790839 18690 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:32.827702 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71816us
I20260811 16:05:32.828524 18790 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.828717 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:32.831701 18786 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.833181 13743 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:32.833138 18790 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.834141 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.834355 18790 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.835064 13902 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:32.835774 18640 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.836093 18780 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.836309 18640 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.836612 18790 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.838265 14573 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:32.841030 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.842414 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.844977 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.776947 18874 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.851593 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:32.852877 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.853569 13738 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:32.854394 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:32.855708 18911 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.490s	user 0.000s	sys 0.003s
I20260811 16:05:32.855561 18710 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:32.857239 18280 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:32.858246 18916 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.493s	user 0.003s	sys 0.000s
I20260811 16:05:32.860208 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.860854 13826 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:32.861716 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.862284 13826 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
W20260811 16:05:32.863935 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 136538us
I20260811 16:05:32.864842 18832 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:32.870172 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.610s (SENT)
I20260811 16:05:32.870694 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:32.870868 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.871544 13741 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:32.872377 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:32.872874 13741 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:32.876457 13737 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:32.881284 13824 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260811 16:05:32.881765 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:32.882359 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.884676 13742 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:32.885108 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.885874 13742 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:32.886848 18280 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.888052 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:32.888846 13817 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:32.889101 18874 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:32.890139 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 144036us
I20260811 16:05:32.890879 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:32.893795 18869 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:32.894321 18869 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:32.894776 18869 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:32.896003 18742 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:32.897292 18742 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:32.897327 18645 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.897908 18742 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:32.898551 18742 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:32.900115 18050 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:32.902221 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73677.3us
I20260811 16:05:32.903931 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:32.904902 18690 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:32.905495 18690 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:32.907778 18702 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:32.908270 18702 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:32.911798 18804 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:32.912364 18817 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:32.912818 18817 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:32.913146 18817 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:32.913376 18825 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:32.906674 18690 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:32.915443 18866 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:32.915921 18866 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:32.917047 18866 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:32.915024 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2581) took 1221 ms. Trace:
I20260811 16:05:32.863041 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.919510 13738 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:32.925712 13735 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:32.928972 14573 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:32.929477 13740 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:32.843102 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:32.932163 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.962311 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:32.963920 13826 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:32.974555 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 352031us
I20260811 16:05:32.963198 13907 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
W20260811 16:05:32.929340 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47736.8us
I20260811 16:05:32.987862 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:32.988579 14573 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:32.994746 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.996055 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:32.996937 13824 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:32.918768 13821 rpcz_store.cc:276] 0811 16:05:31.693454 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:31.693737 (+   283us) service_pool.cc:227] Handling call
0811 16:05:31.694237 (+   500us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:31.701033 (+  6796us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:31.701065 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:31.715240 (+ 14175us) log.cc:842] Serialized 26 byte log entry
0811 16:05:32.063800 (+348560us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:32.064229 (+   429us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:32.914446 (+850217us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b5400380ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:32.914499 (+    53us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:32.914547 (+    48us) raft_consensus.cc:1671] finished
0811 16:05:32.914582 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:32.914843 (+   261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15023488,"thread_start_us":317594,"threads_started":1,"wal-append.queue_time_us":321083}
I20260811 16:05:33.005707 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:33.008049 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:32.838297 18640 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:33.014336 13902 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260811 16:05:33.006611 13827 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:33.019879 18710 raft_consensus.cc:979] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:05:33.020020 18594 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:33.020536 18594 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:33.020591 18710 raft_consensus.cc:1067] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:05:33.021026 18594 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:33.025162 13741 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:33.026850 13741 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:33.043823 18751 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:33.047892 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:33.053062 18825 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:32.964699 18810 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:32.962092 18894 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:32.979172 18870 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:33.011790 18280 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260811 16:05:33.069253 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:33.069623 18810 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:33.071529 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:33.056401 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 70192.2us
I20260811 16:05:33.064621 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:33.070637 13743 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:33.085219 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:33.086200 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:32.897946 18797 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.093050 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:33.108282 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 831) took 1940 ms (client timeout 1987 ms). Trace:
I20260811 16:05:33.122421 13907 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260811 16:05:32.981904 18803 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:33.115578 13818 rpcz_store.cc:269] 0811 16:05:31.167996 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:31.168152 (+   156us) service_pool.cc:227] Handling call
0811 16:05:33.081115 (+1912963us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400355054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:33.108199 (+ 27084us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1110683008}
I20260811 16:05:33.132062 13741 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:33.133493 18463 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260811 16:05:33.136318 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:05:33.136559 13908 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:33.141290 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.143313 18050 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:33.144790 18561 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:33.145385 13901 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:33.070488 18868 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260811 16:05:33.159255 13824 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:33.163862 13826 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260811 16:05:33.164515 13902 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260811 16:05:33.162896 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46797.1us
I20260811 16:05:33.114919 18645 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:33.150132 18810 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.087610 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:33.123260 18786 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:33.175443 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:33.191359 14575 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260811 16:05:33.202154 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:32.983376 13871 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.778s (SENT) [suppressed 10 similar messages]
I20260811 16:05:33.200278 13817 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:33.205878 14580 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:33.166715 18463 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:33.207093 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:33.207052 14573 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:05:33.231796 14573 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:33.233242 14573 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:33.227797 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
W20260811 16:05:33.239516 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 256198us
I20260811 16:05:33.246721 18149 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:33.247350 18149 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:33.248427 18149 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.253322 13821 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:33.258850 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 128997us
I20260811 16:05:33.260529 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:33.262754 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:33.266124 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:33.267850 13818 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:33.269117 13826 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 7. Current term is 8. Ops: []
W20260811 16:05:33.243320 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56306.2us
I20260811 16:05:33.213847 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:33.144445 18050 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260811 16:05:33.126684 18825 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.322558 13908 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:33.226274 18463 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:33.337001 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:33.348193 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:33.353930 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:33.359916 14581 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.038s	sys 0.085s
W20260811 16:05:33.360414 14581 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.038s	sys 0.085s
I20260811 16:05:33.330117 18751 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:33.345494 18463 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:33.389068 13738 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:33.400876 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:33.408066 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:33.409368 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.056s
W20260811 16:05:33.410820 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.056s
I20260811 16:05:33.397553 18050 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
W20260811 16:05:33.415985 18702 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260811 16:05:33.388267 18751 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:33.423789 18690 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.008s
W20260811 16:05:33.434675 18690 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.007s	sys 0.008s
I20260811 16:05:33.417127 18050 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:33.417980 18797 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:33.462107 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 595763us
I20260811 16:05:33.429514 18814 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260811 16:05:33.476081 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.454775 18803 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:33.471909 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.438517 18702 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.495321 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.496191 14580 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
W20260811 16:05:33.485162 18832 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.007s
W20260811 16:05:33.504462 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49098.2us
W20260811 16:05:33.508713 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 338175us
I20260811 16:05:33.474898 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.509858 14575 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:33.518029 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:33.504596 17781 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.080s	sys 0.114s
I20260811 16:05:33.521567 13739 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:05:33.463984 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 408891us
I20260811 16:05:33.537499 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 892) took 1199 ms. Trace:
I20260811 16:05:33.508363 18640 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260811 16:05:33.524386 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:33.525013 17781 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.081s	sys 0.115s
I20260811 16:05:33.537935 13739 rpcz_store.cc:276] 0811 16:05:32.327553 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.327721 (+   168us) service_pool.cc:227] Handling call
0811 16:05:33.526867 (+1199146us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400002b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:33.526963 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2535892736}
I20260811 16:05:33.523270 18675 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:33.572041 18866 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:33.574842 18692 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260811 16:05:33.575937 18692 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:33.576337 18692 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:33.577267 18692 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:33.577975 18942 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260811 16:05:33.578716 18692 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:33.580706 18825 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:33.535769 18803 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260811 16:05:33.583487 18803 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:33.559609 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.593988 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:33.588902 14573 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.601243 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:33.601370 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 340922us
W20260811 16:05:33.600034 18931 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260811 16:05:33.601997 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:33.603530 14577 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:33.589829 18675 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.636672 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:33.639528 14573 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:33.640162 18941 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260811 16:05:33.640414 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.643914 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.644744 14580 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:33.647572 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:33.598659 18702 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:33.624876 18954 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:33.657112 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:33.662601 18935 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.215s	user 0.000s	sys 0.002s
W20260811 16:05:33.654264 18817 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.741s	user 0.015s	sys 0.000s
I20260811 16:05:33.666823 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:33.653601 18751 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:33.676527 18869 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.004s
I20260811 16:05:33.672430 18817 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.677043 18869 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:33.677399 18940 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:05:33.659634 18954 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:33.680554 14579 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:33.681481 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 139882us
I20260811 16:05:33.678889 18817 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:33.698129 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59177.5us
I20260811 16:05:33.685639 18751 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:33.700053 18885 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:33.712827 18751 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:33.704680 18050 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.723999 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1004) took 1469 ms. Trace:
W20260811 16:05:33.725114 18561 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260811 16:05:33.725868 18050 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:33.726473 18934 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260811 16:05:33.728192 14574 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260811 16:05:33.729738 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1029) took 1069 ms. Trace:
I20260811 16:05:33.730146 14574 rpcz_store.cc:276] 0811 16:05:32.665469 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.688629 (+ 23160us) service_pool.cc:227] Handling call
0811 16:05:32.688979 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:33.728656 (+1039677us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:33.729432 (+   776us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:33.729664 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2388948352}
I20260811 16:05:33.731504 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1317) took 1078 ms. Trace:
I20260811 16:05:33.731858 18640 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:33.732071 18867 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:33.732563 18640 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:33.715749 18956 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260811 16:05:33.718050 18675 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:33.719376 18885 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:33.734763 18885 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:33.732769 18867 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.750890 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1941) took 1129 ms. Trace:
W20260811 16:05:33.699324 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 67657.4us
W20260811 16:05:33.761179 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62025.7us
I20260811 16:05:33.762169 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:33.680644 18869 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:33.751528 18935 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260811 16:05:33.701488 18950 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260811 16:05:33.751312 18797 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:33.731881 14578 rpcz_store.cc:276] 0811 16:05:32.653183 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.653319 (+   136us) service_pool.cc:227] Handling call
0811 16:05:32.658564 (+  5245us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:32.716190 (+ 57626us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:32.716243 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:32.719058 (+  2815us) log.cc:842] Serialized 26 byte log entry
0811 16:05:33.166898 (+447840us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:33.166954 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:33.167040 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:33.725615 (+558575us) spinlock_profiling.cc:243] Waited 9.49 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:33.731225 (+  5610us) raft_consensus.cc:1671] finished
0811 16:05:33.731246 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:33.731447 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":34768,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6940,"spinlock_wait_cycles":21816064,"thread_start_us":431291,"threads_started":1,"wal-append.queue_time_us":701671}
I20260811 16:05:33.773660 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:33.776149 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 267885us
I20260811 16:05:33.752952 13737 rpcz_store.cc:276] 0811 16:05:32.621682 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.877853 (+256171us) service_pool.cc:227] Handling call
0811 16:05:32.878330 (+   477us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:32.878941 (+   611us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:33.430331 (+551390us) log.cc:842] Serialized 14 byte log entry
0811 16:05:33.653809 (+223478us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:33.674964 (+ 21155us) log.cc:842] Serialized 52 byte log entry
0811 16:05:33.675109 (+   145us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:33.675163 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:33.675243 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:33.750576 (+ 75333us) raft_consensus.cc:1671] finished
0811 16:05:33.750618 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:33.750800 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5814,"prepare.queue_time_us":379520,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":8838,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":7947,"thread_start_us":662474,"threads_started":2,"wal-append.queue_time_us":304767}
I20260811 16:05:33.685222 18954 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:33.735090 18640 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:33.777522 14575 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:33.700858 18944 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260811 16:05:33.741394 18963 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:33.787720 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 272278us
I20260811 16:05:33.742887 18867 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:33.787446 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 225031us
I20260811 16:05:33.724622 14582 rpcz_store.cc:276] 0811 16:05:32.258251 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.260204 (+  1953us) service_pool.cc:227] Handling call
0811 16:05:32.265624 (+  5420us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:32.473818 (+208194us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:32.585289 (+111471us) log.cc:842] Serialized 14 byte log entry
0811 16:05:33.421529 (+836240us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:33.421608 (+    79us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:33.421676 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:33.723515 (+301839us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:33.723580 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:33.723775 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52824,"prepare.queue_time_us":169824,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":73,"raft.queue_time_us":216447,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":7994,"spinlock_wait_cycles":398792576,"thread_start_us":833724,"threads_started":3,"wal-append.queue_time_us":739440}
I20260811 16:05:33.741029 18870 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260811 16:05:33.801095 18885 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:33.724001 18751 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.803373 18885 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:33.803447 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:33.801395 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:33.804425 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:33.806161 18640 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:33.807709 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:33.807938 18640 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:33.809144 18640 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:33.809587 18640 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:33.809942 18640 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:33.799299 18710 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:33.811506 18710 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:33.776156 18909 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260811 16:05:33.776921 18797 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:33.820245 18710 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.821658 13737 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:33.827035 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:33.828083 13743 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:33.826318 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1318) took 1145 ms. Trace:
I20260811 16:05:33.831717 14577 raft_consensus.cc:2396] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260811 16:05:33.773509 18675 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260811 16:05:33.831755 14581 rpcz_store.cc:276] 0811 16:05:32.680548 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.725280 (+ 44732us) service_pool.cc:227] Handling call
0811 16:05:32.736840 (+ 11560us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:32.760647 (+ 23807us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:32.760700 (+    53us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:32.812830 (+ 52130us) log.cc:842] Serialized 590 byte log entry
0811 16:05:33.360851 (+548021us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:33.360893 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:33.360962 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:33.825999 (+465037us) raft_consensus.cc:1671] finished
0811 16:05:33.826032 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:33.826239 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":215478,"raft.queue_time_us":16355,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6837,"thread_start_us":547564,"threads_started":1,"wal-append.queue_time_us":708679}
I20260811 16:05:33.879599 13822 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:33.838496 18561 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:05:33.885936 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 196774us
W20260811 16:05:33.889868 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 127833us
I20260811 16:05:33.891899 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1853) took 1130 ms. Trace:
W20260811 16:05:33.893409 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89065us
I20260811 16:05:33.892383 13820 rpcz_store.cc:276] 0811 16:05:32.761298 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.761540 (+   242us) service_pool.cc:227] Handling call
0811 16:05:32.769335 (+  7795us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:32.777781 (+  8446us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:32.778201 (+   420us) log.cc:842] Serialized 14 byte log entry
0811 16:05:33.172681 (+394480us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:33.326865 (+154184us) log.cc:842] Serialized 26 byte log entry
0811 16:05:33.338950 (+ 12085us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:33.339005 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:33.339096 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:33.891672 (+552576us) raft_consensus.cc:1671] finished
0811 16:05:33.891693 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:33.891826 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1427,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":398357,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":29048,"thread_start_us":393183,"threads_started":1,"wal-append.queue_time_us":621791}
I20260811 16:05:33.882874 18710 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:33.817621 18963 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:33.899273 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:33.831238 18867 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260811 16:05:33.877877 18463 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:33.892470 18561 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:33.896956 18594 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.875s	user 0.016s	sys 0.000s
I20260811 16:05:33.915477 13743 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260811 16:05:33.913316 18742 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.014s	user 0.008s	sys 0.008s
I20260811 16:05:33.917922 18870 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260811 16:05:33.916718 18594 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.922857 18867 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:05:33.925045 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:33.928717 18463 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:33.932637 18963 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:33.914367 18561 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:33.933324 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:33.937106 18870 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:33.939366 18742 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:33.457681 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:33.940367 18803 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:33.953457 18963 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:33.976975 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:33.978262 13743 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:33.978686 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77583.2us
W20260811 16:05:33.982072 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 73623.2us
I20260811 16:05:33.918198 18751 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260811 16:05:33.949609 18463 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
W20260811 16:05:33.984313 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51116.9us
W20260811 16:05:33.988140 14542 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.550s (SENT)
I20260811 16:05:33.988652 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:33.963747 18974 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:33.963613 18978 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:33.983834 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:33.963510 18965 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:33.979022 18972 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:33.977064 18867 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:33.980623 18803 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:33.978034 18963 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:33.966375 18640 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:33.998073 18814 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:34.003228 18957 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:33.996241 18463 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:34.003741 18957 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:34.004112 18463 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:33.994762 18978 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:34.004731 18640 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:34.005070 18978 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:34.006027 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:33.995028 18972 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:34.007951 18977 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260811 16:05:34.008446 18964 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260811 16:05:34.008864 18977 consensus_queue.cc:1225] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260811 16:05:34.008661 18972 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:33.998956 18966 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:33.994639 18965 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:34.009989 18966 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:34.010100 18972 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:34.010238 18965 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.011238 18742 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:34.010972 18966 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.012600 18966 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:34.013046 18594 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:34.013692 18594 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:34.004742 18957 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.007656 18963 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.016587 18963 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.002725 18980 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:34.017463 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2586) took 1886 ms. Trace:
I20260811 16:05:34.015718 18957 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:34.009567 18803 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:34.025118 18803 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:34.026131 18803 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.027556 18803 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:34.028512 18797 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.029960 18797 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:33.997520 18867 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.032157 18867 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:34.017946 13822 rpcz_store.cc:276] 0811 16:05:32.131561 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:32.131721 (+   160us) service_pool.cc:227] Handling call
0811 16:05:33.101763 (+970042us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:33.893890 (+792127us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:34.016288 (+122398us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400355054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:34.017244 (+   956us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400355050. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:34.017403 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4010604672}
I20260811 16:05:33.994441 18974 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:34.007455 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.007393 18751 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260811 16:05:33.996331 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:34.037303 18050 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:34.043509 18050 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.046689 18751 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:34.047245 18751 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:34.047415 18955 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:34.048318 18751 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.049638 18751 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:34.056804 13742 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:34.055459 18909 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:34.057204 13742 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:34.057433 18978 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.058065 13742 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.059319 18974 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:34.005143 18463 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.061378 18463 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:34.069872 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.047813 18955 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:34.071827 18978 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:34.072745 18955 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.073732 14577 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:34.074259 18955 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.075322 13743 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:34.055899 18954 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.076445 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:34.077334 18954 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:34.077334 18814 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:34.078481 18814 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:34.079557 18814 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.084074 13742 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:34.104671 13630 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.105727 18561 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.107553 18982 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:34.109145 18983 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:34.109548 18983 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:34.110438 18983 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:34.111606 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 104235us
I20260811 16:05:34.112190 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.113224 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.114647 18983 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:34.114961 18050 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:34.123219 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 125806us
W20260811 16:05:34.123716 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 136002us
I20260811 16:05:34.091009 18954 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:34.128707 18751 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:34.128736 18968 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:34.130892 18968 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:34.131330 18968 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:34.135546 13742 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:34.143611 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:34.150520 14574 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:05:34.147747 18692 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260811 16:05:34.158934 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45798.1us
I20260811 16:05:34.151978 14577 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:34.164889 18867 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:34.154546 18978 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:34.166841 18867 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:34.167938 18867 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.171900 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:34.174548 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49762.4us
I20260811 16:05:34.180052 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:34.186084 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.187740 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.189040 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.189742 18965 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.190485 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.193473 18965 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:34.195667 18957 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:34.196504 18885 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:34.196228 18968 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.199640 18885 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:34.202689 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 208678us
I20260811 16:05:34.208242 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:34.209314 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.216423 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:34.218106 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46272.5us
I20260811 16:05:34.220911 13823 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:34.221205 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.222334 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.217558 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.223232 13822 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:34.201815 18966 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.219520 13630 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:34.238931 13904 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:05:34.234831 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.209898 18885 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:34.208055 18965 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.248767 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.264263 13909 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:34.251420 18810 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:34.243865 18050 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260811 16:05:34.253031 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.253885 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.196622 18974 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.254786 13901 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:34.255120 18561 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:34.255548 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.220736 18982 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.256721 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.260455 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.260771 18988 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:34.261129 18957 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:34.265971 13903 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:34.256450 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47268.3us
I20260811 16:05:34.302249 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.303988 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:34.268716 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 169338us
I20260811 16:05:34.314543 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:34.315564 13817 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:34.268888 18983 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:34.324151 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:34.343392 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 124591us
I20260811 16:05:34.348624 13907 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:34.363766 13901 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:34.319231 18978 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:34.263309 18866 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260811 16:05:34.388759 18968 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:34.391294 18974 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:34.397574 13906 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:34.398906 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.401250 13906 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:34.402160 13903 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:34.402415 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.403884 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.369283 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.404974 13900 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:34.369519 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61526.9us
I20260811 16:05:34.327630 18803 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.312575 18982 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.403563 13630 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 8, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.270619 18965 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.263777 18966 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:34.421190 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 160796us
I20260811 16:05:34.372632 18983 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.361732 18985 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:34.493348 13817 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:34.499533 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.503351 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.349448 18814 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.541525 13903 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:34.489305 17781 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:34.542681 13907 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:34.492319 13630 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 7, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193), now has a pending config: VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193), VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194), VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195), VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 7 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:34.541942 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:34.494033 18880 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.549793 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:34.556294 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.560765 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:34.557003 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.562906 13901 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260811 16:05:34.564715 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.565574 13741 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:34.564910 13902 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:34.563414 13901 pending_rounds.cc:76] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 7
I20260811 16:05:34.569447 13901 pending_rounds.cc:97] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260811 16:05:34.569768 13901 raft_consensus.cc:2866] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:34.568652 18810 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:34.572407 18810 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:34.572439 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.573931 13744 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:34.575014 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.575994 13630 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 11, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:34.578306 13630 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 8, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.581346 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.581537 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.581779 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.582183 13740 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:34.575937 14574 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:34.583249 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.584424 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.581032 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.588281 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.589154 14582 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:34.590026 13907 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:34.495771 18977 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260811 16:05:34.543026 18985 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:34.496845 18983 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.593497 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.598807 13736 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:34.598699 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.572649 18974 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:34.597240 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.572811 18810 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.602321 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:34.606654 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.607524 14582 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:34.580919 18880 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.569892 18692 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.604630 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:34.616680 13822 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:05:34.617856 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.622288 13903 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:34.621557 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.630213 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:34.630944 13824 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:34.621481 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.632256 13907 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:34.561231 18814 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.646832 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.602963 18974 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:34.663443 18974 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.645506 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.644578 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.641817 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:34.644832 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.669903 13743 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:34.651656 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.651496 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.652557 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.671895 13744 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.670974 13741 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:34.654153 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:34.573279 17781 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.656747 14581 pending_rounds.cc:76] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 10
I20260811 16:05:34.675508 14577 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.675619 14581 pending_rounds.cc:97] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260811 16:05:34.676265 14581 raft_consensus.cc:2866] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:34.658028 18814 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:34.642580 18988 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260811 16:05:34.631721 18463 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:34.661854 18963 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:34.657912 18997 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260811 16:05:34.632793 18968 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:34.713436 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.714164 13630 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 9, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 9 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.716818 13907 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:34.668538 13740 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:34.720762 13821 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:34.644548 18978 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:34.701167 13739 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:34.729483 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 182425us
I20260811 16:05:34.686345 13818 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:34.703624 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.639518 18971 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:34.732630 13735 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260811 16:05:34.606797 18989 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:34.739894 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.740775 13901 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:34.744815 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:34.668488 18972 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:34.752668 13738 raft_consensus.cc:2396] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:34.756563 13736 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:34.760210 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.632576 18692 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.655380 18885 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.719198 18968 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:34.780671 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.754594 13630 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:34.781322 13739 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:34.784337 14577 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:34.726540 18957 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:34.793274 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:34.788178 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.808049 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.809011 13740 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:34.799753 13744 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:34.756429 19003 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:34.820273 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43999.5us
I20260811 16:05:34.857251 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:34.710745 18963 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:34.785776 18997 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260811 16:05:34.821919 13822 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:34.843657 13630 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:34.775848 18978 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:34.824518 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:34.786459 18968 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:34.779428 18966 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:34.822517 13737 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13.
I20260811 16:05:34.865448 13822 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:34.874354 13630 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 8, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.881973 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:34.888957 13902 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:34.890537 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:34.786588 18971 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.895246 13817 raft_consensus.cc:2354] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:05:34.865448 19009 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:34.892427 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:34.863065 18463 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:34.901153 13630 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.805589 18972 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:34.890563 19000 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260811 16:05:34.820840 18957 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.910037 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.880651 18988 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:34.767324 18985 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.936833 13907 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:34.887602 18640 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:34.938342 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.896354 18983 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:34.952406 13630 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 6, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 6 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:34.878051 18978 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:34.972321 19005 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260811 16:05:34.863415 19003 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.918676 18982 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:34.966256 18974 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:34.908146 19009 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:34.975421 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:34.959754 13817 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:34.978489 13741 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:34.983894 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:34.997860 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:35.003372 14577 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:35.005589 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:35.009819 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.011260 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.979521 18966 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.020671 18966 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.021665 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.022995 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:35.023845 13625 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 212) took 39669 ms (client timeout 15000 ms). Trace:
I20260811 16:05:35.024219 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.024573 19003 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:35.031876 19014 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:05:35.033015 19009 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.033910 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.034814 13907 raft_consensus.cc:2354] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:35.035732 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.036850 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.037429 13907 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:35.038211 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:35.039887 19007 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260811 16:05:35.040701 17781 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.009245 18988 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.043637 18988 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.045950 18988 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.046224 18963 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.047238 18885 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:34.955773 18640 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.048194 18974 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.054754 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:34.981472 18936 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.055768 13825 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
W20260811 16:05:35.056594 18803 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260811 16:05:35.057081 18803 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:35.057017 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.058033 13825 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:35.048185 18972 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.060869 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.061760 13741 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:35.062544 18880 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.062677 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:34.988940 18987 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:35.068084 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.066671 18640 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:35.070734 13822 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.072268 13907 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:35.074321 18978 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.066875 18966 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.076989 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:35.078011 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.078670 13908 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:34.937767 18463 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:35.079743 13900 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260811 16:05:35.079690 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.080149 13900 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:35.018659 13630 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 10, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 10 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:35.081944 13737 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:35.078011 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.082130 18692 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.055938 13742 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:05:35.079751 13821 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:35.080904 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.088671 13908 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:35.089942 13908 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:35.056330 18936 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.091995 18957 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.092310 18936 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.093797 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.093523 18810 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.094686 13739 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:35.095002 13826 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:35.082732 13741 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:35.096474 13741 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:35.096415 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.097863 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:35.098868 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.100118 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.101387 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.101939 13823 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:35.102656 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.082698 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.104010 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.080935 18463 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.108649 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:35.080957 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.109915 13900 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:35.104663 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 99177.3us
I20260811 16:05:35.107683 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.048333 18982 raft_consensus.cc:2741] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260811 16:05:35.111625 13821 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:35.104234 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.112552 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.105191 13736 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:35.087549 13630 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:35.113289 13907 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:35.109925 14541 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13.
I20260811 16:05:35.151497 14541 leader_election.cc:401] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260811 16:05:35.097286 13742 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:35.102950 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.112777 13904 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:35.115260 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:35.152733 13823 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:35.153973 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.154754 13823 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:35.143216 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 298876us
I20260811 16:05:35.128866 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.140159 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.157069 13824 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:35.138463 13740 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:35.141258 13630 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 9, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 9 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:35.160064 13630 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 7, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 7 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:35.144114 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.144151 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.101992 13817 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:35.155645 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.163801 13737 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:35.164288 13820 raft_consensus.cc:2354] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:05:35.112114 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:35.164743 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.165174 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:35.165328 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55541.1us
I20260811 16:05:35.162026 13630 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 10, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 10 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:35.105372 18965 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.174027 13735 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:35.171973 13902 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:35.173763 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.176942 13825 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:35.179484 13630 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:35.189879 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.192565 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:35.194802 13630 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:35.201476 18989 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:35.155851 18957 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260811 16:05:35.205329 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.206602 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.207118 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.207435 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:35.208109 14575 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:35.208423 18702 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:35.208968 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:35.209357 18702 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:35.209741 18702 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:35.210125 18702 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:35.210899 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.211571 13817 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:35.211743 18880 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:35.212189 18880 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:35.183693 18814 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:35.213989 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.214579 13820 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 10
I20260811 16:05:35.217078 18810 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.209967 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.222971 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.224931 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.225696 13738 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:35.227595 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.227677 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:35.228513 13825 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:35.228662 14573 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:35.233734 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:35.244213 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:35.244998 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.245992 13902 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:35.246636 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:35.249226 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.251932 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.250226 13821 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:35.145066 18463 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260811 16:05:35.254628 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:35.254930 13817 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260811 16:05:35.253876 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 125123us
I20260811 16:05:35.256969 13822 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.257360 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:35.255345 14573 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:35.260141 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.261027 13825 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:35.261214 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.261829 13826 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:35.262538 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:35.262728 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.263504 13903 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:35.183178 18965 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:35.266105 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56235.3us
I20260811 16:05:35.265447 13900 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:35.299113 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.183387 19026 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:35.302453 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.305608 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.299696 13630 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 1 to 6, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 6 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:35.310432 19010 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:35.312230 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.312647 18989 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:35.313263 18989 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:35.315333 18645 raft_consensus.cc:2741] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260811 16:05:35.317871 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.312347 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:35.318769 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:35.319592 13736 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:35.321395 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.314968 18909 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:35.325145 13826 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:35.297417 19023 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260811 16:05:35.328542 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.334101 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.329519 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:35.329873 13820 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:35.272857 13902 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260811 16:05:35.266410 18982 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:35.331408 13630 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 11, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 11 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:35.266275 18987 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:35.352030 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:35.352937 13735 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:35.338662 13630 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:35.353387 13735 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:35.272511 18966 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:35.213049 18880 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.314194 18989 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.304651 19029 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:35.323827 18866 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:35.310510 18957 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.337553 18803 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:35.328410 18751 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:35.373621 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2524) took 1139 ms. Trace:
I20260811 16:05:35.337714 18982 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.374258 13903 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:35.405460 13905 rpcz_store.cc:276] 0811 16:05:34.234294 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.234577 (+   283us) service_pool.cc:227] Handling call
0811 16:05:34.261787 (+ 27210us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:34.262253 (+   466us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:34.620976 (+358723us) log.cc:842] Serialized 14 byte log entry
0811 16:05:35.156071 (+535095us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:35.178349 (+ 22278us) log.cc:842] Serialized 26 byte log entry
0811 16:05:35.178593 (+   244us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:35.190260 (+ 11667us) log.cc:842] Serialized 14 byte log entry
0811 16:05:35.190501 (+   241us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:35.190570 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:35.373284 (+182714us) raft_consensus.cc:1671] finished
0811 16:05:35.373316 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:35.373539 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":73662,"prepare.queue_time_us":375963,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":77,"raft.queue_time_us":119137,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":6876,"thread_start_us":692288,"threads_started":3,"wal-append.queue_time_us":341012}
I20260811 16:05:35.351883 19026 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:35.407904 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2538) took 1010 ms. Trace:
I20260811 16:05:35.424999 13906 rpcz_store.cc:276] 0811 16:05:34.397568 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.403622 (+  6054us) service_pool.cc:227] Handling call
0811 16:05:35.407698 (+1004076us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54000884d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:35.407829 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1498594048}
W20260811 16:05:35.370076 18977 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.019s	sys 0.003s
I20260811 16:05:35.406453 13736 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
W20260811 16:05:35.397202 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1355437838938087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260811 16:05:35.357151 18675 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260811 16:05:35.428488 13630 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 2 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 5 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:35.431757 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:35.410796 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 187888us
I20260811 16:05:35.366324 18987 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:35.442934 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.444051 19028 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.444609 19028 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.446050 18751 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:35.446695 18751 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:35.416752 18957 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.447525 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.448316 13825 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:35.448582 19017 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:35.449260 18957 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.449009 19017 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.449740 19017 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:35.444062 13822 raft_consensus.cc:2354] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:35.451225 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:35.451666 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.452034 13736 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:35.439713 18866 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260811 16:05:35.456246 19028 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.457502 13826 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:35.460237 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.461452 18972 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:35.461859 18972 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.462234 18972 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:35.464026 13735 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:35.469098 13612 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.005s
W20260811 16:05:35.469610 13612 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.017s	sys 0.005s
I20260811 16:05:35.462762 19017 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:35.428233 18977 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.019s	sys 0.004s
I20260811 16:05:35.486527 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2535) took 1090 ms. Trace:
I20260811 16:05:35.436777 14542 leader_election.cc:398] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:35.498351 14542 leader_election.cc:401] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:35.495950 13909 rpcz_store.cc:276] 0811 16:05:34.396377 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.401205 (+  4828us) service_pool.cc:227] Handling call
0811 16:05:34.876317 (+475112us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:34.876488 (+   171us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:34.876724 (+   236us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:34.876750 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:34.889778 (+ 13028us) log.cc:842] Serialized 26 byte log entry
0811 16:05:35.144513 (+254735us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:35.182814 (+ 38301us) log.cc:842] Serialized 14 byte log entry
0811 16:05:35.184197 (+  1383us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:35.184297 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:35.442979 (+258682us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b1800218680. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:35.484539 (+ 41560us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:35.486299 (+  1760us) raft_consensus.cc:1671] finished
0811 16:05:35.486320 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:35.486459 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10646,"prepare.queue_time_us":45352,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":2958,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":176350848,"thread_start_us":206464,"threads_started":1,"wal-append.queue_time_us":500720}
I20260811 16:05:35.375262 19034 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:35.404323 19027 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:35.421591 18982 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:35.512720 13824 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260811 16:05:35.408622 18966 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:35.524042 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 199359us
I20260811 16:05:35.514842 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.419376 18803 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.471289 18702 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:35.517053 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 343856us
I20260811 16:05:35.528767 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.519093 18972 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.526734 13818 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:35.555028 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.556205 13817 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:35.418398 19009 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.099s
I20260811 16:05:35.513576 13903 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:35.560272 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.529632 13821 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:35.531780 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.534169 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:35.524616 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88035.7us
I20260811 16:05:35.561384 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.562585 13826 raft_consensus.cc:2396] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260811 16:05:35.562918 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:35.497660 18987 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.574723 18987 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:35.481099 19013 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:35.431593 19029 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:35.480548 19017 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.539232 18803 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:35.573832 18968 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.689s	user 0.004s	sys 0.007s
I20260811 16:05:35.512274 18692 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:35.520069 13789 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.761s (SENT)
I20260811 16:05:35.565766 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:35.579475 19003 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:35.602784 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.600349 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.616680 13817 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:35.608271 13818 raft_consensus.cc:2362] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8. Re-sending same reply.
I20260811 16:05:35.611821 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:35.619040 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99028.2us
I20260811 16:05:35.582854 19013 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:35.642030 18957 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:35.646512 18966 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.610515 19046 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
W20260811 16:05:35.654677 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 325220us
I20260811 16:05:35.712110 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:35.674592 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 340617us
W20260811 16:05:35.680336 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 371582us
I20260811 16:05:35.729190 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.695513 18978 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:35.732007 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.747058 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:35.730808 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.755672 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.756603 13900 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:35.024458 13625 rpcz_store.cc:269] 0811 16:04:55.354407 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:04:55.412136 (+ 57729us) service_pool.cc:227] Handling call
0811 16:05:35.023538 (+39611402us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:05:23.617659 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:05:23.652017 (+ 34358us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:05:23.652083 (+    66us) write_op.cc:435] Acquired schema lock
0811 16:05:23.652108 (+    25us) tablet.cc:660] Decoding operations
0811 16:05:23.653018 (+   910us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:05:23.653132 (+   114us) write_op.cc:641] Partition lock acquired for write op
0811 16:05:23.653158 (+    26us) tablet.cc:683] Acquiring locks for 6 operations
0811 16:05:23.653830 (+   672us) tablet.cc:699] Row locks acquired
0811 16:05:23.653864 (+    34us) write_op.cc:260] PREPARE: finished
0811 16:05:23.654051 (+   187us) write_op.cc:270] Start()
0811 16:05:23.654196 (+   145us) write_op.cc:276] Timestamp: P: 1786464323653990 usec, L: 0
0811 16:05:23.654240 (+    44us) op_driver.cc:331] REPLICATION: starting
0811 16:05:23.754995 (+100755us) log.cc:842] Serialized 2452 byte log entry
0811 16:05:24.464429 (+709434us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:25.627619 (+1163190us) op_driver.cc:444] REPLICATION: finished
0811 16:05:25.964028 (+336409us) write_op.cc:301] APPLY: starting
0811 16:05:25.964217 (+   189us) tablet.cc:1365] starting BulkCheckPresence
0811 16:05:26.641766 (+677549us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b1800325360. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:26.693931 (+ 52165us) tablet.cc:1368] finished BulkCheckPresence
0811 16:05:26.693988 (+    57us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:05:27.564359 (+870371us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:05:27.564681 (+   322us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0811 16:05:27.564742 (+    61us) write_op.cc:312] APPLY: finished
0811 16:05:27.565110 (+   368us) log.cc:842] Serialized 65 byte log entry
0811 16:05:28.752785 (+1187675us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb
0811 16:05:29.134117 (+381332us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:29.147552 (+ 13435us) write_op.cc:454] Released schema lock
0811 16:05:29.202332 (+ 54780us) write_op.cc:341] FINISH: Updating metrics
0811 16:05:29.307031 (+104699us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:29.330209 (+ 23178us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":43891,"mutex_wait_us":22782,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":227478,"apply.run_cpu_time_us":59823,"apply.run_wall_time_us":3450139,"cfile_cache_hit":22,"cfile_cache_hit_bytes":22946,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6213,"cfile_init":2,"lbm_read_time_us":91733,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":9,"num_ops":6,"prepare.queue_time_us":344795,"prepare.run_cpu_time_us":55509,"prepare.run_wall_time_us":579948,"raft.queue_time_us":479070,"raft.run_cpu_time_us":21921,"raft.run_wall_time_us":175857,"replication_time_us":1970574,"spinlock_wait_cycles":162611712,"thread_start_us":2521817,"threads_started":5,"wal-append.queue_time_us":2034214,"wal-append.run_cpu_time_us":44976,"wal-append.run_wall_time_us":3571001}]]}
W20260811 16:05:35.769074 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 349239us
I20260811 16:05:35.770932 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.773021 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.776341 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.712425 18810 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.785106 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:35.798557 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 66663us
I20260811 16:05:35.742513 19034 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.796800 13908 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:35.712311 18909 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.609174 18968 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.794379 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.814229 13905 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:35.799381 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.795600 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.792793 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.815760 13909 raft_consensus.cc:2362] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:05:35.817178 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.808729 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.743000 18978 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:35.822244 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.820065 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.815636 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.816377 13902 raft_consensus.cc:2362] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10. Re-sending same reply.
I20260811 16:05:35.827781 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.828577 13903 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:05:35.829702 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.830592 13903 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:35.831864 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.796605 19037 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.800681 19030 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:35.818218 13901 raft_consensus.cc:2362] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12. Re-sending same reply.
I20260811 16:05:35.834512 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:35.771955 18977 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260811 16:05:35.603669 19026 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.837832 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.844588 13909 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:35.812664 19027 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:35.839610 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.839665 13823 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:35.839124 13905 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13. Re-sending same reply.
I20260811 16:05:35.841984 13908 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:35.838261 13825 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:35.845921 13902 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:35.822465 19053 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.846692 13820 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:35.856684 19053 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.769448 19029 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.858763 19003 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:35.846706 19025 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:35.859325 19027 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:35.814222 19034 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.859709 19003 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:35.860281 19003 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:35.860817 19003 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:35.860442 19027 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.861564 19034 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:35.849743 18978 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.850631 19030 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:05:35.851583 19031 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.634s	user 0.007s	sys 0.005s
I20260811 16:05:35.852913 17781 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:35.855762 18710 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:35.879923 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:05:35.881515 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 453917us
I20260811 16:05:35.883363 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:35.884100 13908 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:35.839921 18814 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.001s
I20260811 16:05:35.816745 18810 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.831890 18971 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.819896 18909 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:35.894690 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.882462 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:35.872629 18983 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.037s
I20260811 16:05:35.843313 18957 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:35.858952 19053 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.800793 19040 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260811 16:05:35.953645 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:35.897734 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 334885us
I20260811 16:05:35.941625 13817 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:35.954445 13825 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:35.873520 19048 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260811 16:05:35.942631 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 387891us
I20260811 16:05:35.873234 18972 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.957552 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:35.957876 18957 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:35.890473 13900 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:35.932617 19010 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.010s	sys 0.032s
I20260811 16:05:35.960031 18957 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:35.960368 19010 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.010s	sys 0.032s
I20260811 16:05:35.883594 17781 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.961884 19010 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:35.962215 17781 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:35.962615 19010 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:35.964304 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2184) took 1314 ms. Trace:
I20260811 16:05:35.963804 19010 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:35.953747 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71360.6us
I20260811 16:05:35.965713 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:35.964762 13743 rpcz_store.cc:276] 0811 16:05:34.650223 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.726671 (+ 76448us) service_pool.cc:227] Handling call
0811 16:05:34.765621 (+ 38950us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:34.805819 (+ 40198us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:34.805854 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:34.806372 (+   518us) log.cc:842] Serialized 26 byte log entry
0811 16:05:35.112688 (+306316us) raft_consensus.cc:1631] Marking committed up to 3
0811 16:05:35.112743 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:35.112807 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:35.850791 (+737984us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:35.963953 (+113162us) raft_consensus.cc:1671] finished
0811 16:05:35.963979 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:35.964217 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3308,"raft.queue_time_us":29438,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":18869,"spinlock_wait_cycles":655375744,"thread_start_us":236800,"threads_started":1,"wal-append.queue_time_us":357383}
I20260811 16:05:35.939736 18978 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:35.969158 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:35.970573 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.971992 18936 raft_consensus.cc:2741] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260811 16:05:35.839708 19037 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:35.949995 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55443.7us
I20260811 16:05:35.972901 18936 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:35.973342 18936 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:35.973757 18936 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:35.974917 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:35.884027 18702 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:35.873044 19030 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:35.938936 18742 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:05:35.941545 19033 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260811 16:05:35.801546 19013 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:35.987603 19035 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260811 16:05:35.981968 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:35.864022 19046 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260811 16:05:36.004060 13817 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:35.988616 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:35.992374 19049 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260811 16:05:35.938089 18814 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13.
I20260811 16:05:35.982708 13825 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:35.952612 18983 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.012s	sys 0.038s
I20260811 16:05:35.976744 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.961876 18909 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:35.998461 19030 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:35.998972 18742 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:36.001911 18702 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:36.015741 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:35.935225 18987 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:36.020042 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 251906us
I20260811 16:05:36.011556 19037 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.032310 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 212344us
I20260811 16:05:36.034780 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:36.015295 19055 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:36.077481 13903 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:36.045192 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:36.024000 18742 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:36.057897 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:36.025372 18965 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.005s	sys 0.017s
I20260811 16:05:36.059720 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:36.090803 13743 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:36.064589 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 236685us
I20260811 16:05:36.078406 14573 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:36.024240 18702 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:36.086124 14575 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:36.093495 14544 leader_election.cc:398] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10.
I20260811 16:05:36.110436 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.094260 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:36.105118 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1043) took 1234 ms. Trace:
I20260811 16:05:36.113117 14579 rpcz_store.cc:276] 0811 16:05:34.871084 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.871336 (+   252us) service_pool.cc:227] Handling call
0811 16:05:34.890652 (+ 19316us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:34.891128 (+   476us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:34.891185 (+    57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:34.891737 (+   552us) log.cc:842] Serialized 26 byte log entry
0811 16:05:35.248476 (+356739us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:35.248535 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:35.248638 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:36.104828 (+856190us) raft_consensus.cc:1671] finished
0811 16:05:36.104849 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:36.105031 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2895,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8520,"thread_start_us":272571,"threads_started":1,"wal-append.queue_time_us":482277}
I20260811 16:05:36.076870 18968 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.090560 18965 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.005s	sys 0.017s
I20260811 16:05:36.123931 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:36.122382 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 106721us
I20260811 16:05:36.131879 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:36.133756 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:36.124372 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.097206 18702 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:36.116485 18909 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260811 16:05:36.145048 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 185949us
I20260811 16:05:36.107301 19064 raft_consensus.cc:2741] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260811 16:05:36.147938 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:36.105607 19072 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:36.097811 18983 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260811 16:05:36.095690 19040 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260811 16:05:36.155107 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88136.4us
I20260811 16:05:36.132827 18977 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:36.137640 18885 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:36.176587 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206122us
I20260811 16:05:36.181311 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:36.145130 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 184212us
W20260811 16:05:36.153422 18982 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260811 16:05:36.153060 19046 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:36.212110 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.213047 13736 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:36.215451 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:36.181403 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.184300 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.146878 18909 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:36.193291 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.197880 13743 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:36.153190 19037 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:36.149906 19083 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:36.181892 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:36.247967 19060 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260811 16:05:36.250458 19091 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:36.251295 19052 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:36.251364 19013 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:36.255275 13742 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:36.253895 14578 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:36.250948 19091 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:36.190848 18810 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.257390 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73185.1us
W20260811 16:05:36.254418 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73030.7us
I20260811 16:05:36.246019 18977 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:36.244750 19083 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:36.246654 19055 raft_consensus.cc:2741] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260811 16:05:36.201119 18814 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260811 16:05:36.282732 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.286226 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.284536 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.282965 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.296774 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:36.297436 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:36.278998 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62476us
I20260811 16:05:36.291245 18977 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:36.302876 19090 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:36.238754 19078 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260811 16:05:36.284723 19017 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:36.306386 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 113142us
I20260811 16:05:36.326876 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.327728 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:36.328994 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:36.306619 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 124825us
I20260811 16:05:36.330080 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.330492 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:36.246905 18909 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:36.335297 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:36.310279 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.256837 19052 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:36.263212 19046 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:36.194510 18885 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.265851 18978 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:36.196264 18982 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.320411 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:36.264981 18971 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:36.262307 19091 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:36.334885 13709 leader_election.cc:398] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:05:36.369320 13709 leader_election.cc:401] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260811 16:05:36.299036 19064 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260811 16:05:36.336977 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53957.7us
I20260811 16:05:36.370432 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:36.370959 14579 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:36.371699 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.253636 19037 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:36.339322 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:36.355554 19046 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:36.341035 13739 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:36.304327 18866 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:36.339481 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 215617us
I20260811 16:05:36.379859 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:36.344190 19017 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:36.345360 19080 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:36.344506 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 210726us
I20260811 16:05:36.351470 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:36.396469 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:36.351958 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:36.303922 18985 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:36.304368 19083 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:36.304910 18987 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:36.401453 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:36.402305 13739 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:36.372236 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:36.358436 18810 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:36.411342 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:36.411487 19088 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260811 16:05:36.412196 14579 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
W20260811 16:05:36.413949 19073 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260811 16:05:36.375890 13737 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:36.340442 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:36.415366 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 786) took 1215 ms. Trace:
I20260811 16:05:36.415630 19079 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:36.361716 19090 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:36.415796 13907 rpcz_store.cc:276] 0811 16:05:35.200374 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:35.258247 (+ 57873us) service_pool.cc:227] Handling call
0811 16:05:35.271884 (+ 13637us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:35.520907 (+249023us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:35.520939 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:35.535866 (+ 14927us) log.cc:842] Serialized 26 byte log entry
0811 16:05:36.081439 (+545573us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:36.081500 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:36.135103 (+ 53603us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:36.135197 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:36.414998 (+279801us) raft_consensus.cc:1671] finished
0811 16:05:36.415023 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:36.415299 (+   276us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":112016,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":189825408,"thread_start_us":650886,"threads_started":2,"wal-append.queue_time_us":578077}
I20260811 16:05:36.359776 18978 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:36.417356 19104 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:36.417502 18978 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:36.417773 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:36.417917 19104 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.353034 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:36.408957 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:36.416975 19090 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:36.372493 19074 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:36.418895 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:36.393949 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65037.3us
W20260811 16:05:36.429709 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49940.4us
I20260811 16:05:36.387526 19046 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:36.434856 13907 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:36.372891 18977 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.460243 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:36.462927 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.464116 13909 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:36.465888 13739 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:36.372758 18971 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.432425 18880 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:36.429924 18810 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:36.428231 19090 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:36.501294 13737 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:36.489449 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:36.411371 19110 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:36.433279 19064 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:05:36.397763 19017 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.510672 13740 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:36.439226 19079 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:36.403775 18985 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:36.502882 19003 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.005s
I20260811 16:05:36.471402 19074 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:36.460641 19026 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:36.524163 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:36.524290 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:36.525625 13909 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:36.528195 13820 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:36.529989 19064 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:36.531558 19101 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:36.532151 19101 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:36.532783 18803 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.001s
I20260811 16:05:36.533245 18803 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:36.533187 19101 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:36.535504 18810 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:36.508047 18977 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:36.542220 13908 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:36.538864 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:36.403525 19080 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:36.549523 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 173002us
W20260811 16:05:36.552089 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89239.5us
I20260811 16:05:36.552731 13907 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:36.553251 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:36.560982 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:36.513810 19110 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.563197 18985 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.564549 19099 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260811 16:05:36.568039 18645 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:05:36.511205 19090 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:36.573390 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:36.530946 19064 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:36.460033 18936 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.568645 19017 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:36.587221 13907 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:36.520865 18463 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:36.596228 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:36.527400 19074 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:36.616338 13820 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:36.625599 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:36.608405 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:36.521087 19003 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:36.602160 18751 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.082s	user 0.014s	sys 0.000s
I20260811 16:05:36.528975 19026 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:36.674063 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 302398us
W20260811 16:05:36.678151 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104824us
I20260811 16:05:36.680121 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:36.613306 18982 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.681782 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 280394us
I20260811 16:05:36.683856 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:36.703768 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:36.705442 13907 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260811 16:05:36.702620 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:36.604257 19064 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:36.706390 13820 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:36.710736 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:36.669585 18885 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:36.719784 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:36.600471 18985 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.106s
I20260811 16:05:36.726507 19119 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:36.727375 19119 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:36.727739 19119 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:36.682200 19037 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:36.682614 18803 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:36.683339 13904 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:36.677173 18751 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:36.471735 19052 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.633216 18463 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.604434 19120 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
W20260811 16:05:36.757115 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77229.1us
W20260811 16:05:36.829582 17781 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.867s	user 0.006s	sys 0.013s
I20260811 16:05:36.728819 18885 raft_consensus.cc:2741] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260811 16:05:36.779495 19112 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260811 16:05:36.728078 19119 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:36.757781 19080 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.828620 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 326309us
I20260811 16:05:36.780534 18936 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:36.709426 19104 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:36.781796 18803 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:36.716985 19017 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:36.861892 18463 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:36.829036 19095 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260811 16:05:36.814015 18645 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:36.826294 19074 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:36.883339 13905 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:36.899066 13737 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:36.932240 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:36.908298 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 128016us
I20260811 16:05:36.713752 19079 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:36.997545 14575 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.017s	sys 0.018s
W20260811 16:05:36.997960 14575 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.017s	sys 0.018s
I20260811 16:05:36.906172 18810 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:36.992543 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:36.993613 13789 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.527s (SENT)
I20260811 16:05:37.001058 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:37.079102 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 85533.4us
W20260811 16:05:36.929687 19121 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260811 16:05:36.936031 19097 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260811 16:05:36.886065 19120 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:36.928433 19115 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260811 16:05:36.930585 19125 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260811 16:05:36.930316 19145 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:36.924805 18936 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:36.875106 17781 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:36.997303 19017 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:37.106731 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 244733us
I20260811 16:05:36.931624 19026 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:37.035116 18987 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:36.933432 19139 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:37.156579 13909 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.005s
I20260811 16:05:36.927871 19135 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:36.928805 19085 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:36.930466 18751 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:37.119020 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 400869us
I20260811 16:05:36.928578 19136 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:05:37.119728 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 410866us
W20260811 16:05:37.127202 14577 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.005s	sys 0.019s
I20260811 16:05:37.178063 19159 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.166220 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:37.179093 19147 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:37.183363 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:36.934986 19146 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:37.038789 19110 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:36.999610 18645 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:36.997916 19003 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:37.157037 13909 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:37.101369 19080 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:37.161154 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:36.986804 18803 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.163429 13743 raft_consensus.cc:2354] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:37.131937 19017 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:37.184253 14577 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.009s	sys 0.020s
I20260811 16:05:37.185927 13737 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:05:37.231544 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:37.168727 19085 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:37.102943 18880 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260811 16:05:37.191352 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 113329us
I20260811 16:05:37.196925 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:37.174342 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2208) took 1141 ms. Trace:
W20260811 16:05:37.170388 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.020s	sys 0.057s
I20260811 16:05:37.248051 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:37.248427 13821 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:37.248733 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.021s	sys 0.062s
I20260811 16:05:37.208191 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:37.208451 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:37.206806 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1893) took 1065 ms. Trace:
I20260811 16:05:37.107270 19120 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.161773 19135 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:37.226563 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:37.270720 13909 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:37.227900 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:37.186537 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:37.039026 18810 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.289215 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:37.236406 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:37.194375 19136 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:37.131618 18936 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.194196 19145 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:37.248391 13742 rpcz_store.cc:276] 0811 16:05:36.032859 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.033020 (+   161us) service_pool.cc:227] Handling call
0811 16:05:36.033328 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:36.262066 (+228738us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:37.174015 (+911949us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54002814d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:37.174266 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":509938944}
I20260811 16:05:37.301626 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:37.249915 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 696760us
I20260811 16:05:37.263221 14574 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:37.273479 13821 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:37.263442 13825 rpcz_store.cc:276] 0811 16:05:36.141756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.141922 (+   166us) service_pool.cc:227] Handling call
0811 16:05:36.142403 (+   481us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:36.293535 (+151132us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:36.293640 (+   105us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:36.295250 (+  1610us) log.cc:842] Serialized 26 byte log entry
0811 16:05:36.366742 (+ 71492us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:36.366792 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:36.366891 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:37.202664 (+835773us) raft_consensus.cc:1671] finished
0811 16:05:37.202685 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:37.206736 (+  4051us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6792,"raft.queue_time_us":58039,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":14926,"thread_start_us":201767,"threads_started":2,"wal-append.queue_time_us":164139}
I20260811 16:05:37.250547 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:37.238916 18909 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.000s
W20260811 16:05:37.276700 19109 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260811 16:05:37.277187 19162 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260811 16:05:37.277904 19096 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:37.278206 19120 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:37.283674 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2560) took 1525 ms. Trace:
W20260811 16:05:37.289337 19082 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.003s	sys 0.022s
I20260811 16:05:37.290239 13909 raft_consensus.cc:2354] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
W20260811 16:05:37.287748 19067 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.011s
I20260811 16:05:37.228331 18463 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:37.383713 13903 rpcz_store.cc:276] 0811 16:05:35.757861 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:35.831538 (+ 73677us) service_pool.cc:227] Handling call
0811 16:05:37.283419 (+1451881us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400142b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:37.283574 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":519474560}
I20260811 16:05:37.394476 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:37.282505 18957 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:37.280480 19158 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.234467 19080 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.280530 19009 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.279393 19102 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:37.274564 19135 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:37.180377 19159 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.279235 19140 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:37.388933 19110 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:37.389564 19030 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.363s	user 0.011s	sys 0.004s
I20260811 16:05:37.388387 18692 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:37.401399 19067 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.015s	sys 0.012s
I20260811 16:05:37.384549 19162 consensus_queue.cc:1225] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260811 16:05:37.428354 19114 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:37.402634 18742 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.305s	user 0.007s	sys 0.007s
W20260811 16:05:37.523113 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 218425us
W20260811 16:05:37.501119 18702 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.354s	user 0.014s	sys 0.000s
I20260811 16:05:37.392889 19096 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:37.211205 19146 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:37.409044 18977 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260811 16:05:37.476738 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:37.482173 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:37.428141 19034 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:37.495683 13735 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:37.497335 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 310890us
I20260811 16:05:37.382792 18909 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:37.505049 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 348212us
W20260811 16:05:37.398046 19082 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.003s	sys 0.023s
W20260811 16:05:37.511315 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 303212us
I20260811 16:05:37.693512 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:37.465049 19093 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.000s	sys 0.013s
I20260811 16:05:37.413775 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1032) took 1104 ms. Trace:
W20260811 16:05:37.565276 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 259848us
I20260811 16:05:37.336056 19145 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.587688 18810 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:37.583567 19163 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260811 16:05:37.641844 19144 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.296090 18645 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.674634 13903 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:37.451722 18957 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.681468 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:37.398737 19157 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
I20260811 16:05:37.517277 19067 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:37.509251 19110 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:37.690173 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.010s	sys 0.027s
W20260811 16:05:37.724853 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.010s	sys 0.027s
I20260811 16:05:37.522596 17781 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:37.696405 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:37.680898 18978 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.263s	user 0.010s	sys 0.003s
I20260811 16:05:37.701368 13737 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:37.563874 18742 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.672091 18702 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:37.697813 19093 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.000s	sys 0.014s
I20260811 16:05:37.509231 18692 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.721021 19082 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:37.459559 19009 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.716686 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:37.476166 19102 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.497313 19085 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.719429 19127 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.719967 19176 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.721014 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:37.502260 19030 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.730686 13735 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:37.702366 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:37.699527 18977 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.672633 19096 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:37.752090 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:37.528106 19140 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.769933 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:37.798473 14574 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:37.711287 18710 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:37.710132 18803 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:37.716686 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:37.776711 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:37.477468 19158 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.784042 13818 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260811 16:05:37.709245 19156 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:37.785400 14581 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:37.786432 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:37.814584 13822 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:37.752743 18645 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:37.789532 13741 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:37.792924 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2204) took 2476 ms (client timeout 1523 ms). Trace:
I20260811 16:05:37.518579 19136 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.768394 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:37.798839 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:37.782982 19137 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260811 16:05:37.802613 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:37.821753 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:37.799449 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 230920us
I20260811 16:05:37.811656 13909 raft_consensus.cc:2354] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
W20260811 16:05:37.795737 19013 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.536s	user 0.011s	sys 0.004s
I20260811 16:05:37.832578 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:37.833405 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:37.809809 19082 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.754988 18978 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:37.818881 13735 rpcz_store.cc:269] 0811 16:05:35.316783 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:35.320239 (+  3456us) service_pool.cc:227] Handling call
0811 16:05:35.463559 (+143320us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b5400361620. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a2951 00007f5c51903321 00007f5c51904b4e 00007f5c51910228 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2
0811 16:05:35.694907 (+231348us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b58005174b0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51887f63 00007f5c518ebaba 00007f5c519033af 00007f5c51904b4e 00007f5c51910228 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c
0811 16:05:37.462092 (+1767185us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b580070cdb0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51887f63 00007f5c518ebaba 00007f5c519033af 00007f5c51904b4e 00007f5c51910228 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c
0811 16:05:37.792831 (+330739us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1057505664}
W20260811 16:05:37.824482 18866 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.428s	user 0.013s	sys 0.002s
I20260811 16:05:37.713624 19144 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.800177 18710 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:37.835968 19189 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:37.872380 13822 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:37.820657 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:37.819406 19003 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:37.862697 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2261) took 1509 ms. Trace:
I20260811 16:05:37.849385 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:37.851701 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1959) took 1569 ms. Trace:
I20260811 16:05:37.890730 13907 rpcz_store.cc:276] 0811 16:05:36.353168 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.667857 (+314689us) service_pool.cc:227] Handling call
0811 16:05:36.681227 (+ 13370us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:36.709410 (+ 28183us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:37.862351 (+1152941us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54001b1554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:37.862608 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":55093632}
I20260811 16:05:37.891413 13743 rpcz_store.cc:276] 0811 16:05:36.282234 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.282471 (+   237us) service_pool.cc:227] Handling call
0811 16:05:37.851460 (+1568989us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:37.851625 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1955618688}
I20260811 16:05:37.854897 13818 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260811 16:05:37.861357 13827 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:37.851531 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 369580us
I20260811 16:05:37.850625 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:37.801728 18936 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:37.870502 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.011s
I20260811 16:05:37.856209 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:37.898924 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.000s	sys 0.012s
I20260811 16:05:37.857103 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:37.887791 14583 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:37.811242 18803 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:37.803259 18977 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.891067 13735 raft_consensus.cc:2362] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
I20260811 16:05:37.827549 19080 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:37.898015 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:37.832942 19156 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:37.884518 13903 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:37.907070 13817 raft_consensus.cc:2396] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260811 16:05:37.870647 19178 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.812053 19172 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260811 16:05:37.886217 18866 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:37.905234 19064 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.198s	user 0.012s	sys 0.003s
W20260811 16:05:37.914644 13707 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.846s (SENT)
I20260811 16:05:37.797926 19176 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.938256 14582 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:37.936538 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:37.939131 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:37.939867 13817 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:37.940860 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:37.924110 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:37.941519 13817 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:37.923437 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 221158us
I20260811 16:05:37.921756 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:37.942723 13743 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:37.848263 19177 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.796116 19127 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.861007 18880 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:37.920976 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:37.946798 13907 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:37.947182 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:37.942740 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:37.913524 18909 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:37.957401 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:37.925884 19119 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.007s	user 0.010s	sys 0.002s
W20260811 16:05:37.922597 19147 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.000s	sys 0.017s
I20260811 16:05:37.922078 18936 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:37.982405 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:37.979077 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64412.4us
I20260811 16:05:37.935845 19080 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:38.003726 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:38.048877 19147 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.007s	sys 0.019s
I20260811 16:05:38.059684 19147 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:38.043627 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:38.061831 13735 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:37.950176 18880 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:37.861119 19164 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260811 16:05:38.040885 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:38.059968 13903 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:38.075544 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2274) took 1235 ms. Trace:
I20260811 16:05:38.075562 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2276) took 1099 ms. Trace:
W20260811 16:05:38.060638 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78356.6us
W20260811 16:05:38.049729 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.249s (SENT) [suppressed 58 similar messages]
I20260811 16:05:37.925345 19157 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:38.051065 13817 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:37.957875 19153 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
W20260811 16:05:37.957743 19138 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.533s	user 0.000s	sys 0.001s
I20260811 16:05:38.073838 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:38.165532 13743 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:37.957496 19110 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.075920 13903 rpcz_store.cc:276] 0811 16:05:36.840998 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.003417 (+1162419us) service_pool.cc:227] Handling call
0811 16:05:38.075474 (+ 72057us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.076821 13907 rpcz_store.cc:276] 0811 16:05:36.976797 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.955851 (+979054us) service_pool.cc:227] Handling call
0811 16:05:38.075506 (+119655us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:37.904501 19183 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260811 16:05:38.005556 17781 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:37.954363 19146 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.027154 19079 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:38.003221 18742 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:38.174007 19090 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.554s	user 0.020s	sys 0.008s
W20260811 16:05:38.135897 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86214us
I20260811 16:05:38.052927 18957 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.180888 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:37.999437 18866 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:38.062951 19009 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.054911 18702 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:37.864723 19082 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:37.898989 19189 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:37.947415 19064 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.008231 19159 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.076615 18880 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:38.131161 19139 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.003s
I20260811 16:05:38.056505 19145 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.219316 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:38.135380 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:05:38.280164 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 145305us
I20260811 16:05:38.281832 13871 leader_election.cc:398] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:38.282241 13871 leader_election.cc:401] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:38.180406 18692 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.221877 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:38.064086 18936 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.283600 13903 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:38.284124 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2281) took 1105 ms. Trace:
I20260811 16:05:38.284430 13903 rpcz_store.cc:276] 0811 16:05:37.178637 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.189465 (+1010828us) service_pool.cc:227] Handling call
0811 16:05:38.284060 (+ 94595us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.222486 18978 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.285354 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:38.286247 13903 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260811 16:05:38.285518 18936 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.222762 19143 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:37.954648 19177 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.223203 19105 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:38.287932 19105 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.223678 19132 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:38.289431 19132 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.224117 19175 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.290872 19175 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.224521 19167 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:38.292502 19167 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.293066 19167 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.296237 19189 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.297120 19189 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:38.297693 19189 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:38.062062 19147 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.189352 17781 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:38.241458 18866 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.243731 18971 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.039175 19119 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.244455 19188 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.443348 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:38.180105 19141 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:38.446882 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.052s	sys 0.106s
W20260811 16:05:38.448091 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.052s	sys 0.106s
W20260811 16:05:38.263484 19138 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260811 16:05:37.933269 19178 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.197500 19110 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:38.190490 19030 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:38.219318 19184 raft_consensus.cc:465] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Not starting pre-election -- already a leader
I20260811 16:05:38.253214 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:38.231752 18803 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:38.265666 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1972) took 1072 ms. Trace:
I20260811 16:05:38.272433 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:38.248265 19091 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.870s	user 0.015s	sys 0.000s
I20260811 16:05:38.273746 19173 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260811 16:05:38.286652 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2279) took 1108 ms. Trace:
I20260811 16:05:38.222640 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:38.264230 19083 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.830s	user 0.000s	sys 0.015s
I20260811 16:05:38.360683 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:38.315196 18957 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:38.258261 19054 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:38.259699 19102 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:38.453780 14580 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.003s
I20260811 16:05:38.301736 19105 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.315076 19159 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:38.548244 19169 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.507s	user 0.000s	sys 0.001s
I20260811 16:05:38.548712 19119 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.548548 19159 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.549479 19197 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.314267 19139 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:38.551286 19185 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:38.298791 19189 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.314733 19140 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.541306 19110 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:05:38.393800 19170 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.508s	user 0.000s	sys 0.001s
I20260811 16:05:38.394737 17781 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:38.551972 19185 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.473272 19177 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:38.508437 14574 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260811 16:05:38.526113 13903 rpcz_store.cc:276] 0811 16:05:37.177926 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.285050 (+1107124us) service_pool.cc:227] Handling call
0811 16:05:38.286597 (+  1547us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.527190 19129 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.527217 19184 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.527777 19059 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:38.528342 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.007s	sys 0.007s
I20260811 16:05:38.247628 19183 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:38.526229 13907 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:38.393602 18977 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:38.446175 18955 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:38.234529 19090 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:38.537891 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 284758us
I20260811 16:05:38.171314 19157 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.454602 19143 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:38.312201 19003 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:38.358408 19167 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.541276 14580 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:38.228595 19156 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:38.499008 19046 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 2.025s	user 0.015s	sys 0.001s
I20260811 16:05:38.547777 19134 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.709832 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:38.474954 18936 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:38.498711 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.011s
W20260811 16:05:38.716254 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.003s	sys 0.011s
I20260811 16:05:38.554668 14575 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:38.398016 19172 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:38.458740 19141 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.719090 19172 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:38.559640 13821 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.036s	sys 0.143s
W20260811 16:05:38.720237 13821 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.036s	sys 0.144s
I20260811 16:05:38.458642 19164 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:38.526494 19179 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.025s	sys 0.015s
I20260811 16:05:38.468065 19144 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.550846 19159 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:38.533726 19083 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.397840 19187 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260811 16:05:38.498261 13735 rpcz_store.cc:276] 0811 16:05:37.193303 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.246600 (+1053297us) service_pool.cc:227] Handling call
0811 16:05:38.264961 (+ 18361us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:38.265238 (+   277us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:38.265274 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:38.265330 (+    56us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:38.265373 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.265442 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:38.265593 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:38.691740 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.014s	sys 0.007s
W20260811 16:05:38.751991 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.000s	sys 0.011s
I20260811 16:05:38.691584 14574 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
W20260811 16:05:38.752642 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.000s	sys 0.011s
I20260811 16:05:38.474190 18909 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:38.551954 19161 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.855s	user 0.002s	sys 0.000s
I20260811 16:05:38.550037 19197 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.698560 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:38.754909 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:38.755716 14580 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:38.712882 13906 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:38.535780 19176 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:38.721261 14583 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.809s	user 0.009s	sys 0.003s
I20260811 16:05:38.730293 13907 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:38.757794 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2280) took 1579 ms. Trace:
I20260811 16:05:38.758263 13907 rpcz_store.cc:276] 0811 16:05:37.178310 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.189542 (+1011232us) service_pool.cc:227] Handling call
0811 16:05:38.757715 (+568173us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.696476 18955 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:38.741094 14579 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:38.762753 13818 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.001s	sys 0.013s
I20260811 16:05:38.597926 18866 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:38.741472 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.036s	sys 0.096s
W20260811 16:05:38.767187 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.037s	sys 0.096s
W20260811 16:05:38.582242 13820 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.031s	sys 0.050s
W20260811 16:05:38.768029 13820 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.039s	sys 0.055s
I20260811 16:05:38.753140 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1049) took 1045 ms. Trace:
I20260811 16:05:38.696894 19010 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:38.763816 13818 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.001s	sys 0.013s
I20260811 16:05:38.757556 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:38.788465 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1051) took 1076 ms. Trace:
I20260811 16:05:38.788846 14583 rpcz_store.cc:276] 0811 16:05:37.711660 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.804263 (+ 92603us) service_pool.cc:227] Handling call
0811 16:05:38.788389 (+984126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.767732 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:38.757194 19192 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.568s	user 0.000s	sys 0.002s
I20260811 16:05:38.741858 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:38.797642 13903 raft_consensus.cc:2362] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
I20260811 16:05:38.798327 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2278) took 1642 ms. Trace:
I20260811 16:05:38.798699 13903 rpcz_store.cc:276] 0811 16:05:37.156307 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.714254 (+1557947us) service_pool.cc:227] Handling call
0811 16:05:38.798245 (+ 83991us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.530645 19091 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.503988 19188 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.789433 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:38.541903 18957 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.789738 13907 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:38.762287 19159 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:38.770571 14574 rpcz_store.cc:276] 0811 16:05:37.707975 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.751824 (+ 43849us) service_pool.cc:227] Handling call
0811 16:05:38.753051 (+1001227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.563442 19054 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.831451 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:38.804353 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2570) took 2657 ms. Trace:
I20260811 16:05:38.741830 19158 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.750779 19127 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.814927 14580 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:38.844609 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:38.844743 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1048) took 1145 ms. Trace:
I20260811 16:05:38.845291 14580 rpcz_store.cc:276] 0811 16:05:37.699662 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.730708 (+1031046us) service_pool.cc:227] Handling call
0811 16:05:38.844654 (+113946us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.699366 19183 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.718290 19046 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.773809 19082 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:38.834801 13742 raft_consensus.cc:2354] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:38.796619 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:38.860638 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64178us
I20260811 16:05:38.861462 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:38.833245 13904 rpcz_store.cc:276] 0811 16:05:36.146548 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.146685 (+   137us) service_pool.cc:227] Handling call
0811 16:05:36.167998 (+ 21313us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:36.304306 (+136308us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:36.336629 (+ 32323us) log.cc:842] Serialized 14 byte log entry
0811 16:05:36.674871 (+338242us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:36.682542 (+  7671us) log.cc:842] Serialized 590 byte log entry
0811 16:05:36.683027 (+   485us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:37.116938 (+433911us) log.cc:842] Serialized 14 byte log entry
0811 16:05:38.549725 (+1432787us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b180002efc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:05:38.803584 (+253859us) log.cc:842] Serialized 14 byte log entry
0811 16:05:38.803930 (+   346us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.804100 (+   170us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:38.804146 (+    46us) raft_consensus.cc:1671] finished
0811 16:05:38.804158 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:38.804297 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17063,"prepare.queue_time_us":36667,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":94787,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":68761,"spinlock_wait_cycles":25096576,"thread_start_us":594517,"threads_started":4,"wal-append.queue_time_us":804632}
I20260811 16:05:38.835747 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:38.837174 13903 raft_consensus.cc:2362] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12. Re-sending same reply.
I20260811 16:05:38.792104 19144 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:38.842095 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:38.735409 18936 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.846467 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:38.790381 13901 raft_consensus.cc:2354] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9.
I20260811 16:05:38.850955 19054 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:38.851696 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.029s	sys 0.085s
I20260811 16:05:38.855928 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:38.768625 18909 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:38.856655 19191 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.402s	user 0.000s	sys 0.002s
I20260811 16:05:38.737926 19164 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.714382 19184 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.727524 19059 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.864331 14583 raft_consensus.cc:2362] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
I20260811 16:05:38.865130 14580 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 6.
I20260811 16:05:38.896365 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1054) took 1143 ms. Trace:
I20260811 16:05:38.896739 14580 rpcz_store.cc:276] 0811 16:05:37.752899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.846142 (+1093243us) service_pool.cc:227] Handling call
0811 16:05:38.896315 (+ 50173us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:38.832315 19175 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:38.873209 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.018s	sys 0.045s
I20260811 16:05:38.833729 19064 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.879803 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:38.876127 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.030s	sys 0.085s
I20260811 16:05:38.908062 13904 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:38.875511 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1385) took 1122 ms. Trace:
I20260811 16:05:38.908895 19224 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:38.909063 14574 rpcz_store.cc:276] 0811 16:05:37.753785 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.835376 (+1081591us) service_pool.cc:227] Handling call
0811 16:05:38.875421 (+ 40045us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:38.909947 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 211483us
I20260811 16:05:38.910429 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:38.911500 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1050) took 1200 ms. Trace:
I20260811 16:05:38.888700 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:38.891104 14573 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:38.802666 19010 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.891827 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:38.886490 18710 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.989s	user 0.013s	sys 0.000s
I20260811 16:05:39.015062 18710 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:38.899875 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.018s	sys 0.045s
I20260811 16:05:38.903476 19164 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.905040 19184 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:38.887531 19190 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.017s
W20260811 16:05:38.889621 19017 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.639s	user 0.013s	sys 0.003s
I20260811 16:05:39.021018 19017 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.021899 18710 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.022449 19010 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:38.887835 19198 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260811 16:05:39.023613 19179 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Stepping down as leader of term 7
I20260811 16:05:38.875352 19199 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:39.024055 19179 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:38.841387 19119 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:38.969743 19157 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:38.942178 18966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.748s	user 0.021s	sys 0.059s
I20260811 16:05:38.874949 19144 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.956000 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 871) took 1078 ms. Trace:
I20260811 16:05:38.960599 19224 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:38.743729 19134 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:38.970430 19211 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260811 16:05:38.947978 19141 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:38.823441 19003 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.944020 19212 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:38.974283 19219 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:39.067595 13743 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:39.063741 19110 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
W20260811 16:05:39.050484 19180 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 1.137s	user 0.005s	sys 0.000s
I20260811 16:05:39.045094 19010 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:38.913867 19210 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260811 16:05:38.952906 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:38.767558 19172 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.864939 19143 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.952559 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:38.852634 18955 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.951874 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.091251 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1389) took 1023 ms. Trace:
I20260811 16:05:39.091675 14583 rpcz_store.cc:276] 0811 16:05:38.067666 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.907376 (+839710us) service_pool.cc:227] Handling call
0811 16:05:39.091165 (+183789us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.092695 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.093123 19028 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:39.093317 14583 raft_consensus.cc:2362] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
I20260811 16:05:39.093588 19028 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:39.095100 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 695) took 2814 ms. Trace:
I20260811 16:05:39.095533 13902 rpcz_store.cc:276] 0811 16:05:36.281123 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.281326 (+   203us) service_pool.cc:227] Handling call
0811 16:05:39.094440 (+2813114us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.095010 (+   570us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5736060288}
I20260811 16:05:39.094515 19028 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:38.953188 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:38.738583 19129 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:38.965597 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 873) took 1087 ms. Trace:
I20260811 16:05:39.012681 13903 raft_consensus.cc:2362] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
W20260811 16:05:39.013804 19200 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260811 16:05:39.034330 19119 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.016222 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 870) took 1159 ms. Trace:
I20260811 16:05:38.990798 19090 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:39.033838 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.002345 19083 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.040196 19091 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.040794 18957 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.041169 19017 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.041961 19046 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:39.042397 19221 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260811 16:05:39.043191 18909 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.033676 13818 rpcz_store.cc:276] 0811 16:05:37.877728 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.907920 (+ 30192us) service_pool.cc:227] Handling call
0811 16:05:37.908276 (+   356us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:37.908475 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:05:38.788093 (+879618us) log.cc:842] Serialized 14 byte log entry
0811 16:05:38.955568 (+167475us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:38.955628 (+    60us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:38.955682 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.955774 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:38.955925 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":75760,"prepare.queue_time_us":559649,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":57243,"spinlock_wait_cycles":3096448,"thread_start_us":973717,"threads_started":2}
I20260811 16:05:39.011261 19185 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:39.032763 18966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.842s	user 0.037s	sys 0.071s
I20260811 16:05:39.048290 19183 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.084841 19212 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:39.063171 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2257) took 2708 ms (client timeout 1646 ms). Trace:
I20260811 16:05:39.081586 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:39.067559 19053 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.083415 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:39.151176 13820 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 12
I20260811 16:05:39.136422 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 931) took 3179 ms. Trace:
I20260811 16:05:39.152066 13738 rpcz_store.cc:276] 0811 16:05:35.956632 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:35.956845 (+   213us) service_pool.cc:227] Handling call
0811 16:05:35.957195 (+   350us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:35.957507 (+   312us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:35.957535 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:37.515049 (+1557514us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b2c0004cec8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:37.515483 (+   434us) log.cc:842] Serialized 26 byte log entry
0811 16:05:38.049486 (+534003us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:38.049525 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.049604 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:39.136087 (+1086483us) raft_consensus.cc:1671] finished
0811 16:05:39.136112 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.136340 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":15126,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":40380160,"thread_start_us":353649,"threads_started":1,"wal-append.queue_time_us":924670}
I20260811 16:05:39.150593 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:39.064754 19179 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.099467 19010 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.077153 19189 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:39.099258 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1388) took 1161 ms. Trace:
I20260811 16:05:39.161059 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.097292 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.161087 14580 rpcz_store.cc:276] 0811 16:05:37.937778 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.906324 (+968546us) service_pool.cc:227] Handling call
0811 16:05:39.099173 (+192849us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.101297 19028 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.014456 19188 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.063449 19197 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.139766 19129 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.108881 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.144011 19134 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.103029 13821 rpcz_store.cc:276] 0811 16:05:37.878369 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.910572 (+ 32203us) service_pool.cc:227] Handling call
0811 16:05:37.910908 (+   336us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:38.720700 (+809792us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:38.744136 (+ 23436us) log.cc:842] Serialized 14 byte log entry
0811 16:05:38.880947 (+136811us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:38.881447 (+   500us) log.cc:842] Serialized 26 byte log entry
0811 16:05:38.881778 (+   331us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:38.881811 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.881881 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:38.965376 (+ 83495us) raft_consensus.cc:1671] finished
0811 16:05:38.965397 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:38.965527 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9143,"prepare.queue_time_us":25082,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":348721,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":10075,"thread_start_us":891737,"threads_started":2,"wal-append.queue_time_us":202241}
I20260811 16:05:39.109699 13907 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.084154 19110 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:39.112530 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.178228 13904 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:39.178830 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2285) took 1998 ms. Trace:
I20260811 16:05:39.180598 13904 rpcz_store.cc:276] 0811 16:05:37.179917 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.099723 (+1919806us) service_pool.cc:227] Handling call
0811 16:05:39.178760 (+ 79037us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.129297 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.126081 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1903) took 2258 ms. Trace:
I20260811 16:05:39.114475 18955 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.130774 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2571) took 2983 ms. Trace:
I20260811 16:05:39.142242 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1030) took 2845 ms. Trace:
I20260811 16:05:39.134101 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:39.149523 13905 rpcz_store.cc:269] 0811 16:05:36.350887 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.351098 (+   211us) service_pool.cc:227] Handling call
0811 16:05:39.058697 (+2707599us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003b06d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.058827 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":336740736}
I20260811 16:05:39.190006 13818 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:39.136032 19235 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260811 16:05:39.136822 19228 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260811 16:05:39.196964 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:39.159282 14578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1366) took 3970 ms (client timeout 1919 ms). Trace:
I20260811 16:05:39.164883 13902 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:39.199481 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2283) took 2020 ms. Trace:
W20260811 16:05:39.199159 14578 rpcz_store.cc:269] 0811 16:05:35.185049 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:35.185328 (+   279us) service_pool.cc:227] Handling call
0811 16:05:39.155755 (+3970427us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.155862 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1853526400}
I20260811 16:05:39.200266 13902 rpcz_store.cc:276] 0811 16:05:37.179293 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.096978 (+1917685us) service_pool.cc:227] Handling call
0811 16:05:39.199421 (+102443us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.201092 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.203904 14578 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:39.154593 13825 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:39.201169 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:38.915234 14574 rpcz_store.cc:276] 0811 16:05:37.711296 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.910089 (+1198793us) service_pool.cc:227] Handling call
0811 16:05:38.911431 (+  1342us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:39.089833 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 136960us
I20260811 16:05:39.105477 13822 rpcz_store.cc:276] 0811 16:05:37.856483 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.887496 (+ 31013us) service_pool.cc:227] Handling call
0811 16:05:37.887850 (+   354us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:37.888107 (+   257us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:37.888141 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:37.907452 (+ 19311us) log.cc:842] Serialized 26 byte log entry
0811 16:05:38.767623 (+860171us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:38.767665 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.767751 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:39.015996 (+248245us) raft_consensus.cc:1671] finished
0811 16:05:39.016018 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.016161 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":768753,"threads_started":1,"wal-append.queue_time_us":943575}
W20260811 16:05:39.083879 19096 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.270s	user 0.011s	sys 0.003s
I20260811 16:05:39.175886 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.179565 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.180018 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:39.111353 18645 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.291s	user 0.013s	sys 0.002s
I20260811 16:05:39.157816 19053 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.164520 18936 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.181967 13823 rpcz_store.cc:276] 0811 16:05:36.864004 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.864270 (+   266us) service_pool.cc:227] Handling call
0811 16:05:36.864632 (+   362us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:37.095717 (+231085us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:37.095765 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:37.106550 (+ 10785us) log.cc:842] Serialized 26 byte log entry
0811 16:05:38.449529 (+1342979us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:38.449579 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:38.449689 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:39.121421 (+671732us) raft_consensus.cc:1671] finished
0811 16:05:39.121461 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.121636 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":216727,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":15871,"thread_start_us":1435643,"threads_started":2,"wal-append.queue_time_us":1423681}
I20260811 16:05:39.261288 13821 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:39.185299 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1379) took 1453 ms. Trace:
I20260811 16:05:39.167917 19179 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:39.190661 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.266516 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.266794 13905 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:39.188542 14573 rpcz_store.cc:276] 0811 16:05:36.296638 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.296751 (+   113us) service_pool.cc:227] Handling call
0811 16:05:36.297024 (+   273us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.013247 (+2716223us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.141959 (+128712us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b54005703d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:39.142168 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5958539008}
I20260811 16:05:39.186662 13900 rpcz_store.cc:276] 0811 16:05:36.146992 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.147223 (+   231us) service_pool.cc:227] Handling call
0811 16:05:36.170746 (+ 23523us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:36.184886 (+ 14140us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:36.184933 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:36.190680 (+  5747us) log.cc:842] Serialized 26 byte log entry
0811 16:05:36.373670 (+182990us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:36.428471 (+ 54801us) log.cc:842] Serialized 14 byte log entry
0811 16:05:36.428703 (+   232us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:36.428786 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:39.022838 (+2594052us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b2400244808. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c8740 00007f5c515bb578 00007f5c515bbcd8 00007f5c515936e8 00007f5c5158eaea 00007f5c5158df36
0811 16:05:39.123678 (+100840us) raft_consensus.cc:1671] finished
0811 16:05:39.130468 (+  6790us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.130693 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20153,"prepare.queue_time_us":54628,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":74027,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":38675,"spinlock_wait_cycles":20039808,"thread_start_us":68203,"threads_started":1,"wal-append.queue_time_us":671759}
I20260811 16:05:39.197853 13903 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:39.259421 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.209969 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.269979 13904 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:39.262255 14583 rpcz_store.cc:276] 0811 16:05:37.731746 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.103795 (+1372049us) service_pool.cc:227] Handling call
0811 16:05:39.185207 (+ 81412us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.263859 13820 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:39.264334 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:39.259178 14580 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:39.268572 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.271394 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1057) took 1423 ms. Trace:
I20260811 16:05:39.268657 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:39.215411 13907 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:39.273607 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.274291 13907 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:05:39.271931 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.271809 14580 rpcz_store.cc:276] 0811 16:05:37.848669 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.163317 (+1314648us) service_pool.cc:227] Handling call
0811 16:05:39.271336 (+108019us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.277988 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:39.191660 19130 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.333s	user 0.024s	sys 0.045s
I20260811 16:05:39.269629 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.278983 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.298094 14573 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:39.298962 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.278972 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:39.280295 19239 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260811 16:05:39.280123 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.281266 19119 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:39.283851 18880 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.007s
I20260811 16:05:39.284103 19212 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:39.284987 19238 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260811 16:05:39.170392 19189 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:39.287277 19135 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.800s	user 0.013s	sys 0.003s
I20260811 16:05:39.133693 19224 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.291326 19046 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.291599 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.293280 19183 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260811 16:05:39.330282 19183 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:39.330783 19183 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:39.296039 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1060) took 1110 ms. Trace:
I20260811 16:05:39.331296 14578 rpcz_store.cc:276] 0811 16:05:38.185619 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.209897 (+1024278us) service_pool.cc:227] Handling call
0811 16:05:39.295976 (+ 86079us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.309885 19129 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:39.343621 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1973) took 2139 ms (client timeout 1892 ms). Trace:
W20260811 16:05:39.344180 13737 rpcz_store.cc:269] 0811 16:05:37.203720 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.250245 (+ 46525us) service_pool.cc:227] Handling call
0811 16:05:39.343366 (+2093121us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54002779d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.343534 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":909166848}
I20260811 16:05:39.345835 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.306008 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.306705 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.307286 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1976) took 1007 ms. Trace:
I20260811 16:05:39.305825 14580 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11. Re-sending same reply.
I20260811 16:05:39.310396 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:39.313150 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.265717 19205 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.361511 19205 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.363703 19156 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.364382 19156 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.318861 19199 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260811 16:05:39.297861 19130 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.440s	user 0.025s	sys 0.045s
I20260811 16:05:39.366909 19130 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:39.367383 19130 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:39.368330 19130 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.4, Last appended by leader: 4, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.366925 14573 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:39.369449 19130 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:39.315716 18880 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.372300 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:39.372843 13908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2572) took 3225 ms (client timeout 1894 ms). Trace:
I20260811 16:05:39.343668 19129 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:39.373618 19129 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.374264 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.305454 19081 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.311702 19075 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:39.314384 18640 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:39.375384 19081 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.375618 19075 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:39.375834 18640 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:39.376662 19075 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.377180 18640 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:39.346854 19124 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.493s	user 0.002s	sys 0.001s
I20260811 16:05:39.332597 13900 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:39.304566 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.337085 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.331420 19046 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:39.341082 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2275) took 2433 ms (client timeout 1904 ms). Trace:
I20260811 16:05:39.342545 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1907) took 1061 ms. Trace:
I20260811 16:05:39.347308 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2210) took 3133 ms. Trace:
I20260811 16:05:39.266434 19096 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.358301 13743 rpcz_store.cc:276] 0811 16:05:38.300028 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.304247 (+  4219us) service_pool.cc:227] Handling call
0811 16:05:39.307009 (+1002762us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.307207 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1433278336}
I20260811 16:05:39.347496 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1981) took 1045 ms. Trace:
I20260811 16:05:39.360281 14583 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:39.373297 13908 rpcz_store.cc:269] 0811 16:05:36.147535 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.147659 (+   124us) service_pool.cc:227] Handling call
0811 16:05:39.372635 (+3224976us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400322154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.372774 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":892071680}
I20260811 16:05:39.374955 13738 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:39.372960 14580 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:39.329524 19010 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.205943 19059 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.379160 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 934) took 3167 ms. Trace:
I20260811 16:05:39.433399 19166 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:39.435717 13817 rpcz_store.cc:276] 0811 16:05:38.281084 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.528814 (+247730us) service_pool.cc:227] Handling call
0811 16:05:38.529157 (+   343us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:38.727967 (+198810us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:38.727998 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:38.728038 (+    40us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:38.728068 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.342223 (+614155us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400173c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:39.342289 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.342464 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":456698624}
I20260811 16:05:39.435130 13744 rpcz_store.cc:276] 0811 16:05:36.211359 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.211520 (+   161us) service_pool.cc:227] Handling call
0811 16:05:36.211945 (+   425us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:36.871534 (+659589us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:36.871585 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:36.887806 (+ 16221us) log.cc:842] Serialized 26 byte log entry
0811 16:05:37.141793 (+253987us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:37.141840 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.378716 (+2236876us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54003476d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:39.378770 (+    54us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:39.378820 (+    50us) raft_consensus.cc:1671] finished
0811 16:05:39.378832 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.379074 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52107,"raft.queue_time_us":344346,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":372259712,"thread_start_us":618960,"threads_started":2,"wal-append.queue_time_us":557016}
I20260811 16:05:39.437103 13737 rpcz_store.cc:276] 0811 16:05:38.301766 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.345465 (+1043699us) service_pool.cc:227] Handling call
0811 16:05:39.347426 (+  1961us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:39.417379 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 138439us
W20260811 16:05:39.436142 13909 rpcz_store.cc:269] 0811 16:05:36.907819 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.394153 (+486334us) service_pool.cc:227] Handling call
0811 16:05:39.340761 (+1946608us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.340971 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":897670400}
I20260811 16:05:39.346940 13903 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:39.451479 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.452203 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.452508 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:39.453225 13737 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:39.442864 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.383848 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.458544 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1055) took 1673 ms. Trace:
I20260811 16:05:39.459018 14574 rpcz_store.cc:276] 0811 16:05:37.785200 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.383509 (+1598309us) service_pool.cc:227] Handling call
0811 16:05:39.458465 (+ 74956us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.460747 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.462440 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.470460 19029 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:39.471055 13737 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:39.455173 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1052) took 1737 ms. Trace:
I20260811 16:05:39.472024 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 935) took 2247 ms. Trace:
I20260811 16:05:39.472967 13737 rpcz_store.cc:276] 0811 16:05:37.225033 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.470466 (+2245433us) service_pool.cc:227] Handling call
0811 16:05:39.470862 (+   396us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.471682 (+   820us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.471958 (+   276us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.474747 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.471971 14578 rpcz_store.cc:276] 0811 16:05:37.718062 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.336702 (+1618640us) service_pool.cc:227] Handling call
0811 16:05:39.455051 (+118349us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.437134 13736 rpcz_store.cc:276] 0811 16:05:36.214259 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.214378 (+   119us) service_pool.cc:227] Handling call
0811 16:05:36.214739 (+   361us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:37.273184 (+1058445us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:05:37.491292 (+218108us) log.cc:842] Serialized 14 byte log entry
0811 16:05:37.887364 (+396072us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:37.887439 (+    75us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:37.887506 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.347014 (+1459508us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:39.347065 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.347251 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":85835,"prepare.queue_time_us":511777,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":173139,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":28337,"spinlock_wait_cycles":2426810112,"thread_start_us":321202,"threads_started":2,"wal-append.queue_time_us":434110}
I20260811 16:05:39.496373 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.451517 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.501327 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1977) took 1200 ms. Trace:
I20260811 16:05:39.501770 13743 rpcz_store.cc:276] 0811 16:05:38.300436 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.435368 (+1134932us) service_pool.cc:227] Handling call
0811 16:05:39.501244 (+ 65876us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.442488 19046 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.332866 19135 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.495476 19029 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:39.514125 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.375891 19081 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.435366 19166 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:39.536962 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.537289 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.542089 13744 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:39.538353 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.542148 13905 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:39.543651 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.544044 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1378) took 1812 ms. Trace:
I20260811 16:05:39.436009 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.537015 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.529403 13737 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:39.544512 14574 rpcz_store.cc:276] 0811 16:05:37.731393 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.537819 (+1806426us) service_pool.cc:227] Handling call
0811 16:05:39.543979 (+  6160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.546382 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2217) took 1716 ms. Trace:
I20260811 16:05:39.546828 13737 rpcz_store.cc:276] 0811 16:05:37.829646 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.528603 (+1698957us) service_pool.cc:227] Handling call
0811 16:05:39.529149 (+   546us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.546022 (+ 16873us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.546326 (+   304us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.547744 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.548405 13737 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:39.548563 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:39.514066 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:39.545696 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71053.2us
I20260811 16:05:39.549827 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.550650 13903 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:39.464082 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.550356 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:39.551671 13909 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:39.550806 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.552479 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.553967 13825 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:39.496121 19034 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.555051 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.562222 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.562230 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.550662 13900 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:39.564517 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1980) took 1263 ms. Trace:
I20260811 16:05:39.564961 13738 rpcz_store.cc:276] 0811 16:05:38.301409 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.435716 (+1134307us) service_pool.cc:227] Handling call
0811 16:05:39.564456 (+128740us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.555475 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.532871 19029 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:39.563215 13905 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:39.564630 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.557013 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.566912 14578 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.567476 13908 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.567024 13744 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:39.568275 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:39.564286 13902 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:39.571453 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.570892 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:39.574018 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.574779 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:39.575533 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.576041 14574 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.545151 19166 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:39.581540 13907 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:39.580500 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.580696 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:39.580739 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:39.570629 14583 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:39.584038 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.581256 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:39.585021 13902 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.585111 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.581681 13908 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:39.583954 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.587011 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.555637 18810 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:39.588469 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:39.589028 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.587805 13905 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:39.590474 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:39.590696 13900 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:39.556811 19199 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.588469 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:39.587512 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.591493 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.555121 19059 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.595317 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:39.600220 13825 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:39.595394 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.562810 19167 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:39.579489 19209 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:39.598403 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.585989 19010 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:39.601483 13908 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:39.601755 19074 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:39.565788 19135 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.590329 18936 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:39.610471 14583 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11.
I20260811 16:05:39.582648 18645 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:39.586059 19164 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.596868 18810 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:39.611307 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.586555 19003 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:39.614298 13904 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260811 16:05:39.589751 19119 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:39.628019 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.607299 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.617913 13908 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: [13.4-13.4]
I20260811 16:05:39.586190 19053 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:39.630069 13905 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:39.597720 19143 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:39.589641 19146 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:39.622294 13902 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:39.629009 13738 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:39.633376 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2297) took 1242 ms. Trace:
I20260811 16:05:39.600320 14580 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:39.601603 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.622822 13787 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11.
I20260811 16:05:39.572872 19034 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.619046 19074 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:39.624208 14578 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:39.640676 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.640820 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.641338 14578 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:39.637006 19053 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.626298 18810 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:39.607632 18880 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.620690 13903 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260811 16:05:39.619640 17781 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.881s	user 0.014s	sys 0.006s
I20260811 16:05:39.634858 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2270) took 3028 ms. Trace:
I20260811 16:05:39.652525 13908 rpcz_store.cc:276] 0811 16:05:36.601297 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.617243 (+3015946us) service_pool.cc:227] Handling call
0811 16:05:39.617592 (+   349us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.629800 (+ 12208us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.630017 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.652861 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2272) took 2936 ms. Trace:
I20260811 16:05:39.633965 13904 rpcz_store.cc:276] 0811 16:05:38.390714 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.186319 (+795605us) service_pool.cc:227] Handling call
0811 16:05:39.633295 (+446976us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.637378 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.604238 19199 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.621789 19209 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:39.672919 14574 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:39.605540 19059 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.621481 19164 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.642320 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.644749 19010 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:39.628654 19119 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.641989 19053 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.665926 13903 rpcz_store.cc:276] 0811 16:05:36.716288 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.618018 (+2901730us) service_pool.cc:227] Handling call
0811 16:05:39.618343 (+   325us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.648701 (+ 30358us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.652770 (+  4069us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.666906 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.667804 13908 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260811 16:05:39.668147 13905 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260811 16:05:39.638043 13787 leader_election.cc:401] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260811 16:05:39.656992 13909 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:39.685999 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2286) took 2505 ms. Trace:
I20260811 16:05:39.670091 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.634316 19156 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.673491 13818 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:39.639377 13902 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:39.651729 19096 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.675544 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:39.675469 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.675194 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2575) took 2469 ms. Trace:
I20260811 16:05:39.676441 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:39.638844 19003 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:39.707808 19003 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.642830 19074 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:39.643306 19143 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:39.603912 19055 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:39.680605 14578 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:39.711957 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.713136 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.713653 14578 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:39.713716 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.714383 14573 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:05:39.668218 19052 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.808s	user 0.018s	sys 0.024s
W20260811 16:05:39.686026 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63393.7us
W20260811 16:05:39.715013 19052 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.855s	user 0.019s	sys 0.024s
I20260811 16:05:39.715277 19110 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.715478 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.715737 19110 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.716094 19110 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.716446 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.716671 19167 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:39.717129 19167 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.717495 19167 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:39.714516 14578 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:47006
I20260811 16:05:39.687844 13905 rpcz_store.cc:276] 0811 16:05:37.180205 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.637008 (+2456803us) service_pool.cc:227] Handling call
0811 16:05:39.667626 (+ 30618us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.685670 (+ 18044us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.685938 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.657819 13907 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:39.690056 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2284) took 2510 ms. Trace:
I20260811 16:05:39.675175 13737 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:05:39.674834 18880 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:39.722680 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2265) took 3312 ms. Trace:
I20260811 16:05:39.723098 19205 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.693456 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.723104 13907 rpcz_store.cc:276] 0811 16:05:36.422368 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.605476 (+3183108us) service_pool.cc:227] Handling call
0811 16:05:39.657572 (+ 52096us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.722424 (+ 64852us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.722621 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.731210 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.734035 13903 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260811 16:05:39.695405 13904 rpcz_store.cc:276] 0811 16:05:37.199553 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.666500 (+2466947us) service_pool.cc:227] Handling call
0811 16:05:39.668429 (+  1929us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.668614 (+   185us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.668637 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:39.668678 (+    41us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:39.668708 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.668768 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.668865 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.699908 19146 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.683350 19164 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.694746 14580 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 8.
I20260811 16:05:39.719749 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:39.720050 19143 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.722481 13902 rpcz_store.cc:276] 0811 16:05:37.179609 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.636658 (+2457049us) service_pool.cc:227] Handling call
0811 16:05:39.637021 (+   363us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.689805 (+ 52784us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.689994 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.680461 19059 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.686424 19189 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.735810 14573 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:39.702744 19199 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.723332 19104 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:39.688905 19119 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:39.735953 13706 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.700066 19053 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.733431 13737 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:39.741580 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:39.742076 14578 raft_consensus.cc:595] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:39.778239 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.745602 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.691525 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2574) took 2492 ms. Trace:
I20260811 16:05:39.778990 13908 rpcz_store.cc:276] 0811 16:05:37.199191 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.653641 (+2454450us) service_pool.cc:227] Handling call
0811 16:05:39.667526 (+ 13885us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.691000 (+ 23474us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.691451 (+   451us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.780136 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.780823 13908 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:39.735677 13904 pending_rounds.cc:76] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 10
I20260811 16:05:39.752972 19055 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:39.753086 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:39.753794 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60445.9us
I20260811 16:05:39.754343 19205 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:39.755810 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:39.664692 17781 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.773319 19209 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.817842 17781 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.818921 18987 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.819448 18987 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:39.820797 19183 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.779850 18936 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.822657 13735 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:39.822759 18936 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.823410 18936 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:39.824122 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1979) took 1523 ms. Trace:
I20260811 16:05:39.824600 13735 rpcz_store.cc:276] 0811 16:05:38.301047 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:38.832942 (+531895us) service_pool.cc:227] Handling call
0811 16:05:39.823885 (+990943us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003430d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.824051 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2175196416}
I20260811 16:05:39.825982 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.757230 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1380) took 2025 ms. Trace:
I20260811 16:05:39.826884 14573 rpcz_store.cc:276] 0811 16:05:37.732058 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.715010 (+1982952us) service_pool.cc:227] Handling call
0811 16:05:39.735635 (+ 20625us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.756988 (+ 21353us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.757175 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:39.827656 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1039) took 2624 ms (client timeout 1742 ms). Trace:
W20260811 16:05:39.828050 14581 rpcz_store.cc:269] 0811 16:05:37.202755 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.203657 (+   902us) service_pool.cc:227] Handling call
0811 16:05:39.827438 (+2623781us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.827582 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1180419456}
I20260811 16:05:39.736650 19010 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:39.687567 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.830338 19010 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.831591 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2632) took 2060 ms. Trace:
I20260811 16:05:39.831964 13824 rpcz_store.cc:276] 0811 16:05:37.771357 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.783969 (+ 12612us) service_pool.cc:227] Handling call
0811 16:05:37.798159 (+ 14190us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:38.299677 (+501518us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:38.299724 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:38.299780 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:38.299823 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.831377 (+1531554us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:39.831425 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.831539 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":251360,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":1152480512}
I20260811 16:05:39.778311 14578 raft_consensus.cc:603] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:05:39.782474 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0245783990249038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260811 16:05:39.782505 13904 pending_rounds.cc:97] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260811 16:05:39.834335 13904 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:39.796941 19158 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:39.797417 18955 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.602s	user 0.015s	sys 0.010s
I20260811 16:05:39.777091 19052 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:39.802031 19132 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.758797 18989 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:39.771936 19034 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:39.850908 19183 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.762720 19104 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:39.851600 19205 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:39.833307 18645 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:39.814328 19166 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:39.826272 19116 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.546s	user 0.002s	sys 0.002s
I20260811 16:05:39.828099 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:39.728264 19156 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:39.854314 13740 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:39.854403 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1038) took 2655 ms (client timeout 2143 ms). Trace:
W20260811 16:05:39.859927 14575 rpcz_store.cc:269] 0811 16:05:37.199262 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.210570 (+ 11308us) service_pool.cc:227] Handling call
0811 16:05:39.854204 (+2643634us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.854326 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2906220416}
I20260811 16:05:39.853106 18645 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.783706 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:39.836028 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.744423 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:39.801716 19129 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.867492 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.847913 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1381) took 2115 ms. Trace:
I20260811 16:05:39.868969 14580 rpcz_store.cc:276] 0811 16:05:37.732370 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.785566 (+2053196us) service_pool.cc:227] Handling call
0811 16:05:39.847401 (+ 61835us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.847592 (+   191us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.847620 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:39.847658 (+    38us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:39.847690 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.847745 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.847855 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.849416 19052 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.874560 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1384) took 2125 ms. Trace:
I20260811 16:05:39.875092 14575 rpcz_store.cc:276] 0811 16:05:37.749638 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.860945 (+2111307us) service_pool.cc:227] Handling call
0811 16:05:39.873940 (+ 12995us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.874177 (+   237us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.874212 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:39.874260 (+    48us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:39.874304 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.874371 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.874491 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.851701 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2576) took 2651 ms. Trace:
I20260811 16:05:37.694561 14577 rpcz_store.cc:276] 0811 16:05:36.309825 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.310172 (+   347us) service_pool.cc:227] Handling call
0811 16:05:36.329446 (+ 19274us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:36.329632 (+   186us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:05:36.504839 (+175207us) log.cc:842] Serialized 14 byte log entry
0811 16:05:37.413275 (+908436us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:37.413362 (+    87us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:37.413433 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:37.413525 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:37.413696 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13593,"prepare.queue_time_us":36815,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":298034,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":122550,"thread_start_us":1069050,"threads_started":3,"wal-append.queue_time_us":1010559}
I20260811 16:05:39.759253 18880 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:39.857566 14573 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:39.760258 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:39.865474 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 121517us
I20260811 16:05:39.845866 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:39.866009 18645 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:39.902572 19052 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.872566 19034 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:39.904511 19167 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.908079 19034 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:39.909143 19034 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.853470 19055 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.851608 19104 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:39.892138 13908 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 8. Ops: []
I20260811 16:05:39.916067 19166 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.891669 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1386) took 2108 ms. Trace:
I20260811 16:05:39.859303 19156 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:39.897687 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:39.849475 19081 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:39.853022 18989 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:39.916939 14580 rpcz_store.cc:276] 0811 16:05:37.766437 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.870192 (+2103755us) service_pool.cc:227] Handling call
0811 16:05:39.870573 (+   381us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.870795 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.870831 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:39.870885 (+    54us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:39.870929 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.871001 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.871127 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.893129 13903 rpcz_store.cc:276] 0811 16:05:37.199859 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.685176 (+2485317us) service_pool.cc:227] Handling call
0811 16:05:39.733690 (+ 48514us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.734452 (+   762us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.851497 (+117045us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b5400301950. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.851643 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":77962496}
I20260811 16:05:39.918208 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:39.938561 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2555) took 4187 ms (client timeout 1846 ms). Trace:
W20260811 16:05:39.944149 13906 rpcz_store.cc:269] 0811 16:05:35.751558 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:35.770558 (+ 19000us) service_pool.cc:227] Handling call
0811 16:05:39.938386 (+4167828us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:39.938493 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6367305472}
I20260811 16:05:39.945497 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:39.946403 13906 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:39.950218 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:39.953421 14574 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:05:39.954598 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1391) took 1113 ms. Trace:
I20260811 16:05:39.955122 14574 rpcz_store.cc:276] 0811 16:05:38.841350 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.893851 (+1052501us) service_pool.cc:227] Handling call
0811 16:05:39.952963 (+ 59112us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.954270 (+  1307us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.954533 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.927546 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1053) took 2181 ms. Trace:
I20260811 16:05:39.921348 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1387) took 2126 ms. Trace:
I20260811 16:05:39.958062 14575 rpcz_store.cc:276] 0811 16:05:37.795357 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.876309 (+2080952us) service_pool.cc:227] Handling call
0811 16:05:39.920306 (+ 43997us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.920928 (+   622us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.920965 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:39.921022 (+    57us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:39.921066 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.921140 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:39.921276 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:39.959297 14573 rpcz_store.cc:276] 0811 16:05:37.746056 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.856997 (+2110941us) service_pool.cc:227] Handling call
0811 16:05:39.857383 (+   386us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.927099 (+ 69716us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:39.927458 (+   359us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:39.934399 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88584.6us
I20260811 16:05:39.935416 14583 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:39.891000 19183 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260811 16:05:39.861936 18955 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260811 16:05:39.936797 19081 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:39.936959 19167 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:39.937531 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47002 (request call id 0) took 1686 ms. Trace:
I20260811 16:05:39.974632 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:39.877290 19158 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:39.938566 19144 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:39.964893 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:39.891508 19130 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:39.974762 14577 rpcz_store.cc:276] 0811 16:05:38.250951 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.893762 (+1642811us) service_pool.cc:227] Handling call
0811 16:05:39.937341 (+ 43579us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:40.044255 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.043483 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:40.052951 13823 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.050014 19110 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.047963 18645 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.095953 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.096876 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
W20260811 16:05:39.971951 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53837us
I20260811 16:05:40.066468 14574 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:39.856814 19046 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:39.930267 19156 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:39.972996 18989 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:39.988145 14580 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:39.942620 19174 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.165s
I20260811 16:05:40.089250 14573 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:40.092809 13824 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:39.939273 19052 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:39.892158 19219 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.174s
I20260811 16:05:39.910921 19119 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:40.105551 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1974) took 2901 ms (client timeout 1968 ms). Trace:
I20260811 16:05:40.091642 19130 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:40.155201 13742 rpcz_store.cc:269] 0811 16:05:37.204018 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.301317 (+ 97299us) service_pool.cc:227] Handling call
0811 16:05:40.105354 (+2804037us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:40.105485 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3523890048}
I20260811 16:05:40.156656 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.106298 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1377) took 3671 ms. Trace:
I20260811 16:05:40.106894 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 933) took 3896 ms. Trace:
I20260811 16:05:40.157564 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.112604 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:39.952108 19029 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.020145 19241 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:40.069833 19101 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:40.088371 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 123605us
I20260811 16:05:40.141840 14541 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.143465 14573 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:40.143916 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:39.988379 19132 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
W20260811 16:05:40.193329 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.034s	sys 0.081s
W20260811 16:05:40.242964 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.035s	sys 0.086s
I20260811 16:05:39.919804 18810 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.104559 19057 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:05:40.154764 13743 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.009s
W20260811 16:05:40.249085 13743 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.011s	sys 0.010s
I20260811 16:05:40.157598 14582 rpcz_store.cc:276] 0811 16:05:36.435119 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.435351 (+   232us) service_pool.cc:227] Handling call
0811 16:05:36.470162 (+ 34811us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:37.947882 (+1477720us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.106079 (+2158197us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54007e13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.106242 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3375884160}
I20260811 16:05:39.852782 19205 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.095325 17781 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.098s
I20260811 16:05:40.159348 13820 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:40.157884 13741 rpcz_store.cc:276] 0811 16:05:36.210979 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.211203 (+   224us) service_pool.cc:227] Handling call
0811 16:05:36.211540 (+   337us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:37.818450 (+1606910us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.106671 (+2288221us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400278dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.106833 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3628466560}
I20260811 16:05:40.252902 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.258657 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1969) took 3074 ms. Trace:
I20260811 16:05:40.171618 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.076201 19158 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:40.267180 13901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2259) took 3915 ms (client timeout 1527 ms). Trace:
W20260811 16:05:40.267751 13901 rpcz_store.cc:269] 0811 16:05:36.351899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:36.352680 (+   781us) service_pool.cc:227] Handling call
0811 16:05:40.266920 (+3914240us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:40.267081 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5402259712}
I20260811 16:05:40.246169 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:40.250687 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108943us
I20260811 16:05:40.252929 14575 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:40.095561 19178 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:40.247285 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 103482us
I20260811 16:05:40.263125 13739 rpcz_store.cc:276] 0811 16:05:37.184430 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.194405 (+  9975us) service_pool.cc:227] Handling call
0811 16:05:37.222501 (+ 28096us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:37.401645 (+179144us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:37.409629 (+  7984us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:37.409695 (+    66us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:37.409732 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.258349 (+2848617us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000a91d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.258414 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.258581 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":75160,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":14963,"spinlock_wait_cycles":411221760}
W20260811 16:05:40.165880 19136 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.015s
I20260811 16:05:40.258558 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.281100 13903 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:40.190126 19241 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:40.259670 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 791) took 1243 ms. Trace:
I20260811 16:05:40.240938 19206 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
W20260811 16:05:40.275935 13900 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.010s	sys 0.021s
W20260811 16:05:40.287626 13900 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.010s	sys 0.021s
I20260811 16:05:40.276547 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.093150 18936 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.293182 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.270903 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.273334 13817 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:40.279932 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:40.284677 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2577) took 1206 ms. Trace:
I20260811 16:05:40.295631 13901 rpcz_store.cc:276] 0811 16:05:39.078150 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.283637 (+1205487us) service_pool.cc:227] Handling call
0811 16:05:40.284064 (+   427us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.284280 (+   216us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:40.284318 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.284373 (+    55us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:40.284415 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.284482 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.284609 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:40.253543 19199 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:40.275418 14573 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.150327 19162 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.127940 19059 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.311930 14573 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.312563 13903 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:40.288520 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.310017 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2580) took 1219 ms. Trace:
I20260811 16:05:40.314687 13901 rpcz_store.cc:276] 0811 16:05:39.081039 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.300044 (+1219005us) service_pool.cc:227] Handling call
0811 16:05:40.300355 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.300553 (+   198us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:40.300588 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.300641 (+    53us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:40.300685 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.300753 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.300875 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:40.319940 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2579) took 1239 ms. Trace:
I20260811 16:05:40.320492 13903 rpcz_store.cc:276] 0811 16:05:39.080732 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.281917 (+1201185us) service_pool.cc:227] Handling call
0811 16:05:40.306696 (+ 24779us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.319625 (+ 12929us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.319868 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:40.288040 19136 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.000s	sys 0.016s
I20260811 16:05:40.300192 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260811 16:05:40.323038 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:40.328738 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:40.329515 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:40.286867 19206 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:40.254362 19025 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:40.337131 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2630) took 2566 ms. Trace:
I20260811 16:05:40.303710 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:40.338100 14579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1045) took 2639 ms (client timeout 1893 ms). Trace:
W20260811 16:05:40.338515 14579 rpcz_store.cc:269] 0811 16:05:37.698710 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.698881 (+   171us) service_pool.cc:227] Handling call
0811 16:05:40.337874 (+2638993us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:40.338013 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2184749952}
I20260811 16:05:40.338980 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:40.280241 19085 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.020s
I20260811 16:05:40.344030 13903 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:40.342298 13736 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:40.305682 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:40.288461 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.018s	sys 0.013s
W20260811 16:05:40.345295 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.019s	sys 0.013s
I20260811 16:05:40.317072 19057 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:40.269141 19082 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.022s
I20260811 16:05:40.161072 19183 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
I20260811 16:05:40.190330 19130 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:40.289407 19241 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.323619 13901 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:40.286454 19178 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260811 16:05:40.245050 19224 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.020s	sys 0.016s
I20260811 16:05:40.332156 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.302846 19144 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:40.348084 19078 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.337774 13827 rpcz_store.cc:276] 0811 16:05:37.770741 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:37.770872 (+   131us) service_pool.cc:227] Handling call
0811 16:05:37.791432 (+ 20560us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:37.892779 (+101347us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.336823 (+2444044us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b54002dcdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.337059 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":105962752}
I20260811 16:05:40.392542 19078 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:40.397990 19164 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.002s
I20260811 16:05:40.400215 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 794) took 1380 ms. Trace:
I20260811 16:05:40.400699 13908 rpcz_store.cc:276] 0811 16:05:39.020011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.781441 (+761430us) service_pool.cc:227] Handling call
0811 16:05:39.781749 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.912510 (+130761us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.399891 (+487381us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002ac6d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.400132 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":251342720}
I20260811 16:05:40.402638 13908 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:40.404812 19167 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:40.405388 19167 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:40.408434 19029 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.316780 19162 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.410132 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2587) took 1321 ms. Trace:
I20260811 16:05:40.411401 19162 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.411721 13905 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:40.322154 18987 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.413609 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2287) took 2083 ms. Trace:
I20260811 16:05:40.414070 13905 rpcz_store.cc:276] 0811 16:05:38.330302 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.721521 (+1391219us) service_pool.cc:227] Handling call
0811 16:05:40.411272 (+689751us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.412186 (+   914us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.413367 (+  1181us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54000c8850. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:40.413536 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1585445760}
I20260811 16:05:40.410612 13909 rpcz_store.cc:276] 0811 16:05:39.088689 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.580234 (+491545us) service_pool.cc:227] Handling call
0811 16:05:40.409932 (+829698us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:40.410060 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":168438144}
I20260811 16:05:40.418254 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2219) took 2586 ms. Trace:
I20260811 16:05:40.249294 19101 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:40.345651 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 2.39664e+06us
W20260811 16:05:40.357462 19080 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.010s
W20260811 16:05:40.346380 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.013s	sys 0.037s
W20260811 16:05:40.480976 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.014s	sys 0.037s
W20260811 16:05:40.481333 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 777784us
I20260811 16:05:40.481761 19059 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.352046 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 806) took 1112 ms. Trace:
I20260811 16:05:40.165158 18885 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.168s
I20260811 16:05:40.317101 19120 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.483397 13903 rpcz_store.cc:276] 0811 16:05:39.239963 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.321439 (+1081476us) service_pool.cc:227] Handling call
0811 16:05:40.343853 (+ 22414us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.351692 (+  7839us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.351968 (+   276us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:40.336603 18640 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.035s
I20260811 16:05:40.151244 18880 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.323709 19129 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.360015 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.366466 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2581) took 1285 ms. Trace:
W20260811 16:05:40.346889 19085 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.020s
I20260811 16:05:40.337441 19025 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:40.344286 19081 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:05:40.354655 19082 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.022s
I20260811 16:05:40.370152 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.339630 14581 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:40.359325 19074 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.002s
W20260811 16:05:40.376888 19146 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.001s
W20260811 16:05:40.369247 19224 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.020s	sys 0.016s
I20260811 16:05:40.377990 13741 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:40.384431 19156 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.387617 19046 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.388494 18645 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.391016 18936 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.418970 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1383) took 2686 ms. Trace:
I20260811 16:05:40.524278 14583 rpcz_store.cc:276] 0811 16:05:37.732954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.830652 (+2097698us) service_pool.cc:227] Handling call
0811 16:05:39.831032 (+   380us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.964436 (+133404us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.418691 (+454255us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b54006603d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.418902 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":223386368}
I20260811 16:05:40.525092 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:40.357903 19003 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.006s	sys 0.010s
I20260811 16:05:40.276160 19158 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.445473 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.536108 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.539193 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.541601 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:40.532866 19003 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.007s	sys 0.010s
I20260811 16:05:40.547957 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.550262 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.551637 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 793) took 1531 ms. Trace:
I20260811 16:05:40.490839 19120 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.552068 13902 rpcz_store.cc:276] 0811 16:05:39.019722 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.752269 (+732547us) service_pool.cc:227] Handling call
0811 16:05:39.756578 (+  4309us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.756936 (+   358us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.756963 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:39.757382 (+   419us) log.cc:842] Serialized 26 byte log entry
0811 16:05:40.254975 (+497593us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:40.255016 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.255084 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:40.551413 (+296329us) raft_consensus.cc:1671] finished
0811 16:05:40.551435 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.551580 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":893,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4187,"thread_start_us":497305,"threads_started":1,"wal-append.queue_time_us":750583}
I20260811 16:05:40.554065 19120 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:40.554229 13902 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260811 16:05:40.552953 19130 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.282984 13907 rpcz_store.cc:276] 0811 16:05:39.016509 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.727106 (+710597us) service_pool.cc:227] Handling call
0811 16:05:39.732546 (+  5440us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.732958 (+   412us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:05:39.764541 (+ 31583us) log.cc:842] Serialized 14 byte log entry
0811 16:05:40.259265 (+494724us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.259380 (+   115us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:40.259431 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.259502 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.259614 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":30827,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":93,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14623,"thread_start_us":494182,"threads_started":1}
I20260811 16:05:40.558220 13907 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260811 16:05:40.358336 13823 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:40.451532 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2599) took 1121 ms. Trace:
I20260811 16:05:40.448647 13736 rpcz_store.cc:276] 0811 16:05:37.831980 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.517635 (+1685655us) service_pool.cc:227] Handling call
0811 16:05:39.552139 (+ 34504us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.344738 (+792599us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.417966 (+ 73228us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.418167 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1816372096}
I20260811 16:05:40.466758 19101 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.560282 19130 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.565043 19166 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260811 16:05:40.566259 19166 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:40.368635 19110 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:40.417372 18810 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.414636 18987 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:40.420715 19104 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260811 16:05:40.468120 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2601) took 1093 ms. Trace:
I20260811 16:05:40.577306 13905 rpcz_store.cc:276] 0811 16:05:39.542182 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.453705 (+911523us) service_pool.cc:227] Handling call
0811 16:05:40.467541 (+ 13836us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.467801 (+   260us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:40.467825 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.467866 (+    41us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:40.467893 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.467952 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.468058 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:40.468864 19078 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:40.416095 19206 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:40.471887 13789 connection.cc:232] RPC call timeout handler was delayed by -2.4620145370718092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260811 16:05:40.475065 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2224) took 1583 ms. Trace:
I20260811 16:05:40.398591 19164 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.444903 19119 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.415652 19131 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:40.483537 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1919) took 1174 ms. Trace:
I20260811 16:05:40.589035 13822 rpcz_store.cc:276] 0811 16:05:39.309272 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.326930 (+ 17658us) service_pool.cc:227] Handling call
0811 16:05:39.408387 (+ 81457us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.408681 (+   294us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.408718 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:39.496264 (+ 87546us) log.cc:842] Serialized 26 byte log entry
0811 16:05:40.243584 (+747320us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:40.243630 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.243714 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:40.483043 (+239329us) raft_consensus.cc:1671] finished
0811 16:05:40.483064 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.483467 (+   403us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":681338,"threads_started":1,"wal-append.queue_time_us":947182}
I20260811 16:05:40.590333 14583 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:40.485944 13904 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.015s	sys 0.032s
W20260811 16:05:40.591095 13904 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.015s	sys 0.033s
W20260811 16:05:40.484045 19080 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.011s
I20260811 16:05:40.491019 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.491362 13901 rpcz_store.cc:276] 0811 16:05:39.081291 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.315895 (+1234604us) service_pool.cc:227] Handling call
0811 16:05:40.316326 (+   431us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.366192 (+ 49866us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.366400 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:40.406500 19167 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:40.486687 18640 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.009s	sys 0.035s
I20260811 16:05:40.506664 13903 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260811 16:05:40.604426 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2603) took 1036 ms. Trace:
I20260811 16:05:40.604875 13903 rpcz_store.cc:276] 0811 16:05:39.567722 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.487244 (+919522us) service_pool.cc:227] Handling call
0811 16:05:40.506342 (+ 19098us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.604110 (+ 97768us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.604351 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:40.485795 19010 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.024s	sys 0.025s
I20260811 16:05:40.489871 19061 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:40.491904 19055 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.005s	sys 0.055s
W20260811 16:05:40.486663 19034 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.032s	sys 0.016s
W20260811 16:05:40.486621 19143 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.013s	sys 0.035s
I20260811 16:05:40.504055 19025 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:40.503806 19051 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.519196 13735 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:40.519933 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.618970 13741 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:40.620479 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.530634 14573 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:40.504105 19081 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:40.576417 18885 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260811 16:05:40.522727 19146 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11.
I20260811 16:05:40.561146 13908 rpcz_store.cc:276] 0811 16:05:39.330604 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.401788 (+1071184us) service_pool.cc:227] Handling call
0811 16:05:40.402200 (+   412us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.403034 (+   834us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.451434 (+ 48400us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:40.561769 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.572242 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:40.524113 19108 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:40.578841 13789 connection.cc:232] RPC call timeout handler was delayed by -2.4269145369762555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260811 16:05:40.644825 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3735763080185279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31020000000000003s for a response
W20260811 16:05:40.645210 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3711158540099859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260811 16:05:40.645293 13741 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260811 16:05:40.645550 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3144158539362252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260811 16:05:40.645848 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2604158539324999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260811 16:05:40.646176 13789 connection.cc:232] RPC call timeout handler was delayed by -1.248715854017064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260811 16:05:40.578866 13743 rpcz_store.cc:276] 0811 16:05:38.891331 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.505782 (+614451us) service_pool.cc:227] Handling call
0811 16:05:39.542782 (+ 37000us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.543312 (+   530us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.543340 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:39.546227 (+  2887us) log.cc:842] Serialized 26 byte log entry
0811 16:05:40.249538 (+703311us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:40.249580 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.249654 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:40.474825 (+225171us) raft_consensus.cc:1671] finished
0811 16:05:40.474846 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.474997 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":682,"raft.queue_time_us":159,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11368,"thread_start_us":662698,"threads_started":1,"wal-append.queue_time_us":876654}
I20260811 16:05:40.566644 19166 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:40.593003 14582 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260811 16:05:40.596275 14544 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.018s
W20260811 16:05:40.648824 14544 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.019s
W20260811 16:05:40.649171 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 599807us
I20260811 16:05:40.592765 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:40.651528 14579 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:40.523586 19074 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.600025 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.601485 13740 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:40.533011 18989 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:40.660012 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 381327us
I20260811 16:05:40.613205 14583 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:40.588824 19131 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:40.614347 19034 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.032s	sys 0.016s
W20260811 16:05:40.606581 19010 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.025s	sys 0.025s
I20260811 16:05:40.642539 14578 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:40.664217 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 341277us
W20260811 16:05:40.665503 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 339492us
W20260811 16:05:40.646474 13789 connection.cc:232] RPC call timeout handler was delayed by -1.20731585402973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260811 16:05:40.667649 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1749158540042117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260811 16:05:40.668088 13789 connection.cc:232] RPC call timeout handler was delayed by -1.078607834991999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3073s for a response
W20260811 16:05:40.668421 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0345158539712429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260811 16:05:40.668757 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0309158540330827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260811 16:05:40.669072 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0282158539630473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260811 16:05:40.669382 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0219158539548516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260811 16:05:40.617007 19055 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.005s	sys 0.055s
I20260811 16:05:40.671013 19080 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:40.672116 13909 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:40.673033 19080 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:40.673521 13742 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:40.673950 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:40.675336 18987 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:40.675652 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:40.675868 18987 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:40.676863 18987 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.680480 19034 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:40.671075 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:40.673548 19080 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:40.682336 19034 consensus_queue.cc:1225] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260811 16:05:40.685315 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 798) took 1647 ms. Trace:
I20260811 16:05:40.700167 13906 rpcz_store.cc:276] 0811 16:05:39.038423 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.278892 (+1240469us) service_pool.cc:227] Handling call
0811 16:05:40.304731 (+ 25839us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.304999 (+   268us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:40.657503 (+352504us) log.cc:842] Serialized 14 byte log entry
0811 16:05:40.684532 (+ 27029us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.684658 (+   126us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:40.684755 (+    97us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.684935 (+   180us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.685170 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19499,"prepare.queue_time_us":63738,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":2555,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":344425,"threads_started":2}
I20260811 16:05:40.707017 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:40.707599 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51171.8us
I20260811 16:05:40.708033 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1913) took 1622 ms. Trace:
W20260811 16:05:40.710064 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53982.3us
I20260811 16:05:40.710183 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.710974 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.608508 19206 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:40.621151 19143 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.013s	sys 0.036s
I20260811 16:05:40.692049 14578 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:40.718230 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:40.718938 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:40.719759 14578 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:40.719924 13817 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260811 16:05:40.693300 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:40.694118 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:40.725605 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50041.3us
I20260811 16:05:40.708420 13826 rpcz_store.cc:276] 0811 16:05:39.085663 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.085850 (+   187us) service_pool.cc:227] Handling call
0811 16:05:39.109462 (+ 23612us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:39.109685 (+   223us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:39.120196 (+ 10511us) log.cc:842] Serialized 14 byte log entry
0811 16:05:40.338139 (+1217943us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b1800342fa0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:05:40.707696 (+369557us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.707752 (+    56us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:40.707795 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.707869 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:40.707976 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45511,"prepare.queue_time_us":10353,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"spinlock_wait_cycles":4453760,"thread_start_us":323755,"threads_started":1}
I20260811 16:05:40.726112 19164 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.726778 19209 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:40.726845 19164 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:40.727460 19164 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:40.727617 19209 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:40.649503 19081 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:40.728106 19209 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:40.728658 19209 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:05:40.729185 19265 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260811 16:05:40.735785 19263 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260811 16:05:40.736243 18936 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:40.614574 19061 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.711184 18810 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:40.586335 19104 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:40.739722 19262 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260811 16:05:40.740192 19061 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.741178 13818 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:40.738867 18810 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.608924 19059 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260811 16:05:40.698621 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:40.600028 18955 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260811 16:05:40.766443 13744 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:40.689951 19078 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.784947 18955 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:40.755052 13823 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.799799 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.800825 13905 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11.
I20260811 16:05:40.801853 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.752887 19074 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.745540 19149 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:40.727880 19164 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:40.768777 19205 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260811 16:05:40.804263 19205 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:40.804692 19205 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:40.805707 19205 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.760231 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.798816 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:40.808715 13827 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:40.740908 19104 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.808943 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:40.742539 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:40.783577 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.655387 19160 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
I20260811 16:05:40.787673 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:40.820851 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.737859 19209 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.785992 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.831089 13902 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11. Re-sending same reply.
I20260811 16:05:40.786763 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.769317 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.832603 13908 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:40.770155 14578 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:40.810884 18955 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:40.837507 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:40.838529 13826 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:40.656232 19046 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.840453 19046 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.753559 19146 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260811 16:05:40.783245 18989 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.845269 18968 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Stepping down as leader of term 11
W20260811 16:05:40.786911 19266 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:05:40.845876 18968 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:40.770560 13901 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260811 16:05:40.847051 18968 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.848592 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.849061 18968 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:40.849493 13901 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:40.767123 13736 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:40.794029 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:40.796044 19258 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260811 16:05:40.784960 19278 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.708838 19156 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:40.649178 19051 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.857438 19051 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.716264 18692 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:40.858260 18692 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:40.797523 13817 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:40.797643 19129 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:40.859350 13739 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:40.810117 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91965.2us
I20260811 16:05:40.861225 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.862291 18968 raft_consensus.cc:2741] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260811 16:05:40.812093 14583 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:40.812870 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.823073 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.867899 18968 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260811 16:05:40.868157 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55397.4us
I20260811 16:05:40.869325 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.870378 18968 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:40.828311 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.876869 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.878612 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.785377 19166 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.838601 18955 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.881110 18692 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.836196 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:40.717144 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:40.832482 13907 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:40.827718 19104 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.753876 19145 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260811 16:05:40.792955 19078 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:40.894027 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 80835.1us
W20260811 16:05:40.897998 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104058us
I20260811 16:05:40.903347 17781 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:40.889351 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.850971 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.821300 19205 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.897055 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:40.912518 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81113.8us
W20260811 16:05:40.943610 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54381.6us
I20260811 16:05:40.827575 13823 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:40.944450 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.944406 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:40.947376 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:40.948657 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.948820 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.926997 14583 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:40.950469 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:40.953064 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:40.923979 19129 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:40.901044 19037 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:40.901612 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 191627us
I20260811 16:05:40.751420 19241 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.900812 19013 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260811 16:05:40.933974 13820 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260811 16:05:40.935556 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104523us
I20260811 16:05:40.906876 13826 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:40.973516 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.974169 13902 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.870941 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:40.895582 19053 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:40.962921 19278 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:40.887993 19046 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:40.956568 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.929157 13908 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:40.989806 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.958465 19055 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:40.958671 18987 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:40.960522 18692 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:40.961418 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:40.958235 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:40.971776 18955 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.936514 19104 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:41.001961 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 43801.1us
I20260811 16:05:40.955106 18968 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:40.966094 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:40.953200 13612 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 254220us
I20260811 16:05:40.932112 18885 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:40.901055 19149 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260811 16:05:40.903951 19158 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:40.956143 19257 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260811 16:05:40.977548 19003 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260811 16:05:40.982627 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.922161 14578 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:40.982937 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2233) took 1353 ms. Trace:
I20260811 16:05:40.949882 17781 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:40.912343 19101 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:40.951762 19082 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:40.987522 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 116691us
I20260811 16:05:40.987661 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:40.993078 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:40.996930 13901 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:40.997666 13822 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:40.955302 19183 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:40.957237 19129 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:40.970794 18936 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260811 16:05:41.016930 14579 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:40.945645 19034 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260811 16:05:40.901266 19080 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:40.981544 18880 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260811 16:05:41.018713 13902 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:41.234685 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1988) took 1484 ms. Trace:
W20260811 16:05:41.141978 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 203597us
I20260811 16:05:41.093348 13827 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
W20260811 16:05:41.255925 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 302320us
I20260811 16:05:41.259459 13903 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:41.072328 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 106327us
I20260811 16:05:41.258303 13740 rpcz_store.cc:276] 0811 16:05:39.750782 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.549993 (+799211us) service_pool.cc:227] Handling call
0811 16:05:41.234401 (+684408us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.234597 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":115652352}
I20260811 16:05:41.261232 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:40.988473 19199 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:41.258440 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.278733 13902 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:41.063546 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:41.083868 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1989) took 1319 ms (client timeout 1524 ms). Trace:
W20260811 16:05:41.279806 13737 rpcz_store.cc:269] 0811 16:05:39.764311 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.783346 (+ 19035us) service_pool.cc:227] Handling call
0811 16:05:41.083606 (+1300260us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.083787 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2461108992}
I20260811 16:05:41.093144 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.261276 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.280993 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.281229 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:40.976667 18989 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:41.269049 13744 rpcz_store.cc:276] 0811 16:05:39.629250 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.629403 (+   153us) service_pool.cc:227] Handling call
0811 16:05:39.631883 (+  2480us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.766905 (+1135022us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.982695 (+215790us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002783d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:40.982879 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2608838912}
I20260811 16:05:41.270843 13908 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:40.997329 19287 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:41.272189 19224 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:41.060081 18968 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.213s
I20260811 16:05:41.292430 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:41.294860 13743 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260811 16:05:41.294942 13903 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.272562 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:41.272538 19302 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:05:41.024284 19055 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:41.059357 19146 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.214s
I20260811 16:05:41.023216 19174 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260811 16:05:41.306416 19078 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:41.306982 19164 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260811 16:05:41.298254 19165 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260811 16:05:41.307449 19164 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.072885 19209 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:41.059755 19291 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260811 16:05:41.285431 19162 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:41.278306 19199 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:41.275292 19158 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.021978 18987 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:40.983592 19053 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:40.991921 19059 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.284s
I20260811 16:05:41.088608 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 1983) took 1343 ms. Trace:
I20260811 16:05:41.095448 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.331110 13738 rpcz_store.cc:276] 0811 16:05:39.745515 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.745669 (+   154us) service_pool.cc:227] Handling call
0811 16:05:39.778537 (+ 32868us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.783191 (+  4654us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.783226 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:39.815397 (+ 32171us) log.cc:842] Serialized 26 byte log entry
0811 16:05:40.314432 (+499035us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:40.314473 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.314538 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:40.851252 (+536714us) raft_consensus.cc:1671] finished
0811 16:05:40.851287 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:41.088227 (+236940us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5400280fd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.088527 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13742,"raft.queue_time_us":300,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5577,"spinlock_wait_cycles":4529408,"thread_start_us":498643,"threads_started":1,"wal-append.queue_time_us":793587}
I20260811 16:05:41.279882 14583 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:41.091665 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1927) took 1167 ms. Trace:
I20260811 16:05:41.281993 14541 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:41.333962 13818 rpcz_store.cc:276] 0811 16:05:39.924054 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.924460 (+   406us) service_pool.cc:227] Handling call
0811 16:05:39.924857 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.741614 (+816757us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.091395 (+349781us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400173c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.091599 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1876949760}
I20260811 16:05:41.283286 14577 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:41.063767 19298 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260811 16:05:41.330432 19053 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:41.337667 19025 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.683s	user 0.003s	sys 0.007s
I20260811 16:05:41.338099 19025 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.339704 19165 consensus_queue.cc:1225] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:05:41.340199 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.294137 13907 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:05:41.072533 19278 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:41.319206 19205 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:41.075480 19149 consensus_queue.cc:1225] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:05:41.284935 14578 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:41.348989 14578 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:05:41.278059 17781 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.254369 19061 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.351421 19061 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.353276 18810 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.280349 18742 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.074550 19241 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.258040 19183 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:41.302364 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 277140us
I20260811 16:05:41.305389 19104 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.305455 19302 consensus_queue.cc:1225] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260811 16:05:41.372259 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2268) took 4853 ms. Trace:
I20260811 16:05:41.372758 13900 rpcz_store.cc:276] 0811 16:05:36.518458 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.610676 (+3092218us) service_pool.cc:227] Handling call
0811 16:05:39.611030 (+   354us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:39.616880 (+  5850us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.616914 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:39.621531 (+  4617us) log.cc:842] Serialized 26 byte log entry
0811 16:05:40.288250 (+666719us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:40.329404 (+ 41154us) log.cc:842] Serialized 14 byte log entry
0811 16:05:40.335030 (+  5626us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.335122 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:41.236887 (+901765us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b18004a27e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:41.371929 (+135042us) raft_consensus.cc:1671] finished
0811 16:05:41.372052 (+   123us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:41.372188 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10816,"prepare.queue_time_us":29909,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":19173,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":10567,"spinlock_wait_cycles":21846400,"thread_start_us":641254,"threads_started":1,"wal-append.queue_time_us":872597}
I20260811 16:05:41.308756 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:41.071933 19289 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260811 16:05:41.375684 19183 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:41.313668 19310 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:41.377115 19110 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:41.377517 19110 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.378328 19110 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:41.314507 19081 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260811 16:05:41.321514 13735 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260811 16:05:41.323594 13908 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
W20260811 16:05:41.325553 19206 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260811 16:05:41.325929 19055 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.315409 19129 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.354718 19205 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.327313 19303 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:41.303284 19144 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:41.390746 19081 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.393813 19205 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.025827 18885 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.395426 19081 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:41.332825 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46373us
I20260811 16:05:41.335199 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:41.329737 18987 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.396605 18885 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.332597 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:41.397715 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65234.3us
I20260811 16:05:41.398766 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.399945 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:41.338387 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:41.213194 19269 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260811 16:05:41.335893 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53966.8us
I20260811 16:05:41.402456 14577 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:41.262785 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.403234 19110 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:41.403528 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 792) took 2384 ms. Trace:
I20260811 16:05:41.403980 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.403887 13904 rpcz_store.cc:276] 0811 16:05:39.019437 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.734924 (+715487us) service_pool.cc:227] Handling call
0811 16:05:39.735378 (+   454us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:39.851804 (+116426us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:39.851833 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:39.852437 (+   604us) log.cc:842] Serialized 52 byte log entry
0811 16:05:40.591595 (+739158us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:40.614961 (+ 23366us) log.cc:842] Serialized 14 byte log entry
0811 16:05:40.615390 (+   429us) log.cc:842] Serialized 14 byte log entry
0811 16:05:40.622614 (+  7224us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.622720 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:41.086426 (+463706us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18002ddc60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:41.403313 (+316887us) raft_consensus.cc:1671] finished
0811 16:05:41.403336 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:41.403470 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13399,"prepare.queue_time_us":173655,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":18221,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":14265,"spinlock_wait_cycles":85843584,"thread_start_us":738743,"threads_started":1,"wal-append.queue_time_us":844184}
I20260811 16:05:41.065877 19172 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:41.344424 19164 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.346633 13903 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:41.353379 19061 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.298982 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.355706 13789 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11.
I20260811 16:05:41.365293 18742 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.366725 19143 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:41.371524 19101 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.372154 19025 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.296907 19287 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:41.380336 19131 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.432075 19287 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.433051 19131 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:41.436269 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:41.419942 19241 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:41.375705 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.345608 19162 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:41.381896 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2239) took 1259 ms. Trace:
I20260811 16:05:41.382807 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 938) took 1259 ms. Trace:
I20260811 16:05:41.374107 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1382) took 3641 ms. Trace:
I20260811 16:05:41.440079 14581 rpcz_store.cc:276] 0811 16:05:37.732665 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.829119 (+2096454us) service_pool.cc:227] Handling call
0811 16:05:40.339452 (+510333us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.506199 (+166747us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.373900 (+867701us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54006aefd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.374036 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1172528896}
I20260811 16:05:41.386482 17781 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.356172 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.392088 19129 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:41.405553 13740 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:41.411648 13906 raft_consensus.cc:2354] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
W20260811 16:05:41.411901 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56524.6us
I20260811 16:05:41.452301 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2244) took 1002 ms. Trace:
I20260811 16:05:41.452621 13740 rpcz_store.cc:276] 0811 16:05:40.452645 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.405109 (+952464us) service_pool.cc:227] Handling call
0811 16:05:41.405388 (+   279us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.452043 (+ 46655us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.452243 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:41.453300 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.453965 13740 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:41.454811 19167 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:41.455437 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:41.455714 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:41.456106 18463 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:41.456415 19108 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:41.456514 18463 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:41.456723 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.346002 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.457001 18463 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.457338 19302 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:41.402724 14541 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.457897 19302 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:41.458277 19302 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:41.458429 19090 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:05:41.458592 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55959.9us
I20260811 16:05:41.460000 19166 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:41.460457 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.461102 13823 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.461282 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.461910 13826 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:41.416056 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 80964.1us
I20260811 16:05:41.416105 13737 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260811 16:05:41.465080 13737 pending_rounds.cc:76] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 6
I20260811 16:05:41.465341 13737 pending_rounds.cc:97] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260811 16:05:41.465605 13737 raft_consensus.cc:2866] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:41.465418 18880 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:05:41.466338 19130 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:41.429744 19303 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.386314 19053 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.415295 19144 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:41.419016 19205 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:41.417076 19206 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:41.417164 19174 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:41.354456 13738 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:41.416808 19143 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:41.439528 13743 rpcz_store.cc:276] 0811 16:05:40.122124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.646900 (+524776us) service_pool.cc:227] Handling call
0811 16:05:40.647292 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:41.295370 (+648078us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.381623 (+ 86253us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.381837 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1482441088}
I20260811 16:05:41.427744 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.439951 13736 rpcz_store.cc:276] 0811 16:05:40.123651 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.650307 (+526656us) service_pool.cc:227] Handling call
0811 16:05:40.704369 (+ 54062us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.851762 (+147393us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.382590 (+530828us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54003471d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.382751 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":113945984}
I20260811 16:05:41.446514 13818 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260811 16:05:41.439347 19162 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:41.447644 19310 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:05:41.439440 19025 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:41.448611 17781 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.448782 18742 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.449308 19241 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:41.386335 19199 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.438577 18987 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.467846 19303 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.468798 19053 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.471786 19143 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.450234 19034 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:41.509052 19034 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.437685 19081 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260811 16:05:41.457464 14574 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:41.414500 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.510493 13901 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260811 16:05:41.467082 13737 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
W20260811 16:05:41.511353 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 96914.4us
I20260811 16:05:41.513252 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:41.470923 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.515566 14581 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:41.473512 14577 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:41.486065 19162 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.480779 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.516434 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.486039 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.479113 13826 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:41.489836 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.522209 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.522234 13900 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:41.523128 14573 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:41.523944 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.521436 14581 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:41.525769 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.526556 13737 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260811 16:05:41.526714 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:41.528890 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.530701 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.532253 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 949) took 1154 ms. Trace:
I20260811 16:05:41.532671 13742 rpcz_store.cc:276] 0811 16:05:40.377334 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.658413 (+281079us) service_pool.cc:227] Handling call
0811 16:05:40.658809 (+   396us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.674005 (+ 15196us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.531963 (+857958us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.532185 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":33300864}
I20260811 16:05:41.480078 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.488108 13823 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:41.501583 13818 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:41.502840 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.503412 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.508210 18987 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:41.456912 19108 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:41.439707 13744 raft_consensus.cc:2396] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:05:41.385681 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.469380 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.469730 19205 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:41.535367 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:41.509052 19143 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:41.536110 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.536916 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 808) took 2203 ms. Trace:
I20260811 16:05:41.537317 14575 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:41.530282 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:41.538779 14583 raft_consensus.cc:2354] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11.
W20260811 16:05:41.538761 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 153162us
I20260811 16:05:41.530268 14581 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:41.539968 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70670us
I20260811 16:05:41.469477 19144 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.467882 18880 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260811 16:05:41.510768 19304 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:41.557340 19304 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.558276 19304 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.559723 19304 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.561700 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.562491 14577 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.509620 19025 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.565222 19025 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.542124 19053 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:41.567770 18880 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:41.568233 18880 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:41.569149 18880 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.570429 18880 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.529618 18968 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:41.571604 18968 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:41.536993 19199 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:41.572021 18968 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:41.574257 19183 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.564249 19080 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:41.576128 19075 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.576735 19075 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.578023 13825 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260811 16:05:41.578361 13825 pending_rounds.cc:76] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 6
I20260811 16:05:41.578563 13825 pending_rounds.cc:97] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260811 16:05:41.578801 13825 raft_consensus.cc:2866] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:41.580078 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1921) took 1908 ms. Trace:
I20260811 16:05:41.579880 19034 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.580454 13825 rpcz_store.cc:276] 0811 16:05:39.671384 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:39.672024 (+   640us) service_pool.cc:227] Handling call
0811 16:05:39.672343 (+   319us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.579265 (+1906922us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.579840 (+   575us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.580021 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4381921536}
I20260811 16:05:41.580950 19034 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.584254 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2238) took 1463 ms. Trace:
I20260811 16:05:41.585853 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2242) took 1137 ms. Trace:
I20260811 16:05:41.585490 19241 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.586210 13735 rpcz_store.cc:276] 0811 16:05:40.448821 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.868155 (+419334us) service_pool.cc:227] Handling call
0811 16:05:40.868536 (+   381us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:41.388037 (+519501us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.585598 (+197561us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54001045d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.585796 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1041067392}
I20260811 16:05:41.584638 13741 rpcz_store.cc:276] 0811 16:05:40.121189 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.646082 (+524893us) service_pool.cc:227] Handling call
0811 16:05:40.646372 (+   290us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.741042 (+ 94670us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:40.741074 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:40.741114 (+    40us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:40.741156 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.584035 (+842879us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.584079 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:41.584201 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":868,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":216961408}
I20260811 16:05:41.519333 19130 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:41.544576 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.590929 13909 rpcz_store.cc:276] 0811 16:05:39.333247 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.447211 (+1113964us) service_pool.cc:227] Handling call
0811 16:05:40.447638 (+   427us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:40.672592 (+224954us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.536667 (+864075us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.536857 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":515728768}
I20260811 16:05:41.593271 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.594664 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.596053 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.596666 13821 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.597867 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.599630 13823 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:41.600015 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.600975 14581 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:41.601620 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71432us
I20260811 16:05:41.603678 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.605396 13737 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:41.605726 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.606622 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.607431 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:41.609469 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74210.4us
I20260811 16:05:41.523775 19310 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260811 16:05:41.611835 19308 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:41.612596 19308 consensus_queue.cc:1225] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:05:41.613080 19308 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:41.613386 19308 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:41.547569 19287 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:41.614359 18742 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:41.614812 18742 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:41.614248 19308 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.542385 19108 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.615521 14579 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:05:41.615549 19053 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:41.616663 19053 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.617652 19053 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.616664 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.619954 13826 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:41.620106 19075 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:41.620999 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.607643 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:41.621847 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.611835 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.623643 13901 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260811 16:05:41.592512 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.624099 13909 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:05:41.624363 14575 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:41.622337 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.628207 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.628876 13737 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.627588 14577 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:41.602837 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.630178 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.631592 13905 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:41.632380 14573 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:41.634254 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:41.635821 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:41.638484 13900 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260811 16:05:41.633263 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.648523 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.648829 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.649287 13900 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:41.648295 14573 raft_consensus.cc:2362] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12. Re-sending same reply.
I20260811 16:05:41.649699 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.650486 13826 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:41.634582 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.653273 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.650336 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.653805 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.537922 19037 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:41.661294 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.655871 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.662180 13744 raft_consensus.cc:2396] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260811 16:05:41.662326 14583 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:41.656934 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.657361 13826 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:41.663630 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.656953 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.657730 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:41.665397 13735 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:41.664142 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:41.665238 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.544328 19224 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:41.700469 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.544484 19205 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:41.704105 14573 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:41.704144 14581 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:41.716822 14581 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:41.704905 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.718205 14573 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:41.700842 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:41.616061 19308 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:41.680279 13821 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:41.529160 19174 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.136s
I20260811 16:05:41.720033 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.718935 13902 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:41.666774 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:41.673926 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:41.712747 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:41.713145 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:41.721985 13900 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.713474 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.641512 13818 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:05:41.714133 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43834.5us
I20260811 16:05:41.723201 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.625599 19110 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.715307 13741 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:41.718310 13823 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:41.541702 19104 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.159s
I20260811 16:05:41.700680 19081 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260811 16:05:41.749329 19290 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.798s	user 0.004s	sys 0.001s
I20260811 16:05:41.712946 19037 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:41.750633 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1414) took 1178 ms. Trace:
I20260811 16:05:41.751695 19134 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:05:41.753275 19134 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:41.753116 19037 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.660818 19156 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.767175 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.769874 14574 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:41.770280 14574 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:41.723946 13818 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:41.724061 14573 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:41.724381 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50574.6us
I20260811 16:05:41.771556 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.725885 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.777405 14583 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:41.528775 19206 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260811 16:05:41.736682 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.739665 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.783932 13826 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:41.701082 19119 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260811 16:05:41.771098 14574 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.796247 14574 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:41.747659 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.796985 13743 raft_consensus.cc:1203] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Deduplicated request from leader. Original: 11.9->[12.10-12.10]   Dedup: 12.10->[]
I20260811 16:05:41.661187 19101 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:41.615247 18742 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.655573 19028 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:41.751052 14580 rpcz_store.cc:276] 0811 16:05:40.571867 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.572749 (+   882us) service_pool.cc:227] Handling call
0811 16:05:40.573022 (+   273us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:40.574651 (+  1629us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:40.574685 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:40.575099 (+   414us) log.cc:842] Serialized 26 byte log entry
0811 16:05:40.681423 (+106324us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:40.681459 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:40.681529 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:41.069215 (+387686us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b48000606d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:05:41.748649 (+679434us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:41.750411 (+  1762us) raft_consensus.cc:1671] finished
0811 16:05:41.750435 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:41.750575 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1236,"raft.queue_time_us":1940,"raft.run_cpu_time_us":2370,"raft.run_wall_time_us":493027,"spinlock_wait_cycles":16718592,"thread_start_us":77248,"threads_started":1,"wal-append.queue_time_us":312873}
I20260811 16:05:41.739267 13737 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:41.759819 13902 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:41.761101 13900 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:41.809461 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.705327 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.721192 19059 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:41.784880 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.819103 19177 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:41.819554 19310 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:41.820853 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:41.821918 14573 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:05:41.822036 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.822959 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:41.786648 19183 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.788033 18968 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.790217 14541 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.719442 19090 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260811 16:05:41.747476 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:41.797489 13743 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260811 16:05:41.799786 13821 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:41.831722 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.800107 13909 raft_consensus.cc:1203] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Deduplicated request from leader. Original: 9.10->[10.11-10.11]   Dedup: 10.11->[]
I20260811 16:05:41.802098 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1934) took 1107 ms. Trace:
I20260811 16:05:41.655341 19287 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260811 16:05:41.803916 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2298) took 1035 ms. Trace:
I20260811 16:05:41.832903 13909 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260811 16:05:41.833374 13906 rpcz_store.cc:276] 0811 16:05:40.768284 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.768415 (+   131us) service_pool.cc:227] Handling call
0811 16:05:41.803707 (+1035292us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.803860 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1378340736}
I20260811 16:05:41.804373 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 1991) took 1356 ms. Trace:
I20260811 16:05:41.834941 13739 rpcz_store.cc:276] 0811 16:05:40.448132 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.526353 (+ 78221us) service_pool.cc:227] Handling call
0811 16:05:41.804173 (+1277820us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.804299 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":728568064}
I20260811 16:05:41.756821 19145 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:41.739845 19224 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:41.805954 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.850462 13826 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:41.758828 19110 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.816700 14581 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.818100 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.823526 14573 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:41.700776 19080 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260811 16:05:41.824210 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:41.763725 19314 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260811 16:05:41.866767 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:41.826359 19266 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260811 16:05:41.843171 14575 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
I20260811 16:05:41.878204 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:41.844352 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:41.843250 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.854717 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:41.832880 13822 rpcz_store.cc:276] 0811 16:05:40.694987 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.695160 (+   173us) service_pool.cc:227] Handling call
0811 16:05:40.695488 (+   328us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.267463 (+571975us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:41.801821 (+534358us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:41.802027 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":694344448}
I20260811 16:05:41.869382 13826 raft_consensus.cc:1203] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.10->[10.11-10.11]   Dedup: 10.11->[]
I20260811 16:05:41.869688 13825 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 7. Current term is 9. Ops: [7.9-7.9]
I20260811 16:05:41.880432 13821 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260811 16:05:41.727919 18955 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260811 16:05:41.881491 13826 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260811 16:05:41.884649 14573 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:41.886847 13818 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:41.887563 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:41.824558 19206 consensus_queue.cc:1225] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:05:41.760280 18463 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.819561 19177 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:41.905948 13907 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:41.839855 19310 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:41.828286 18640 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:41.894326 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:41.839681 19149 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:41.912426 13822 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:41.783104 19156 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.871552 19120 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:41.932789 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2310) took 1160 ms. Trace:
I20260811 16:05:41.933246 13905 rpcz_store.cc:276] 0811 16:05:40.772098 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.801567 (+ 29469us) service_pool.cc:227] Handling call
0811 16:05:41.932617 (+1131050us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54002adad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:41.932726 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1870567296}
I20260811 16:05:41.935601 13824 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:41.892176 19197 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.908668 19003 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:41.944505 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101730us
I20260811 16:05:41.916033 19104 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:41.917513 19082 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.930159 19183 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:41.959252 19177 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.959424 19183 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:41.960676 19177 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:41.961768 19183 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:41.953043 19197 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:41.968752 19197 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:41.970423 19320 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260811 16:05:41.971181 13736 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260811 16:05:41.971555 13736 pending_rounds.cc:76] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 5
I20260811 16:05:41.971789 13736 pending_rounds.cc:97] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260811 16:05:41.972069 13736 raft_consensus.cc:2866] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:41.852941 19302 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:41.940199 19319 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260811 16:05:42.007833 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:41.916129 19172 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
W20260811 16:05:42.006966 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 273854us
I20260811 16:05:41.946997 19120 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:41.949986 19010 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:41.950614 19104 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:42.052441 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:42.003759 13907 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:42.094969 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:42.102030 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:42.102805 13743 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:42.021073 19183 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:42.123445 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:42.155690 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 314779us
I20260811 16:05:42.044843 19010 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:41.974845 19082 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:42.144925 19108 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260811 16:05:42.177668 19090 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:41.980345 19224 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:42.182713 19330 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
W20260811 16:05:42.184396 19322 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260811 16:05:42.185966 13827 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:42.190299 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.177902 13743 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:05:42.184065 19119 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:42.192744 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:42.193115 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:42.185678 19090 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:42.098176 18936 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260811 16:05:42.202255 19329 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260811 16:05:42.179687 19104 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.205569 17781 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:42.206045 17781 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:41.977958 19279 consensus_queue.cc:1159] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:05:42.197790 19110 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:42.197948 18463 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:42.199699 18989 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
W20260811 16:05:42.200045 19325 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260811 16:05:42.207983 18968 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:42.200789 19326 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260811 16:05:42.239478 18989 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:42.202131 18936 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
W20260811 16:05:42.177052 19162 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.003s
I20260811 16:05:42.198202 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:42.208854 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 379034us
I20260811 16:05:42.206805 17781 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.221742 13817 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:42.222070 13743 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260811 16:05:42.154445 19183 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.214725 19174 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:42.250272 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:42.199051 19119 consensus_queue.cc:1225] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:05:42.251796 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.194172 19055 raft_consensus.cc:2741] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260811 16:05:42.243284 19331 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260811 16:05:42.260027 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:42.257375 19328 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260811 16:05:42.259253 18463 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260811 16:05:42.291036 18463 consensus_queue.cc:1225] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:05:42.291088 19332 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:42.292308 19082 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:42.291887 19332 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.240855 18989 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.288792 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:42.260329 18936 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:42.257532 19162 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.263339 19156 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:42.298844 19143 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:42.271452 19174 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:42.194199 19108 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.226493 19010 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.299741 18989 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:42.300829 18742 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.303598 18968 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:42.305042 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:42.347411 13743 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:42.349376 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:42.318245 19143 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:42.306638 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1076) took 1615 ms. Trace:
W20260811 16:05:42.314270 19167 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.000s
I20260811 16:05:42.346347 13823 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:42.356601 14582 rpcz_store.cc:276] 0811 16:05:40.691425 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:40.691736 (+   311us) service_pool.cc:227] Handling call
0811 16:05:41.883506 (+1191770us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:41.883756 (+   250us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:42.306122 (+422366us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:42.306170 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:42.306230 (+    60us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:42.306274 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.306361 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.306560 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":467430,"spinlock_wait_cycles":58226560,"thread_start_us":399084,"threads_started":1}
I20260811 16:05:42.319006 19101 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:42.361780 19174 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.4, Last appended by leader: 4, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.368177 14577 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:42.288923 14580 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:47006
W20260811 16:05:42.358923 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 464695us
I20260811 16:05:42.373976 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:42.343056 19082 raft_consensus.cc:465] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Not starting pre-election -- already a leader
W20260811 16:05:42.355939 19199 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.783s	user 0.006s	sys 0.005s
I20260811 16:05:42.325630 19302 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:42.346665 19059 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:42.346859 19145 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:42.354339 18463 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:42.365496 19010 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:42.367514 19296 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260811 16:05:42.386329 14582 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:42.412979 14574 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:42.419883 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:42.386046 19053 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.010s	sys 0.023s
I20260811 16:05:42.424045 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:42.402642 13820 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:42.416586 18463 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:42.443774 14582 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260811 16:05:42.443816 13906 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260811 16:05:42.434600 19308 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.004s
I20260811 16:05:42.418926 19120 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:42.454295 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 185962us
W20260811 16:05:42.450446 14575 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.016s	sys 0.009s
W20260811 16:05:42.458606 14575 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.016s	sys 0.009s
I20260811 16:05:42.460927 14578 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260811 16:05:42.422796 19302 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election won for term 11
W20260811 16:05:42.436506 19053 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.010s	sys 0.024s
W20260811 16:05:42.417697 19034 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.000s
I20260811 16:05:42.364987 19090 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.470932 14580 raft_consensus.cc:595] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:05:42.448272 19164 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.017s	sys 0.027s
W20260811 16:05:42.483863 19164 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.018s	sys 0.027s
W20260811 16:05:42.488994 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69216.9us
I20260811 16:05:42.499696 14580 raft_consensus.cc:603] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:42.500123 19302 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:42.509690 19090 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:42.510094 19302 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.514784 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:42.452864 18463 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:42.536484 19059 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.388008 18936 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.553241 18742 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:42.553764 19337 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260811 16:05:42.423202 19143 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.562034 19145 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.564641 19108 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:42.553331 19334 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260811 16:05:42.471585 19308 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:42.529302 19183 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:42.574399 19310 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.001s
I20260811 16:05:42.572093 19332 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:42.590219 19177 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.627s	user 0.014s	sys 0.000s
I20260811 16:05:42.586254 19308 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:42.644186 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.008s	sys 0.000s
W20260811 16:05:42.645109 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.001s	sys 0.007s
W20260811 16:05:42.645710 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.003s
I20260811 16:05:42.646490 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2004) took 1257 ms. Trace:
I20260811 16:05:42.646010 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:42.656214 13738 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.000s
I20260811 16:05:42.657979 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:42.658345 13740 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260811 16:05:42.659945 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:42.661558 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.664358 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:42.664832 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 891) took 1066 ms. Trace:
I20260811 16:05:42.666030 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.668154 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 892) took 1070 ms. Trace:
I20260811 16:05:42.669888 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2625) took 1031 ms. Trace:
W20260811 16:05:42.525516 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 100214us
I20260811 16:05:42.551674 19034 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:42.744899 19304 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:42.529567 18880 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.959s	user 0.013s	sys 0.001s
I20260811 16:05:42.590440 19310 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:42.745950 19304 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.693005 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 879) took 1098 ms. Trace:
I20260811 16:05:42.747413 13827 rpcz_store.cc:276] 0811 16:05:41.594512 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.742512 (+148000us) service_pool.cc:227] Handling call
0811 16:05:42.185778 (+443266us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:42.186433 (+   655us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.692311 (+505878us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54000983d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.692723 (+   412us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1018491136}
I20260811 16:05:42.529228 19110 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.058s
W20260811 16:05:42.749568 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:42.750859 19003 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:42.749673 19304 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:42.752804 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:42.754041 14573 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:42.760402 13741 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:42.760253 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1422) took 1769 ms. Trace:
I20260811 16:05:42.760951 14579 rpcz_store.cc:276] 0811 16:05:40.990344 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.261896 (+271552us) service_pool.cc:227] Handling call
0811 16:05:41.262312 (+   416us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.615908 (+353596us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.759574 (+1143666us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54004e02d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:42.759978 (+   404us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":811543424}
I20260811 16:05:42.762022 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:42.471257 19101 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.769372 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1067) took 1209 ms. Trace:
I20260811 16:05:42.770138 14578 rpcz_store.cc:276] 0811 16:05:41.559393 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.621585 (+ 62192us) service_pool.cc:227] Handling call
0811 16:05:42.768719 (+1147134us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54005c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.769107 (+   388us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1916487040}
I20260811 16:05:42.723980 13735 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260811 16:05:42.810977 13789 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40908 dropped due to backpressure. The service queue is full; it has 50 items.
W20260811 16:05:42.727803 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.004s
I20260811 16:05:42.814075 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 818) took 1325 ms. Trace:
W20260811 16:05:42.734171 13738 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.008s	sys 0.000s
W20260811 16:05:42.742381 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 218369us
I20260811 16:05:42.815850 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2003) took 1454 ms. Trace:
I20260811 16:05:42.816397 13738 rpcz_store.cc:276] 0811 16:05:41.361315 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.472087 (+110772us) service_pool.cc:227] Handling call
0811 16:05:41.472421 (+   334us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:41.472630 (+   209us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:41.472655 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:41.473068 (+   413us) log.cc:842] Serialized 26 byte log entry
0811 16:05:41.706537 (+233469us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:42.102470 (+395933us) log.cc:842] Serialized 14 byte log entry
0811 16:05:42.815253 (+712783us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.815417 (+   164us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:42.815542 (+   125us) raft_consensus.cc:1671] finished
0811 16:05:42.815563 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.815768 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56251,"prepare.queue_time_us":559252,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":195247,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":1172543,"threads_started":3,"wal-append.queue_time_us":451578}
I20260811 16:05:42.720206 19143 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:42.821600 19104 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:42.823858 19081 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:42.824242 14573 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260811 16:05:42.728473 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.009s	sys 0.001s
W20260811 16:05:42.825364 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.01538e+06us
I20260811 16:05:42.827322 19177 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:42.832870 19190 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:42.833489 19190 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:42.771682 19034 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:42.837203 18987 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:42.838331 18987 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:42.814618 13908 rpcz_store.cc:276] 0811 16:05:41.488931 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.489101 (+   170us) service_pool.cc:227] Handling call
0811 16:05:41.489515 (+   414us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.489788 (+   273us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:05:41.658834 (+169046us) log.cc:842] Serialized 14 byte log entry
0811 16:05:42.812847 (+1154013us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800358ae0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b
0811 16:05:42.813284 (+   437us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:42.813390 (+   106us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:42.813470 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.813614 (+   144us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.813843 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":350205,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":16073,"raft.queue_time_us":23569,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"spinlock_wait_cycles":32148736,"thread_start_us":403775,"threads_started":2,"wal-append.queue_time_us":484159}
I20260811 16:05:42.841161 18987 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:42.844313 19034 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.845759 13818 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260811 16:05:42.846745 19336 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
I20260811 16:05:42.769474 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1069) took 1209 ms. Trace:
I20260811 16:05:42.852317 14577 rpcz_store.cc:276] 0811 16:05:41.560070 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.629867 (+ 69797us) service_pool.cc:227] Handling call
0811 16:05:42.768879 (+1139012us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.769222 (+   343us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1684768512}
I20260811 16:05:42.854031 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:42.776458 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1954) took 1259 ms. Trace:
I20260811 16:05:42.776762 13822 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:42.855353 13824 rpcz_store.cc:276] 0811 16:05:41.517071 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.517233 (+   162us) service_pool.cc:227] Handling call
0811 16:05:42.775870 (+1258637us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540014dcd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.776194 (+   324us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":789767424}
I20260811 16:05:42.855858 14574 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:05:42.717067 13901 rpcz_store.cc:276] 0811 16:05:41.638120 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.638260 (+   140us) service_pool.cc:227] Handling call
0811 16:05:41.638639 (+   379us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:41.666741 (+ 28102us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:41.666771 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:41.712933 (+ 46162us) log.cc:842] Serialized 52 byte log entry
0811 16:05:42.044770 (+331837us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:42.044811 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.044887 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:42.668903 (+624016us) raft_consensus.cc:1671] finished
0811 16:05:42.668976 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.669492 (+   516us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28032,"raft.queue_time_us":27984,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":17951,"thread_start_us":288235,"threads_started":1,"wal-append.queue_time_us":534288}
I20260811 16:05:42.716173 13825 rpcz_store.cc:276] 0811 16:05:41.597772 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.880727 (+282955us) service_pool.cc:227] Handling call
0811 16:05:41.880965 (+   238us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.881138 (+   173us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:42.242487 (+361349us) log.cc:842] Serialized 14 byte log entry
0811 16:05:42.663634 (+421147us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:42.663780 (+   146us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:42.664017 (+   237us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.664188 (+   171us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.664565 (+   377us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":559296,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2749,"raft.queue_time_us":21279,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":354,"thread_start_us":749329,"threads_started":2,"wal-append.queue_time_us":358841}
I20260811 16:05:42.714170 13736 rpcz_store.cc:276] 0811 16:05:41.389051 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.473472 (+ 84421us) service_pool.cc:227] Handling call
0811 16:05:41.503732 (+ 30260us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.972563 (+468831us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.645638 (+673075us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54000302d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:42.646211 (+   573us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1074066688}
I20260811 16:05:42.856992 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.857398 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.857749 13736 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:42.858053 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 903) took 1103 ms. Trace:
I20260811 16:05:42.858439 13825 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:42.783244 18640 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:42.859601 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.859656 18640 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.470225 19120 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.860944 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2628) took 1212 ms. Trace:
I20260811 16:05:42.774055 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1059) took 1302 ms. Trace:
I20260811 16:05:42.861505 13907 rpcz_store.cc:276] 0811 16:05:41.648428 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.648546 (+   118us) service_pool.cc:227] Handling call
0811 16:05:42.860532 (+1211986us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000c8354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.860748 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":422056192}
I20260811 16:05:42.794368 19199 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:42.804993 19028 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:42.863085 19199 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.863126 19028 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.865253 13736 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260811 16:05:42.809057 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:42.810767 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:42.847185 19190 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:42.855023 19358 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260811 16:05:42.778128 19308 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:42.776011 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:42.789857 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.858071 13824 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:42.858505 13823 rpcz_store.cc:276] 0811 16:05:41.754850 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.766920 (+ 12070us) service_pool.cc:227] Handling call
0811 16:05:42.857647 (+1090727us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54002dcdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.857875 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1329774336}
I20260811 16:05:42.861054 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.874255 13735 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:42.854981 14577 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:42.818364 19055 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260811 16:05:42.862358 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.713s (SENT)
I20260811 16:05:42.861969 14583 rpcz_store.cc:276] 0811 16:05:41.471043 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.778126 (+307083us) service_pool.cc:227] Handling call
0811 16:05:42.771356 (+993230us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:42.772496 (+  1140us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:42.772534 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:42.772616 (+    82us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:42.772693 (+    77us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.772807 (+   114us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.773591 (+   784us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54005c7e50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:42.773803 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":15075,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":259,"spinlock_wait_cycles":2202457472}
I20260811 16:05:42.891525 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.716678 13821 rpcz_store.cc:276] 0811 16:05:41.597992 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.881121 (+283129us) service_pool.cc:227] Handling call
0811 16:05:41.882070 (+   949us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.882249 (+   179us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:42.337035 (+454786us) log.cc:842] Serialized 14 byte log entry
0811 16:05:42.667295 (+330260us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:42.667438 (+   143us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:42.667585 (+   147us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.667708 (+   123us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.667950 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30732,"prepare.queue_time_us":645069,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":19510,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"thread_start_us":738850,"threads_started":2,"wal-append.queue_time_us":264710}
I20260811 16:05:42.892974 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:42.917076 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.918409 13825 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:42.920318 19308 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260811 16:05:42.920773 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58682.2us
W20260811 16:05:42.921716 14544 leader_election.cc:334] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.814s (SENT)
I20260811 16:05:42.922379 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:42.924475 14581 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:42.927469 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.927767 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:42.928543 13824 raft_consensus.cc:2362] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9. Re-sending same reply.
I20260811 16:05:42.929791 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.930846 13824 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260811 16:05:42.934423 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:42.935719 13740 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:42.936368 13818 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:42.943048 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1430) took 1468 ms. Trace:
W20260811 16:05:42.942922 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 124225us
I20260811 16:05:42.938445 13827 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:42.944780 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.943713 14575 rpcz_store.cc:276] 0811 16:05:41.474287 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.876527 (+402240us) service_pool.cc:227] Handling call
0811 16:05:41.876800 (+   273us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:42.459055 (+582255us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:42.459096 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:42.528549 (+ 69453us) log.cc:842] Serialized 26 byte log entry
0811 16:05:42.712223 (+183674us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:42.712359 (+   136us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.737850 (+ 25491us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:42.938620 (+200770us) raft_consensus.cc:1671] finished
0811 16:05:42.938642 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.942817 (+  4175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":443579,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13951,"thread_start_us":627902,"threads_started":2,"wal-append.queue_time_us":246608}
I20260811 16:05:42.950317 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:42.960821 13825 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260811 16:05:42.961530 18692 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260811 16:05:42.968611 19205 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.233s	user 0.013s	sys 0.011s
I20260811 16:05:42.969210 19205 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:42.971597 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:42.973526 13737 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260811 16:05:42.975275 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1955) took 1179 ms. Trace:
I20260811 16:05:42.962008 19028 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:42.975589 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.971694 13742 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260811 16:05:42.935353 13789 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40908 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2650)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2664)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2644)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1957)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2673)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2677)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2681)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1964)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1966)
I20260811 16:05:42.978766 13820 raft_consensus.cc:2362] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11. Re-sending same reply.
I20260811 16:05:42.979359 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:42.980464 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:42.980911 19174 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:42.982506 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 146072us
W20260811 16:05:42.995872 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 117023us
I20260811 16:05:42.998919 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.005266 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.009682 13735 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:43.011664 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.015244 13821 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:43.014576 13820 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:43.000234 19119 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:42.999197 19308 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:43.026942 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.024499 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1044) took 1559 ms. Trace:
I20260811 16:05:43.017416 13905 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:43.030774 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.016875 19190 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:43.032900 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.027872 14581 rpcz_store.cc:276] 0811 16:05:41.460389 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.703664 (+243275us) service_pool.cc:227] Handling call
0811 16:05:41.704002 (+   338us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:41.816345 (+112343us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b54003ddc20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a2951 00007f5c51903321 00007f5c51904b4e 00007f5c5190ec89 00007f5c5190f556 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612
0811 16:05:42.757356 (+941011us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b58004ed1b0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51887f63 00007f5c518ebaba 00007f5c519033af 00007f5c51904b4e 00007f5c5190ec89 00007f5c5190f556 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684
0811 16:05:43.004380 (+247024us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:43.004451 (+    71us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:43.013270 (+  8819us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:43.013330 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.013457 (+   127us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:43.019548 (+  6091us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4335,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":12199,"spinlock_wait_cycles":705783936}
I20260811 16:05:43.013321 19172 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:43.048861 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:43.045846 13820 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:43.052732 14580 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:43.026525 19199 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:42.975713 13826 rpcz_store.cc:276] 0811 16:05:41.731700 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.882175 (+150475us) service_pool.cc:227] Handling call
0811 16:05:41.882468 (+   293us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:41.963820 (+ 81352us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:41.963857 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:41.964332 (+   475us) log.cc:842] Serialized 26 byte log entry
0811 16:05:42.309666 (+345334us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:42.309706 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:42.309795 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:42.853915 (+544120us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:42.878976 (+ 25061us) raft_consensus.cc:1671] finished
0811 16:05:42.879003 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:42.910985 (+ 31982us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":80969,"raft.queue_time_us":82130,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":34114944,"thread_start_us":344938,"threads_started":1,"wal-append.queue_time_us":469943}
W20260811 16:05:43.078666 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 157040us
I20260811 16:05:43.048219 19119 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:43.081548 19037 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.016s	sys 0.028s
I20260811 16:05:43.081707 13744 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260811 16:05:43.082161 19037 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.016s	sys 0.028s
I20260811 16:05:43.083034 19164 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.083843 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.083750 19164 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.085239 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.086012 13818 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:43.086458 19164 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.088603 19219 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:43.089121 19219 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:43.090447 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65824.2us
W20260811 16:05:43.091361 19387 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260811 16:05:43.092547 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.093911 19131 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:43.094766 14582 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260811 16:05:43.095120 19046 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260811 16:05:43.095536 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1433) took 1326 ms. Trace:
I20260811 16:05:43.095762 19332 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.095896 14582 rpcz_store.cc:276] 0811 16:05:41.769591 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:42.734940 (+965349us) service_pool.cc:227] Handling call
0811 16:05:43.093894 (+358954us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:43.094174 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.095267 (+  1093us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.095469 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":178326784}
I20260811 16:05:43.026974 19177 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260811 16:05:43.097435 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.092324 18936 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:43.029352 19174 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:43.086866 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.096716 13817 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:43.101649 13903 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260811 16:05:43.105093 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59866.1us
I20260811 16:05:43.110392 19332 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:43.114477 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44718.5us
I20260811 16:05:43.100908 19205 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.123311 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:43.115178 14544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.847s (SENT) [suppressed 50 similar messages]
I20260811 16:05:43.115746 19177 consensus_queue.cc:1225] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:05:43.135635 13821 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260811 16:05:43.137960 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.130440 18936 consensus_queue.cc:1225] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:05:43.145294 13825 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:43.137317 19279 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:43.156045 19279 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:43.160140 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 231974us
I20260811 16:05:43.160017 19145 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260811 16:05:43.161371 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.162089 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:43.162412 19177 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.162849 13907 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:43.127420 19172 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:43.164086 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.153203 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2647) took 1200 ms. Trace:
I20260811 16:05:43.166067 13826 rpcz_store.cc:276] 0811 16:05:41.952646 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.114342 (+1161696us) service_pool.cc:227] Handling call
0811 16:05:43.153109 (+ 38767us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:43.166488 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43537.6us
I20260811 16:05:43.169927 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:43.169927 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.175112 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.175870 13826 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:43.176946 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.118876 19119 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.179786 18463 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.184055 13738 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 4. Preceding OpId from leader: term: 15 index: 5. (index mismatch)
I20260811 16:05:43.186724 19146 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260811 16:05:43.189379 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48165us
I20260811 16:05:43.178144 18955 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:43.191577 18955 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:43.192005 18955 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:43.163290 19177 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.199712 19332 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.202787 13823 raft_consensus.cc:2354] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11.
I20260811 16:05:43.204782 13736 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260811 16:05:43.205236 13736 pending_rounds.cc:76] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 5
I20260811 16:05:43.205560 13736 pending_rounds.cc:97] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260811 16:05:43.205870 13736 raft_consensus.cc:2866] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:43.207682 14544 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.733s (SENT)
I20260811 16:05:43.208155 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:43.207727 19177 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.209081 19119 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.209790 19119 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:43.198278 18463 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:43.210534 14544 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.699s (SENT)
I20260811 16:05:43.211649 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:43.212597 13735 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:43.213694 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:43.218104 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:43.219482 19308 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:43.211506 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:43.221491 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54991.4us
I20260811 16:05:43.222707 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:43.224592 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:43.225052 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.226751 19174 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.219522 19053 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:43.227094 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.228133 19037 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:43.273049 19279 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.273236 19028 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260811 16:05:43.273571 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46655.8us
I20260811 16:05:43.273844 19028 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:43.274221 19028 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:43.274626 19059 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:43.275512 14582 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:43.228711 19172 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:43.228921 13709 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.534s (SENT)
W20260811 16:05:43.279361 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 100760us
W20260811 16:05:43.280139 13709 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.535s (SENT)
W20260811 16:05:43.280220 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69720.7us
I20260811 16:05:43.272436 19162 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.257004 13907 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:43.266659 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:43.257462 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2255) took 1311 ms. Trace:
I20260811 16:05:43.264334 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.234752 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.256837 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:43.289309 13824 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:43.280691 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:43.267663 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:43.265861 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:43.259282 13817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2648) took 1295 ms (client timeout 1549 ms). Trace:
I20260811 16:05:43.239471 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2643) took 1438 ms. Trace:
I20260811 16:05:43.256989 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:43.295478 14581 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:05:43.290934 13817 rpcz_store.cc:269] 0811 16:05:41.964075 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:42.251548 (+287473us) service_pool.cc:227] Handling call
0811 16:05:43.258959 (+1007411us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400355054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:43.259175 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":988148096}
I20260811 16:05:43.288538 13742 rpcz_store.cc:276] 0811 16:05:41.945912 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.946088 (+   176us) service_pool.cc:227] Handling call
0811 16:05:41.955442 (+  9354us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:43.006532 (+1051090us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.257127 (+250595us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:43.257397 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2335902080}
I20260811 16:05:43.292424 13822 rpcz_store.cc:276] 0811 16:05:41.800963 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.920727 (+119764us) service_pool.cc:227] Handling call
0811 16:05:42.776174 (+855447us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:42.855537 (+ 79363us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.239173 (+383636us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b540014dcd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:43.239371 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1912992640}
I20260811 16:05:43.313957 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.232657 18885 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
W20260811 16:05:43.271013 19010 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.844s	user 0.015s	sys 0.008s
I20260811 16:05:43.323936 13736 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
W20260811 16:05:43.319957 14544 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.746s (SENT)
I20260811 16:05:43.327548 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.237195 19278 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:43.253237 18640 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.324787 14580 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:43.234508 19003 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:43.337004 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:43.327463 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:43.312081 19172 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.342515 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:43.341260 13735 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:43.343232 14583 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:43.331097 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:43.344449 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.350665 13817 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260811 16:05:43.350970 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 126515us
I20260811 16:05:43.266599 18692 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
I20260811 16:05:43.354060 13744 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:43.257309 19183 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260811 16:05:43.356951 13824 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:43.361814 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.362660 13826 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 8.
I20260811 16:05:43.363664 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.240906 19053 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.359642 13903 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:43.333210 19278 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:43.370222 13735 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:43.345165 18885 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:43.365659 14582 pending_rounds.cc:76] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 9
I20260811 16:05:43.379817 14582 pending_rounds.cc:97] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260811 16:05:43.380147 14582 raft_consensus.cc:2866] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:43.365067 13905 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:43.372532 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.384841 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2664) took 1100 ms. Trace:
I20260811 16:05:43.385262 13822 rpcz_store.cc:276] 0811 16:05:42.284794 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.341098 (+1056304us) service_pool.cc:227] Handling call
0811 16:05:43.384766 (+ 43668us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.357861 19190 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.393906 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:43.395675 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:43.388540 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.397989 13824 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:43.398592 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:43.356148 19172 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:43.399704 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.405768 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:43.406965 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 98461.3us
I20260811 16:05:43.407920 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:43.410104 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:43.411360 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 131285us
I20260811 16:05:43.411896 19347 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:43.400910 19145 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260811 16:05:43.412631 13739 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260811 16:05:43.412356 19104 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:43.413138 13901 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:05:43.417388 19120 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.418448 18955 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.392042 19332 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260811 16:05:43.423255 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:43.426024 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.437671 13822 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:43.438113 13905 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:05:43.392146 19046 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:43.436751 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2660) took 1282 ms. Trace:
I20260811 16:05:43.440610 13817 rpcz_store.cc:276] 0811 16:05:42.154745 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.368137 (+1213392us) service_pool.cc:227] Handling call
0811 16:05:43.436668 (+ 68531us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.453490 13826 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:05:43.447048 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:43.455741 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45809.1us
I20260811 16:05:43.399226 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:43.458516 13906 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:43.439966 19010 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:43.460438 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:43.459327 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.442493 19081 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:43.471916 13735 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:43.463414 13744 raft_consensus.cc:595] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:43.464186 19046 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.491513 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2656) took 1525 ms. Trace:
I20260811 16:05:43.492058 13824 rpcz_store.cc:276] 0811 16:05:41.966529 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.431589 (+1465060us) service_pool.cc:227] Handling call
0811 16:05:43.491447 (+ 59858us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.470623 13820 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:43.439658 19119 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:43.428054 19279 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:43.437170 19190 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.496479 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:05:43.518981 13709 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.549s (SENT)
W20260811 16:05:43.519384 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61678us
I20260811 16:05:43.471810 19010 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:43.525305 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.523504 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:43.524911 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:43.542671 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 159793us
I20260811 16:05:43.501250 19347 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:43.543852 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.526180 18463 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.462395 18880 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:43.527570 19010 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:43.548472 13822 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:43.553115 13735 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260811 16:05:43.555780 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 163593us
I20260811 16:05:43.569574 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:43.570174 14578 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:43.576799 13817 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:43.577313 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2644) took 1717 ms. Trace:
I20260811 16:05:43.577621 13822 rpcz_store.cc:276] 0811 16:05:41.851470 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.443963 (+1592493us) service_pool.cc:227] Handling call
0811 16:05:43.523605 (+ 79642us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.568852 (+ 45247us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.569117 (+   265us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.548626 19146 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:43.501006 19174 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.550644 19177 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:43.580856 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.876s (SENT)
I20260811 16:05:43.594353 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2645) took 1678 ms. Trace:
I20260811 16:05:43.604972 13817 rpcz_store.cc:276] 0811 16:05:41.907207 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.455967 (+1548760us) service_pool.cc:227] Handling call
0811 16:05:43.532321 (+ 76354us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.585556 (+ 53235us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.585765 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.574982 19104 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:43.576025 19347 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:43.499755 18885 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:43.551610 19279 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.574492 19055 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.054s
I20260811 16:05:43.569037 19119 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.688684 13817 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:43.683331 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:05:43.659574 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206282us
I20260811 16:05:43.664659 14573 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260811 16:05:43.708069 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:43.611234 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:43.792802 18936 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:43.793387 18936 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:43.793483 19296 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:43.792098 14577 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:43.794548 18936 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.796002 18936 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:43.671370 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:43.700177 13822 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:43.800094 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2646) took 1868 ms. Trace:
I20260811 16:05:43.800519 13822 rpcz_store.cc:276] 0811 16:05:41.931451 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.585821 (+1654370us) service_pool.cc:227] Handling call
0811 16:05:43.627565 (+ 41744us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.799809 (+172244us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.800032 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.792948 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2658) took 1825 ms. Trace:
I20260811 16:05:43.813764 14578 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:43.807602 13817 rpcz_store.cc:276] 0811 16:05:41.973299 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.605815 (+1632516us) service_pool.cc:227] Handling call
0811 16:05:43.685831 (+ 80016us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.789217 (+103386us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.792868 (+  3651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:43.667012 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2260) took 1438 ms. Trace:
I20260811 16:05:43.842985 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:05:43.797583 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 227455us
I20260811 16:05:43.591938 19146 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:43.595194 18955 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.841176 13737 rpcz_store.cc:276] 0811 16:05:42.223106 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:42.223612 (+   506us) service_pool.cc:227] Handling call
0811 16:05:42.224005 (+   393us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:42.974048 (+750043us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.629947 (+655899us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b540020a8d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:43.661003 (+ 31056us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1722252032}
I20260811 16:05:43.789507 13744 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:05:43.623646 19334 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260811 16:05:43.707406 18989 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.359s	user 0.019s	sys 0.003s
I20260811 16:05:43.622653 19053 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:43.627068 19398 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
I20260811 16:05:43.681095 19046 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:43.610054 19308 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.292s
I20260811 16:05:43.742869 19172 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.610301 18463 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.623819 19302 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:43.627405 19149 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.624693 19156 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:43.688823 19190 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.622017 19108 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:43.884686 19146 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:43.885064 19120 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.711293 19174 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:43.906953 13709 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.723s (SENT)
I20260811 16:05:43.665009 19177 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:43.909932 13818 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:43.911540 13817 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:43.970166 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2662) took 1747 ms. Trace:
I20260811 16:05:43.912050 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:43.687988 19311 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:43.976666 19311 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:43.977175 19347 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.977859 19311 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:43.980060 19174 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:43.980631 19177 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:43.981935 19119 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:43.892835 19131 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260811 16:05:43.906664 19081 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:43.939989 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 346707us
W20260811 16:05:43.987263 19378 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.037s	sys 0.042s
W20260811 16:05:43.938311 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 466809us
W20260811 16:05:43.954238 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 341673us
I20260811 16:05:43.913483 19104 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:43.971122 14577 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:43.970567 13817 rpcz_store.cc:276] 0811 16:05:42.222626 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.817251 (+1594625us) service_pool.cc:227] Handling call
0811 16:05:43.908619 (+ 91368us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.969857 (+ 61238us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.970106 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:43.975672 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 78203.2us
I20260811 16:05:43.976198 18880 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.976737 19425 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:43.952098 19108 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:43.623994 19350 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.408s
I20260811 16:05:43.938160 19046 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:43.982278 19120 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:43.995543 19378 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.037s	sys 0.043s
I20260811 16:05:43.945204 19156 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:43.917379 18989 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:43.935489 19028 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.661s	user 0.015s	sys 0.000s
I20260811 16:05:43.987583 19172 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:43.989238 19311 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:43.953989 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260811 16:05:43.960304 19149 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:44.016518 13908 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.017s	sys 0.030s
I20260811 16:05:44.001710 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:44.033644 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 136856us
I20260811 16:05:44.002028 19108 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:44.014771 19410 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260811 16:05:44.035806 13817 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260811 16:05:44.034168 13709 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.773s (SENT)
I20260811 16:05:44.023939 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:44.036513 13908 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.017s	sys 0.030s
I20260811 16:05:44.023514 19156 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:44.043520 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:44.040944 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:44.048946 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:44.031325 19303 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:44.053435 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2666) took 1705 ms. Trace:
I20260811 16:05:44.055894 13817 rpcz_store.cc:276] 0811 16:05:42.341076 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.998316 (+1657240us) service_pool.cc:227] Handling call
0811 16:05:44.035055 (+ 36739us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:44.043080 (+  8025us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.046009 (+  2929us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:44.056775 19348 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.482s	user 0.017s	sys 0.020s
W20260811 16:05:44.057271 19413 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260811 16:05:44.057344 19348 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.521s	user 0.017s	sys 0.021s
I20260811 16:05:44.058888 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:44.061594 18989 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.064353 18989 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.066490 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.054355 19279 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.067546 13827 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:44.068085 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2675) took 1398 ms (client timeout 1786 ms). Trace:
W20260811 16:05:44.068480 13827 rpcz_store.cc:269] 0811 16:05:42.669955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.052338 (+1382383us) service_pool.cc:227] Handling call
0811 16:05:44.068017 (+ 15679us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.061508 19134 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:44.057915 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1960) took 1714 ms. Trace:
I20260811 16:05:44.075656 13817 rpcz_store.cc:276] 0811 16:05:42.343004 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.056873 (+1713869us) service_pool.cc:227] Handling call
0811 16:05:44.057302 (+   429us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.057513 (+   211us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:44.057533 (+    20us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:44.057573 (+    40us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:44.057606 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.057654 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.057751 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.025861 19081 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.077629 19120 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.064385 19149 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.077925 13827 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:44.078919 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1961) took 1731 ms. Trace:
I20260811 16:05:44.079196 19081 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:44.079478 14544 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.821s (SENT)
I20260811 16:05:44.080438 13817 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260811 16:05:44.081060 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2673) took 1412 ms. Trace:
I20260811 16:05:44.081368 13817 rpcz_store.cc:276] 0811 16:05:42.668704 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.076614 (+1407910us) service_pool.cc:227] Handling call
0811 16:05:44.080107 (+  3493us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.080801 (+   694us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.080981 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.082468 14583 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260811 16:05:44.082661 13817 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:44.083688 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.083771 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.084738 14577 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 9.
W20260811 16:05:44.086095 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62648.9us
I20260811 16:05:44.086943 14582 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:05:44.079288 13827 rpcz_store.cc:276] 0811 16:05:42.347649 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.069293 (+1721644us) service_pool.cc:227] Handling call
0811 16:05:44.077535 (+  8242us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.078635 (+  1100us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.078844 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.086798 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.079952 19134 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:44.092573 13740 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:44.083117 14544 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.178s (SENT)
I20260811 16:05:44.094226 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2677) took 1417 ms. Trace:
I20260811 16:05:44.100315 13817 rpcz_store.cc:276] 0811 16:05:42.676907 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.082099 (+1405192us) service_pool.cc:227] Handling call
0811 16:05:44.082439 (+   340us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.083110 (+   671us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.094146 (+ 11036us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.029233 19046 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.015906 18880 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.094655 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.033085 19028 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.104597 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:44.110388 19046 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.112732 19028 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.112934 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.113624 13740 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:44.103058 19120 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:44.114923 19120 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:44.115376 19120 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:44.115496 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.115968 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.116278 14580 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:44.116828 14577 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:44.111003 19046 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:44.123368 19378 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:44.123842 19134 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.126178 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2687) took 1333 ms. Trace:
I20260811 16:05:44.126596 13826 rpcz_store.cc:276] 0811 16:05:42.792706 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.363409 (+570703us) service_pool.cc:227] Handling call
0811 16:05:44.125962 (+762553us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b54000d5554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.126116 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":187955584}
I20260811 16:05:44.127295 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.128281 13826 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 6. Current term is 7. Ops: []
I20260811 16:05:44.129230 13827 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:05:44.129788 13736 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:44.128401 13743 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 9: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:44.025863 19425 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.075234 19131 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:44.115420 14578 pending_rounds.cc:76] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 9
I20260811 16:05:44.149197 14578 pending_rounds.cc:97] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260811 16:05:44.149621 14578 raft_consensus.cc:2866] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:44.130705 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2678) took 1453 ms. Trace:
I20260811 16:05:44.136230 13737 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:44.126993 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.150385 13827 rpcz_store.cc:276] 0811 16:05:42.677412 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.088504 (+1411092us) service_pool.cc:227] Handling call
0811 16:05:44.105433 (+ 16929us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.129823 (+ 24390us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.130635 (+   812us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.140036 19046 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.140561 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2683) took 1447 ms. Trace:
I20260811 16:05:44.160152 13826 rpcz_store.cc:276] 0811 16:05:42.694200 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.127475 (+1433275us) service_pool.cc:227] Handling call
0811 16:05:44.127904 (+   429us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.130462 (+  2558us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.130647 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.141222 19420 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:05:44.038456 19172 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.164263 13817 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:44.170905 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2681) took 1492 ms. Trace:
I20260811 16:05:44.171416 13817 rpcz_store.cc:276] 0811 16:05:42.678676 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.101202 (+1422526us) service_pool.cc:227] Handling call
0811 16:05:44.134224 (+ 33022us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.170538 (+ 36314us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.170828 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.134991 19303 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.191777 19303 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.194054 19303 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:44.176560 13827 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260811 16:05:44.176877 19406 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260811 16:05:44.195245 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1963) took 1416 ms. Trace:
I20260811 16:05:44.195686 13827 rpcz_store.cc:276] 0811 16:05:42.779230 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.151341 (+1372111us) service_pool.cc:227] Handling call
0811 16:05:44.176141 (+ 24800us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.194860 (+ 18719us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.195174 (+   314us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:44.185269 13820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2692) took 1151 ms (client timeout 1511 ms). Trace:
I20260811 16:05:44.178005 19302 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:44.198257 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2271) took 1002 ms. Trace:
W20260811 16:05:44.198738 13820 rpcz_store.cc:269] 0811 16:05:43.042555 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.072136 (+ 29581us) service_pool.cc:227] Handling call
0811 16:05:44.185090 (+1112954us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.185201 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":417749888}
W20260811 16:05:44.179102 13904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 817) took 2698 ms (client timeout 1847 ms). Trace:
I20260811 16:05:44.179589 13826 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260811 16:05:44.205679 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1964) took 1418 ms. Trace:
I20260811 16:05:44.206187 13826 rpcz_store.cc:276] 0811 16:05:42.799576 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.161308 (+1361732us) service_pool.cc:227] Handling call
0811 16:05:44.163164 (+  1856us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.205275 (+ 42111us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.205601 (+   326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.179692 19046 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.193832 19219 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.150436 19378 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:44.178471 19010 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.005s
W20260811 16:05:44.204129 13904 rpcz_store.cc:269] 0811 16:05:41.480773 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:41.481058 (+   285us) service_pool.cc:227] Handling call
0811 16:05:44.178715 (+2697657us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002ac6d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.178892 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3569016704}
I20260811 16:05:44.232583 13820 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260811 16:05:44.202860 13738 rpcz_store.cc:276] 0811 16:05:43.195476 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.195702 (+   226us) service_pool.cc:227] Handling call
0811 16:05:43.236081 (+ 40379us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:43.236526 (+   445us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:05:43.236930 (+   404us) log.cc:842] Serialized 14 byte log entry
0811 16:05:43.528849 (+291919us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:43.544567 (+ 15718us) log.cc:842] Serialized 26 byte log entry
0811 16:05:43.544823 (+   256us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:43.546057 (+  1234us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:43.546158 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:44.197980 (+651822us) raft_consensus.cc:1671] finished
0811 16:05:44.198008 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.198177 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":808,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":3308,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":4839,"thread_start_us":290936,"threads_started":1,"wal-append.queue_time_us":752359}
I20260811 16:05:44.234249 13826 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:05:44.240636 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2697) took 1004 ms. Trace:
I20260811 16:05:44.198932 18463 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.243775 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2698) took 1005 ms. Trace:
I20260811 16:05:44.224640 19302 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:44.245297 13826 rpcz_store.cc:276] 0811 16:05:43.229589 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.230243 (+1000654us) service_pool.cc:227] Handling call
0811 16:05:44.230717 (+   474us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.234694 (+  3977us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.234891 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.249312 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1966) took 1347 ms. Trace:
I20260811 16:05:44.241217 13820 rpcz_store.cc:276] 0811 16:05:43.229186 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.228492 (+999306us) service_pool.cc:227] Handling call
0811 16:05:44.228935 (+   443us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.233048 (+  4113us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.233306 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.189589 19425 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.249758 13817 rpcz_store.cc:276] 0811 16:05:42.907309 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.172370 (+1265061us) service_pool.cc:227] Handling call
0811 16:05:44.225322 (+ 52952us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.248986 (+ 23664us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:44.249017 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:44.249055 (+    38us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:44.249092 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.249154 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.249258 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.260969 13826 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:44.249125 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190381us
I20260811 16:05:44.248693 19347 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.377327 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.265537 19219 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:44.170099 19104 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.385793 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1972) took 1107 ms. Trace:
I20260811 16:05:44.236771 19010 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.392967 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.351558 19420 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:44.390311 13817 rpcz_store.cc:276] 0811 16:05:43.278663 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.251050 (+972387us) service_pool.cc:227] Handling call
0811 16:05:44.354360 (+103310us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.385360 (+ 31000us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:44.385401 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:44.385456 (+    55us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:44.385498 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.385578 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.385719 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:44.396728 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.398166 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.235615 19378 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.406474 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.368245 18463 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:44.410560 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.418246 13735 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260811 16:05:44.400476 19405 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.517s	user 0.004s	sys 0.000s
I20260811 16:05:44.417940 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.425129 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:44.427556 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 340733us
I20260811 16:05:44.427338 13738 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
W20260811 16:05:44.437254 13709 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.807s (SENT)
I20260811 16:05:44.455132 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:44.384634 19347 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.481591 18640 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:44.481878 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.482317 18640 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.482911 13736 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:44.421423 19429 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
W20260811 16:05:44.485742 19416 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260811 16:05:44.486279 19429 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:44.487130 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2640) took 1143 ms. Trace:
I20260811 16:05:44.487588 13908 rpcz_store.cc:276] 0811 16:05:43.344374 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.344578 (+   204us) service_pool.cc:227] Handling call
0811 16:05:43.364497 (+ 19919us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:43.372047 (+  7550us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:43.372088 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:43.397249 (+ 25161us) log.cc:842] Serialized 26 byte log entry
0811 16:05:44.043778 (+646529us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:44.043829 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.043898 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:44.486836 (+442938us) raft_consensus.cc:1671] finished
0811 16:05:44.486875 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.487059 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2833,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4644,"thread_start_us":583606,"threads_started":1,"wal-append.queue_time_us":692536}
I20260811 16:05:44.407742 19420 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.417948 19303 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260811 16:05:44.499631 18640 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.425071 18463 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:44.494868 19405 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260811 16:05:44.512624 13738 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:44.516022 14575 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:44.434137 19108 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:44.522501 19433 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260811 16:05:44.522665 19183 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:44.523316 19183 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:44.524416 19183 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.525746 19183 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:44.529559 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1448) took 1211 ms. Trace:
I20260811 16:05:44.530052 14581 rpcz_store.cc:276] 0811 16:05:43.318095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.319654 (+  1559us) service_pool.cc:227] Handling call
0811 16:05:43.343387 (+ 23733us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:43.406362 (+ 62975us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:43.406393 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:44.119125 (+712732us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:44.119579 (+   454us) log.cc:842] Serialized 26 byte log entry
0811 16:05:44.401407 (+281828us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:44.401456 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.401559 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:44.529172 (+127613us) raft_consensus.cc:1671] finished
0811 16:05:44.529208 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.529475 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16627,"raft.queue_time_us":40860,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":57289600,"thread_start_us":281436,"threads_started":1,"wal-append.queue_time_us":407634}
I20260811 16:05:44.537232 19347 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.438373 19146 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.542794 19420 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.544817 18463 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.510190 19341 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:44.486889 19429 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.549078 19429 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.549096 19420 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:44.514706 19134 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:44.551065 19420 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:44.551537 19420 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:44.552556 19420 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.553998 19420 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:44.554623 19441 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.555294 19441 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.557511 19441 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.564155 13824 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:44.508147 18880 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.514577 19439 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.546353 19341 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.608816 13737 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260811 16:05:44.611860 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:44.612705 14577 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:44.616811 19378 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:44.624012 13789 connection.cc:232] RPC call timeout handler was delayed by -1.2443475649924949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260811 16:05:44.625363 13789 leader_election.cc:398] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:44.625717 13789 leader_election.cc:401] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:44.571389 19046 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:44.603212 19426 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260811 16:05:44.517154 19436 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260811 16:05:44.589644 19010 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:44.628078 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 196490us
W20260811 16:05:44.653012 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 219138us
I20260811 16:05:44.640277 19425 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:44.659659 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.614602 18880 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:44.630340 18989 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.657243 14577 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:44.664734 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.660360 13901 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:44.674747 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:44.645481 18463 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:44.610621 19439 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:44.681859 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 282301us
I20260811 16:05:44.686288 13904 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:44.675477 19120 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.001s
I20260811 16:05:44.663081 19172 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.693325 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:44.685601 18885 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:44.711127 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:44.708170 13709 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.857s (SENT)
I20260811 16:05:44.712766 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.718140 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:44.716846 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91740.5us
I20260811 16:05:44.717543 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.723279 13901 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:44.676586 19425 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.725486 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1973) took 1313 ms. Trace:
I20260811 16:05:44.730816 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:44.729868 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:44.725917 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1967) took 1764 ms. Trace:
I20260811 16:05:44.733593 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:44.733991 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.680860 18880 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.707221 19146 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:44.717715 19440 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
I20260811 16:05:44.740684 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.713280 19046 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.744611 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.696295 18989 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.746517 13735 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
W20260811 16:05:44.732026 19156 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.006s
I20260811 16:05:44.746695 14581 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:44.748112 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.721767 18463 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:44.722122 19172 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:44.694442 19120 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.754838 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:44.754989 13817 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260811 16:05:44.756053 14577 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:05:44.745375 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:44.722821 18885 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:44.734157 13827 rpcz_store.cc:276] 0811 16:05:42.958909 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.196652 (+1237743us) service_pool.cc:227] Handling call
0811 16:05:44.197049 (+   397us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.197365 (+   316us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:44.572019 (+374654us) log.cc:842] Serialized 14 byte log entry
0811 16:05:44.720028 (+148009us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:44.720084 (+    56us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:44.720130 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.720193 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.720315 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1235,"prepare.queue_time_us":475232,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":38,"raft.queue_time_us":3310,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":2687,"thread_start_us":470731,"threads_started":2}
I20260811 16:05:44.763564 13900 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:44.757063 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:44.764503 13903 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11.
I20260811 16:05:44.754904 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:44.771449 13743 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:44.771824 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:44.768036 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:44.773152 19444 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260811 16:05:44.747710 19434 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:44.766361 19350 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
W20260811 16:05:44.776604 19447 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260811 16:05:44.777314 19341 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.751868 18463 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:44.779588 18463 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:44.763032 19347 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:44.783449 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1958) took 2443 ms. Trace:
W20260811 16:05:44.784858 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2691) took 1974 ms (client timeout 1799 ms). Trace:
I20260811 16:05:44.784025 13822 rpcz_store.cc:276] 0811 16:05:42.339734 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.842092 (+1502358us) service_pool.cc:227] Handling call
0811 16:05:43.907725 (+ 65633us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:44.383035 (+475310us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:44.383083 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:44.425528 (+ 42445us) log.cc:842] Serialized 26 byte log entry
0811 16:05:44.630800 (+205272us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:44.630863 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.631082 (+   219us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:44.783212 (+152130us) raft_consensus.cc:1671] finished
0811 16:05:44.783235 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.783384 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":62106,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":584432,"threads_started":2,"wal-append.queue_time_us":216733}
I20260811 16:05:44.785000 13820 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:44.785267 13821 rpcz_store.cc:269] 0811 16:05:42.810499 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.018669 (+208170us) service_pool.cc:227] Handling call
0811 16:05:44.784632 (+1765963us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000d6454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.784789 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":234864512}
I20260811 16:05:44.785805 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.740613 19010 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:44.789099 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2650) took 2824 ms (client timeout 3173 ms). Trace:
W20260811 16:05:44.789551 13818 rpcz_store.cc:269] 0811 16:05:41.964772 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.129638 (+1164866us) service_pool.cc:227] Handling call
0811 16:05:44.788883 (+1659245us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.789027 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1678603648}
I20260811 16:05:44.766499 19055 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260811 16:05:44.744246 19108 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:44.782179 19278 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.794111 19278 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:44.767416 19146 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:44.795631 19146 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:44.766649 19028 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.029s
I20260811 16:05:44.796118 19146 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:44.778569 18885 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.807276 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:44.810900 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53891.2us
I20260811 16:05:44.821107 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:44.821893 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:44.830173 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.831178 13817 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:44.836185 13904 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:44.756317 19156 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.820402 19434 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:44.840763 19156 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.765208 19302 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.829030 19425 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:44.844246 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 149397us
I20260811 16:05:44.844560 19302 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:44.845055 13709 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.934s (SENT)
W20260811 16:05:44.845702 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 102798us
I20260811 16:05:44.846292 19436 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:44.847077 18880 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.846915 19436 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.849144 19436 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.851981 19439 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:44.852329 19120 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.853279 19308 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:44.853751 19308 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:44.854125 19308 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:44.858546 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:44.868153 19434 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:44.868571 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1971) took 1590 ms. Trace:
I20260811 16:05:44.868893 19434 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:44.868968 13820 rpcz_store.cc:276] 0811 16:05:43.278294 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.250405 (+972111us) service_pool.cc:227] Handling call
0811 16:05:44.784809 (+534404us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.785628 (+   819us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.868373 (+ 82745us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54000d6450. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.868512 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":978656512}
I20260811 16:05:44.869853 19434 consensus_queue.cc:1225] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:05:44.870371 19434 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:44.870790 19434 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:44.873555 19450 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260811 16:05:44.876142 14582 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:44.876837 13901 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:44.870416 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.877480 13820 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:44.885025 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.886353 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1450) took 1307 ms. Trace:
I20260811 16:05:44.886787 14574 rpcz_store.cc:276] 0811 16:05:43.578922 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.586525 (+  7603us) service_pool.cc:227] Handling call
0811 16:05:43.608897 (+ 22372us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:43.903195 (+294298us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:43.903227 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:43.903282 (+    55us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:43.903321 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.886125 (+982804us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540067eb54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:44.886172 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.886294 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":654809984}
I20260811 16:05:44.893560 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.886391 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.903097 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:44.892421 13823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2667) took 2544 ms (client timeout 1773 ms). Trace:
W20260811 16:05:44.905475 13823 rpcz_store.cc:269] 0811 16:05:42.347752 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:42.893388 (+545636us) service_pool.cc:227] Handling call
0811 16:05:44.892116 (+1998728us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540004e054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.892319 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":446699904}
I20260811 16:05:44.752843 19046 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.816605 19347 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:44.922688 13709 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.075s (SENT)
I20260811 16:05:44.894485 13900 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
I20260811 16:05:44.915376 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:44.922420 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.918764 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:44.924760 13827 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:44.925624 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:44.927066 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:44.927714 14577 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:44.930143 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:44.930612 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:44.930810 13904 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:44.931205 13741 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:44.931630 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:44.920560 19219 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.003s
I20260811 16:05:44.932435 13820 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:44.944696 13825 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260811 16:05:44.933503 19081 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.946043 19081 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.947482 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:44.948197 19081 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:44.948369 19454 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.949043 19454 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.949335 19146 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:44.950534 13821 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:44.731195 13826 rpcz_store.cc:276] 0811 16:05:43.407735 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.358826 (+951091us) service_pool.cc:227] Handling call
0811 16:05:44.359642 (+   816us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.395432 (+ 35790us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:44.607996 (+212564us) log.cc:842] Serialized 14 byte log entry
0811 16:05:44.720645 (+112649us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:44.720703 (+    58us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:44.720748 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.720814 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:44.720915 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":305763,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2115,"raft.queue_time_us":96,"thread_start_us":278194,"threads_started":2}
I20260811 16:05:44.951450 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:44.952180 13903 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:44.952270 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.941043 19425 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:44.953341 19425 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:44.953445 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.955781 13907 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260811 16:05:44.948211 13900 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 11
I20260811 16:05:44.971837 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:44.966430 13908 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:44.975867 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.977510 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.978715 13823 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260811 16:05:44.955756 14583 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:44.960664 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:05:44.953600 13739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2258) took 2778 ms (client timeout 1905 ms). Trace:
I20260811 16:05:44.929193 19304 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:44.986667 13739 rpcz_store.cc:269] 0811 16:05:42.175105 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:42.175347 (+   242us) service_pool.cc:227] Handling call
0811 16:05:44.953339 (+2777992us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002814d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:44.953499 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2646911232}
I20260811 16:05:44.990141 13904 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:44.957865 19445 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260811 16:05:44.995083 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:44.943984 18880 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:44.995988 14577 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:45.000097 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.000767 13826 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:44.988919 19199 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.010088 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:45.004289 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:45.005439 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 87669us
I20260811 16:05:45.002189 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.008914 13906 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:44.995434 19279 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.014626 13823 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:44.935811 19347 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.016283 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.014637 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:45.017588 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.019763 13741 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:45.019989 13744 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:45.017668 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:45.013561 13904 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:45.021447 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.028296 13820 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:45.030675 13826 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:45.011713 19454 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:44.989364 19434 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.032189 18989 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.048041 19046 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.033434 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.072114 13905 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260811 16:05:44.999441 19304 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:45.075884 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 198455us
I20260811 16:05:45.043587 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.041625 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.064831 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.077085 13904 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:45.077873 13903 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:45.042331 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:45.034384 19463 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260811 16:05:45.085048 13820 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:45.087927 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:45.088178 19462 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260811 16:05:45.088488 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.089721 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.090256 13902 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:45.088608 14578 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:45.035277 18880 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
W20260811 16:05:45.105211 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 612761us
I20260811 16:05:45.105986 19046 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:45.039325 19183 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:45.024210 19199 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.114886 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1957) took 3202 ms. Trace:
I20260811 16:05:45.045746 19146 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:45.136622 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:45.118513 13824 rpcz_store.cc:276] 0811 16:05:41.912767 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.498108 (+1585341us) service_pool.cc:227] Handling call
0811 16:05:43.551487 (+ 53379us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:44.570388 (+1018901us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:45.114654 (+544266us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400219b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:45.114831 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2328439680}
I20260811 16:05:45.117847 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.030977 19279 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.109108 19434 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:45.109050 19467 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260811 16:05:45.147336 19162 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:05:45.149147 18989 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.126489 19304 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.127727 19347 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.131069 19308 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.071573 18463 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.115957 13743 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:45.140985 13900 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:45.116521 19046 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:45.161065 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.141901 13905 raft_consensus.cc:2354] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 9. Current term is 10.
I20260811 16:05:45.142024 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.143163 13820 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:45.163651 13739 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:45.141916 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.145395 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.119252 19183 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:45.146394 13709 connection.cc:232] RPC call timeout handler was delayed by -1.8193514220183715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2559s for a response
W20260811 16:05:45.169363 13709 connection.cc:232] RPC call timeout handler was delayed by -1.8176847699796781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3053s for a response
I20260811 16:05:45.146906 19423 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.104666 19219 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.157825 19146 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.154739 13903 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:45.179175 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.157114 19162 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260811 16:05:45.166059 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.166726 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.190014 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.174330 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.192981 13822 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:45.124871 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:45.154008 19172 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.163652 19108 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:45.179347 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.203133 13903 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:45.154865 13902 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:05:45.189968 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.137364 18880 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:45.195091 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:45.205094 13818 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 10
I20260811 16:05:45.036115 19451 raft_consensus.cc:979] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:05:45.198885 13900 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:45.177963 13744 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:45.174220 19183 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:45.168545 19046 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.212471 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.209329 13741 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:45.209447 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:45.204375 13905 raft_consensus.cc:2362] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15. Re-sending same reply.
I20260811 16:05:45.214949 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.215704 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.215889 13905 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:45.221120 13820 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260811 16:05:45.223212 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.223904 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.222927 18692 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:45.223220 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:45.226943 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.227588 13902 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:45.228132 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.229234 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.230324 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.168684 18989 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.232934 18989 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.233635 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:45.238615 19452 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.561s	user 0.004s	sys 0.000s
W20260811 16:05:45.243491 13825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2695) took 2104 ms (client timeout 1511 ms). Trace:
I20260811 16:05:45.243769 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:45.243999 13825 rpcz_store.cc:269] 0811 16:05:43.140922 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:43.151705 (+ 10783us) service_pool.cc:227] Handling call
0811 16:05:45.243222 (+2091517us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540029fc54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:45.243387 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4098960768}
I20260811 16:05:45.244517 13905 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:45.245576 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.246251 13905 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:45.247298 13905 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260811 16:05:45.248596 13905 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260811 16:05:45.201627 19119 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:45.201345 18955 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:45.230932 13900 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:05:45.253404 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1083) took 1171 ms. Trace:
I20260811 16:05:45.262432 14583 rpcz_store.cc:276] 0811 16:05:44.082369 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:44.083369 (+  1000us) service_pool.cc:227] Handling call
0811 16:05:45.253183 (+1169814us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54005c6cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:45.253329 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2003423616}
I20260811 16:05:45.235059 13902 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:45.248919 13818 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:45.289700 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:45.291671 13900 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:45.177839 19423 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.294523 13905 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 15 index: 5. (index mismatch)
I20260811 16:05:45.270763 13909 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:45.249752 19456 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:45.297565 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.258167 19341 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:45.318203 13709 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.875s (SENT)
I20260811 16:05:45.258137 18692 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:45.210081 19055 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260811 16:05:45.190678 19219 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.196959 19146 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.260664 19119 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:45.266229 18955 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:45.334506 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:45.255715 18463 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.334193 19456 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:45.292699 18936 raft_consensus.cc:1067] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
W20260811 16:05:45.380290 19445 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:05:45.296214 19432 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.296434 19420 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.254325 19438 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260811 16:05:45.335975 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.333910 19304 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.218953 19172 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.009967 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:45.379240 19341 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:45.399751 18955 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:45.433866 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.444350 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:45.442772 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60730.1us
I20260811 16:05:45.387980 19119 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:05:45.447288 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150529us
I20260811 16:05:45.409660 19456 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:45.452162 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.453161 19378 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:45.453253 19304 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.457746 19489 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:45.458482 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.423575 18880 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.499612 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.463426 18692 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.422856 19420 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.455035 19308 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:45.465196 19477 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260811 16:05:45.467549 13709 connection.cc:232] RPC call timeout handler was delayed by -1.6285252799279988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22940000000000002s for a response
W20260811 16:05:45.512050 13709 connection.cc:232] RPC call timeout handler was delayed by -1.5962847699411213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3299s for a response
I20260811 16:05:45.471695 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.472509 19055 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:45.474175 19146 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.457790 18936 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:45.476334 19423 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.477792 19199 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.517580 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.518376 13905 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:45.519407 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.451988 19279 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.482564 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.483991 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.524351 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:45.525275 13901 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:45.484416 19438 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:45.485837 19219 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:45.487731 19479 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.360s	user 0.000s	sys 0.005s
I20260811 16:05:45.492412 19425 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.527014 19438 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:45.439582 19278 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.543493 19438 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.544543 19278 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.544978 19438 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.493515 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:45.547595 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54163.3us
I20260811 16:05:45.548169 18955 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.550354 18955 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.495115 19172 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.525349 19055 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:45.551527 19120 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:45.495973 19034 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:05:45.552166 19120 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:45.552726 19034 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:45.553109 19034 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:45.553157 19120 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.554081 19034 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.551595 19055 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:45.546840 19278 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:45.552196 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:45.566371 19456 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.567806 19420 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.568462 19420 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:45.568910 19456 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:45.575795 19472 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.451s	user 0.005s	sys 0.008s
I20260811 16:05:45.578045 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1090) took 2902 ms. Trace:
I20260811 16:05:45.497167 19046 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.440672 19432 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.503032 18463 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:05:45.466156 19478 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260811 16:05:45.503598 13908 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:45.502753 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44363.2us
I20260811 16:05:45.501996 19304 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:45.502372 19489 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:45.523509 19454 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:45.479950 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:45.527701 13709 connection.cc:232] RPC call timeout handler was delayed by -1.333851155010052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2577s for a response
W20260811 16:05:45.646659 13709 connection.cc:232] RPC call timeout handler was delayed by -1.3126506879925728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260811 16:05:45.527583 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.541719 19108 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:45.566462 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:45.648442 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82059.8us
I20260811 16:05:45.632820 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:45.642316 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:45.652349 13818 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:45.578531 14579 rpcz_store.cc:276] 0811 16:05:42.679609 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:42.762361 (+ 82752us) service_pool.cc:227] Handling call
0811 16:05:44.187472 (+1425111us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:44.187691 (+   219us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:44.188133 (+   442us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:44.188165 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:44.884483 (+696318us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:44.885102 (+   619us) log.cc:842] Serialized 26 byte log entry
0811 16:05:44.990802 (+105700us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:44.994352 (+  3550us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:44.994597 (+   245us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:45.570846 (+576249us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:45.577731 (+  6885us) raft_consensus.cc:1671] finished
0811 16:05:45.577761 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:45.577939 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":291659520,"thread_start_us":105230,"threads_started":1,"wal-append.queue_time_us":199289}
I20260811 16:05:45.640437 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:45.645859 13901 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260811 16:05:45.502012 19183 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:45.662107 13709 connection.cc:232] RPC call timeout handler was delayed by -1.2120899009751156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4702s for a response
W20260811 16:05:45.670410 13709 connection.cc:232] RPC call timeout handler was delayed by -1.0505527990171686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29460000000000003s for a response
I20260811 16:05:45.663342 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.666649 13817 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260811 16:05:45.668499 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:45.672855 13901 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:45.671783 13903 raft_consensus.cc:2362] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11. Re-sending same reply.
I20260811 16:05:45.636735 19034 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:45.694111 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53802.4us
I20260811 16:05:45.695190 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:45.700596 19434 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260811 16:05:45.701674 13827 raft_consensus.cc:2396] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260811 16:05:45.646420 19454 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:45.704272 13824 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260811 16:05:45.704643 13824 pending_rounds.cc:76] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 11
I20260811 16:05:45.704085 19454 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.704886 13824 pending_rounds.cc:97] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260811 16:05:45.705169 13824 raft_consensus.cc:2866] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:45.705507 19454 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.642885 19205 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:45.707888 19205 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.709197 19456 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:45.646978 18463 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:45.707489 19489 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.712515 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.712442 18463 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.714349 13903 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260811 16:05:45.661438 19108 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.668363 18955 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.717985 18955 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.669504 19278 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260811 16:05:45.721580 19162 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:45.722177 19162 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:45.724509 19172 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:45.724968 19172 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:45.725517 19172 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:45.724901 19162 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.726538 19162 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:45.727344 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 247499us
I20260811 16:05:45.744660 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:45.727413 19434 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:45.755654 19434 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:45.756176 19434 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:45.759446 19205 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.760769 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:45.765039 19432 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.767860 18955 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.769454 19046 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:45.770548 19183 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:45.665858 19430 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:45.771868 19430 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:45.772248 19430 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:45.567911 19055 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:45.779100 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.023s	sys 0.034s
W20260811 16:05:45.782176 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.023s	sys 0.034s
I20260811 16:05:45.728245 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:45.810552 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 82407.1us
I20260811 16:05:45.813997 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:45.814747 14580 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:45.778860 19055 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:45.812613 19451 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.014s	sys 0.017s
W20260811 16:05:45.809103 19332 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.024s	sys 0.030s
I20260811 16:05:45.823107 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.809865 19302 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:45.832917 13907 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60522
I20260811 16:05:45.853219 13741 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:05:45.853394 13907 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:45.853900 13907 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.814747 13908 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:45.847167 13818 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:45.852203 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.865142 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:45.836174 19332 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.026s	sys 0.030s
W20260811 16:05:45.854899 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.016s	sys 0.015s
I20260811 16:05:45.822700 19378 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:45.873795 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.016s	sys 0.016s
W20260811 16:05:45.874564 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 584927us
I20260811 16:05:45.840070 13901 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:45.880508 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:45.885012 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89938.3us
W20260811 16:05:45.838943 19451 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.015s	sys 0.020s
I20260811 16:05:45.887977 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.888774 13741 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:45.886543 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:45.896888 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 459918us
I20260811 16:05:45.904856 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.906507 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.864162 19302 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.913312 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.914045 13742 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:05:45.914518 13630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 325) took 22772 ms (client timeout 15000 ms). Trace:
I20260811 16:05:45.920013 19432 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:45.920302 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:45.920930 13736 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.925177 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:45.926157 19432 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:45.926592 19432 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:45.927014 19432 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:45.927464 19347 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:45.928112 19347 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:45.915475 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.915620 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:45.932094 13739 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:45.916373 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.916178 13627 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 5 to 8, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:45.854542 19304 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260811 16:05:45.879551 19046 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:45.919538 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.919860 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:45.915196 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.904958 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:45.942755 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:45.943614 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:45.944118 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:05:45.939993 13907 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:45.946965 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49253.7us
I20260811 16:05:45.863411 18955 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:45.928910 19003 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:45.961005 13901 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:45.962424 13741 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:45.965085 13907 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:45.971443 19003 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:45.972792 19003 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:45.973552 19420 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:45.973999 19420 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:45.974335 19420 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:45.975278 18955 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:45.975715 18955 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:45.979169 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59397.8us
I20260811 16:05:45.929162 19347 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.980955 19493 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:45.979823 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 74999.1us
I20260811 16:05:45.996763 14581 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:46.047487 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.047572 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.049026 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.049139 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.049638 13821 raft_consensus.cc:2362] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13. Re-sending same reply.
I20260811 16:05:46.047799 13736 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:46.050688 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.051745 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:46.051991 13821 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:46.052764 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.052597 19501 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
W20260811 16:05:46.053591 19438 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.002s
I20260811 16:05:46.053597 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.055500 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.055809 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:46.056018 13821 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:46.056952 19162 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:46.057449 19162 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:46.056877 13627 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 6 to 7, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 7 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:46.057808 19162 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:46.059460 18936 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:46.065670 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1985) took 1228 ms. Trace:
I20260811 16:05:45.959805 19119 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:45.982635 19046 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.072052 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:46.072853 13907 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:45.920763 13630 rpcz_store.cc:269] 0811 16:05:23.190182 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:23.212500 (+ 22318us) service_pool.cc:227] Handling call
0811 16:05:45.914273 (+22701773us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:05:36.419933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:05:36.536313 (+116380us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:05:36.536372 (+    59us) write_op.cc:435] Acquired schema lock
0811 16:05:36.536388 (+    16us) tablet.cc:660] Decoding operations
0811 16:05:36.566018 (+ 29630us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:05:36.566135 (+   117us) write_op.cc:641] Partition lock acquired for write op
0811 16:05:36.566181 (+    46us) tablet.cc:683] Acquiring locks for 23 operations
0811 16:05:36.567971 (+  1790us) tablet.cc:699] Row locks acquired
0811 16:05:36.568011 (+    40us) write_op.cc:260] PREPARE: finished
0811 16:05:36.568205 (+   194us) write_op.cc:270] Start()
0811 16:05:36.568355 (+   150us) write_op.cc:276] Timestamp: P: 1786464336568126 usec, L: 0
0811 16:05:36.568403 (+    48us) op_driver.cc:331] REPLICATION: starting
0811 16:05:36.723478 (+155075us) log.cc:842] Serialized 9317 byte log entry
0811 16:05:39.342457 (+2618979us) op_driver.cc:444] REPLICATION: finished
0811 16:05:39.779772 (+437315us) write_op.cc:301] APPLY: starting
0811 16:05:39.791952 (+ 12180us) tablet.cc:1365] starting BulkCheckPresence
0811 16:05:40.744577 (+952625us) tablet.cc:1368] finished BulkCheckPresence
0811 16:05:40.744709 (+   132us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:05:41.410507 (+665798us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:05:41.436052 (+ 25545us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0811 16:05:41.438904 (+  2852us) write_op.cc:312] APPLY: finished
0811 16:05:41.583603 (+144699us) log.cc:842] Serialized 204 byte log entry
0811 16:05:41.869852 (+286249us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:41.921095 (+ 51243us) write_op.cc:454] Released schema lock
0811 16:05:41.944306 (+ 23211us) write_op.cc:341] FINISH: Updating metrics
0811 16:05:42.020696 (+ 76390us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:42.033438 (+ 12742us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":484689,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":394950,"apply.run_cpu_time_us":80470,"apply.run_wall_time_us":2354853,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100083,"num_ops":23,"prepare.queue_time_us":347967,"prepare.run_cpu_time_us":23874,"prepare.run_wall_time_us":1412649,"raft.queue_time_us":222138,"raft.run_cpu_time_us":15312,"raft.run_wall_time_us":307071,"replication_time_us":2764002,"thread_start_us":1664903,"threads_started":5,"wal-append.queue_time_us":1410578,"wal-append.run_cpu_time_us":16903,"wal-append.run_wall_time_us":3683750}]]}
W20260811 16:05:46.010383 18880 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.022s
W20260811 16:05:46.078429 18880 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.013s	sys 0.023s
I20260811 16:05:46.084415 19028 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:46.053592 19501 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:46.089691 19501 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:46.092159 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97356.2us
I20260811 16:05:46.093516 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:46.097652 13901 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260811 16:05:46.099593 19119 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:46.108986 13901 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:05:46.110479 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:46.113113 13901 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:46.059015 13627 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 6 to 7, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 7 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:05:46.114827 13909 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.023s	sys 0.010s
W20260811 16:05:46.115217 13909 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.023s	sys 0.010s
I20260811 16:05:46.115305 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:46.118343 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:46.119550 13901 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:05:46.123273 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.123955 13736 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:46.119004 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:46.125308 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 94830.8us
I20260811 16:05:46.125403 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:46.066216 13823 rpcz_store.cc:276] 0811 16:05:44.837189 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.077392 (+240203us) service_pool.cc:227] Handling call
0811 16:05:45.113257 (+ 35865us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:45.167858 (+ 54601us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:45.167889 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:45.177901 (+ 10012us) log.cc:842] Serialized 26 byte log entry
0811 16:05:45.698894 (+520993us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:45.698953 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.065152 (+366199us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b54002dc3d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:46.065213 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:46.065266 (+    53us) raft_consensus.cc:1671] finished
0811 16:05:46.065278 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:46.065581 (+   303us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":24488,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9698,"spinlock_wait_cycles":111238016,"thread_start_us":463687,"threads_started":1,"wal-append.queue_time_us":673978}
I20260811 16:05:46.146631 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.147383 13741 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:46.145545 13739 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:46.149360 13900 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:46.173141 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.162985 13907 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:46.175490 13741 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:46.177734 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:46.175077 13823 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:46.184008 13901 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:46.185400 18880 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:05:46.170357 13627 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 3 to 6, term changed from 4 to 6, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to <none>, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:46.186088 19451 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 16:05:46.176867 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:46.115902 19302 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:46.134114 19120 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.016s	sys 0.014s
I20260811 16:05:46.187672 13627 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:05:46.128329 19199 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:46.188102 19010 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260811 16:05:46.210359 19199 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:46.210951 19199 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:46.192535 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:46.210383 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.214303 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:46.191174 19508 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260811 16:05:46.215406 13823 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260811 16:05:46.216876 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.129436 19028 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:46.152603 19205 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:46.220003 13823 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:46.219621 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:46.162343 19278 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:05:46.203125 19120 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.014s
I20260811 16:05:46.124444 19172 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.253750 13627 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 7 to 10, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:05:46.263998 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168865us
I20260811 16:05:46.220538 19183 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:46.239725 13789 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.985s (SENT)
I20260811 16:05:46.224753 19046 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:46.231468 19278 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:46.187686 19162 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.235246 19506 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:46.217947 19108 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:46.235947 19430 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.281381 19183 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:46.288880 13627 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 5 to 6, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 6 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:05:46.235431 19436 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.027s	sys 0.027s
W20260811 16:05:46.297616 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57938.7us
I20260811 16:05:46.339645 13904 raft_consensus.cc:1203] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[10.6-12.7]   Dedup: 12.7->[]
I20260811 16:05:46.340536 13904 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260811 16:05:46.188521 19493 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
W20260811 16:05:46.246742 19477 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:05:46.279947 13825 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:46.321333 19278 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:46.303757 13823 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:46.352372 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.353202 13823 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:46.354545 13826 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:46.235322 19434 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:46.359575 13789 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.230s (SENT)
W20260811 16:05:46.339597 19436 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.027s	sys 0.027s
I20260811 16:05:46.339564 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2654) took 1325 ms. Trace:
I20260811 16:05:46.381508 13818 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:46.426795 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 152891us
I20260811 16:05:46.369383 13627 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 2 to 8, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 8 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:05:46.368746 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:46.430637 13735 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.020s	sys 0.040s
W20260811 16:05:46.432037 13735 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.020s	sys 0.040s
I20260811 16:05:46.423736 13906 rpcz_store.cc:276] 0811 16:05:45.016686 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.025854 (+  9168us) service_pool.cc:227] Handling call
0811 16:05:45.026136 (+   282us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:05:45.078527 (+ 52391us) raft_consensus.cc:1520] Early marking committed up to index 5
0811 16:05:45.331592 (+253065us) log.cc:842] Serialized 14 byte log entry
0811 16:05:45.841017 (+509425us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:05:45.851312 (+ 10295us) log.cc:842] Serialized 78 byte log entry
0811 16:05:45.856035 (+  4723us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:45.857094 (+  1059us) log.cc:842] Serialized 14 byte log entry
0811 16:05:46.335012 (+477918us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.335123 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:46.339191 (+  4068us) raft_consensus.cc:1671] finished
0811 16:05:46.339210 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:46.339503 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1230,"prepare.queue_time_us":154719,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":35939,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":74993,"thread_start_us":1080070,"threads_started":3,"wal-append.queue_time_us":811318}
I20260811 16:05:46.353005 19485 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:46.446226 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:46.447402 13824 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:46.432997 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.027s
W20260811 16:05:46.448246 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.027s
W20260811 16:05:46.448627 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 590865us
I20260811 16:05:46.366678 13823 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:46.353652 19506 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:05:46.438448 19513 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.124s	user 0.002s	sys 0.001s
W20260811 16:05:46.439805 19432 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.006s
W20260811 16:05:46.483525 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45217.3us
I20260811 16:05:46.501214 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:46.499900 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:05:46.502964 13738 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.013s	sys 0.030s
W20260811 16:05:46.503746 13738 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.013s	sys 0.030s
I20260811 16:05:46.495628 13822 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:46.505784 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:46.510082 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:46.381369 18955 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.518898 13824 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260811 16:05:46.522138 13824 pending_rounds.cc:76] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 7
I20260811 16:05:46.522486 13824 pending_rounds.cc:97] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260811 16:05:46.521772 13627 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 4 to 5, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 5 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:46.522835 13824 raft_consensus.cc:2866] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:46.488113 18463 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
W20260811 16:05:46.497854 19347 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.016s
I20260811 16:05:46.515951 19454 raft_consensus.cc:2741] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260811 16:05:46.543720 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:46.545364 13908 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.016s	sys 0.018s
I20260811 16:05:46.517959 19172 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:46.521219 19304 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:46.529131 19034 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 8 FOLLOWER]: Advancing to term 9
W20260811 16:05:46.548686 13908 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.016s	sys 0.018s
I20260811 16:05:46.525818 19493 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:46.557796 13739 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
W20260811 16:05:46.559188 14544 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.011s	sys 0.015s
I20260811 16:05:46.488520 19432 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:46.503605 19120 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260811 16:05:46.536069 19347 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.017s
W20260811 16:05:46.561158 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61339.1us
W20260811 16:05:46.568003 14544 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.012s	sys 0.016s
I20260811 16:05:46.481377 19485 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.541082 18463 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:46.579741 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:46.552152 19489 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.011s	sys 0.017s
I20260811 16:05:46.594027 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.542172 19108 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:46.547549 19430 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:46.585520 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 701841us
W20260811 16:05:46.598776 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.847s (SENT)
I20260811 16:05:46.599359 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:46.556511 19162 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:46.622826 14580 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:46.623359 19162 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:46.623706 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.622800 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:46.624096 19516 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260811 16:05:46.584167 19506 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:46.628042 19514 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260811 16:05:46.629758 18463 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:46.631855 19510 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260811 16:05:46.632743 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:46.633476 14582 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:46.636749 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2322) took 1549 ms. Trace:
I20260811 16:05:46.637251 13904 rpcz_store.cc:276] 0811 16:05:45.087688 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.093541 (+  5853us) service_pool.cc:227] Handling call
0811 16:05:46.339462 (+1245921us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:46.340960 (+  1498us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.636492 (+295532us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000c8850. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:46.636677 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2808448896}
I20260811 16:05:46.647506 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.648154 14581 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:05:46.579854 19304 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:46.648765 13905 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:46.579965 19183 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:46.567559 19493 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:46.661546 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.661630 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.667090 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:46.654243 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.584694 19434 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:46.594776 19489 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.012s	sys 0.017s
I20260811 16:05:46.656940 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:46.670753 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.012s	sys 0.033s
I20260811 16:05:46.671238 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:46.671226 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.013s	sys 0.033s
I20260811 16:05:46.676775 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1992) took 1125 ms. Trace:
I20260811 16:05:46.648058 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 849) took 1486 ms. Trace:
I20260811 16:05:46.709532 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.693928 13909 rpcz_store.cc:276] 0811 16:05:45.161239 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.337937 (+176698us) service_pool.cc:227] Handling call
0811 16:05:45.381236 (+ 43299us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:45.418029 (+ 36793us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:45.418068 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:45.422480 (+  4412us) log.cc:842] Serialized 26 byte log entry
0811 16:05:46.115584 (+693104us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:46.115624 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.115691 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:46.647832 (+532141us) raft_consensus.cc:1671] finished
0811 16:05:46.647851 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:46.647996 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":13718,"thread_start_us":630446,"threads_started":1,"wal-append.queue_time_us":1037201}
I20260811 16:05:46.713761 13737 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:46.707898 13627 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 4 to 5, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 5 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:46.717031 13627 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 6 to 7, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 7 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:46.662398 19493 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:46.670397 19003 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.003s	sys 0.037s
W20260811 16:05:46.720698 13821 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.015s	sys 0.008s
I20260811 16:05:46.722100 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:46.720323 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.013s	sys 0.012s
W20260811 16:05:46.725512 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.013s	sys 0.012s
W20260811 16:05:46.725875 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 549062us
W20260811 16:05:46.728296 13821 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.016s	sys 0.008s
W20260811 16:05:46.729372 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58273.5us
I20260811 16:05:46.730486 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:46.730854 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.731814 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:46.734509 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:46.736521 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.741047 13739 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:46.739765 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:46.721769 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.009s	sys 0.033s
W20260811 16:05:46.744186 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.010s	sys 0.033s
W20260811 16:05:46.702303 13903 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.017s	sys 0.030s
W20260811 16:05:46.745280 13903 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.017s	sys 0.030s
I20260811 16:05:46.745077 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:46.744804 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 592451us
I20260811 16:05:46.677242 13820 rpcz_store.cc:276] 0811 16:05:45.551237 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.555255 (+  4018us) service_pool.cc:227] Handling call
0811 16:05:45.555600 (+   345us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:45.566932 (+ 11332us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:46.001661 (+434729us) log.cc:842] Serialized 14 byte log entry
0811 16:05:46.676415 (+674754us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:46.676475 (+    60us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:46.676518 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.676582 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:46.676717 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":696,"prepare.queue_time_us":835933,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":10503,"raft.queue_time_us":1529,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":17660,"thread_start_us":1106836,"threads_started":2}
I20260811 16:05:46.693027 19430 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:46.750118 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:46.753017 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.705986 19494 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:46.626773 19199 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.692363 19131 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:46.751957 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.705858 19162 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:46.749257 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:46.724694 19003 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.004s	sys 0.037s
I20260811 16:05:46.751858 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:46.748484 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.662580 19304 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.757076 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:46.748178 19010 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:46.762216 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141875us
I20260811 16:05:46.765472 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:46.747093 19347 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:46.771405 13827 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.027s
I20260811 16:05:46.748836 19046 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:46.752029 19119 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:46.774494 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:46.774652 13825 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:46.776710 14582 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:46.771442 13906 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:46.778668 14583 pending_rounds.cc:76] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 10
I20260811 16:05:46.819371 14583 pending_rounds.cc:97] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260811 16:05:46.819700 14583 raft_consensus.cc:2866] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:46.820356 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.778501 13737 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:46.751840 19430 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:46.768872 19131 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:46.753361 19172 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:46.768296 18936 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:46.794322 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.828742 13906 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:05:46.804876 19378 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.028s	sys 0.038s
W20260811 16:05:46.755270 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.010s	sys 0.050s
W20260811 16:05:46.832578 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48856.2us
I20260811 16:05:46.806691 13820 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:46.810446 13827 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.008s	sys 0.027s
I20260811 16:05:46.783337 19434 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:46.875092 19434 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.878079 19434 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:46.879184 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.023s
I20260811 16:05:46.827654 19430 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:46.813097 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.822228 14581 pending_rounds.cc:76] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 9
I20260811 16:05:46.893337 14581 pending_rounds.cc:97] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260811 16:05:46.893746 14581 raft_consensus.cc:2866] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:46.832456 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 640006us
I20260811 16:05:46.901969 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:46.904119 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48176.3us
I20260811 16:05:46.909305 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:46.910214 14580 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:46.912598 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.920337 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.924268 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.925241 13740 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:46.926858 13744 raft_consensus.cc:2354] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:46.938467 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:46.942451 13743 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
W20260811 16:05:46.832823 19378 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.029s	sys 0.039s
W20260811 16:05:46.822763 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48386.4us
I20260811 16:05:47.017691 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:46.792784 19454 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:46.775749 19183 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260811 16:05:46.827803 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.026712 14580 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:47.036979 14582 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:46.805902 19108 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:46.778473 19489 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260811 16:05:46.821512 19451 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:46.780833 19010 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.831179 19523 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:46.840991 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.841874 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:46.842938 19003 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:47.063220 14574 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:46.847805 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.848871 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:46.851634 19131 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:46.860469 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:46.861310 19162 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:46.864853 19304 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:46.865603 19172 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:46.865818 18936 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:46.866487 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 1996) took 1142 ms. Trace:
I20260811 16:05:47.089286 13827 rpcz_store.cc:276] 0811 16:05:45.723740 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.755263 (+ 31523us) service_pool.cc:227] Handling call
0811 16:05:45.755746 (+   483us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:45.756020 (+   274us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:46.143657 (+387637us) log.cc:842] Serialized 14 byte log entry
0811 16:05:46.837823 (+694166us) log.cc:842] Serialized 14 byte log entry
0811 16:05:46.866124 (+ 28301us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:46.866183 (+    59us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:46.866231 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.866307 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:46.866420 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":97025,"prepare.queue_time_us":715892,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":256278,"raft.run_cpu_time_us":2257,"raft.run_wall_time_us":41626,"thread_start_us":977902,"threads_started":2}
I20260811 16:05:46.827083 19432 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:46.991452 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.065199 19535 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:46.992880 19526 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260811 16:05:47.052574 19055 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260811 16:05:47.001205 19278 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.004s
W20260811 16:05:46.940265 19420 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.004s
I20260811 16:05:47.021369 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:47.131065 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 109794us
I20260811 16:05:47.016826 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 853) took 1378 ms. Trace:
I20260811 16:05:47.031957 19134 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:47.047665 14580 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:47.050611 13744 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260811 16:05:47.050835 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2343) took 1581 ms. Trace:
W20260811 16:05:47.058531 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2348) took 1587 ms (client timeout 1919 ms). Trace:
I20260811 16:05:47.051909 19543 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260811 16:05:47.047515 19542 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:47.059269 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:46.866967 19199 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:47.072788 19501 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.026s	sys 0.025s
I20260811 16:05:47.059890 19034 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:47.106027 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 924) took 1067 ms. Trace:
I20260811 16:05:46.849925 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.111914 14579 raft_consensus.cc:2362] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12. Re-sending same reply.
W20260811 16:05:47.115324 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 370672us
W20260811 16:05:47.281584 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 431728us
I20260811 16:05:47.117162 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.105695 19537 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:47.282980 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 165932us
I20260811 16:05:47.046515 19454 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.088462 19172 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:47.133137 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:47.296545 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 163509us
W20260811 16:05:47.133477 13908 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.026s	sys 0.042s
W20260811 16:05:47.299355 13908 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.026s	sys 0.042s
I20260811 16:05:47.133898 13903 rpcz_store.cc:276] 0811 16:05:45.638809 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.717674 (+ 78865us) service_pool.cc:227] Handling call
0811 16:05:45.718047 (+   373us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:45.718456 (+   409us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:45.718480 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:45.718996 (+   516us) log.cc:842] Serialized 26 byte log entry
0811 16:05:46.746080 (+1027084us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:46.758237 (+ 12157us) log.cc:842] Serialized 14 byte log entry
0811 16:05:46.758465 (+   228us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.758535 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:46.980641 (+222106us) raft_consensus.cc:1671] finished
0811 16:05:46.980675 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:47.016735 (+ 36060us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":11768,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":6242,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":11570944,"thread_start_us":938851,"threads_started":1,"wal-append.queue_time_us":1110709}
I20260811 16:05:46.821028 13742 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 14
I20260811 16:05:47.150359 13905 rpcz_store.cc:276] 0811 16:05:45.469676 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.520366 (+ 50690us) service_pool.cc:227] Handling call
0811 16:05:46.648511 (+1128145us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:46.656371 (+  7860us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:47.050542 (+394171us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002ad5d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:47.050751 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2593799424}
W20260811 16:05:47.151258 13900 rpcz_store.cc:269] 0811 16:05:45.474642 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.527259 (+ 52617us) service_pool.cc:227] Handling call
0811 16:05:47.058336 (+1531077us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:47.058464 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":936754432}
I20260811 16:05:47.112715 19131 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.163130 13825 rpcz_store.cc:276] 0811 16:05:46.038340 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:46.048871 (+ 10531us) service_pool.cc:227] Handling call
0811 16:05:47.105826 (+1056955us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540021aa54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:47.105955 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":529177344}
W20260811 16:05:47.163182 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 105099us
I20260811 16:05:47.065929 19108 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.148217 19304 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:47.179513 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 391365us
I20260811 16:05:47.066308 19523 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:47.168092 19501 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.027s	sys 0.026s
I20260811 16:05:47.159720 19308 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.196197 18936 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:47.197675 19518 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.582s	user 0.003s	sys 0.000s
I20260811 16:05:47.102001 19493 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.171645 19183 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:47.163611 19540 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.218820 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2304) took 1284 ms. Trace:
I20260811 16:05:47.132177 19278 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.193898 19506 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.158563 19432 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260811 16:05:47.153971 19420 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.230337 19494 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.362485 19494 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.240309 13740 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:47.121362 19535 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.247772 14580 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260811 16:05:47.366801 14580 pending_rounds.cc:76] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 8
I20260811 16:05:47.367046 14580 pending_rounds.cc:97] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260811 16:05:47.367316 14580 raft_consensus.cc:2866] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:47.232334 19119 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260811 16:05:47.264839 19545 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260811 16:05:47.266409 19010 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.271508 19542 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.369473 19542 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.370036 13742 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:47.229676 19558 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260811 16:05:47.282605 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:47.293820 19537 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:47.371524 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89029.9us
I20260811 16:05:47.372298 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:47.303244 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.311764 13787 leader_election.cc:398] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:47.373899 13787 leader_election.cc:401] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260811 16:05:47.374439 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 71429.7us
I20260811 16:05:47.300318 19543 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:47.301791 19172 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:47.377789 19420 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:47.331545 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 178157us
I20260811 16:05:47.295635 19552 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:47.301471 19436 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:47.380208 19539 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:47.380466 19436 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:47.380941 19436 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.311959 19489 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:47.379524 19081 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:47.329035 19304 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.378890 19120 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:47.311539 19554 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260811 16:05:47.420936 19108 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.327409 18880 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260811 16:05:47.422380 18955 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.353077 13738 rpcz_store.cc:276] 0811 16:05:45.935257 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.935432 (+   175us) service_pool.cc:227] Handling call
0811 16:05:45.940971 (+  5539us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:45.941343 (+   372us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:45.941374 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:45.941836 (+   462us) log.cc:842] Serialized 26 byte log entry
0811 16:05:46.504332 (+562496us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:46.504389 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:46.504715 (+   326us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:47.218498 (+713783us) raft_consensus.cc:1671] finished
0811 16:05:47.218530 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:47.218736 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2010,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":562058,"threads_started":1,"wal-append.queue_time_us":848763}
I20260811 16:05:47.338359 19183 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:47.385743 19506 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.415035 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.337728 19544 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:47.385685 19034 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260811 16:05:47.380981 19539 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260811 16:05:47.418201 19489 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.419198 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:47.438580 13741 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:47.423812 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2663) took 1571 ms. Trace:
W20260811 16:05:47.428678 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 125533us
I20260811 16:05:47.411980 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:47.434464 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54820.3us
I20260811 16:05:47.339406 19003 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260811 16:05:47.439159 13908 rpcz_store.cc:276] 0811 16:05:45.852078 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:45.855069 (+  2991us) service_pool.cc:227] Handling call
0811 16:05:45.855512 (+   443us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:46.560874 (+705362us) raft_consensus.cc:1520] Early marking committed up to index 4
0811 16:05:46.624967 (+ 64093us) log.cc:842] Serialized 14 byte log entry
0811 16:05:47.299869 (+674902us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:47.300501 (+   632us) log.cc:842] Serialized 52 byte log entry
0811 16:05:47.300687 (+   186us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:47.300734 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:47.300811 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:47.423566 (+122755us) raft_consensus.cc:1671] finished
0811 16:05:47.423590 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:47.423732 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7591,"prepare.queue_time_us":38231,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":16871,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":26487,"thread_start_us":1378949,"threads_started":2,"wal-append.queue_time_us":622218}
I20260811 16:05:47.419229 19454 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:47.429315 19430 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.003s
I20260811 16:05:47.426117 19183 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.457178 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.470023 13827 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:47.456600 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.476363 19278 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:47.339334 19521 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260811 16:05:47.430683 19554 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.434717 19420 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.365500 19494 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.368772 19535 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:47.372524 19537 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:47.504397 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 56768.2us
W20260811 16:05:47.508697 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:47.513761 19172 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.516623 19489 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.518077 19493 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.479161 19485 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.525063 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:47.526459 13742 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.487198 19010 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260811 16:05:47.505169 19554 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.531821 19554 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.539088 13740 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:05:47.541694 19568 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:47.542268 19568 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:47.539355 19556 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:47.543259 19568 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.543450 19522 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:47.548127 19522 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:47.548907 19304 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:47.543879 19556 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:47.549140 19522 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.549820 19162 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:05:47.550292 19205 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:47.550112 19556 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.550617 19522 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.551482 19556 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:47.508703 13825 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:47.551998 13825 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:47.466415 19081 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:47.552881 19081 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:47.552759 13825 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.553810 13825 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:47.554179 19568 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:47.553851 19081 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.451455 19566 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:47.555500 19566 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.550688 19205 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:47.558821 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 183719us
I20260811 16:05:47.564234 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:47.567062 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:47.567561 13741 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:47.571592 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:47.573851 13742 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:47.575254 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:47.576205 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:47.559594 19081 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:47.595768 13825 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260811 16:05:47.596378 13825 pending_rounds.cc:76] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 9
I20260811 16:05:47.596642 13825 pending_rounds.cc:97] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260811 16:05:47.596942 13825 raft_consensus.cc:2866] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:05:47.599237 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 227017us
I20260811 16:05:47.599296 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.600394 14579 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:47.602160 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:47.603543 13741 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:05:47.604735 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:47.607352 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 221510us
I20260811 16:05:47.608201 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.613615 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:47.615979 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:47.617065 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.618652 14581 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:47.619647 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.619776 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.445568 19544 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:47.620916 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 270719us
I20260811 16:05:47.598287 19308 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.600499 19347 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:47.623844 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:47.600210 19485 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:47.621379 14580 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:47.535496 19572 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260811 16:05:47.606442 19162 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:47.625501 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:47.628690 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.629038 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.629614 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.634334 13905 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:47.641124 14581 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:47.626740 19347 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:47.620368 19521 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:47.588531 19430 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.648488 14577 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260811 16:05:47.647261 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.647502 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.653564 13903 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:47.598187 19543 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:47.618260 19438 raft_consensus.cc:2741] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260811 16:05:47.622680 19304 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:47.660593 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:47.672122 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 181616us
I20260811 16:05:47.661883 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.673971 14580 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:47.674661 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:47.675562 13825 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:47.647805 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.628098 19454 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:47.616966 19493 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260811 16:05:47.679868 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.684508 14579 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:47.685150 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.685802 13820 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 7: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:47.686367 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:47.686915 13826 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.687126 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.687935 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.688432 13902 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15. Re-sending same reply.
W20260811 16:05:47.677174 19563 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.181s	user 0.000s	sys 0.008s
I20260811 16:05:47.648816 19552 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:47.695986 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.652295 19162 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:47.678004 19304 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:47.700209 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.700344 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.727013 19304 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.727725 13741 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:47.728088 19304 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:47.701025 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:47.728381 19420 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:47.701947 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.659379 19172 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.676617 19378 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.730756 13821 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:47.630707 19205 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.731010 19378 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.732378 19205 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:47.732539 19535 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:47.733114 19378 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:47.733222 19535 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:47.736603 19562 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.480s	user 0.004s	sys 0.000s
I20260811 16:05:47.680097 19521 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:47.743963 13903 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:47.744513 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.745086 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.748224 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.708089 13902 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260811 16:05:47.628453 19308 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.710731 19432 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:47.696586 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:47.750949 14580 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:47.712399 13901 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260811 16:05:47.751796 13820 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260811 16:05:47.713245 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 4 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.709223 19347 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.644960 19573 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260811 16:05:47.644135 19120 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260811 16:05:47.719949 19506 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.681095 19485 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:47.762117 19508 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:47.762521 19508 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:47.763470 19308 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.763568 19535 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.763381 19508 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.764765 19508 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:47.761768 19485 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:47.720213 19162 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.743319 19552 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:47.721084 19580 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260811 16:05:47.721407 19055 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:05:47.771632 19566 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:47.684752 19108 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.683913 19537 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260811 16:05:47.771651 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.706842 19199 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.772483 19108 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.773175 13901 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:47.723690 19543 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.725929 19544 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.750303 14581 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:47.752434 13904 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15. Re-sending same reply.
I20260811 16:05:47.742494 19542 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.746203 13903 raft_consensus.cc:2362] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11. Re-sending same reply.
I20260811 16:05:47.755271 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:47.756999 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64544.2us
I20260811 16:05:47.758152 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.718367 19183 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.754032 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.760768 19278 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:47.774019 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.782759 19199 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.782675 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.784663 19108 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.780913 13821 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
W20260811 16:05:47.789767 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 102711us
I20260811 16:05:47.797577 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.797626 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.799441 19539 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:47.799996 19542 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:47.802644 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.804276 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.793040 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:47.781816 13902 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:47.805219 19542 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:47.816726 19542 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:47.820736 14575 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260811 16:05:47.821646 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:47.825894 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.827276 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.828158 13739 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:47.833792 13902 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:47.835224 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.835865 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.792546 13826 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:47.837208 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.840265 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.840423 13737 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:47.841382 13737 raft_consensus.cc:595] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:05:47.841426 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62524.1us
I20260811 16:05:47.841840 13737 raft_consensus.cc:603] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:47.838366 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.840373 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.841447 14579 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:47.837138 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.850250 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:47.850323 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57362us
I20260811 16:05:47.860862 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.862121 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.863947 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.865713 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:47.866967 13740 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:47.867081 13904 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:47.868795 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.871816 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.872220 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:47.878365 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.878650 13742 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260811 16:05:47.881836 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.849391 19539 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:47.837495 19586 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.888746 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.888748 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.840782 19108 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.837363 19523 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:47.917905 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.782969 19493 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260811 16:05:47.922940 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:47.895654 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.924655 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.865909 19199 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:47.862814 19542 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.865036 19566 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:47.950982 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.917153 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:47.951817 13905 raft_consensus.cc:2362] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13. Re-sending same reply.
I20260811 16:05:47.917059 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:47.865206 19562 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:05:47.784698 19436 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.871212 19120 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.897291 19583 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:47.899895 19308 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:47.922323 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82012.1us
I20260811 16:05:47.858812 19544 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:47.928049 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.871244 19432 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
W20260811 16:05:47.935626 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64729.6us
I20260811 16:05:47.887610 19081 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:47.939041 19523 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:47.933147 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:47.947986 19543 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:47.866097 19451 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260811 16:05:47.916407 19561 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260811 16:05:47.840298 19569 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260811 16:05:47.962369 19566 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:47.952698 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.898252 19485 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:48.008558 13903 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:47.945501 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.959930 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:47.894213 19539 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:05:47.923506 19131 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.007s
I20260811 16:05:47.968457 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.933805 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.952260 14579 raft_consensus.cc:2362] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13. Re-sending same reply.
W20260811 16:05:48.021515 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87845.7us
I20260811 16:05:47.962853 14574 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260811 16:05:47.908740 18463 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:47.976897 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.971227 19378 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:47.938438 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:47.933877 19034 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:47.935148 19430 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:47.919400 19552 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:47.885607 19521 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:47.961772 19573 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:47.934175 19199 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:47.949838 13742 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:48.045251 13742 raft_consensus.cc:595] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:48.045724 13742 raft_consensus.cc:603] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:48.005636 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:47.971844 19308 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:48.009963 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64601.1us
I20260811 16:05:48.005371 19572 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260811 16:05:48.020298 19162 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:05:48.024345 19432 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:48.020512 19539 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:48.072626 19162 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:48.073654 19162 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.042172 19583 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:48.048763 19199 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:48.077163 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.078452 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.026369 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:48.079818 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53549us
W20260811 16:05:48.082417 19522 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260811 16:05:48.082706 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:47.918785 19586 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.029671 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.085064 13907 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:48.001197 19544 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:48.032029 13904 raft_consensus.cc:2362] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13. Re-sending same reply.
I20260811 16:05:48.040675 19561 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
W20260811 16:05:48.089762 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 121398us
I20260811 16:05:47.994480 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:48.008211 19566 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:48.046592 13818 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:48.007107 13905 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:05:48.013883 19485 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:48.041589 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:47.972097 19120 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.005231 19134 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260811 16:05:48.069808 19438 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:48.083071 19172 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:05:48.027448 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60821us
I20260811 16:05:48.087565 13735 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:48.094985 13903 raft_consensus.cc:2354] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:05:48.157538 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.101153 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:48.107091 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.158949 14574 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:48.159094 13907 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:48.089766 19522 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:48.084189 19568 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.002s
I20260811 16:05:48.091697 19456 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:48.166461 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.064193 19183 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.037410 18463 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.174778 18463 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.175890 19120 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.132239 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.083982 19420 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260811 16:05:48.134481 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.177983 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.101814 19485 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:48.138649 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.189827 13904 raft_consensus.cc:2362] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12. Re-sending same reply.
I20260811 16:05:48.141842 19451 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:48.142402 19591 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.405s	user 0.002s	sys 0.000s
I20260811 16:05:48.146426 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.151983 19539 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.156085 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.129457 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:48.089496 19544 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:48.092432 19561 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:48.167672 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:48.263211 13740 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:48.263796 13740 raft_consensus.cc:603] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:05:48.169788 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 194531us
I20260811 16:05:48.265822 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:48.176210 13743 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260811 16:05:48.178928 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:48.130178 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:48.267284 13742 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:48.131174 13739 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:48.187765 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.052049 19573 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.095479 19597 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:48.214421 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.190430 13901 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:48.217839 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:48.238080 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108706us
I20260811 16:05:48.215951 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:48.258734 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 102708us
I20260811 16:05:48.280050 13907 raft_consensus.cc:2362] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11. Re-sending same reply.
W20260811 16:05:48.271775 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92953.3us
I20260811 16:05:48.282428 13905 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:48.272809 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:48.275481 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.259007 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.284737 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:48.287158 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71248.6us
I20260811 16:05:48.288734 13905 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:48.284614 13904 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:48.286166 13817 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:48.262275 19034 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:48.260522 19540 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:48.188445 19438 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.183830 19522 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.189931 19456 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.262111 19523 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:48.319763 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.313508 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.349257 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.274902 19582 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:48.356135 13904 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:48.281026 19436 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:48.346971 19454 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.648s	user 0.002s	sys 0.010s
I20260811 16:05:48.279269 19572 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:48.275377 19568 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:48.361635 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:48.423159 13736 raft_consensus.cc:595] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:48.361939 19438 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:48.362917 19010 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Stepping down as leader of term 6
W20260811 16:05:48.365872 19600 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260811 16:05:48.368357 19539 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:48.368618 19596 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.633s	user 0.002s	sys 0.001s
I20260811 16:05:48.369205 19573 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.296757 19081 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:48.371229 19522 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.372020 19055 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:48.374820 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.416548 19552 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:48.376727 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104513us
W20260811 16:05:48.377889 19508 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.001s
W20260811 16:05:48.378679 19587 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.640s	user 0.002s	sys 0.000s
I20260811 16:05:48.383725 19523 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.381233 13902 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:48.381994 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.322156 19302 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:48.298400 19120 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260811 16:05:48.302503 13789 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.503s (SENT)
I20260811 16:05:48.339928 13742 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:48.331210 13905 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:05:48.385298 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55133.8us
I20260811 16:05:48.291116 14574 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:48.306833 19034 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:48.513365 19034 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:48.393235 13903 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:48.419348 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.421401 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.341409 19304 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260811 16:05:48.435041 13908 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260811 16:05:48.517009 19612 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260811 16:05:48.517643 19605 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260811 16:05:48.421695 19454 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:48.442739 13901 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260811 16:05:48.519515 19590 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.782s	user 0.003s	sys 0.000s
I20260811 16:05:48.519790 13906 raft_consensus.cc:2354] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13.
W20260811 16:05:48.375806 19599 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260811 16:05:48.359659 19561 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.459219 19586 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.423350 19430 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:48.426591 19010 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:48.512746 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 210275us
I20260811 16:05:48.452998 19055 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:48.416695 19199 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:48.533937 13789 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.534s (SENT)
I20260811 16:05:48.523038 13742 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:05:48.524652 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 180109us
I20260811 16:05:48.526746 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:48.497973 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:48.521596 19602 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260811 16:05:48.540140 13826 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260811 16:05:48.528051 19278 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.709s	user 0.004s	sys 0.007s
I20260811 16:05:48.522111 13905 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260811 16:05:48.460414 19308 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.499766 19552 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.515673 19120 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:48.345961 19544 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.539007 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:48.543658 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.454172 19081 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.558912 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:48.572906 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:48.537369 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:48.572789 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:48.564816 13821 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:48.538450 19561 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:48.574610 13789 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.603s (SENT)
W20260811 16:05:48.577409 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 120298us
I20260811 16:05:48.577280 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.547789 19539 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:48.520596 19302 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.543154 19586 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:48.583806 13742 raft_consensus.cc:595] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:48.593210 13742 raft_consensus.cc:603] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:48.554610 19278 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:48.560822 19308 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:48.572077 19120 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:48.576234 19432 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:48.618682 13903 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:48.621744 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.628908 13902 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:05:48.622982 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44912us
I20260811 16:05:48.633373 14574 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:05:48.591724 19436 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:48.590372 19584 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:48.648329 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:48.538431 19430 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.645939 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.607702 19539 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:48.662446 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:48.663268 13825 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:48.669485 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:48.675043 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:48.678319 13902 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:05:48.626560 19308 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:48.704309 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 129730us
W20260811 16:05:48.705052 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.831s (SENT) [suppressed 37 similar messages]
I20260811 16:05:48.597873 19055 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.672935 19494 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:48.677531 19586 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:48.672706 19436 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:48.726300 13907 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:48.696789 19568 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260811 16:05:48.735740 13789 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.901s (SENT)
I20260811 16:05:48.743848 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.646503 19010 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:48.711892 19623 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
W20260811 16:05:48.737138 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60969.4us
I20260811 16:05:48.722754 19436 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.721204 19506 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:48.720749 19523 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.725203 19586 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:48.704438 19134 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260811 16:05:48.761845 19584 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260811 16:05:48.769204 19485 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260811 16:05:48.765268 19568 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:48.769712 19485 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:48.775799 19637 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260811 16:05:48.776762 13789 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.905s (SENT)
I20260811 16:05:48.743320 19199 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.768221 19436 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.784523 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.743685 19003 raft_consensus.cc:2741] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Leader pre-election decision vote started in defunct term 11: won
I20260811 16:05:48.766474 19302 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:48.768790 19610 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
I20260811 16:05:48.781141 19586 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:48.796993 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:48.795071 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:48.795437 13827 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
W20260811 16:05:48.794785 19615 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.374s	user 0.002s	sys 0.002s
I20260811 16:05:48.799356 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:48.809058 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:48.794597 19568 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:48.764194 19028 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:48.785192 19081 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:48.755746 19494 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260811 16:05:48.817536 13789 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.968s (SENT)
I20260811 16:05:48.819680 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.748703 19539 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:48.825488 19627 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260811 16:05:48.826649 19436 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:48.827242 19436 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.833304 19597 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:48.834229 19485 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.836020 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:48.839236 19634 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260811 16:05:48.844705 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2035) took 2019 ms (client timeout 1549 ms). Trace:
W20260811 16:05:48.866914 13735 rpcz_store.cc:269] 0811 16:05:46.825483 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:46.859941 (+ 34458us) service_pool.cc:227] Handling call
0811 16:05:48.844448 (+1984507us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:48.844583 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2219189120}
I20260811 16:05:48.867479 19430 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.793004 19552 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:48.851675 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:48.870847 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:48.871750 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2354) took 1242 ms (client timeout 1503 ms). Trace:
W20260811 16:05:48.854336 19620 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260811 16:05:48.856376 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2678) took 1112 ms. Trace:
I20260811 16:05:48.873991 13907 rpcz_store.cc:276] 0811 16:05:47.743979 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.520489 (+776510us) service_pool.cc:227] Handling call
0811 16:05:48.532424 (+ 11935us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:48.737271 (+204847us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:48.856037 (+118766us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:48.856291 (+   254us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":432290048}
I20260811 16:05:48.858793 19120 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.877359 19120 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:48.856827 19456 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:48.887616 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:48.860344 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:48.865337 19508 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:05:48.895643 13821 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:05:48.872290 13906 rpcz_store.cc:269] 0811 16:05:47.629164 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.629321 (+   157us) service_pool.cc:227] Handling call
0811 16:05:48.871471 (+1242150us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54000c7454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:48.871663 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2036014976}
I20260811 16:05:48.880326 13905 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260811 16:05:48.880620 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:48.897964 13743 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:48.889642 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:48.890519 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:48.830777 19436 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:48.903712 13735 raft_consensus.cc:2354] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:05:48.904987 19199 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:48.907764 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:48.784693 19432 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
I20260811 16:05:48.909879 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:48.803828 19010 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 6 FOLLOWER]: Advancing to term 7
I20260811 16:05:48.910820 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:05:48.816608 19108 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:48.916847 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:48.922528 13742 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260811 16:05:48.925652 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:48.933962 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:48.780661 19506 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:48.927176 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:48.943509 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:48.949460 13739 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:48.961611 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:48.969743 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:48.894806 19508 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:48.906912 19430 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:48.970489 13735 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:48.978217 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 160693us
W20260811 16:05:48.984407 13789 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.027s (SENT)
W20260811 16:05:48.985894 13789 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.028s (SENT)
W20260811 16:05:48.989575 13789 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.096s (SENT)
I20260811 16:05:48.990505 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:48.889827 19028 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:48.997004 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:48.972041 19420 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:49.000535 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.004266 19199 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:49.007347 19568 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.011875 19508 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.012372 19648 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:49.014746 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2672) took 1367 ms. Trace:
I20260811 16:05:48.996223 19108 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260811 16:05:49.038094 19554 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
W20260811 16:05:49.043418 19633 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260811 16:05:49.044741 19028 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:49.047919 19034 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.002s
I20260811 16:05:49.050653 13900 rpcz_store.cc:276] 0811 16:05:47.646996 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.647212 (+   216us) service_pool.cc:227] Handling call
0811 16:05:47.794566 (+147354us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:05:47.794745 (+   179us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:47.795056 (+   311us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:47.795079 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:47.835099 (+ 40020us) log.cc:842] Serialized 26 byte log entry
0811 16:05:48.053244 (+218145us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:48.219561 (+166317us) log.cc:842] Serialized 14 byte log entry
0811 16:05:48.274053 (+ 54492us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:48.274274 (+   221us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:49.014294 (+740020us) raft_consensus.cc:1671] finished
0811 16:05:49.014437 (+   143us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:49.014635 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2527,"prepare.queue_time_us":243374,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":23395,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":32043,"spinlock_wait_cycles":6778112,"thread_start_us":273941,"threads_started":2,"wal-append.queue_time_us":283437}
I20260811 16:05:49.054908 13738 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260811 16:05:49.055161 13742 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:49.059805 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70269us
I20260811 16:05:49.024971 19308 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:49.066062 13789 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.098s (SENT)
I20260811 16:05:49.078405 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:49.042120 19199 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:49.117045 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:49.084376 19454 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.026s
I20260811 16:05:49.126340 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.127126 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.028147 19420 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.129144 13820 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:49.069685 19568 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.119575 19308 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:49.133565 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.067852 19554 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:49.120193 19199 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:49.124621 19508 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:49.144379 13738 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:05:49.132947 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.132143 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:49.145480 13827 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:49.131271 19454 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.000s	sys 0.027s
I20260811 16:05:49.158002 19081 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:49.158433 19081 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:49.158803 19081 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:49.158921 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:49.147877 19506 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:49.149307 19651 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260811 16:05:49.151396 19420 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.152694 19554 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.155412 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.163636 13817 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:05:49.083024 19034 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:49.155965 19619 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.577s	user 0.002s	sys 0.000s
W20260811 16:05:49.156239 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 90230.5us
I20260811 16:05:49.129837 19108 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260811 16:05:49.132543 19633 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:05:49.169332 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.174777 13826 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260811 16:05:49.173241 13827 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260811 16:05:49.176119 13827 pending_rounds.cc:76] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 7
I20260811 16:05:49.171475 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.176393 13827 pending_rounds.cc:97] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260811 16:05:49.177271 13827 raft_consensus.cc:2866] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:49.177186 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.178112 13818 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260811 16:05:49.188340 13820 raft_consensus.cc:2354] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12.
I20260811 16:05:49.188612 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.189616 13827 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260811 16:05:49.187016 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 263047us
I20260811 16:05:49.188419 13822 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:49.194981 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.198348 13821 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:49.201213 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 377632us
I20260811 16:05:49.202306 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.205513 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:49.207942 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:49.210700 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:49.218222 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:49.134043 19430 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260811 16:05:49.224372 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 872) took 1047 ms. Trace:
I20260811 16:05:49.224825 13904 rpcz_store.cc:276] 0811 16:05:48.176830 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.357386 (+180556us) service_pool.cc:227] Handling call
0811 16:05:49.224176 (+866790us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54002c10d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:49.224303 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1594407808}
I20260811 16:05:49.231321 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.167209 19521 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
W20260811 16:05:49.221763 19566 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.105s	user 0.017s	sys 0.009s
I20260811 16:05:49.237522 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:49.188205 19582 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:49.247642 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.214548 19644 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:49.248412 13904 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:49.256042 14583 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:05:49.250571 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2011) took 1293 ms. Trace:
I20260811 16:05:49.257086 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.257622 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:49.258304 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:49.236434 19561 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.001s
I20260811 16:05:49.219596 19108 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:49.261242 13817 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:05:49.162971 19308 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.228638 19028 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:49.258911 13904 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:49.274837 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.256882 13824 rpcz_store.cc:276] 0811 16:05:47.957215 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.958394 (+  1179us) service_pool.cc:227] Handling call
0811 16:05:47.978567 (+ 20173us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:47.978831 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:47.978867 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:47.996768 (+ 17901us) log.cc:842] Serialized 26 byte log entry
0811 16:05:48.384818 (+388050us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:48.384852 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:48.385152 (+   300us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:49.155276 (+770124us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:49.237701 (+ 82425us) raft_consensus.cc:1671] finished
0811 16:05:49.237736 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:49.250490 (+ 12754us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":21604608,"thread_start_us":361137,"threads_started":1,"wal-append.queue_time_us":528638}
I20260811 16:05:49.267316 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:49.232440 19120 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:49.269289 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:49.255230 19572 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.820s	user 0.010s	sys 0.006s
I20260811 16:05:49.247480 19535 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:49.283986 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:49.288071 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.291282 13817 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:49.292958 19183 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:49.289211 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:49.293922 19183 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:49.301546 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.302842 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:49.290447 13735 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:49.303649 14579 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:49.270856 19302 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:49.299826 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:49.308224 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.237114 19566 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.304740 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:49.309815 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:49.308578 14580 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:49.298251 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:49.284658 19120 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:49.289165 19561 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:49.312947 13736 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:49.296113 19535 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:49.317312 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.329849 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.296934 19420 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:49.296530 19572 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:49.363291 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.364907 13827 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260811 16:05:49.371130 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:49.372570 13735 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:49.373219 13739 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260811 16:05:49.374337 13820 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260811 16:05:49.374657 13736 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:49.375620 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.376516 13820 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:49.377301 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.274636 19485 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260811 16:05:49.378206 13741 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:49.383116 13823 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260811 16:05:49.383704 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:49.384114 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.371681 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:49.378851 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.307938 19302 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:49.275431 19108 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.269533 19582 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.379974 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:49.381284 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.386857 13822 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260811 16:05:49.388877 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.362869 19120 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:49.389849 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.380024 13904 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:49.394335 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:49.448856 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 155909us
I20260811 16:05:49.290484 19028 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.444717 13820 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:49.400735 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.312040 19657 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:49.371603 19535 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:49.451964 13826 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:49.481452 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 192331us
I20260811 16:05:49.482383 13826 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:49.448462 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.388481 19183 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:49.444797 19506 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:05:49.483897 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89732.2us
I20260811 16:05:49.441174 19302 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:49.483124 13904 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:49.493875 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:49.494457 13904 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:49.387876 19644 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:49.491206 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:49.481827 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 184079us
I20260811 16:05:49.483114 19034 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:49.527349 13904 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:49.531359 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:49.532393 13904 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:49.532473 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:49.387559 19420 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.541509 13904 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:49.492575 19506 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:49.490257 19657 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:49.551841 13906 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:05:49.499526 19670 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:49.557564 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66482us
I20260811 16:05:49.558480 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.503724 19644 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:49.538735 19572 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
W20260811 16:05:49.542799 19620 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260811 16:05:49.577659 13904 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260811 16:05:49.583385 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129608us
I20260811 16:05:49.529600 19522 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:49.542542 19183 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:05:49.507062 19454 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260811 16:05:49.594195 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:49.555333 19506 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:49.629765 13904 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:49.639891 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:49.641371 13904 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260811 16:05:49.643914 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 134665us
I20260811 16:05:49.579906 19644 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:49.647554 13744 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:05:49.585417 19485 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:49.556690 19681 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:49.591583 19522 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:49.592993 18463 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:49.626932 19572 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:49.663622 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.671419 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:49.672453 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.626086 19684 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:05:49.700654 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108190us
I20260811 16:05:49.578637 19670 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:49.711513 19586 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.001s
I20260811 16:05:49.712152 19586 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.714584 19586 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.669894 19566 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:49.715914 19028 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.716261 19582 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:49.667407 19681 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.678613 19485 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260811 16:05:49.718480 19666 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260811 16:05:49.719344 19108 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:49.720746 19676 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260811 16:05:49.722705 19674 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260811 16:05:49.723624 19199 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.004s
I20260811 16:05:49.724133 19199 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:49.725034 19675 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260811 16:05:49.726593 19199 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:49.678881 19621 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260811 16:05:49.727958 19420 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.729333 13740 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:49.731458 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2690) took 1176 ms. Trace:
I20260811 16:05:49.688928 18463 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:49.688606 19684 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:49.738087 14580 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
W20260811 16:05:49.726981 19010 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.000s
I20260811 16:05:49.738664 19681 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:49.723590 19081 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260811 16:05:49.742920 19572 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.754074 19081 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.743929 19684 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:49.756368 19682 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260811 16:05:49.757019 19081 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:49.757901 19108 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:49.747026 19535 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.758671 19108 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:49.759482 14575 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:49.699364 19657 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.759949 19687 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:49.750831 19120 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.731925 13907 rpcz_store.cc:276] 0811 16:05:48.559063 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.919779 (+360716us) service_pool.cc:227] Handling call
0811 16:05:48.967414 (+ 47635us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:48.967978 (+   564us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:48.968022 (+    44us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:48.976003 (+  7981us) log.cc:842] Serialized 52 byte log entry
0811 16:05:49.274534 (+298531us) raft_consensus.cc:1631] Marking committed up to 4
0811 16:05:49.274589 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:49.274667 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:49.731194 (+456527us) raft_consensus.cc:1671] finished
0811 16:05:49.731219 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:49.731386 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4912,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8258,"thread_start_us":199410,"threads_started":1,"wal-append.queue_time_us":343560}
I20260811 16:05:49.768271 18463 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.777097 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:49.775813 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 130494us
I20260811 16:05:49.812651 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:49.691354 19686 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260811 16:05:49.817781 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:49.828081 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 194457us
W20260811 16:05:49.830595 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.021s
W20260811 16:05:49.832231 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.001s	sys 0.021s
W20260811 16:05:49.833701 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 535527us
I20260811 16:05:49.840153 13871 leader_election.cc:398] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:05:49.840818 13871 leader_election.cc:401] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260811 16:05:49.816092 19521 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:49.844484 19685 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:05:49.846794 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:49.846004 19508 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.003s
I20260811 16:05:49.831067 19681 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:49.847231 19670 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:49.834311 19552 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:49.856971 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.863003 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:49.867208 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.867656 19712 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:49.868117 19712 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:49.868430 19712 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:49.868768 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:49.870421 19055 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:49.872650 19434 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:49.873215 19434 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.873499 19302 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.874583 14578 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:49.863977 19630 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:49.891639 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 219298us
I20260811 16:05:49.879344 19712 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:49.880580 19522 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.855047 19120 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:49.885950 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.887789 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.944878 13824 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:49.888607 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.856897 19681 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:49.899446 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:49.859586 19552 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:49.834474 19695 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260811 16:05:49.945784 13826 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:49.947549 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48186.8us
I20260811 16:05:49.846830 19521 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:49.876206 19420 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
W20260811 16:05:49.949559 19682 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260811 16:05:49.943518 19686 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:49.950265 19552 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:49.898061 19454 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260811 16:05:49.966131 13906 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:49.946647 19681 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:49.969209 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:49.967849 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:49.950120 19378 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:49.946909 19535 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.956653 19302 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.981808 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:49.981864 13826 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:49.983791 14582 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:49.980342 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:49.964017 19434 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:49.949294 19436 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260811 16:05:49.988219 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:49.989833 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:49.969789 19034 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:49.991384 13826 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:49.995690 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:49.996318 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:50.001087 13825 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:50.005801 19699 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260811 16:05:50.005906 14582 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:50.010437 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.004948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.011673 13826 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:50.012174 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64523.3us
I20260811 16:05:50.026324 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:50.028987 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:50.029701 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:50.030447 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:50.032037 18463 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:05:49.997138 19302 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:50.035959 19434 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:50.005733 19535 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:50.039830 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:50.033804 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89687.4us
I20260811 16:05:49.993959 19657 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260811 16:05:49.996870 19034 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.034868 19420 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:50.037140 19454 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:49.973122 19686 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.049916 13825 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:50.055954 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:50.049041 19706 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:50.065603 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:50.101243 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.098053 19506 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:50.102257 19639 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.233s	user 0.006s	sys 0.000s
I20260811 16:05:50.103078 19701 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:50.103842 19701 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
W20260811 16:05:50.104290 19655 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.166s	user 0.003s	sys 0.005s
I20260811 16:05:50.104712 19698 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.063504 19688 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260811 16:05:50.071310 19714 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260811 16:05:50.106832 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 874) took 1929 ms. Trace:
I20260811 16:05:50.071754 19722 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:50.107272 13909 rpcz_store.cc:276] 0811 16:05:48.177621 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.703664 (+526043us) service_pool.cc:227] Handling call
0811 16:05:48.732200 (+ 28536us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:48.732905 (+   705us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:48.732982 (+    77us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:48.734320 (+  1338us) log.cc:842] Serialized 26 byte log entry
0811 16:05:48.786972 (+ 52652us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:48.787152 (+   180us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:48.787224 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:50.103499 (+1316275us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:50.106423 (+  2924us) raft_consensus.cc:1671] finished
0811 16:05:50.106443 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.106769 (+   326us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":71082880,"thread_start_us":51639,"threads_started":1,"wal-append.queue_time_us":186635}
I20260811 16:05:50.109141 19506 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.073360 19521 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.081035 19034 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.110092 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1011) took 2287 ms. Trace:
I20260811 16:05:50.110481 13741 rpcz_store.cc:276] 0811 16:05:47.822515 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.825446 (+  2931us) service_pool.cc:227] Handling call
0811 16:05:50.109897 (+2284451us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:50.110030 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3484782464}
I20260811 16:05:50.073105 19717 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.111624 19717 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.113803 19717 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.105309 19698 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.115734 19712 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.116369 19698 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:50.114583 19715 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260811 16:05:50.117041 19710 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:05:50.005031 19683 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260811 16:05:50.120831 19684 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.089201 19686 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:50.083597 19711 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260811 16:05:50.072485 19708 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260811 16:05:50.109063 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.125492 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:50.132421 14575 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:50.133381 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:50.126802 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:50.137836 13825 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:50.141831 14578 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:50.142402 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.143384 14581 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 7.
I20260811 16:05:50.146551 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.148687 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.104314 19701 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:50.117038 19644 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.168660 19644 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.170998 19684 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.172720 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:50.173133 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.174002 13909 raft_consensus.cc:2362] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10. Re-sending same reply.
I20260811 16:05:50.174855 19722 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:50.175334 14575 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:50.175698 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.176944 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:50.176658 13909 raft_consensus.cc:2362] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12. Re-sending same reply.
I20260811 16:05:50.179765 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.180415 13825 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:50.183666 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:50.173919 19714 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260811 16:05:50.185792 19688 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:50.187076 19434 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:50.189646 19714 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:50.190982 19420 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:50.178290 19681 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.227991 14582 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:50.208101 19714 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:50.211612 19434 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:50.232923 19649 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.380s	user 0.003s	sys 0.007s
I20260811 16:05:50.237105 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2381) took 2471 ms. Trace:
I20260811 16:05:50.238204 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2723) took 1043 ms. Trace:
W20260811 16:05:50.231917 19662 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.961s	user 0.002s	sys 0.002s
I20260811 16:05:50.237532 13901 rpcz_store.cc:276] 0811 16:05:47.765634 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.518884 (+753250us) service_pool.cc:227] Handling call
0811 16:05:48.519288 (+   404us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:48.538541 (+ 19253us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:48.538582 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:48.558601 (+ 20019us) log.cc:842] Serialized 52 byte log entry
0811 16:05:48.728194 (+169593us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:05:48.753747 (+ 25553us) log.cc:842] Serialized 14 byte log entry
0811 16:05:48.755973 (+  2226us) log.cc:842] Serialized 14 byte log entry
0811 16:05:48.756197 (+   224us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:48.756288 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:48.867546 (+111258us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18004a3860. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:50.224088 (+1356542us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b2400244808. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:05:50.236832 (+ 12744us) raft_consensus.cc:1671] finished
0811 16:05:50.236853 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.237031 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20666,"prepare.queue_time_us":106290,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":94,"raft.queue_time_us":41777,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":38893,"spinlock_wait_cycles":94661888,"thread_start_us":124757,"threads_started":1,"wal-append.queue_time_us":277492}
I20260811 16:05:50.207954 19552 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.242421 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2383) took 2476 ms. Trace:
I20260811 16:05:50.238692 13818 rpcz_store.cc:276] 0811 16:05:49.194472 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.201031 (+  6559us) service_pool.cc:227] Handling call
0811 16:05:49.213998 (+ 12967us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:49.226760 (+ 12762us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:49.447627 (+220867us) log.cc:842] Serialized 14 byte log entry
0811 16:05:49.850038 (+402411us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:49.851252 (+  1214us) log.cc:842] Serialized 26 byte log entry
0811 16:05:49.851426 (+   174us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:49.851772 (+   346us) log.cc:842] Serialized 14 byte log entry
0811 16:05:49.943230 (+ 91458us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:49.943324 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:50.237991 (+294667us) raft_consensus.cc:1671] finished
0811 16:05:50.238013 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.238145 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24833,"prepare.queue_time_us":29339,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":2808,"raft.queue_time_us":78727,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":6650,"thread_start_us":598453,"threads_started":3,"wal-append.queue_time_us":400594}
I20260811 16:05:50.243719 13905 rpcz_store.cc:276] 0811 16:05:47.766162 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.544954 (+778792us) service_pool.cc:227] Handling call
0811 16:05:48.880012 (+335058us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:48.906935 (+ 26923us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.242134 (+1335199us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54000c7450. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:50.242343 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":734759808}
I20260811 16:05:50.245685 13905 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260811 16:05:50.245786 19629 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:50.246376 19629 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.247345 19629 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.248921 19629 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:50.252770 19432 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:50.253293 19432 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:50.254236 19432 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.207572 19701 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.271464 19681 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:50.273137 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 233377us
I20260811 16:05:50.274732 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.275494 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:50.276165 13824 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:50.262351 19432 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:50.282151 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.282972 13825 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:50.282905 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:50.282089 19721 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:50.286439 19454 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:50.286891 19454 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.287200 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2686) took 2100 ms. Trace:
I20260811 16:05:50.288280 19712 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.287773 19454 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.287602 13902 rpcz_store.cc:276] 0811 16:05:48.186733 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.871862 (+685129us) service_pool.cc:227] Handling call
0811 16:05:48.872159 (+   297us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:48.872373 (+   214us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:05:48.872622 (+   249us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.123264 (+1250642us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.181057 (+ 57793us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:50.286822 (+105765us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:50.286876 (+    54us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:50.286926 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.286997 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.287120 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1083256,"prepare.queue_time_us":934338,"prepare.run_cpu_time_us":842,"prepare.run_wall_time_us":844,"raft.queue_time_us":168090,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":230,"spinlock_wait_cycles":35264384,"thread_start_us":329920,"threads_started":2,"wal-append.queue_time_us":352019}
I20260811 16:05:50.288877 19712 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.289403 19454 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:50.290298 13902 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260811 16:05:50.291275 19583 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:50.292037 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2692) took 1703 ms. Trace:
I20260811 16:05:50.292768 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.293335 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2688) took 1748 ms. Trace:
I20260811 16:05:50.293440 14575 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:50.296813 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2380) took 2531 ms. Trace:
I20260811 16:05:50.293804 13903 rpcz_store.cc:276] 0811 16:05:48.545446 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.895216 (+349770us) service_pool.cc:227] Handling call
0811 16:05:48.895577 (+   361us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:48.895849 (+   272us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:48.969151 (+ 73302us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.008904 (+1039753us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b18004c8460. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:05:50.009172 (+   268us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.292952 (+283780us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:50.293012 (+    60us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:50.293063 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.293140 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.293276 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1147530,"prepare.queue_time_us":1144117,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":3658,"spinlock_wait_cycles":42334080,"thread_start_us":176366,"threads_started":1,"wal-append.queue_time_us":179300}
I20260811 16:05:50.292410 13900 rpcz_store.cc:276] 0811 16:05:48.589237 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.083317 (+494080us) service_pool.cc:227] Handling call
0811 16:05:49.083775 (+   458us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:49.084065 (+   290us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:50.036453 (+952388us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.291524 (+255071us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.291696 (+   172us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:50.291744 (+    48us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:50.291800 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.291869 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.291983 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1071488,"prepare.queue_time_us":957146,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":2667,"raft.queue_time_us":121658,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"spinlock_wait_cycles":2371456,"thread_start_us":134944,"threads_started":1,"wal-append.queue_time_us":171696}
I20260811 16:05:50.299443 13824 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:50.279672 19434 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.316380 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.278571 19685 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:50.319271 19544 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:50.321967 19729 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:05:50.290951 19712 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.323972 19721 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.329496 19688 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:05:50.329712 19552 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.331859 19438 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:50.326102 19183 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.332515 19438 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.333354 19183 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.329823 19721 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.356709 19183 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.359551 19034 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:05:50.359447 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60976.3us
I20260811 16:05:50.360826 19034 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:50.363204 19034 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:50.365105 19308 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.367161 14578 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:50.361281 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.362290 19438 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.371768 14580 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:50.372026 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.373078 13900 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:50.373378 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.380599 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.381099 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.375854 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.384112 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2724) took 1174 ms. Trace:
I20260811 16:05:50.385123 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.386049 13903 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:50.383670 19108 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:50.392544 19108 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:50.384639 13821 rpcz_store.cc:276] 0811 16:05:49.209403 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.215075 (+  5672us) service_pool.cc:227] Handling call
0811 16:05:49.215535 (+   460us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:49.226896 (+ 11361us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:49.226943 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:50.107486 (+880543us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:50.107875 (+   389us) log.cc:842] Serialized 26 byte log entry
0811 16:05:50.191457 (+ 83582us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:50.208623 (+ 17166us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.209125 (+   502us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.209231 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:50.373587 (+164356us) raft_consensus.cc:1671] finished
0811 16:05:50.383858 (+ 10271us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.384031 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10863,"prepare.queue_time_us":19496,"raft.queue_time_us":12103,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":48151296,"thread_start_us":83203,"threads_started":1,"wal-append.queue_time_us":123380}
I20260811 16:05:50.371336 19723 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.394320 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.396827 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.397161 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:50.404322 19690 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.404959 19690 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.394304 19308 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.407970 19308 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.410571 19308 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.392922 19108 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:50.413082 19034 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.414340 19308 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.414911 19308 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.417060 19308 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.419929 19456 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:50.420629 19456 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.428113 13900 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:50.427331 13903 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:05:50.428784 19731 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260811 16:05:50.418351 19723 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.432911 19723 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:50.440753 19642 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.390s	user 0.008s	sys 0.001s
I20260811 16:05:50.442909 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1124) took 2533 ms. Trace:
I20260811 16:05:50.444029 14577 rpcz_store.cc:276] 0811 16:05:47.909394 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.909558 (+   164us) service_pool.cc:227] Handling call
0811 16:05:47.909903 (+   345us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:47.910969 (+  1066us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:47.910998 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:48.444987 (+533989us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:48.503098 (+ 58111us) log.cc:842] Serialized 26 byte log entry
0811 16:05:48.664108 (+161010us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:48.685073 (+ 20965us) log.cc:842] Serialized 14 byte log entry
0811 16:05:48.696892 (+ 11819us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:48.696997 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:48.838841 (+141844us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b180028f840. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:50.439955 (+1601114us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:50.442585 (+  2630us) raft_consensus.cc:1671] finished
0811 16:05:50.442617 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.442822 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3762,"prepare.queue_time_us":20637,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":12975,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":17809,"spinlock_wait_cycles":54780544,"thread_start_us":126227,"threads_started":1,"wal-append.queue_time_us":435373}
W20260811 16:05:50.449486 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 52424.7us
I20260811 16:05:50.450688 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.421897 19456 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.462070 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.463372 19723 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:50.419180 19721 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.466604 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.393251 19688 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.065s
I20260811 16:05:50.427213 19661 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.471760 19721 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.459348 19630 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:50.477800 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1540) took 1167 ms. Trace:
I20260811 16:05:50.479569 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.466822 19454 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.486406 19721 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:50.486740 19702 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.674s	user 0.002s	sys 0.002s
I20260811 16:05:50.488546 19081 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.478348 14583 rpcz_store.cc:276] 0811 16:05:49.310302 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.310478 (+   176us) service_pool.cc:227] Handling call
0811 16:05:49.310771 (+   293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:49.310973 (+   202us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:49.367877 (+ 56904us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.442227 (+1074350us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800378040. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:05:50.476674 (+ 34447us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.477469 (+   795us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:50.477515 (+    46us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:50.477555 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.477617 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.477741 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":502,"prepare.queue_time_us":52841,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4590,"raft.queue_time_us":604,"spinlock_wait_cycles":4446592,"thread_start_us":33814,"threads_started":1}
I20260811 16:05:50.475589 19493 raft_consensus.cc:979] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:05:50.505375 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.506085 13824 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:50.502565 19081 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.508684 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 953) took 1125 ms. Trace:
I20260811 16:05:50.509406 19081 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:50.509892 19733 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260811 16:05:50.513052 19736 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260811 16:05:50.502223 19723 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.516651 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 949) took 1142 ms. Trace:
I20260811 16:05:50.481142 19630 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:50.517098 13827 rpcz_store.cc:276] 0811 16:05:49.374368 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.446490 (+ 72122us) service_pool.cc:227] Handling call
0811 16:05:49.446826 (+   336us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:49.488211 (+ 41385us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:49.488242 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:49.488281 (+    39us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:49.488309 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.516401 (+1028092us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b54002ab7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:50.516462 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.516579 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":94743936}
I20260811 16:05:50.509197 13823 rpcz_store.cc:276] 0811 16:05:49.383042 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.452732 (+ 69690us) service_pool.cc:227] Handling call
0811 16:05:49.453078 (+   346us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:49.621510 (+168432us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:49.621541 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:49.634261 (+ 12720us) log.cc:842] Serialized 26 byte log entry
0811 16:05:49.702574 (+ 68313us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:49.702608 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:49.702675 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:50.485970 (+783295us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:50.508344 (+ 22374us) raft_consensus.cc:1671] finished
0811 16:05:50.508371 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.508615 (+   244us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30500,"raft.queue_time_us":95485,"spinlock_wait_cycles":12637824,"thread_start_us":175412,"threads_started":2,"wal-append.queue_time_us":130088}
I20260811 16:05:50.472649 19714 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.523751 19034 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.525455 19714 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.526058 19108 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.490741 19552 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:50.527705 19552 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:50.500929 19454 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.528707 19552 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.529844 19454 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.531914 19108 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.532811 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.533520 14578 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:50.533823 19630 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:50.532845 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:50.535018 14577 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:50.475400 19661 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.540381 19661 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.531939 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.542367 14583 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:05:50.547458 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.549616 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:50.549846 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.550338 14583 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:50.551716 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:50.551911 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.552393 14580 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:50.552815 13818 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:05:50.553879 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.550516 13903 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:50.515439 19723 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.558483 14577 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:50.561340 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.571672 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.573477 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.572379 13824 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:50.575680 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.577289 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:50.579952 19661 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:50.563365 19454 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.580366 19506 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:50.589253 19506 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.645279 14580 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:50.588068 19454 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:50.588418 19554 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.002s	sys 0.027s
I20260811 16:05:50.648479 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.649966 19108 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:05:50.618630 19746 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:50.586184 19661 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.650678 19108 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:50.651221 19661 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.652021 19108 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.654296 19661 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.640646 19630 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.580977 19629 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:50.655471 19629 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.655891 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:50.657135 13818 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:50.656690 19629 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.658109 19691 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:50.658856 19691 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.662019 19746 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:50.662740 19746 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:50.663903 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.664621 13903 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:50.665967 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.673557 14583 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:50.675575 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.646400 19506 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:05:50.670871 19554 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.002s	sys 0.028s
I20260811 16:05:50.681052 19717 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Leader election won for term 8
I20260811 16:05:50.678048 19430 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:50.670626 19745 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260811 16:05:50.661778 19691 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.688303 14574 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:50.688467 19430 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:50.768042 19629 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:50.688539 19717 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:50.767323 19722 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.759599 19714 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.782136 19629 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.784140 19454 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.780856 19430 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:50.787650 19717 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.788923 19722 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.766314 19695 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.796015 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:50.796690 13818 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:50.784942 19697 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:50.766090 19432 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.786070 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.765777 19621 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.802304 19621 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.802850 19432 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.808877 19432 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.805997 19690 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.814697 19694 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.817482 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.821931 14582 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:50.821775 19694 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.819206 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.823599 13903 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:50.800267 19697 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:50.828958 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.831298 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.833170 19681 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:50.834159 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:50.836027 19681 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.836524 19681 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:50.837875 19722 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.834826 19697 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.800554 19695 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.844043 19695 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.844949 19680 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:50.845549 19680 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.846055 19680 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:50.819823 19621 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.796175 19630 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:50.857180 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.858204 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:50.848233 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.860472 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:50.861335 13818 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:50.844043 19694 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:50.864033 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1535) took 1673 ms. Trace:
I20260811 16:05:50.867360 14574 rpcz_store.cc:276] 0811 16:05:49.190915 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.191071 (+   156us) service_pool.cc:227] Handling call
0811 16:05:49.219974 (+ 28903us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:50.766281 (+1546307us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.863801 (+ 97520us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540067eb54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:50.863971 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3376238336}
I20260811 16:05:50.870075 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:50.793771 19714 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.875411 19644 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:50.876056 19644 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:50.877056 19644 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:50.877733 19690 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.878312 19690 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.880844 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2698) took 1653 ms. Trace:
I20260811 16:05:50.869971 19629 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.882947 19629 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:50.881075 19690 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.883558 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.884328 14574 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:50.888891 19430 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.890399 14580 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:50.891958 19430 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:50.892448 19732 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.508s	user 0.003s	sys 0.000s
I20260811 16:05:50.895413 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:50.895771 19726 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.666s	user 0.002s	sys 0.006s
I20260811 16:05:50.897581 14574 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260811 16:05:50.898701 19690 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:50.899111 19690 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:50.899536 19690 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:50.297192 13908 rpcz_store.cc:276] 0811 16:05:47.765393 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.517550 (+752157us) service_pool.cc:227] Handling call
0811 16:05:48.517936 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:48.530179 (+ 12243us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:48.530214 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:48.536849 (+  6635us) log.cc:842] Serialized 26 byte log entry
0811 16:05:48.673054 (+136205us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:50.105808 (+1432754us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b1800223120. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f
0811 16:05:50.105948 (+   140us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.296207 (+190259us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.296515 (+   308us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:50.296560 (+    45us) raft_consensus.cc:1671] finished
0811 16:05:50.296638 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.296763 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116658,"prepare.queue_time_us":47273,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":126155,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":5999,"spinlock_wait_cycles":6545152,"thread_start_us":252019,"threads_started":3,"wal-append.queue_time_us":345007,"wal-append.run_cpu_time_us":1841,"wal-append.run_wall_time_us":1021646}
I20260811 16:05:50.881343 13906 rpcz_store.cc:276] 0811 16:05:49.227595 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.629126 (+401531us) service_pool.cc:227] Handling call
0811 16:05:49.629319 (+   193us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:49.973003 (+343684us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.880507 (+907504us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:50.880758 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":774198144}
I20260811 16:05:50.904899 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2332) took 1283 ms. Trace:
I20260811 16:05:50.905351 13743 rpcz_store.cc:276] 0811 16:05:49.622021 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.622574 (+   553us) service_pool.cc:227] Handling call
0811 16:05:49.622985 (+   411us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:49.623268 (+   283us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:49.644910 (+ 21642us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.904381 (+1259471us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180005cda0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:05:50.904540 (+   159us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:50.904588 (+    48us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:50.904635 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.904717 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:50.904838 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3417,"prepare.queue_time_us":24512,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":7201152}
W20260811 16:05:50.911291 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.26306e+06us
I20260811 16:05:50.912066 19680 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.914520 19680 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.916059 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:50.916714 14574 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:50.928490 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.929327 13824 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260811 16:05:50.929541 13903 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:50.932578 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.938723 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:50.943917 13901 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:50.987918 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:50.917171 19586 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:51.005122 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:50.934710 19010 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.028092 19010 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.030375 19010 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:50.938683 19673 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.012135 19556 raft_consensus.cc:1067] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:05:50.915103 19680 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260811 16:05:51.040951 19746 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.041663 19522 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:51.000275 19717 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:51.046051 19506 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.046651 19717 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.048729 19717 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.050247 14583 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:51.049916 19681 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:50.986951 19432 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:51.006337 19573 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.025568 19438 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:51.054920 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:51.066377 13818 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:05:51.000577 19572 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.071161 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2329) took 2114 ms. Trace:
I20260811 16:05:51.068656 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.071470 14574 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:51.069615 13908 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:51.077481 13740 rpcz_store.cc:276] 0811 16:05:48.946030 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:48.947613 (+  1583us) service_pool.cc:227] Handling call
0811 16:05:48.947968 (+   355us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:49.738450 (+790482us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:51.060506 (+1322056us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:51.060675 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1796487040}
I20260811 16:05:51.068960 13901 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:51.080909 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:51.085804 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:51.064316 19746 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.096920 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.096655 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.101151 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.101792 13740 raft_consensus.cc:2354] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:51.032126 19586 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.107728 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.108444 13740 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:51.079376 19685 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.079653 19618 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:51.121227 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.121865 13739 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:51.110252 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:51.079926 19670 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:51.087421 19717 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:51.132982 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:51.113994 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.133673 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.134492 13736 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:51.114039 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.136291 13901 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:51.116750 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.137315 13737 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 13
I20260811 16:05:51.084161 19028 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:51.102979 19556 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.076011 19573 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.128568 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.128957 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.129663 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.156000 13823 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:51.156877 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:51.157423 13823 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:51.155460 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.130394 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.158502 13826 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:51.159991 13826 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:05:51.132251 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.161046 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:51.132647 13825 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:51.075685 19712 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260811 16:05:51.138871 19378 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.167227 19378 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.169391 19378 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:51.160983 13744 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:51.169848 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.170527 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.170642 13822 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:51.063372 19673 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.142831 13908 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:05:51.138937 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.192471 13735 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:51.119266 19698 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:51.148543 13740 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:51.138666 19451 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:51.071801 19432 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.204059 19698 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:51.205049 19698 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.207726 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:51.209365 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48476.6us
I20260811 16:05:51.190521 19556 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.133112 19183 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.151360 19493 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.149983 19558 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.133723 19010 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:51.155416 13827 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:51.117921 19566 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.083134 19572 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.195719 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.142123 19552 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:51.215865 13823 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:51.230073 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:51.230412 13740 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:51.180433 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45515.7us
I20260811 16:05:51.164563 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.230799 13900 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:51.231285 13736 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:51.220721 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:51.221704 14578 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:51.219666 13743 raft_consensus.cc:2362] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12. Re-sending same reply.
I20260811 16:05:51.171490 19055 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:51.122674 19684 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260811 16:05:51.132388 19685 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.247090 13735 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260811 16:05:51.163757 13739 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:51.139081 19436 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.140468 19670 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.219329 19759 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:51.248788 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.139789 19618 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.212541 19451 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.257555 19763 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:51.261265 13740 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:51.248301 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:51.254678 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 101977us
I20260811 16:05:51.234911 19630 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.271850 19630 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.273545 19451 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.273916 19673 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.274663 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.275313 19572 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.275722 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.258035 19586 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:51.236280 19506 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:51.268375 19436 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.258723 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.277891 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.278127 19436 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.155131 19028 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.268079 19746 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:51.275856 19763 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:51.279688 19763 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:51.279965 19432 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.270053 19131 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260811 16:05:51.281792 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.279654 19746 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.283463 19556 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.285012 19746 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:51.279062 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.288048 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.243512 19055 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.293599 19055 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:51.241524 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 321801us
I20260811 16:05:51.265807 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.297573 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.302071 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:05:51.305739 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:51.264636 13737 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:51.310920 13740 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:05:51.312418 14578 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:05:51.314967 13739 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:05:51.229614 19183 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:51.317930 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46621.3us
I20260811 16:05:51.241640 19010 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.331758 19618 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.156136 19717 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:51.321003 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:05:51.240196 19566 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.353276 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:51.259511 19758 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.101s
I20260811 16:05:51.324653 14583 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:05:51.328769 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:51.330936 19714 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.298739 19681 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:51.266144 19573 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.302621 19759 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:51.302460 19583 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.336359 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.236001 19558 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.235119 19493 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.319656 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.342907 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.410346 14574 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:51.290855 19763 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.270757 19690 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.351276 19108 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260811 16:05:51.411728 19759 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.251444 19584 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
W20260811 16:05:51.410925 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 169106us
I20260811 16:05:51.359289 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.416493 13739 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:51.417711 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.367956 19683 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:05:51.371793 19010 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.424403 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.391870 19758 consensus_queue.cc:1225] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:05:51.324218 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2331) took 1702 ms. Trace:
I20260811 16:05:51.376420 13818 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 9: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:51.349126 19028 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:51.405206 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168350us
I20260811 16:05:51.409726 14577 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:51.413475 13817 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:51.351328 13906 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:51.436251 13709 leader_election.cc:398] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12.
I20260811 16:05:51.408031 19583 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:51.432154 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.431094 13744 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:51.436928 13709 leader_election.cc:401] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260811 16:05:51.443754 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.447984 13900 raft_consensus.cc:2396] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260811 16:05:51.450031 13737 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:05:51.452286 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.453802 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:51.441236 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63295.4us
I20260811 16:05:51.457072 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.433269 13742 rpcz_store.cc:276] 0811 16:05:49.621627 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.621868 (+   241us) service_pool.cc:227] Handling call
0811 16:05:49.622412 (+   544us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:49.625876 (+  3464us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:49.625904 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:49.626487 (+   583us) log.cc:842] Serialized 52 byte log entry
0811 16:05:49.779638 (+153151us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:49.836219 (+ 56581us) log.cc:842] Serialized 14 byte log entry
0811 16:05:50.294264 (+458045us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b18003808c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:51.305685 (+1011421us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:51.305762 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:51.305890 (+   128us) raft_consensus.cc:1671] finished
0811 16:05:51.323929 (+ 18039us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:51.324142 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2405465,"prepare.queue_time_us":54429,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1168078,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":49481,"spinlock_wait_cycles":13090560,"thread_start_us":443666,"threads_started":2,"wal-append.queue_time_us":204726,"wal-append.run_cpu_time_us":5698,"wal-append.run_wall_time_us":1067045}
I20260811 16:05:51.470270 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.471864 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:51.432768 19690 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.478166 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.435178 19683 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:51.491537 13739 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260811 16:05:51.495074 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:51.502759 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.549s (SENT)
W20260811 16:05:51.509295 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52311.5us
I20260811 16:05:51.489341 19770 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:51.501080 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:51.490483 19573 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:51.517805 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.499379 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.491829 19685 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:51.520498 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.462272 19746 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260811 16:05:51.494470 19618 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.543455 14574 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:51.537694 19558 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.542203 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.553272 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.553870 13823 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:51.554453 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.504128 19586 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:51.555752 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.556874 13823 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260811 16:05:51.517450 19690 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.509541 19561 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:51.434299 19717 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.543406 13827 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260811 16:05:51.543674 14583 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:05:51.544353 13822 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:05:51.504473 19670 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:51.545881 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.546538 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.561237 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.566124 13905 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260811 16:05:51.566372 13826 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:51.546761 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.547288 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.547429 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.548105 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.499500 19673 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:51.551223 19765 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260811 16:05:51.542552 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.559656 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:51.545271 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.562990 13742 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:51.568248 14573 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:51.567592 14579 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:51.517266 19434 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:51.569103 14575 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:51.564127 13825 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:51.569362 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.562986 14583 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:05:51.569648 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.589006 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.591171 14583 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:51.590349 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.513839 19120 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260811 16:05:51.509900 19055 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260811 16:05:51.572733 13908 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:51.552250 19183 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.573426 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:51.592161 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.663766 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.607108 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:51.664530 14573 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:51.666534 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134546us
I20260811 16:05:51.609910 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:51.668361 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61353.9us
I20260811 16:05:51.579075 14577 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 8: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:51.669150 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.669435 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:51.558990 19758 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:51.552423 19108 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260811 16:05:51.674160 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.675122 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.499341 19761 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260811 16:05:51.675755 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.677080 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.599994 14578 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:51.568789 19714 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:51.561896 19667 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260811 16:05:51.510205 19556 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260811 16:05:51.606172 19661 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:51.679600 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:51.667838 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94506.4us
I20260811 16:05:51.682991 13744 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:51.608330 14575 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:51.687325 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:51.579279 19028 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260811 16:05:51.564617 19690 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.564014 19668 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260811 16:05:51.606436 19572 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
W20260811 16:05:51.688058 19764 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260811 16:05:51.632257 19081 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260811 16:05:51.704743 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:51.720922 19668 consensus_queue.cc:1225] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:05:51.712535 19758 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:05:51.723627 19758 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:51.724551 19758 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.726281 19758 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:51.717211 19568 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260811 16:05:51.702142 19661 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.562996 19618 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.579493 19673 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.674418 19055 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:51.679499 19010 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:51.711964 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.686334 19451 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:51.716361 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:51.663355 19434 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260811 16:05:51.663780 19586 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260811 16:05:51.688838 19670 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:51.702623 19694 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:51.742408 19695 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:51.775296 19694 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.775440 19695 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.775897 19694 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:51.778079 19673 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:51.744954 19661 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:51.686125 19494 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:51.728832 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:51.735111 14583 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.780920 14583 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:51.734329 19668 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
W20260811 16:05:51.697708 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 127248us
I20260811 16:05:51.717330 19771 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:51.703760 19714 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.667379 19683 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.710461 19302 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260811 16:05:51.754122 19010 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:51.740182 19556 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
W20260811 16:05:51.769014 19779 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:05:51.771386 19618 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.774312 19770 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12.
I20260811 16:05:51.775959 19695 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:51.713056 19572 consensus_queue.cc:1225] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:05:51.706780 19746 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260811 16:05:51.783591 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54852us
I20260811 16:05:51.788339 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.710623 19506 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
W20260811 16:05:51.782349 19522 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.740s	user 0.018s	sys 0.000s
I20260811 16:05:51.787513 19108 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260811 16:05:51.811741 19717 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:51.812177 19717 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:51.812574 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.813145 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.813719 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.814476 19690 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:51.787738 19771 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:51.815106 19771 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:51.816474 19714 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:51.796999 19010 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:51.794173 19673 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:51.818883 19717 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.819609 19673 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:51.820278 19717 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:51.814783 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.791193 19785 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:51.822326 19785 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:51.822758 19785 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:51.822007 13739 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:51.796530 19556 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:51.826433 19556 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.825798 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.827958 19556 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:51.796988 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134355us
I20260811 16:05:51.787320 19451 raft_consensus.cc:2741] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260811 16:05:51.808064 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 118936us
I20260811 16:05:51.820541 19673 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.830238 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:51.797374 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 110135us
I20260811 16:05:51.832190 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:51.782073 19668 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:51.830921 13909 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:51.836951 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:51.847973 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1023) took 2674 ms. Trace:
W20260811 16:05:51.847913 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 131647us
I20260811 16:05:51.848905 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:51.849781 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.850862 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.853008 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.853924 19759 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:51.854385 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.854646 19759 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:51.855077 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.855597 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.856192 13827 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:51.856284 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.857354 13827 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260811 16:05:51.857663 13827 pending_rounds.cc:76] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 5
I20260811 16:05:51.850982 19572 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:05:51.857887 13827 pending_rounds.cc:97] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260811 16:05:51.858180 13827 raft_consensus.cc:2866] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:51.859036 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.848497 13738 rpcz_store.cc:276] 0811 16:05:49.173362 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:49.173639 (+   277us) service_pool.cc:227] Handling call
0811 16:05:49.173931 (+   292us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:50.979608 (+1805677us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:50.979656 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:50.979715 (+    59us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:50.979762 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:51.847743 (+867981us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:51.847791 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:51.847918 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1124984,"raft.queue_time_us":1146726,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":28253,"spinlock_wait_cycles":1564569856}
I20260811 16:05:51.860747 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.861258 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.861974 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:51.858623 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.863335 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.863658 13820 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:51.866640 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:51.878170 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:51.878196 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.879313 13904 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:51.880834 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:51.883558 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:51.884459 13820 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260811 16:05:51.884966 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 199803us
I20260811 16:05:51.868040 13827 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:51.847651 19721 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.886879 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:51.887261 13686 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet a48002159c1643c489d152b863d3d839
I20260811 16:05:51.862859 19081 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:51.847307 19746 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:51.893738 13907 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:05:51.894515 13823 pending_rounds.cc:76] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 4
I20260811 16:05:51.896472 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:51.902446 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.906508 13823 pending_rounds.cc:97] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260811 16:05:51.906996 13823 raft_consensus.cc:2866] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:51.909008 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:51.892843 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet a48002159c1643c489d152b863d3d839
I20260811 16:05:51.847249 19522 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.053s
I20260811 16:05:51.885003 19714 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.862684 19506 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260811 16:05:51.923115 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:51.971102 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61613.4us
W20260811 16:05:51.979852 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57245.1us
I20260811 16:05:51.980612 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:51.986889 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:51.994344 13907 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260811 16:05:51.898227 19081 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:51.913219 19028 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:51.914536 19746 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:51.973843 19670 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:51.931939 19183 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.917232 19302 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:51.972985 19793 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:52.083020 19667 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 7 FOLLOWER]: Advancing to term 8
I20260811 16:05:52.075212 19535 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:52.083541 19081 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:52.035778 19584 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:51.932713 19770 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.267s
I20260811 16:05:51.898391 19721 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.036861 19759 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:52.077560 19798 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:52.078519 19583 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.002s
W20260811 16:05:52.255685 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 410866us
W20260811 16:05:52.263022 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 426131us
I20260811 16:05:52.271092 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 961) took 1144 ms. Trace:
W20260811 16:05:52.272318 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2402) took 2170 ms (client timeout 2088 ms). Trace:
W20260811 16:05:52.374269 13909 rpcz_store.cc:269] 0811 16:05:50.101808 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:50.179503 (+ 77695us) service_pool.cc:227] Handling call
0811 16:05:52.272081 (+2092578us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400320d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:52.272228 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3795590528}
W20260811 16:05:52.273247 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 411665us
I20260811 16:05:52.373903 13818 rpcz_store.cc:276] 0811 16:05:51.127090 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.127246 (+   156us) service_pool.cc:227] Handling call
0811 16:05:52.270876 (+1143630us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400380ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:52.271024 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":515998976}
I20260811 16:05:52.083824 19769 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:52.295964 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 461407us
I20260811 16:05:52.378531 13871 leader_election.cc:398] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:52.378852 13871 leader_election.cc:401] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260811 16:05:52.299638 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 312863us
I20260811 16:05:52.036072 19714 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.216681 19120 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:52.203392 19670 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:52.393107 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:52.299260 19586 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:52.379634 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:52.399626 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:51.900023 19668 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.146104 19028 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.395272 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:52.384289 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:52.374097 19694 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
W20260811 16:05:52.299106 19494 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260811 16:05:52.406594 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:52.432119 19797 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.560s	user 0.001s	sys 0.000s
I20260811 16:05:52.441742 14573 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:05:52.397409 19670 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:52.446188 19010 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.004s
I20260811 16:05:52.366860 19584 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.446681 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:52.447759 19630 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.446696 19010 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.395105 19745 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:52.454169 19694 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.460932 19745 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.397265 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:52.241292 19183 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.240942 19793 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.436688 19028 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.450470 19010 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.451792 19494 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:52.452189 19582 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:52.453068 19815 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:52.397126 19120 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.433427 14577 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
I20260811 16:05:52.457932 19630 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:05:52.567026 14583 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.036s	sys 0.025s
W20260811 16:05:52.567778 14583 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.037s	sys 0.025s
I20260811 16:05:52.302876 19535 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:52.499961 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.022s	sys 0.073s
W20260811 16:05:52.571599 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.031s	sys 0.075s
I20260811 16:05:52.471355 19770 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:52.506235 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:52.397759 19695 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
I20260811 16:05:52.385673 19522 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:52.531210 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 156315us
I20260811 16:05:52.517213 19668 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:52.463678 19694 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:52.458835 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52373.1us
I20260811 16:05:52.432771 19586 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:52.464038 19561 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:52.434983 19794 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
W20260811 16:05:52.458918 19755 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.309s	user 0.013s	sys 0.010s
I20260811 16:05:52.576833 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:52.578377 19772 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260811 16:05:52.376370 19583 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.468505 19746 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:52.473335 19556 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.003s
I20260811 16:05:52.580202 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:52.571120 19809 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:52.582806 19535 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.583452 14573 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:52.584461 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.575980 19808 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:52.567819 19717 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.001s
I20260811 16:05:52.529655 19582 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:52.610618 19758 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.884s	user 0.005s	sys 0.006s
W20260811 16:05:52.618029 19683 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.000s	sys 0.007s
I20260811 16:05:52.545989 19010 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:52.650434 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.010s
W20260811 16:05:52.584053 19780 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260811 16:05:52.600081 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:52.583900 19690 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260811 16:05:52.611907 13827 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:52.585464 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.594044 19584 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:52.659636 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74291.6us
I20260811 16:05:52.660502 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:52.660660 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 894) took 2288 ms. Trace:
I20260811 16:05:52.661914 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.661116 13902 rpcz_store.cc:276] 0811 16:05:50.369581 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:50.373443 (+  3862us) service_pool.cc:227] Handling call
0811 16:05:50.393857 (+ 20414us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:50.429866 (+ 36009us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:50.429894 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:50.819743 (+389849us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:50.820175 (+   432us) log.cc:842] Serialized 26 byte log entry
0811 16:05:50.927888 (+107713us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:50.928516 (+   628us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:50.928591 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:52.458280 (+1529689us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:52.658199 (+199919us) raft_consensus.cc:1671] finished
0811 16:05:52.658223 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:52.658373 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35624,"raft.queue_time_us":36335,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":129815040,"thread_start_us":107382,"threads_started":1,"wal-append.queue_time_us":277566}
W20260811 16:05:52.614522 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 234070us
I20260811 16:05:52.663039 19493 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.577061 19770 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:52.669960 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:52.598192 19799 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
I20260811 16:05:52.382579 19769 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.589215 19807 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:52.463093 19745 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.388387 19798 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.196s
W20260811 16:05:52.650782 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.001s	sys 0.010s
I20260811 16:05:52.601404 19695 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.593178 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:52.654268 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54285.2us
W20260811 16:05:52.605261 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.003s	sys 0.004s
W20260811 16:05:52.719533 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.004s	sys 0.004s
I20260811 16:05:52.719471 13826 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
W20260811 16:05:52.650333 19683 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.002s	sys 0.008s
I20260811 16:05:52.668475 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:52.615942 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:52.652491 19661 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.002s
I20260811 16:05:52.648964 19582 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:52.672461 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.674649 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.728180 19794 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:52.728467 13907 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
W20260811 16:05:52.727924 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55552.9us
I20260811 16:05:52.710397 19584 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:05:52.706599 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 307065us
I20260811 16:05:52.654718 19717 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:52.665783 19694 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election won for term 9
I20260811 16:05:52.711831 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:52.712234 13827 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:52.677858 19712 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260811 16:05:52.755957 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 140094us
W20260811 16:05:52.716295 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 640696us
I20260811 16:05:52.673103 19454 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:52.594655 19586 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:52.675351 19746 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:52.672226 19817 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:52.720574 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:52.723484 19120 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:52.724421 14580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1141) took 1907 ms (client timeout 1551 ms). Trace:
I20260811 16:05:52.724699 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:52.729297 19566 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.730084 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.584697 19522 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:52.793704 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63739.7us
I20260811 16:05:52.794771 19522 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.715101 19807 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.795346 19630 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:52.795951 19522 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:52.796957 19807 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.797637 19183 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.797959 19833 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:52.679414 19813 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:52.799474 19813 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.801424 19695 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.801685 19813 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.771814 19694 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:52.803951 19670 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.804243 19694 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:51.900707 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:52.711851 19558 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:05:52.751983 13822 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:52.767274 14582 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:52.767696 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:52.708810 19554 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
W20260811 16:05:52.772409 14580 rpcz_store.cc:269] 0811 16:05:50.816712 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:50.828651 (+ 11939us) service_pool.cc:227] Handling call
0811 16:05:52.724155 (+1895504us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:52.724341 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":139158400}
I20260811 16:05:52.629333 19808 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.834923 19432 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:52.836876 19808 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.837205 19697 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:52.772437 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51988.4us
I20260811 16:05:52.824753 13827 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:52.748106 19761 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260811 16:05:52.778576 19819 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:05:52.766649 19454 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:52.747610 19661 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.782760 19793 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.785908 19759 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:52.747709 19584 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:52.769140 19583 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:52.787019 19786 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.064s	user 0.000s	sys 0.011s
I20260811 16:05:52.866251 19584 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.5, Last appended by leader: 5, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.788297 19769 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.867535 19584 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:52.789695 13906 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:52.868626 19661 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.824193 19558 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:52.869742 19558 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.628052 19809 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.871244 19558 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:52.606696 19561 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.774343 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:52.830992 19794 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:52.824761 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:52.876602 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51976us
I20260811 16:05:52.808575 19081 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.826006 19582 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:52.798964 19833 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:05:52.832342 19785 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.009s	user 0.012s	sys 0.000s
I20260811 16:05:52.841091 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:52.841485 13907 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260811 16:05:52.841710 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.769879 19688 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:52.895356 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:52.896238 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2753) took 1002 ms. Trace:
I20260811 16:05:52.897454 13906 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:52.748517 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:52.776060 19771 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.960s	user 0.010s	sys 0.002s
I20260811 16:05:52.780090 19673 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:52.856169 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:52.809106 19712 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:52.857383 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.855176 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:52.872887 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 152903us
I20260811 16:05:52.903053 13908 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:52.815465 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.872380 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1145) took 1038 ms. Trace:
I20260811 16:05:52.902892 13902 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:52.903818 14583 rpcz_store.cc:276] 0811 16:05:51.834112 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.834631 (+   519us) service_pool.cc:227] Handling call
0811 16:05:51.834980 (+   349us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:51.848010 (+ 13030us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:51.848046 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:51.848464 (+   418us) log.cc:842] Serialized 26 byte log entry
0811 16:05:52.568678 (+720214us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:52.568760 (+    82us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:52.568863 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:52.872133 (+303270us) raft_consensus.cc:1671] finished
0811 16:05:52.872162 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:52.872319 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12604,"raft.queue_time_us":13313,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6331,"thread_start_us":676570,"threads_started":1,"wal-append.queue_time_us":751653}
I20260811 16:05:52.858119 19454 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:52.881362 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55737.8us
W20260811 16:05:52.883713 19597 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.000s	sys 0.021s
I20260811 16:05:52.908697 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:52.899070 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150687us
I20260811 16:05:52.900331 13822 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:52.873901 14581 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
W20260811 16:05:52.906172 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 90840.4us
I20260811 16:05:52.909322 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:52.911372 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:52.913087 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58058.8us
I20260811 16:05:52.914348 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.914976 13900 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:52.915355 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:52.895627 19769 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:52.879848 19833 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:52.917573 13907 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260811 16:05:52.919646 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:52.893800 19630 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:52.892338 19835 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:05:52.916900 19597 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.000s	sys 0.021s
I20260811 16:05:52.922161 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.893604 19785 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.906546 19759 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:52.923748 19081 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.923841 19832 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:52.920246 19583 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:52.920528 19717 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:52.928655 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.929828 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.948989 13903 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:52.917404 19686 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:05:52.932138 19688 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:52.933085 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.902592 19712 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:52.935410 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.730865 19770 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.912065 19506 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:52.918223 19794 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:52.944445 19661 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:52.947227 13904 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260811 16:05:52.959208 19667 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.006s
I20260811 16:05:52.950655 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:52.937004 19670 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.955823 19688 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:52.961129 19712 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:52.940001 19809 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.946012 19583 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:52.946341 19832 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:52.983626 19582 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.985049 19714 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:52.976293 19661 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.987394 19561 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.978556 19688 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:52.988524 19661 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.976533 19667 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260811 16:05:52.981900 19583 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:52.905882 19771 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.945832 19808 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:52.950392 19686 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:52.988402 19721 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.989926 19832 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:53.000010 19686 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:52.945621 19833 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.003793 19687 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:53.005051 19785 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:52.973212 19835 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260811 16:05:53.012184 19835 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:53.012110 19688 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.012763 19771 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.012809 19835 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:53.014662 19688 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.014110 19835 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.015693 19835 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:53.002235 19808 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.018435 19808 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:52.934018 13822 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:52.968165 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:52.958756 13901 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260811 16:05:53.067929 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 99736.2us
I20260811 16:05:53.076283 13737 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:52.969673 19506 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:52.960655 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.080475 19506 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.081135 13907 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:05:53.066562 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:53.082722 13826 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:52.999475 19586 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.099866 19667 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:53.102109 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 184229us
I20260811 16:05:53.104379 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:53.105546 19618 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:53.006402 19687 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:53.081530 19506 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:53.109942 19205 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260811 16:05:53.110522 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 186495us
I20260811 16:05:53.110798 19687 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.112287 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:53.114447 19687 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:53.139914 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:53.141034 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45571.7us
I20260811 16:05:53.141433 19809 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.142588 19809 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.143249 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:53.145231 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.146076 19809 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.110734 19205 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:53.159219 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47484.1us
I20260811 16:05:53.167047 19824 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.167371 14583 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:53.167948 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.168442 19597 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:53.168015 19824 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.169040 14577 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:53.169512 19544 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.170372 19544 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.153815 19205 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:53.168992 19597 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.174358 19597 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:53.174583 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.174993 14581 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:53.175653 14578 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:53.180359 19544 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.171303 19714 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.181592 19714 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.183285 19807 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.184419 19807 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.190548 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:53.191860 19807 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.192070 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.193503 13907 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:53.194880 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.195669 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2065) took 2069 ms. Trace:
I20260811 16:05:53.195942 13907 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:53.196285 13741 rpcz_store.cc:276] 0811 16:05:51.102953 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.103379 (+   426us) service_pool.cc:227] Handling call
0811 16:05:51.293974 (+190595us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:51.294344 (+   370us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:51.294371 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:51.294794 (+   423us) log.cc:842] Serialized 26 byte log entry
0811 16:05:51.444064 (+149270us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:51.444107 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:51.444180 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:51.552233 (+108053us) raft_consensus.cc:1671] finished
0811 16:05:51.552254 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.170821 (+1618567us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540004ef50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.172280 (+  1459us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4323,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":397818752,"thread_start_us":148509,"threads_started":1,"wal-append.queue_time_us":254330,"wal-append.run_cpu_time_us":1627,"wal-append.run_wall_time_us":1001660}
I20260811 16:05:53.200879 19807 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.185228 19714 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.210880 19714 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.212816 13743 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:53.213292 13743 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:53.214282 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:53.215688 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2076) took 2106 ms (client timeout 2099 ms). Trace:
I20260811 16:05:53.216519 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.216907 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:53.217397 14578 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:53.218001 13822 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:53.218806 19769 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:53.218973 19767 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:05:53.220880 19813 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:53.221398 19813 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:53.216248 13744 rpcz_store.cc:269] 0811 16:05:51.109471 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.274367 (+164896us) service_pool.cc:227] Handling call
0811 16:05:53.215233 (+1940866us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002774d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.215415 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":357944192}
I20260811 16:05:53.221879 19813 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:53.214685 13743 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.201845 19807 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.211164 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2083) took 2079 ms. Trace:
I20260811 16:05:53.154002 19809 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.171108 19824 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.234925 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:53.235515 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.236544 14583 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:52.896610 13823 rpcz_store.cc:276] 0811 16:05:51.893644 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.893807 (+   163us) service_pool.cc:227] Handling call
0811 16:05:51.894254 (+   447us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:51.915124 (+ 20870us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:51.915202 (+    78us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:51.916271 (+  1069us) log.cc:842] Serialized 52 byte log entry
0811 16:05:52.285825 (+369554us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:52.286566 (+   741us) log.cc:842] Serialized 14 byte log entry
0811 16:05:52.722676 (+436110us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b18001aaca0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:05:52.876287 (+153611us) log.cc:842] Serialized 14 byte log entry
0811 16:05:52.876502 (+   215us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:52.876571 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:52.895972 (+ 19401us) raft_consensus.cc:1671] finished
0811 16:05:52.895995 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:52.896175 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":151414,"prepare.queue_time_us":51541,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":114218,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":65863,"spinlock_wait_cycles":13204480,"thread_start_us":739572,"threads_started":3,"wal-append.queue_time_us":442446}
I20260811 16:05:53.222553 19690 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:53.239368 13743 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:53.239557 19690 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:53.241098 19690 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.243289 19586 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.235025 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.246953 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.247614 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.248642 13741 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260811 16:05:53.249361 13741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2355) took 1326 ms (client timeout 1641 ms). Trace:
W20260811 16:05:53.249965 13741 rpcz_store.cc:269] 0811 16:05:51.922989 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.200401 (+1277412us) service_pool.cc:227] Handling call
0811 16:05:53.249235 (+ 48834us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.231490 14577 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:53.238922 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:53.251271 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87040.1us
I20260811 16:05:53.211971 19714 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.260637 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:53.243043 19690 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:53.262190 13823 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:53.235002 19183 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:53.258932 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:53.287024 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.287266 19712 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.288465 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2085) took 1436 ms. Trace:
I20260811 16:05:53.288935 13741 rpcz_store.cc:276] 0811 16:05:51.852407 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.253807 (+1401400us) service_pool.cc:227] Handling call
0811 16:05:53.288382 (+ 34575us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.290190 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.290500 19712 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:53.291755 13902 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:53.230868 13735 rpcz_store.cc:276] 0811 16:05:51.131741 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.301713 (+169972us) service_pool.cc:227] Handling call
0811 16:05:51.302067 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:51.303970 (+  1903us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:51.398695 (+ 94725us) log.cc:842] Serialized 14 byte log entry
0811 16:05:51.558586 (+159891us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:51.558633 (+    47us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:51.558695 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.210628 (+1651933us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b54000a8cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:53.210704 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.210946 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":68026,"prepare.queue_time_us":94956,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":51760,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":17103,"spinlock_wait_cycles":28075008,"thread_start_us":201400,"threads_started":2,"wal-append.queue_time_us":304219}
I20260811 16:05:53.293329 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.293704 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.298110 19824 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:53.300083 13735 raft_consensus.cc:2362] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11. Re-sending same reply.
I20260811 16:05:53.274554 19183 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:53.304003 19586 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:53.310205 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.312491 13744 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:53.319108 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:53.326690 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59540.4us
I20260811 16:05:53.320806 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:53.311403 19844 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260811 16:05:53.330006 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1053) took 1460 ms (client timeout 1945 ms). Trace:
I20260811 16:05:53.318347 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:53.333202 13744 rpcz_store.cc:269] 0811 16:05:51.856842 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.232246 (+1375404us) service_pool.cc:227] Handling call
0811 16:05:53.316969 (+ 84723us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.336018 13827 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
W20260811 16:05:53.337352 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 164452us
I20260811 16:05:53.303746 19824 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.309435 19586 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:53.344008 19782 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.344686 19782 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.320065 19183 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.357190 19807 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:53.339078 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:53.350075 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:53.364444 19554 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:53.364904 19554 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:53.365023 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:53.366084 13827 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:53.371230 19183 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:53.374516 19108 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.304292 19809 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.365298 19554 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:53.415444 19824 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.416380 19717 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:53.417166 19717 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.418300 19824 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.420472 19717 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.342195 13826 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:53.430012 19844 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:53.430852 19844 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.433041 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.354108 19794 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:53.434017 13741 raft_consensus.cc:2362] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13. Re-sending same reply.
I20260811 16:05:53.349474 19686 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.434252 13739 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:53.438542 13739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2087) took 1584 ms (client timeout 1861 ms). Trace:
I20260811 16:05:53.347049 19205 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:53.439086 13739 rpcz_store.cc:269] 0811 16:05:51.853907 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.899018 (+ 45111us) service_pool.cc:227] Handling call
0811 16:05:53.438273 (+1539255us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.438477 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3504180608}
I20260811 16:05:53.436702 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:53.443966 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 109163us
I20260811 16:05:53.411373 19108 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:53.447964 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61169.2us
I20260811 16:05:53.436964 19686 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.447853 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:53.450539 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.454639 13735 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:53.353849 19430 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:53.424077 19673 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.517s	user 0.016s	sys 0.004s
I20260811 16:05:53.459474 14581 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260811 16:05:53.459892 13738 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:53.465049 19583 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.438885 19697 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.467198 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.467427 19430 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.468180 14580 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:53.467738 19697 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.468832 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.469890 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.470610 19430 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:53.471911 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2338) took 1925 ms (client timeout 2088 ms). Trace:
I20260811 16:05:53.472165 13900 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:53.472992 19583 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.472952 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.473198 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.474589 19108 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.467224 19714 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.476392 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:53.476527 19454 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.010s
W20260811 16:05:53.477572 19558 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.014s
I20260811 16:05:53.477365 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.478253 19586 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.478458 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:53.479781 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 227581us
I20260811 16:05:53.480142 19794 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:53.530789 14581 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:53.478274 13741 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:05:53.483256 19205 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.488224 19832 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.488812 19809 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.489077 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1562) took 1640 ms. Trace:
I20260811 16:05:53.489583 19671 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.490188 19572 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.490643 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2081) took 2359 ms. Trace:
W20260811 16:05:53.491823 13817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 969) took 2361 ms (client timeout 2215 ms). Trace:
I20260811 16:05:53.495869 13738 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:53.497874 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1158) took 1054 ms. Trace:
W20260811 16:05:53.499601 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 195117us
I20260811 16:05:53.500530 13743 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260811 16:05:53.554632 13743 pending_rounds.cc:76] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 7
I20260811 16:05:53.555015 13743 pending_rounds.cc:97] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260811 16:05:53.555361 13743 raft_consensus.cc:2866] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:53.555792 13743 pending_rounds.cc:97] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260811 16:05:53.556028 13743 raft_consensus.cc:2866] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:53.556819 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2073) took 2448 ms. Trace:
I20260811 16:05:53.557121 13743 rpcz_store.cc:276] 0811 16:05:51.108327 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.293496 (+185169us) service_pool.cc:227] Handling call
0811 16:05:51.293743 (+   247us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.212531 (+1918788us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003a3020. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190e300 00007f5c5190f371 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc
0811 16:05:53.556538 (+344007us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.556765 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":321175936}
I20260811 16:05:53.557741 19832 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.558337 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.503237 13744 raft_consensus.cc:2362] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13. Re-sending same reply.
I20260811 16:05:53.444833 19844 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.352419 19597 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.559783 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.560720 13744 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:53.560158 19572 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.561357 19597 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:53.502476 13742 rpcz_store.cc:269] 0811 16:05:51.546573 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.554187 (+  7614us) service_pool.cc:227] Handling call
0811 16:05:53.471512 (+1917325us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.471734 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17841536}
W20260811 16:05:53.507254 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57735.8us
I20260811 16:05:53.562505 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.562799 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:53.563402 19568 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.563673 19558 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:53.564066 19568 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.563433 13742 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:53.554342 14573 rpcz_store.cc:276] 0811 16:05:52.443722 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:52.446345 (+  2623us) service_pool.cc:227] Handling call
0811 16:05:53.497405 (+1051060us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.497684 (+   279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":312049408}
I20260811 16:05:53.568053 13743 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:53.524468 19687 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:53.537386 19586 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:53.537469 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:53.538513 19454 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.541539 19304 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:05:53.561568 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.550715 13740 rpcz_store.cc:276] 0811 16:05:51.131095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.296486 (+165391us) service_pool.cc:227] Handling call
0811 16:05:51.309852 (+ 13366us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:51.311666 (+  1814us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.490249 (+2178583us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54002792d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.490449 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30114560}
I20260811 16:05:53.549736 14582 rpcz_store.cc:276] 0811 16:05:51.848671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.848891 (+   220us) service_pool.cc:227] Handling call
0811 16:05:51.849200 (+   309us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:52.837931 (+988731us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.488435 (+650504us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b5400437bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:53.488820 (+   385us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2110772992}
I20260811 16:05:53.572516 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.572916 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.573338 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.530967 19794 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:53.585551 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:53.551906 13817 rpcz_store.cc:269] 0811 16:05:51.129933 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.131354 (+  1421us) service_pool.cc:227] Handling call
0811 16:05:53.491304 (+2359950us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400219654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.491557 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":586929920}
I20260811 16:05:53.470633 19697 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.588106 14574 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:53.588718 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:53.565565 19671 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:53.602077 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64772.2us
I20260811 16:05:53.602818 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.570906 19572 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.604074 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.589072 19794 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:53.609992 13741 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:53.608292 13743 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
W20260811 16:05:53.612567 19508 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260811 16:05:53.597307 19813 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.613315 13742 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:53.614439 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.615768 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.616966 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.617679 13742 raft_consensus.cc:2362] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14. Re-sending same reply.
I20260811 16:05:53.618080 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2085) took 1380 ms. Trace:
I20260811 16:05:53.619450 19717 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:53.619865 13905 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:53.620136 19717 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.620611 19717 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:53.621750 13744 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:53.623734 13736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1031) took 2422 ms (client timeout 2950 ms). Trace:
I20260811 16:05:53.623970 19714 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:53.624253 13736 rpcz_store.cc:269] 0811 16:05:51.201403 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.278805 (+ 77402us) service_pool.cc:227] Handling call
0811 16:05:53.623217 (+2344412us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.623502 (+   285us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1056815360}
I20260811 16:05:53.624701 19714 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.625818 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.628065 19108 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:53.628548 19108 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.629014 19712 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:53.629527 19712 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:53.629897 19712 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:53.630256 19558 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.630793 19558 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:53.632200 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 964) took 2503 ms (client timeout 1627 ms). Trace:
W20260811 16:05:53.632676 13821 rpcz_store.cc:269] 0811 16:05:51.128194 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.128331 (+   137us) service_pool.cc:227] Handling call
0811 16:05:53.631779 (+2503448us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400355054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.631992 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1470017920}
I20260811 16:05:53.633885 19833 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:53.632027 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.618672 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.640854 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.641608 19671 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.618487 13820 rpcz_store.cc:276] 0811 16:05:52.237652 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:52.237822 (+   170us) service_pool.cc:227] Handling call
0811 16:05:52.238168 (+   346us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:52.714763 (+476595us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:52.714797 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:52.714838 (+    41us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:52.714865 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.617629 (+902764us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400174154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:53.617714 (+    85us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.617898 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1095626624}
I20260811 16:05:53.628575 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:05:53.661823 19835 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.646s	user 0.012s	sys 0.005s
I20260811 16:05:53.666216 14578 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:53.668704 13908 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:53.641647 19568 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.670224 14542 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:53.670663 19568 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.675343 19454 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:53.674892 19568 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.676419 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:53.677260 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:53.678216 13820 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:53.678769 19568 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.679471 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:53.679769 19572 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.680590 19832 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:05:53.681075 19855 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:05:53.643217 19558 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.629033 19108 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:53.666505 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.671990 19661 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.672241 19683 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:53.672883 19673 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:53.673111 19782 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:53.671171 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70023.7us
I20260811 16:05:53.679948 19055 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260811 16:05:53.699829 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62494.7us
I20260811 16:05:53.705513 13739 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:53.710861 13743 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:05:53.701656 19568 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:53.713455 19683 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:53.714293 19131 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.714716 19683 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.713994 19568 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.714977 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.722896 13742 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:53.723619 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2339) took 2176 ms. Trace:
I20260811 16:05:53.723932 13742 rpcz_store.cc:276] 0811 16:05:51.546888 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.618316 (+2071428us) service_pool.cc:227] Handling call
0811 16:05:53.723559 (+105243us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.722275 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.728958 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.731205 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.746809 13817 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:53.712163 19813 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.717602 19618 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.748836 13744 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:53.748162 19714 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.759610 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.760383 19661 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.747494 19782 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:53.807556 19782 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:53.808825 19782 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.812628 19661 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:53.813189 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1054) took 1955 ms (client timeout 1622 ms). Trace:
I20260811 16:05:53.813990 19680 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.814867 19680 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:53.816920 19810 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.439s	user 0.001s	sys 0.003s
I20260811 16:05:53.817950 19680 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.818852 19618 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.819736 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2084) took 1962 ms. Trace:
I20260811 16:05:53.820113 13825 rpcz_store.cc:276] 0811 16:05:51.857624 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.859887 (+  2263us) service_pool.cc:227] Handling call
0811 16:05:51.860177 (+   290us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:51.872260 (+ 12083us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:51.872316 (+    56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:51.882247 (+  9931us) log.cc:842] Serialized 26 byte log entry
0811 16:05:52.025135 (+142888us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:52.025198 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:52.025308 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:53.815969 (+1790661us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:53.819238 (+  3269us) raft_consensus.cc:1671] finished
0811 16:05:53.819260 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.819561 (+   301us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2215,"raft.queue_time_us":2377,"spinlock_wait_cycles":33301120,"thread_start_us":111523,"threads_started":1,"wal-append.queue_time_us":307747}
I20260811 16:05:53.822783 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2089) took 1369 ms. Trace:
I20260811 16:05:53.825312 13817 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:53.885447 13741 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:53.786192 13739 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:53.767602 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 980) took 1302 ms. Trace:
I20260811 16:05:53.787055 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.789829 14574 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:53.886422 13820 rpcz_store.cc:276] 0811 16:05:52.445327 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.679038 (+1233711us) service_pool.cc:227] Handling call
0811 16:05:53.716853 (+ 37815us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.747695 (+ 30842us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.747738 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:53.747784 (+    46us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:53.747820 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.747892 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.748018 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:53.793887 19690 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.002s
I20260811 16:05:53.763516 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:53.797408 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.714905 19131 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.804994 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.805154 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.826128 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 981) took 1346 ms. Trace:
I20260811 16:05:53.893460 13822 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260811 16:05:53.814266 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2352) took 2004 ms (client timeout 1834 ms). Trace:
I20260811 16:05:53.828413 19763 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.829035 13907 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:53.829759 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 931) took 1162 ms. Trace:
I20260811 16:05:53.831274 19568 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:53.831959 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 203502us
I20260811 16:05:53.836164 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.714322 19673 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.841741 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:53.843611 19778 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 2.120s	user 0.005s	sys 0.017s
I20260811 16:05:53.844355 19770 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:53.894336 13737 rpcz_store.cc:269] 0811 16:05:51.809671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.812912 (+  3241us) service_pool.cc:227] Handling call
0811 16:05:53.814007 (+2001095us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000a82d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.814190 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2863004544}
W20260811 16:05:53.865347 19760 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.428s	user 0.007s	sys 0.044s
W20260811 16:05:53.905061 19760 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.632s	user 0.007s	sys 0.045s
I20260811 16:05:53.905261 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.876889 14578 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260811 16:05:53.907338 13901 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:53.907435 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:53.908249 19584 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.013s
I20260811 16:05:53.741956 19572 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.881107 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.894732 13909 rpcz_store.cc:276] 0811 16:05:52.667621 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:52.667745 (+   124us) service_pool.cc:227] Handling call
0811 16:05:52.668059 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:52.899354 (+231295us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:05:52.920452 (+ 21098us) log.cc:842] Serialized 14 byte log entry
0811 16:05:53.423806 (+503354us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b180024a120. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:05:53.642471 (+218665us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:53.668179 (+ 25708us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:05:53.668281 (+   102us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.829350 (+161069us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400301e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:53.829403 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.829553 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4327,"prepare.queue_time_us":20949,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":4762,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":547825792,"thread_start_us":157088,"threads_started":1,"wal-append.queue_time_us":872423}
W20260811 16:05:53.813802 13738 rpcz_store.cc:269] 0811 16:05:51.857387 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.866387 (+  9000us) service_pool.cc:227] Handling call
0811 16:05:53.812847 (+1946460us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002783d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:53.813072 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3646723840}
I20260811 16:05:53.912268 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:53.914436 13738 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:53.891237 19618 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.916534 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2347) took 2197 ms. Trace:
I20260811 16:05:53.918151 19763 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.918903 19763 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:53.921201 19763 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.917440 19618 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:53.908397 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:53.715015 19803 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:53.893323 13818 rpcz_store.cc:276] 0811 16:05:52.480017 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.825055 (+1345038us) service_pool.cc:227] Handling call
0811 16:05:53.825454 (+   399us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.825651 (+   197us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.825678 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:53.825747 (+    69us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:53.825801 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.825859 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.825961 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.823092 13825 rpcz_store.cc:276] 0811 16:05:52.453454 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.821807 (+1368353us) service_pool.cc:227] Handling call
0811 16:05:53.822218 (+   411us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.822454 (+   236us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.822477 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:53.822532 (+    55us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:53.822559 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.822606 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.822710 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.890565 19717 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:53.786015 19687 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:53.903025 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:53.908208 13737 raft_consensus.cc:2362] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15. Re-sending same reply.
I20260811 16:05:53.879313 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.910789 19572 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.884846 13743 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:05:53.931170 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1048) took 2386 ms. Trace:
I20260811 16:05:53.931677 13743 rpcz_store.cc:276] 0811 16:05:51.544281 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.777235 (+2232954us) service_pool.cc:227] Handling call
0811 16:05:53.884383 (+107148us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.930810 (+ 46427us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.931032 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.917557 13738 rpcz_store.cc:276] 0811 16:05:51.718590 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.913712 (+2195122us) service_pool.cc:227] Handling call
0811 16:05:53.914162 (+   450us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.915753 (+  1591us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.916301 (+   548us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.934173 13737 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:53.934594 13818 raft_consensus.cc:1203] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-14.9]   Dedup: 12.8->[14.9-14.9]
I20260811 16:05:53.935232 13818 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260811 16:05:53.932829 13825 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:53.934265 13738 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:05:53.935111 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2349) took 2143 ms. Trace:
I20260811 16:05:53.916754 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:53.926411 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:53.895646 19183 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.006s
I20260811 16:05:53.906844 19131 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.948607 13737 rpcz_store.cc:276] 0811 16:05:51.791755 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.929234 (+2137479us) service_pool.cc:227] Handling call
0811 16:05:53.933998 (+  4764us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.934754 (+   756us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.935011 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1408}
I20260811 16:05:53.930047 13741 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:53.971300 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2088) took 2094 ms. Trace:
I20260811 16:05:53.971833 13738 rpcz_store.cc:276] 0811 16:05:51.854830 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.933506 (+2078676us) service_pool.cc:227] Handling call
0811 16:05:53.933911 (+   405us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.948477 (+ 14566us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.948730 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.914840 19673 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:53.985092 13738 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
W20260811 16:05:53.985366 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 246894us
I20260811 16:05:53.986107 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2360) took 1221 ms. Trace:
I20260811 16:05:53.985162 13820 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:53.984524 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:53.986552 13738 rpcz_store.cc:276] 0811 16:05:52.765026 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.972821 (+1207795us) service_pool.cc:227] Handling call
0811 16:05:53.984844 (+ 12023us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.985701 (+   857us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.986040 (+   339us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:53.974005 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:53.992982 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:53.993289 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.995530 13738 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260811 16:05:53.997300 13741 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:53.995729 19717 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:53.998165 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2357) took 1235 ms. Trace:
I20260811 16:05:54.000079 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:53.998582 13741 rpcz_store.cc:276] 0811 16:05:52.763194 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.961657 (+1198463us) service_pool.cc:227] Handling call
0811 16:05:53.997073 (+ 35416us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.997855 (+   782us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.998069 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.006915 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2335) took 2444 ms. Trace:
I20260811 16:05:53.970542 13740 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 8.
I20260811 16:05:54.007455 13744 rpcz_store.cc:276] 0811 16:05:51.545734 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.902485 (+2356751us) service_pool.cc:227] Handling call
0811 16:05:53.951027 (+ 48542us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:53.976089 (+ 25062us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.976139 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:53.989521 (+ 13382us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:05:53.989587 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.989675 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.989842 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.008456 13743 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260811 16:05:54.009840 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2334) took 2464 ms. Trace:
I20260811 16:05:54.009697 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.010322 13739 rpcz_store.cc:276] 0811 16:05:51.545463 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.886266 (+2340803us) service_pool.cc:227] Handling call
0811 16:05:53.981382 (+ 95116us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.009444 (+ 28062us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:54.009469 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:54.009511 (+    42us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:54.009538 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.009589 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.009771 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.011813 13739 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:54.015746 13739 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:54.019572 13742 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260811 16:05:54.020519 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2340) took 2473 ms. Trace:
I20260811 16:05:54.020925 13742 rpcz_store.cc:276] 0811 16:05:51.553724 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.901325 (+2347601us) service_pool.cc:227] Handling call
0811 16:05:53.978451 (+ 77126us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:54.020135 (+ 41684us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.020445 (+   310us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.027580 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.015085 19438 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:54.033474 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.036566 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2342) took 2458 ms. Trace:
I20260811 16:05:54.037174 13740 rpcz_store.cc:276] 0811 16:05:51.573332 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.725208 (+2151876us) service_pool.cc:227] Handling call
0811 16:05:54.031382 (+306174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.035523 19438 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.044768 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.052999 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:53.980989 19687 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.061098 14581 raft_consensus.cc:2354] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:54.057236 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.079567 13820 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:54.016054 19618 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.018216 19794 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.048561 19438 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:54.091049 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.093923 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.087211 14574 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:54.085736 13740 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260811 16:05:54.095666 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.097177 19685 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.097481 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.097718 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.098019 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1146) took 2102 ms. Trace:
I20260811 16:05:54.044994 19712 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:54.099802 19857 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260811 16:05:54.116168 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 978) took 1728 ms. Trace:
I20260811 16:05:54.114500 14579 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:54.101794 19671 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:54.104157 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2353) took 2294 ms. Trace:
I20260811 16:05:54.116984 13744 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260811 16:05:54.119423 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 97063.2us
I20260811 16:05:54.126096 13743 rpcz_store.cc:276] 0811 16:05:51.809954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.932684 (+2122730us) service_pool.cc:227] Handling call
0811 16:05:54.008112 (+ 75428us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.008793 (+   681us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.103751 (+ 94958us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b540011d850. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:54.104069 (+   318us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":172594944}
I20260811 16:05:54.128090 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.140153 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.113042 19760 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:54.148933 13736 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.522s	user 0.015s	sys 0.000s
I20260811 16:05:54.151577 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.149395 13736 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:05:54.152629 13901 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:54.152559 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2343) took 2578 ms. Trace:
I20260811 16:05:54.153347 13736 rpcz_store.cc:276] 0811 16:05:51.573862 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.625345 (+2051483us) service_pool.cc:227] Handling call
0811 16:05:54.152494 (+527149us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.120365 13827 rpcz_store.cc:276] 0811 16:05:52.381479 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.366804 (+985325us) service_pool.cc:227] Handling call
0811 16:05:53.447911 (+ 81107us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:53.588627 (+140716us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.588665 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:53.703794 (+115129us) log.cc:842] Serialized 52 byte log entry
0811 16:05:53.899911 (+196117us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:53.945994 (+ 46083us) log.cc:842] Serialized 14 byte log entry
0811 16:05:53.946409 (+   415us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.946486 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:54.109847 (+163361us) raft_consensus.cc:1671] finished
0811 16:05:54.109885 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.110108 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27572,"prepare.queue_time_us":87217,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":60,"raft.queue_time_us":32798,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":12238,"thread_start_us":149892,"threads_started":1,"wal-append.queue_time_us":265361}
I20260811 16:05:54.114305 14575 rpcz_store.cc:276] 0811 16:05:51.834468 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.834605 (+   137us) service_pool.cc:227] Handling call
0811 16:05:51.835416 (+   811us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:53.464336 (+1628920us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b1800472600. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51904f6b 00007f5c5190f78b
0811 16:05:53.464606 (+   270us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.464635 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:53.465357 (+   722us) log.cc:842] Serialized 52 byte log entry
0811 16:05:53.611532 (+146175us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:53.611560 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.710369 (+ 98809us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:53.895971 (+185602us) raft_consensus.cc:1671] finished
0811 16:05:53.895997 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:53.937234 (+ 41237us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35657,"raft.queue_time_us":78770,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":50000,"spinlock_wait_cycles":144445056,"thread_start_us":237066,"threads_started":2,"wal-append.queue_time_us":249934}
I20260811 16:05:54.136469 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.156788 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.125984 19671 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:54.162639 13736 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:54.165436 13737 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260811 16:05:54.160807 14582 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:54.171880 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.147976 19686 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:54.176743 13906 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
W20260811 16:05:54.174836 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 89996.3us
I20260811 16:05:54.157377 19673 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:54.180843 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.181012 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.188532 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:54.190145 14582 raft_consensus.cc:2396] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260811 16:05:54.198136 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:54.200513 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72559us
I20260811 16:05:54.202158 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.200839 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.205346 13901 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:54.205691 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.159827 19108 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.210280 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 979) took 1765 ms. Trace:
I20260811 16:05:54.219744 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.183038 19673 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:54.224604 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:54.143867 19685 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.231524 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.231835 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:54.247749 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.171545 19760 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.264271 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:54.268373 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.266762 13906 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:54.260713 13740 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:54.252065 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:54.266289 19685 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.252089 13823 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:54.273989 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2099) took 1127 ms. Trace:
W20260811 16:05:54.288484 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48471.3us
I20260811 16:05:54.222396 13821 rpcz_store.cc:276] 0811 16:05:52.444609 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.633699 (+1189090us) service_pool.cc:227] Handling call
0811 16:05:53.634245 (+   546us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:53.634896 (+   651us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.634930 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:53.662966 (+ 28036us) log.cc:842] Serialized 26 byte log entry
0811 16:05:53.900319 (+237353us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:05:54.141094 (+240775us) log.cc:842] Serialized 14 byte log entry
0811 16:05:54.141558 (+   464us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.141692 (+   134us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:54.209998 (+ 68306us) raft_consensus.cc:1671] finished
0811 16:05:54.210030 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.210187 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45481,"prepare.queue_time_us":92142,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":614,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":6566,"thread_start_us":377788,"threads_started":2,"wal-append.queue_time_us":382647}
I20260811 16:05:54.282811 13738 rpcz_store.cc:276] 0811 16:05:53.140469 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.996988 (+856519us) service_pool.cc:227] Handling call
0811 16:05:53.997350 (+   362us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:53.998416 (+  1066us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:53.998449 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:53.999030 (+   581us) log.cc:842] Serialized 26 byte log entry
0811 16:05:54.183639 (+184609us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:54.183702 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.183800 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:54.267849 (+ 84049us) raft_consensus.cc:1671] finished
0811 16:05:54.267876 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.268037 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":377,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":139,"thread_start_us":184013,"threads_started":1,"wal-append.queue_time_us":266012}
I20260811 16:05:54.267459 19657 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.315124 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:54.269304 19618 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.252586 19687 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.303627 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2093) took 1597 ms. Trace:
I20260811 16:05:54.322171 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.322271 13817 rpcz_store.cc:276] 0811 16:05:52.706585 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.895685 (+1189100us) service_pool.cc:227] Handling call
0811 16:05:53.951827 (+ 56142us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.112684 (+160857us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:54.112718 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:54.112762 (+    44us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:54.112790 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.303324 (+190534us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:54.303397 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.303564 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":359353600}
I20260811 16:05:54.267488 19712 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.264680 19436 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.329635 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2088) took 1947 ms. Trace:
I20260811 16:05:54.332334 13738 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:54.323027 13740 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
W20260811 16:05:54.314159 19864 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260811 16:05:54.293051 19717 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.330320 13826 rpcz_store.cc:276] 0811 16:05:52.381881 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.421845 (+1039964us) service_pool.cc:227] Handling call
0811 16:05:53.422482 (+   637us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:53.427562 (+  5080us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:05:53.460403 (+ 32841us) log.cc:842] Serialized 14 byte log entry
0811 16:05:53.639498 (+179095us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:53.701636 (+ 62138us) log.cc:842] Serialized 26 byte log entry
0811 16:05:53.701813 (+   177us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:53.701860 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.701937 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:54.329340 (+627403us) raft_consensus.cc:1671] finished
0811 16:05:54.329376 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.329553 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40770,"prepare.queue_time_us":16330,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":41827,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":15717,"thread_start_us":137702,"threads_started":1,"wal-append.queue_time_us":244983}
I20260811 16:05:54.344816 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.341650 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.317070 19686 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:54.320694 19794 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:54.324968 19845 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260811 16:05:54.364264 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 144885us
I20260811 16:05:54.365250 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.239395 19671 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.369812 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.358397 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.372089 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:54.373615 13738 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 10: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:54.355834 19554 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.008s
I20260811 16:05:54.372892 13741 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
W20260811 16:05:54.378813 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 174074us
I20260811 16:05:54.321085 19813 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.390482 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:37762 (request call id 828) took 1027 ms. Trace:
I20260811 16:05:54.395639 13743 rpcz_store.cc:276] 0811 16:05:53.359250 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:54.169343 (+810093us) service_pool.cc:227] Handling call
0811 16:05:54.386036 (+216693us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:54.345501 19183 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.376868 19686 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.358407 19586 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260811 16:05:54.332652 19657 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.407109 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:54.362996 19717 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.329797 19673 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:54.414080 19833 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.779s	user 0.016s	sys 0.002s
I20260811 16:05:54.381650 19436 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.429525 19436 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.419353 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2092) took 1763 ms. Trace:
I20260811 16:05:54.401217 19695 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:05:54.439260 13739 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260811 16:05:54.439185 13823 rpcz_store.cc:276] 0811 16:05:52.656329 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.834836 (+1178507us) service_pool.cc:227] Handling call
0811 16:05:53.835276 (+   440us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.278712 (+443436us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.418964 (+140252us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54002db4d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:54.419268 (+   304us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":940779904}
I20260811 16:05:54.399883 19813 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:54.443128 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77974.9us
I20260811 16:05:54.444088 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:54.385728 19554 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:54.446693 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58459.3us
W20260811 16:05:54.443370 19874 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260811 16:05:54.449851 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:54.411545 19108 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.404510 19686 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.468605 19717 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.468817 19686 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.405506 19183 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.470523 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.470716 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:54.471199 19183 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:54.478006 19880 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260811 16:05:54.480388 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 92159.9us
I20260811 16:05:54.474485 14583 raft_consensus.cc:2354] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:54.447461 19673 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:54.482784 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:54.458252 19803 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:54.456593 19782 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260811 16:05:54.490247 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46238.6us
I20260811 16:05:54.463392 19690 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:54.505790 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2354) took 2572 ms. Trace:
I20260811 16:05:54.506347 13737 rpcz_store.cc:276] 0811 16:05:51.922667 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.960664 (+2037997us) service_pool.cc:227] Handling call
0811 16:05:54.154101 (+193437us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.165841 (+ 11740us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.490251 (+324410us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400104ad0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:54.495118 (+  4867us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":362096384}
I20260811 16:05:54.490597 19586 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:05:54.521641 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50993.1us
W20260811 16:05:54.522149 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51722.8us
I20260811 16:05:54.495736 19782 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:54.505805 19712 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:54.506867 19690 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.514911 19833 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.550148 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2336) took 3004 ms. Trace:
I20260811 16:05:54.506695 19760 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.551038 13735 rpcz_store.cc:276] 0811 16:05:51.546032 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.901955 (+2355923us) service_pool.cc:227] Handling call
0811 16:05:54.015849 (+113894us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:54.037932 (+ 22083us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:54.037962 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:05:54.054276 (+ 16314us) log.cc:842] Serialized 52 byte log entry
0811 16:05:54.227509 (+173233us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:54.227546 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.227626 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:54.549870 (+322244us) raft_consensus.cc:1671] finished
0811 16:05:54.549903 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.550086 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1099,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7996,"thread_start_us":119399,"threads_started":1,"wal-append.queue_time_us":384313}
I20260811 16:05:54.526757 19586 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:54.566079 19586 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:54.514950 19803 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:54.521733 19183 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:54.542163 19712 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:54.551440 19690 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:54.547360 19782 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:54.582604 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:54.584414 13871 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.589437 19712 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:05:54.596174 19875 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260811 16:05:54.568212 19835 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260811 16:05:54.559989 19833 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:54.618835 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77823us
I20260811 16:05:54.620654 13909 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:54.623579 14573 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:54.626701 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 75334.4us
I20260811 16:05:54.630713 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:54.616544 19813 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:54.633733 19873 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.251s	user 0.000s	sys 0.003s
W20260811 16:05:54.642525 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88430.8us
I20260811 16:05:54.644333 19690 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.646888 19690 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.624912 19794 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:54.621759 19554 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.626122 19436 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:54.642328 19183 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:54.656430 19794 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:54.674188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43550us
I20260811 16:05:54.670528 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.665668 19183 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:54.670917 19794 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:54.678220 19183 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:54.732026 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54773.5us
I20260811 16:05:54.735745 13818 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:54.736584 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:54.661832 19803 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.743256 19657 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.677435 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:54.746173 13735 raft_consensus.cc:595] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:54.726117 19685 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:54.726758 19835 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:54.760159 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:54.678799 19436 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260811 16:05:54.766441 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:54.771884 13818 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:54.758247 19760 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.759821 19657 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260811 16:05:54.782341 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 215013us
I20260811 16:05:54.794065 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1152) took 1326 ms. Trace:
I20260811 16:05:54.795953 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1063) took 1089 ms. Trace:
I20260811 16:05:54.796382 13739 rpcz_store.cc:276] 0811 16:05:53.706573 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:54.058229 (+351656us) service_pool.cc:227] Handling call
0811 16:05:54.084427 (+ 26198us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.439916 (+355489us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.793959 (+354043us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400277ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:54.795889 (+  1930us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":799536512}
I20260811 16:05:54.797552 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1565) took 1036 ms. Trace:
I20260811 16:05:54.797842 14573 rpcz_store.cc:276] 0811 16:05:53.760865 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.789287 (+ 28422us) service_pool.cc:227] Handling call
0811 16:05:53.813437 (+ 24150us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:54.629005 (+815568us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:54.794238 (+165233us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54007152d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:54.797477 (+  3239us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1857517440}
I20260811 16:05:54.766937 19685 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:54.800168 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.803768 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:54.804690 13818 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:54.795526 14583 rpcz_store.cc:276] 0811 16:05:53.467756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:53.468520 (+   764us) service_pool.cc:227] Handling call
0811 16:05:54.793842 (+1325322us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:54.793998 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2308818176}
I20260811 16:05:54.775537 19770 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.783365 19833 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.775283 19763 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:54.821435 19686 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.814083 19131 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:54.804631 19760 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.828569 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:54.774518 19690 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260811 16:05:54.833326 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 158485us
I20260811 16:05:54.838507 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:54.839869 13739 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:54.840469 13739 raft_consensus.cc:603] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:54.776448 19835 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.811278 19845 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260811 16:05:54.808089 19813 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260811 16:05:54.855891 19845 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:54.814844 19825 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260811 16:05:54.815630 19770 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.862362 19685 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.862812 19825 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:54.865770 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:54.851763 19673 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:54.851225 19131 consensus_queue.cc:1225] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260811 16:05:54.863317 19868 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.642s	user 0.000s	sys 0.004s
I20260811 16:05:54.856441 19845 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:54.837507 19686 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.876268 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:54.857220 19683 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:54.877735 13739 raft_consensus.cc:595] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:54.878328 13739 raft_consensus.cc:603] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:54.846467 19763 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.869807 19825 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:54.889827 13826 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260811 16:05:54.891209 19108 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:54.891644 19108 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:54.892474 19108 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.894059 19108 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:54.894372 19833 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:54.895399 19687 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:54.895864 19687 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:54.896556 13823 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:54.896751 19687 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.898218 19687 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:54.894873 19782 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:54.900226 19671 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:54.901311 19782 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:54.894901 19833 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:54.904627 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45867.2us
I20260811 16:05:54.873986 19436 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:54.909049 19833 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.919907 13818 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:05:54.921674 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:54.922737 13739 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:54.923270 13739 raft_consensus.cc:603] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:05:54.928287 19863 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.804s	user 0.000s	sys 0.010s
I20260811 16:05:54.929966 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2071) took 3397 ms. Trace:
W20260811 16:05:54.912999 19438 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.004s
I20260811 16:05:54.875404 19673 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.932464 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:54.932864 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 196387us
I20260811 16:05:54.945962 19760 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:54.947839 13743 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:54.948560 13743 raft_consensus.cc:595] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:54.948947 13743 raft_consensus.cc:603] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:54.930459 13824 rpcz_store.cc:276] 0811 16:05:51.532008 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:51.532211 (+   203us) service_pool.cc:227] Handling call
0811 16:05:51.532548 (+   337us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:51.551234 (+ 18686us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:51.551524 (+   290us) log.cc:842] Serialized 14 byte log entry
0811 16:05:53.623487 (+2071963us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b180037ace0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b
0811 16:05:53.625237 (+  1750us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:53.626049 (+   812us) log.cc:842] Serialized 26 byte log entry
0811 16:05:53.790558 (+164509us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:53.790653 (+    95us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:53.801352 (+ 10699us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:54.849266 (+1047914us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:54.929482 (+ 80216us) raft_consensus.cc:1671] finished
0811 16:05:54.929519 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:54.929733 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58671,"prepare.queue_time_us":356,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4853,"raft.queue_time_us":17693,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":6744,"spinlock_wait_cycles":24676864,"thread_start_us":165850,"threads_started":2,"wal-append.queue_time_us":543964,"wal-append.run_cpu_time_us":1465,"wal-append.run_wall_time_us":1083108}
W20260811 16:05:54.954020 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 142162us
I20260811 16:05:54.954530 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:54.958243 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:54.958505 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:54.903815 19683 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.959043 14580 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:54.969610 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:54.977340 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:54.951756 19833 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:54.972584 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:05:54.982327 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:54.935431 19438 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:54.983886 19835 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:54.998665 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:54.999215 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:54.999523 13737 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 8.
I20260811 16:05:54.969383 19378 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260811 16:05:55.007110 19378 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:55.007565 19378 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:55.007982 19378 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.012063 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:55.017693 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 158797us
I20260811 16:05:55.019433 13824 raft_consensus.cc:2396] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260811 16:05:54.985363 19055 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:55.026969 14541 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:55.038534 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:55.040705 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86307.8us
I20260811 16:05:55.041893 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:54.971477 19695 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260811 16:05:54.962008 19586 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:54.991991 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.548s (SENT) [suppressed 20 similar messages]
I20260811 16:05:54.996810 19886 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:55.028911 19055 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:54.951388 19825 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.058820 13818 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:55.065894 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:54.958113 19845 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.028656 19554 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:55.028887 19770 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.056994 19886 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:55.082996 19586 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.085558 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:55.068198 19055 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.094450 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.065189 19887 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:55.097173 14583 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:55.097887 19438 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.098667 19438 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:55.099313 19438 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:55.100519 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:55.099557 13626 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 11 to 12, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 12 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.100319 19438 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.101459 19889 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260811 16:05:55.103876 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 145660us
I20260811 16:05:55.073948 19763 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.109139 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:55.088793 19686 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.108096 19887 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:55.144084 19887 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:55.108278 19825 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:55.125329 19763 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:05:55.124526 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.089748 19554 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.095943 19845 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.133597 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.149544 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.150575 13820 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:55.151615 19712 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.000s
I20260811 16:05:55.152113 19712 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.135818 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.153441 13817 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:55.154596 19712 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.136445 19683 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:55.114308 19108 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:55.155239 19763 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:55.155593 19108 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:55.155797 19763 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:55.156102 19108 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:55.156776 19378 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.139609 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.165920 13823 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:55.166337 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46942.3us
W20260811 16:05:55.121997 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80247us
I20260811 16:05:55.095821 19673 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.090917 19886 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:55.134608 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.167843 13827 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260811 16:05:55.120796 19889 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260811 16:05:55.149789 13826 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:55.134516 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:55.137619 19885 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260811 16:05:55.161221 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.141794 19183 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.247062 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.248409 19378 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.249104 19183 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:55.172951 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 85045.9us
I20260811 16:05:55.173311 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.176142 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.253257 19763 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:55.254127 19794 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260811 16:05:55.255474 13737 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:05:55.240070 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.242482 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:55.246274 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:55.243914 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74769.3us
I20260811 16:05:55.161252 19554 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.257505 14578 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:55.268983 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.249104 13824 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:55.273790 13827 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:55.275439 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:55.278941 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 154515us
I20260811 16:05:55.275070 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.284760 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:55.285566 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 293619us
I20260811 16:05:55.282869 13735 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:55.254725 19794 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.292023 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.293372 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.297902 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.298288 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.298972 13827 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:55.256356 19896 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:55.268502 19183 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:55.274782 19687 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.315400 13818 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260811 16:05:55.315876 19687 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.297518 13626 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 6 to 8, leader changed from <none> to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 8 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.317322 19899 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.318068 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.317910 19899 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.317780 13626 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 8 to 10, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:05:55.318902 13824 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:55.293129 19686 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.322072 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:55.322762 14573 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:55.299961 19690 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:05:55.312136 13627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 327) took 46114 ms (client timeout 15000 ms). Trace:
I20260811 16:05:55.312372 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:55.312865 19813 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:55.313469 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:55.306222 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:55.336936 13626 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 10, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.340363 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.299016 19782 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.346920 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.348826 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.351346 19782 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.353006 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.354601 13735 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:55.354493 13827 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:55.360605 13743 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:55.365746 13738 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:55.334535 19763 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.368287 13824 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:55.320706 19686 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:55.373253 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 60954.5us
I20260811 16:05:55.378437 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.376353 13626 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:05:55.388113 14544 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.215s (SENT)
I20260811 16:05:55.388903 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.349759 19436 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:55.348032 19378 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:55.358731 19687 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.394757 13626 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 10, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 10 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.395397 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.397918 19803 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260811 16:05:55.378439 19899 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.364158 19690 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.343048 19183 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:55.415432 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 112857us
I20260811 16:05:55.406201 13818 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:55.396018 19794 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.429909 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.432720 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.434998 13824 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:55.434309 13626 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 6 to 8, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 8 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.417287 19657 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.407414 19378 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:55.392781 19554 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260811 16:05:55.326923 13627 rpcz_store.cc:269] 0811 16:05:09.230320 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:09.252145 (+ 21825us) service_pool.cc:227] Handling call
0811 16:05:55.311841 (+46059696us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:05:47.738034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:05:47.738738 (+   704us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:05:47.738804 (+    66us) write_op.cc:435] Acquired schema lock
0811 16:05:47.738822 (+    18us) tablet.cc:660] Decoding operations
0811 16:05:47.740064 (+  1242us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:05:47.740161 (+    97us) write_op.cc:641] Partition lock acquired for write op
0811 16:05:47.740210 (+    49us) tablet.cc:683] Acquiring locks for 12 operations
0811 16:05:47.780467 (+ 40257us) tablet.cc:699] Row locks acquired
0811 16:05:47.819087 (+ 38620us) write_op.cc:260] PREPARE: finished
0811 16:05:47.869585 (+ 50498us) write_op.cc:270] Start()
0811 16:05:47.921983 (+ 52398us) write_op.cc:276] Timestamp: P: 1786464347850410 usec, L: 0
0811 16:05:47.949365 (+ 27382us) op_driver.cc:331] REPLICATION: starting
0811 16:05:47.950189 (+   824us) log.cc:842] Serialized 4794 byte log entry
0811 16:05:49.233511 (+1283322us) op_driver.cc:444] REPLICATION: finished
0811 16:05:49.662484 (+428973us) write_op.cc:301] APPLY: starting
0811 16:05:49.688232 (+ 25748us) tablet.cc:1365] starting BulkCheckPresence
0811 16:05:50.195405 (+507173us) tablet.cc:1368] finished BulkCheckPresence
0811 16:05:50.217282 (+ 21877us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:05:50.320148 (+102866us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:05:50.320509 (+   361us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0811 16:05:50.320582 (+    73us) write_op.cc:312] APPLY: finished
0811 16:05:50.320964 (+   382us) log.cc:842] Serialized 113 byte log entry
0811 16:05:50.394416 (+ 73452us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:50.418816 (+ 24400us) write_op.cc:454] Released schema lock
0811 16:05:50.447757 (+ 28941us) write_op.cc:341] FINISH: Updating metrics
0811 16:05:50.464543 (+ 16786us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:05:50.467056 (+  2513us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":117863,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":387338,"apply.run_cpu_time_us":37919,"apply.run_wall_time_us":833650,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54191,"num_ops":12,"prepare.queue_time_us":427300,"prepare.run_cpu_time_us":28746,"prepare.run_wall_time_us":482605,"raft.queue_time_us":229214,"raft.run_cpu_time_us":28372,"raft.run_wall_time_us":208046,"replication_time_us":1284028,"thread_start_us":832372,"threads_started":5,"wal-append.queue_time_us":498776,"wal-append.run_cpu_time_us":25458,"wal-append.run_wall_time_us":2841533}]]}
I20260811 16:05:55.468559 19378 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.439091 13626 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 2 to 9, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 9 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.472584 13787 leader_election.cc:398] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:55.473476 13787 leader_election.cc:401] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260811 16:05:55.479563 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:55.481262 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.452235 19900 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.481266 14573 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:05:55.439282 19687 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:05:55.486810 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97149.4us
I20260811 16:05:55.494966 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.497251 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:55.434983 19436 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260811 16:05:55.497442 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.499987 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:55.485919 19813 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:55.508212 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.491351 19835 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:05:55.469973 19108 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.576299 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 9, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 9 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.502995 19687 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:55.579643 19888 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:55.515553 19782 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.584651 19884 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:55.608408 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.587301 13827 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:05:55.477892 19887 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.494644 19825 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:55.502802 19763 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:55.590489 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 88242.7us
I20260811 16:05:55.517102 19671 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:05:55.601975 19687 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:55.626150 19687 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:55.587847 19833 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:55.630751 19833 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.633471 19833 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.601367 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.634260 13817 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:55.634326 13821 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:55.636782 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.637566 13823 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.639672 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.601372 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.603928 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:55.604677 13824 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:55.641034 13743 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:55.595820 19909 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260811 16:05:55.605579 13626 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.611572 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:55.592288 19586 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.643999 19586 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:55.604880 19891 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260811 16:05:55.650656 14578 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:55.615746 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.592329 19835 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:55.597482 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:55.594326 19055 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.622108 14580 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:55.665015 14577 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 8. Current term is 9. Ops: []
I20260811 16:05:55.622478 19763 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.623610 19671 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:55.615579 19884 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.624163 19686 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.625535 19108 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.605137 19673 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:55.644539 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:55.498217 19900 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.620273 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.685216 13739 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
W20260811 16:05:55.595923 19916 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260811 16:05:55.655001 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.658215 13823 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:55.680275 19919 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:55.669741 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72321.1us
W20260811 16:05:55.674407 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54471.5us
I20260811 16:05:55.697315 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:55.683025 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 304681us
I20260811 16:05:55.684434 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.685595 13626 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 8, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 8 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:05:55.684435 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.659511 13817 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:55.607728 19888 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.680816 19782 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:05:55.695119 14573 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.701009 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.701989 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.694038 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:55.696364 19845 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.005s
I20260811 16:05:55.684314 19685 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.709312 19108 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:55.732409 13902 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260811 16:05:55.733443 19886 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.711810 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.717424 13826 raft_consensus.cc:2354] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:55.737380 13626 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 4 to 9, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 9 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.733023 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.762768 13905 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:55.731735 19671 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.734920 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.621331 19825 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.716571 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.710785 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.786876 13903 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:55.710696 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.762920 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.765738 14581 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:55.774196 13743 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:55.788298 13817 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:55.788203 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:55.764586 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91160.1us
I20260811 16:05:55.776702 14583 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:55.676158 19833 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260811 16:05:55.789256 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:55.706274 19183 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.790236 13901 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:55.790820 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 75372us
I20260811 16:05:55.736114 19889 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:55.717250 19695 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:55.800359 13626 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.794628 13904 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 10. Current term is 11. Ops: []
W20260811 16:05:55.787613 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46190.4us
I20260811 16:05:55.719997 19782 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:55.793889 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.799522 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.799633 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.709112 19914 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.760010 19108 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:55.803020 13905 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:55.697894 19673 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.805150 13908 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:05:55.817577 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.819550 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:55.820772 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 176309us
I20260811 16:05:55.820901 13817 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260811 16:05:55.819614 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.823103 14573 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:55.825356 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.827705 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.828415 13901 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:55.821300 13817 pending_rounds.cc:76] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 11
I20260811 16:05:55.829506 13817 pending_rounds.cc:97] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260811 16:05:55.829897 13817 raft_consensus.cc:2866] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:55.796864 19907 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:55.831351 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:55.829210 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.832041 13905 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:55.831231 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:55.832860 13907 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:55.809214 19108 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:55.839010 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.806759 19782 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:55.834103 13826 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260811 16:05:55.832197 13903 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:55.708784 19919 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.835017 13626 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.839953 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.844952 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.774402 19685 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.849092 19508 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:55.852635 19673 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.851788 13626 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 5 to 6, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:05:55.739012 19835 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.805281 19436 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260811 16:05:55.868377 19888 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:55.817179 19794 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:55.870484 19794 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.871554 19919 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.872998 19794 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:55.873152 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47884.9us
I20260811 16:05:55.876032 19900 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.877099 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.862679 13822 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:55.865569 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.878916 19055 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.868261 19835 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:55.876982 19378 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:55.865694 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:55.884812 13826 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:55.887187 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48297.5us
I20260811 16:05:55.908087 19887 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:55.910406 19657 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:55.913055 19913 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:55.913578 19913 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:55.915485 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.917972 19886 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.922814 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.842381 19690 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:55.914449 19913 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.925616 19913 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:55.924885 13901 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260811 16:05:55.837770 19896 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260811 16:05:55.810935 19695 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:55.930032 19695 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:55.924893 13826 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:55.944085 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:05:55.946969 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72233.6us
I20260811 16:05:55.947209 13907 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:05:55.947460 13905 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:55.954567 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.880218 19438 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:55.955029 13909 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:55.958801 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:55.960738 13823 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
W20260811 16:05:55.961007 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 153305us
I20260811 16:05:55.964205 13822 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:55.930444 19687 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:55.968711 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 145687us
I20260811 16:05:55.970680 13821 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:55.970961 19929 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:05:55.971931 19929 consensus_queue.cc:1225] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:05:55.972736 19927 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:55.973109 19927 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:55.974035 19927 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.975502 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:55.832801 19914 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:55.978500 13817 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260811 16:05:55.980453 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.982569 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:55.999091 13900 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:55.987811 13874 leader_election.cc:398] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:55.995904 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.997936 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:55.998050 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:56.000996 13738 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:55.974480 19813 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:56.005100 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:55.999696 13874 leader_election.cc:401] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260811 16:05:56.001585 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61877.3us
I20260811 16:05:55.959967 19378 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:56.000939 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:56.009056 13739 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:56.009116 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:55.987668 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:55.999996 14583 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:55.956596 19673 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:56.011210 13736 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:56.009809 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 293276us
I20260811 16:05:55.997462 19436 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:56.013515 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.018020 14580 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:56.018317 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:55.984094 19690 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:55.984755 19055 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.014997 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:55.985018 19586 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.024294 13906 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:56.025063 14583 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:56.026417 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.026448 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.040297 14578 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:55.952915 19896 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260811 16:05:56.045451 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:56.034760 13738 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:56.037865 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.053830 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.079694 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.080713 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.082319 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.005230 19911 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:56.008563 19899 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:56.126209 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.126422 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:56.005484 19794 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:56.126981 13738 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:56.084452 19886 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:56.084296 19884 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:56.135749 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.088001 19907 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:56.111788 13818 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:56.029652 19686 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:56.043068 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:56.124079 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84264.3us
I20260811 16:05:56.088100 19687 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.124720 14578 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:56.043567 19825 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:56.041828 19055 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.140100 19907 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:56.156780 19907 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:56.157390 19055 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:56.158243 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.159165 14579 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:56.159288 19886 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.159538 19782 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.161839 19886 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:56.162106 19920 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.482s	user 0.004s	sys 0.000s
I20260811 16:05:56.125782 19911 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.127614 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:56.018218 19927 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:56.128470 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:56.128654 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.128970 14577 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260811 16:05:56.129204 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.164656 13736 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:56.127900 19794 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.042405 19712 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.133543 14580 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:56.092176 19918 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260811 16:05:56.097026 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.081218 19378 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:56.135277 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:56.141117 19934 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:56.141923 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.175529 13743 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:56.143298 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 155722us
I20260811 16:05:56.145649 19937 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:56.148566 19914 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:56.150775 19928 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260811 16:05:56.038208 19673 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.038724 19690 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.165661 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.129498 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.186473 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.167526 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:56.194147 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 151136us
I20260811 16:05:56.195305 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:56.150926 19438 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:05:56.166167 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 156847us
W20260811 16:05:56.163609 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1738859650213271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
I20260811 16:05:56.178673 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:56.181493 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.178267 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:56.183538 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48390us
I20260811 16:05:56.194415 13740 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:56.169894 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.206274 14580 raft_consensus.cc:2354] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:56.174077 19717 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.162099 19782 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:56.201318 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.204247 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:56.212208 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.212898 13737 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260811 16:05:56.214136 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.213819 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:56.150933 19108 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.218858 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:56.203852 19934 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:56.225904 13739 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
W20260811 16:05:56.230556 13789 connection.cc:232] RPC call timeout handler was delayed by -1.7993431109935045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260811 16:05:56.232319 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.213850 19889 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:56.243482 13737 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260811 16:05:56.220361 19436 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:56.220034 19687 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:56.258621 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.222494 19586 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:56.273190 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:56.260076 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:56.227173 19183 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:56.268750 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:56.224360 19438 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:56.263038 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.266247 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:56.266542 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 88403.9us
I20260811 16:05:56.267840 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:56.403228 13826 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:56.229652 19928 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:56.186944 19712 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.245827 19845 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:56.371666 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:56.432685 13907 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 13
I20260811 16:05:56.402501 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:05:56.374857 19911 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.277976 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:56.377437 19554 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
W20260811 16:05:56.377842 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 101621us
I20260811 16:05:56.248788 19685 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:56.260560 19782 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:56.387704 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76834.8us
I20260811 16:05:56.251091 19813 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.387884 13871 leader_election.cc:398] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:56.388803 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:56.432780 19508 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:56.391607 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:56.252507 19055 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:05:56.394622 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 121777us
I20260811 16:05:56.508821 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.225263 19717 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.432006 19845 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:56.192309 19937 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:56.438267 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160378us
I20260811 16:05:56.518446 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:56.279903 13900 raft_consensus.cc:2396] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260811 16:05:56.249531 19899 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260811 16:05:56.442865 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.309007 19889 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260811 16:05:56.389410 13822 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:56.308161 19687 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.307207 19803 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.159s
I20260811 16:05:56.403853 19438 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:56.309808 19900 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260811 16:05:56.436673 19928 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:05:56.468709 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 160665us
I20260811 16:05:56.469879 19947 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.252s
I20260811 16:05:56.471971 19690 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.471074 19949 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:56.475920 13737 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:56.529134 19813 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:56.529047 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 316922us
I20260811 16:05:56.531574 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:56.259631 19378 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.458913 19554 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:56.560518 19928 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:56.546768 19695 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:56.572599 19554 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.546916 19438 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:56.527630 19952 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260811 16:05:56.471335 19922 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:56.514400 19845 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:05:56.545197 19913 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.010s
I20260811 16:05:56.577368 19955 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:56.475844 19586 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:56.577823 19955 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:56.570966 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:56.449365 19958 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.131s
I20260811 16:05:56.579317 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:56.579622 19958 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:56.580101 19958 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:56.580422 19958 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:56.580744 19947 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:56.581122 19947 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:56.574302 19673 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:56.578290 19955 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:56.521993 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 248899us
I20260811 16:05:56.568120 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:56.459182 19782 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:56.609894 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3896985909668729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260811 16:05:56.610724 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:56.613564 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45529.6us
I20260811 16:05:56.620255 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:56.570240 19794 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.599023 19922 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:56.630604 14581 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:05:56.632237 19974 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:56.581911 19949 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.608896 19108 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:56.635522 19108 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:56.637136 19965 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:05:56.621501 19913 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:56.696197 19794 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.614988 19947 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.649827 19889 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Stepping down as leader of term 8
I20260811 16:05:56.716560 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.722033 13900 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
W20260811 16:05:56.750972 19957 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260811 16:05:56.699553 19794 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.715620 19889 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:56.755878 19945 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:56.756603 19945 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:56.757848 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:05:56.769289 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 149173us
I20260811 16:05:56.692975 19899 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:05:56.769459 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 237997us
I20260811 16:05:56.715989 19947 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:56.796182 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 185557us
I20260811 16:05:56.807367 13904 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:56.757833 19945 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.814000 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.718791 19911 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.815371 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2744) took 1076 ms. Trace:
I20260811 16:05:56.821023 13909 rpcz_store.cc:276] 0811 16:05:55.738839 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:55.800681 (+ 61842us) service_pool.cc:227] Handling call
0811 16:05:56.815170 (+1014489us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002acbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:56.815304 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":309413632}
W20260811 16:05:56.771010 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 191785us
I20260811 16:05:56.816944 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.817715 13907 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:56.716367 19913 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:56.829665 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:56.696851 19975 raft_consensus.cc:2741] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260811 16:05:56.834167 19695 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:05:56.835099 19911 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:56.835856 19907 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.679s	user 0.021s	sys 0.004s
I20260811 16:05:56.792404 19900 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.836122 19938 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.839005 19945 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:56.840091 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.840564 19712 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.841351 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:56.841786 19717 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.844655 13907 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:05:56.871544 13823 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:05:56.846426 13822 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:56.758235 19934 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:56.848498 13825 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:56.878412 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:56.879383 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:56.699498 19183 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:56.832991 13871 leader_election.cc:398] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:05:56.805120 19917 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
W20260811 16:05:56.853253 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 394314us
W20260811 16:05:56.854487 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 345737us
I20260811 16:05:56.855057 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.882752 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:56.843106 19835 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.953s	user 0.018s	sys 0.007s
I20260811 16:05:56.863485 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 997) took 1357 ms. Trace:
I20260811 16:05:56.867131 14578 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 12
I20260811 16:05:56.894661 13818 rpcz_store.cc:276] 0811 16:05:55.494914 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:55.496370 (+  1456us) service_pool.cc:227] Handling call
0811 16:05:56.852229 (+1355859us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:56.852384 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1149339392}
W20260811 16:05:56.887305 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54560.9us
W20260811 16:05:56.867002 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 424240us
I20260811 16:05:56.898840 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:56.898859 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:56.914718 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:56.918129 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.918924 13738 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260811 16:05:56.859333 19055 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:56.927707 13822 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:56.931043 13905 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:56.911532 19914 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:05:56.931123 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.900607 19687 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:56.949937 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:56.970379 14582 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.793s	user 0.014s	sys 0.006s
I20260811 16:05:56.964722 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.935702 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:56.938015 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:56.892694 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48293.8us
I20260811 16:05:56.972757 19949 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:56.974483 13900 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:05:56.975538 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:56.976058 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:56.977008 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.951713 14578 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:56.952440 19972 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:56.955417 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.872711 19975 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:56.960151 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:56.948650 19835 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:56.755899 19889 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.891448 19917 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:56.945039 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:56.867520 19907 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:56.914438 19436 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:56.968909 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:56.978618 13900 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:05:56.967589 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.970961 14582 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:56.983250 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:56.984737 13823 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:56.999986 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:56.931474 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:56.987505 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 75136.4us
I20260811 16:05:56.910805 19685 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:57.001291 14577 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260811 16:05:56.716174 19954 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.148s
I20260811 16:05:56.997740 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:56.866688 19900 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.989933 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:57.021306 13740 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:57.021749 13740 raft_consensus.cc:603] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:56.970499 19914 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:56.871356 19938 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.967711 19782 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.036029 19055 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:56.975303 19926 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260811 16:05:57.038101 19926 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:57.038486 19926 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:57.039426 19926 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.041329 19926 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:57.070766 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.059638 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.000753 14578 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:57.007395 19919 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:57.010840 19794 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.012224 19508 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:05:57.014043 13709 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.548s (SENT)
I20260811 16:05:57.001269 19763 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:57.016397 19686 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.003s
I20260811 16:05:57.001607 19685 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:57.017858 19687 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:57.017974 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:56.995589 19937 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.019863 19949 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:57.029798 13821 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:05:57.024740 19956 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260811 16:05:57.033217 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.020170 19961 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260811 16:05:57.034451 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2121) took 1053 ms. Trace:
I20260811 16:05:57.028837 19914 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:05:57.042191 19835 consensus_queue.cc:1159] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 12 status { last_received { term: 12 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 12 index: 12 } }
I20260811 16:05:56.991351 19975 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.003073 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.062438 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.051760 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:57.274638 13740 raft_consensus.cc:595] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:57.003883 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:56.988615 19972 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.108978 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.049793 19900 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:57.151896 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 159753us
I20260811 16:05:57.213183 19508 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:57.042948 19911 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.124720 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:57.298094 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.298869 13905 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:57.053754 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2381) took 1460 ms. Trace:
I20260811 16:05:57.047748 19813 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.116907 13741 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260811 16:05:57.109561 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77412us
I20260811 16:05:57.280987 19984 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.303373 19984 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:57.304540 19987 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260811 16:05:57.304802 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.305616 19984 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:57.141690 19927 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.974s	user 0.015s	sys 0.015s
I20260811 16:05:57.129530 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.046108 19907 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.109586 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.109779 13742 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:05:57.307803 13817 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:05:57.137845 13904 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:56.989835 19981 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:05:57.155490 13737 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.586s	user 0.018s	sys 0.005s
I20260811 16:05:57.029383 19717 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260811 16:05:57.309271 13737 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:05:57.309434 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:57.309839 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2391) took 1037 ms. Trace:
I20260811 16:05:57.310240 13737 rpcz_store.cc:276] 0811 16:05:56.272267 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.278457 (+  6190us) service_pool.cc:227] Handling call
0811 16:05:57.309778 (+1031321us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:57.311306 19717 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:05:57.311651 13743 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260811 16:05:57.311700 19717 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:57.312209 13743 pending_rounds.cc:76] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 5
I20260811 16:05:57.312539 13743 pending_rounds.cc:97] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260811 16:05:57.312822 13743 raft_consensus.cc:2866] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:05:57.312772 19717 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.313719 19954 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.314177 19954 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.314448 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2127) took 1323 ms. Trace:
I20260811 16:05:57.207788 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:57.314527 19717 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:57.317032 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.002648 19913 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.299661 13735 rpcz_store.cc:276] 0811 16:05:55.593086 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:55.593273 (+   187us) service_pool.cc:227] Handling call
0811 16:05:55.608007 (+ 14734us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:55.639715 (+ 31708us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:56.177260 (+537545us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b180024c400. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f
0811 16:05:56.177423 (+   163us) log.cc:842] Serialized 14 byte log entry
0811 16:05:56.401445 (+224022us) log.cc:842] Serialized 14 byte log entry
0811 16:05:56.401869 (+   424us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:56.401918 (+    49us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:56.401966 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.017479 (+615513us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b180024c400. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11
0811 16:05:57.053429 (+ 35950us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:57.053495 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:57.053669 (+   174us) inbound_call.cc:173] Queueing success response
0811 16:05:57.055652 (+  1983us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b180024c400. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
Metrics: {"mutex_wait_us":94235,"prepare.queue_time_us":120302,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":2123,"raft.queue_time_us":156019,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":67412,"spinlock_wait_cycles":156327424,"thread_start_us":148514,"threads_started":2,"wal-append.queue_time_us":209166}
I20260811 16:05:57.216514 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.218096 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.322041 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.322885 14583 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:05:57.323199 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 193799us
I20260811 16:05:57.324275 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.324785 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.316248 13743 rpcz_store.cc:276] 0811 16:05:55.990818 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.177001 (+186183us) service_pool.cc:227] Handling call
0811 16:05:56.177335 (+   334us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:57.313555 (+1136220us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.314176 (+   621us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001dc254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:57.314385 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2607845248}
I20260811 16:05:57.041067 19183 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.257408 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.262302 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.261933 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.262928 14580 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:57.257676 13822 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:57.270502 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.264245 13744 rpcz_store.cc:276] 0811 16:05:55.980890 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:55.986656 (+  5766us) service_pool.cc:227] Handling call
0811 16:05:56.006178 (+ 19522us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:56.090575 (+ 84397us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:56.139045 (+ 48470us) log.cc:842] Serialized 14 byte log entry
0811 16:05:56.562363 (+423318us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:57.016463 (+454100us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b2c0004cec8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:05:57.021319 (+  4856us) log.cc:842] Serialized 26 byte log entry
0811 16:05:57.021467 (+   148us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:57.021504 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.021583 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:57.025850 (+  4267us) raft_consensus.cc:1671] finished
0811 16:05:57.034136 (+  8286us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:57.034385 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":80196,"prepare.queue_time_us":48288,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":108150,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9301,"spinlock_wait_cycles":56160000,"thread_start_us":407232,"threads_started":2,"wal-append.queue_time_us":563304}
W20260811 16:05:57.270051 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 130198us
W20260811 16:05:57.333838 14544 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.875s (SENT)
I20260811 16:05:57.050097 19917 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.004717 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.275038 13740 raft_consensus.cc:603] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:57.225857 19685 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:57.277936 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:57.210942 19438 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.010s
W20260811 16:05:57.279419 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 276424us
I20260811 16:05:57.282866 19937 raft_consensus.cc:2741] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260811 16:05:57.279846 19946 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:57.279999 19671 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:05:57.253388 19949 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:57.261502 19687 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:57.049620 19938 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.227152 19686 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:57.285544 19972 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.287215 19975 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.292045 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.293876 19508 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:57.169802 19967 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260811 16:05:57.326002 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.218010 19690 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:57.437155 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 111258us
I20260811 16:05:57.437373 19508 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.337132 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:57.438025 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:57.438254 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 101203us
I20260811 16:05:57.338583 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.439354 19984 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:57.439487 13818 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:57.439777 19984 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.340811 13741 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:57.440526 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.440752 19378 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260811 16:05:57.340942 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 336248us
I20260811 16:05:57.441315 19436 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:05:57.441817 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.442981 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.353595 19813 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:57.438175 19945 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260811 16:05:57.443814 19813 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.444658 19712 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:05:57.445629 19966 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:05:57.437989 19794 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:57.446805 19972 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:57.447850 19686 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:57.318091 19954 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.358482 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.357409 19671 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:57.332638 19978 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:57.364538 19687 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:57.413789 19958 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.833s	user 0.018s	sys 0.004s
I20260811 16:05:57.357358 19961 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260811 16:05:57.354476 19907 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:57.333280 19657 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:57.436968 19690 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:57.469550 19955 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.845s	user 0.014s	sys 0.008s
I20260811 16:05:57.469839 19690 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.334429 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:57.470202 19955 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:57.471048 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 137243us
I20260811 16:05:57.447213 19972 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:57.451889 13904 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:57.472488 19888 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:57.472745 19972 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:57.473579 19586 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:05:57.452082 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 93703.5us
I20260811 16:05:57.474835 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:05:57.475409 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 471576us
I20260811 16:05:57.475895 19586 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:05:57.476300 19586 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.476657 19586 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:05:57.477804 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 463775us
I20260811 16:05:57.477955 19929 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:57.440140 19984 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:57.478468 13709 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.600s (SENT)
I20260811 16:05:57.478885 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.479488 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.480051 19671 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.481238 19671 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:05:57.482647 19673 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260811 16:05:57.483305 19833 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:57.483426 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.483974 19833 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.485361 19980 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:57.485908 19980 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:57.486754 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.487445 13740 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:57.487910 19977 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.488473 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:57.489259 13744 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:57.490736 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.491719 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.492025 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.492486 13735 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
W20260811 16:05:57.312544 19845 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.014s
I20260811 16:05:57.454803 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.456343 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:57.359925 19438 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.360409 19949 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:57.451278 13909 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:57.452378 19911 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:57.465471 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.463122 19958 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.457521 19686 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:57.470638 19813 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.333105 19884 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260811 16:05:57.488386 19977 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.515600 13826 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:57.515645 13903 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:57.516865 13901 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:57.494132 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:57.517606 19884 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:05:57.493571 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:57.518105 19884 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:57.517189 19690 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:57.505996 19928 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.933s	user 0.017s	sys 0.012s
I20260811 16:05:57.519380 19690 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:05:57.495358 19845 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.519459 19928 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.520447 14579 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:57.493813 19937 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:57.521293 13739 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:57.504069 19995 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260811 16:05:57.493053 19962 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:57.492652 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2131) took 1491 ms. Trace:
I20260811 16:05:57.486752 19980 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.493369 13743 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:57.525991 13743 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:57.526343 19911 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:57.526566 13743 raft_consensus.cc:603] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:57.508030 19979 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.419756 19917 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:57.527879 19979 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:57.494889 13709 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.648s (SENT)
I20260811 16:05:57.538081 19919 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.538803 19919 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:57.539924 19958 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.485126 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.543092 13738 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:57.543468 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88810.3us
I20260811 16:05:57.544889 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.519971 19690 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:05:57.550643 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55798.5us
I20260811 16:05:57.523638 13736 rpcz_store.cc:276] 0811 16:05:55.994697 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.216953 (+222256us) service_pool.cc:227] Handling call
0811 16:05:56.217319 (+   366us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:56.227015 (+  9696us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:56.227050 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:56.249824 (+ 22774us) log.cc:842] Serialized 26 byte log entry
0811 16:05:56.842996 (+593172us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800495e80. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:05:57.133837 (+290841us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:57.164549 (+ 30712us) log.cc:842] Serialized 14 byte log entry
0811 16:05:57.472668 (+308119us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800495e80. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:05:57.473360 (+   692us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.485427 (+ 12067us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:57.485480 (+    53us) raft_consensus.cc:1671] finished
0811 16:05:57.485497 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:57.485631 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7685,"prepare.queue_time_us":32394,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2497,"raft.queue_time_us":365131,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":68140,"spinlock_wait_cycles":41703040,"thread_start_us":290605,"threads_started":1,"wal-append.queue_time_us":1006061}
I20260811 16:05:57.559464 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.564520 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:57.572438 13744 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:57.570232 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.588430 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.591856 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:05:57.593415 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:57.594864 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101353us
I20260811 16:05:57.574504 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:57.597527 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141269us
I20260811 16:05:57.597087 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.597041 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.540868 19911 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.601014 13820 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 10: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:57.601457 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.472512 19955 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.610767 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.611575 13827 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:57.610416 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.611014 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:57.574246 19962 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:05:57.561029 19922 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.608644 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:57.574282 19934 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:57.612847 13824 raft_consensus.cc:2362] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13. Re-sending same reply.
I20260811 16:05:57.619290 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:57.586660 19813 raft_consensus.cc:2741] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260811 16:05:57.623814 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.548256 19690 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.5, Last appended by leader: 5, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.629722 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:57.604329 19436 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:57.643277 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.643349 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.634706 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.628116 13817 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:57.632795 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:57.643446 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.645887 13736 raft_consensus.cc:595] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:57.646040 13904 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:05:57.646278 13736 raft_consensus.cc:603] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:05:57.617306 20007 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260811 16:05:57.608507 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 141946us
I20260811 16:05:57.645298 13820 raft_consensus.cc:2362] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11. Re-sending same reply.
I20260811 16:05:57.588605 19958 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260811 16:05:57.648200 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:05:57.648639 13709 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.673s (SENT)
I20260811 16:05:57.643635 13827 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:57.649113 13818 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:57.660518 13709 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.744s (SENT)
I20260811 16:05:57.649216 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:57.653182 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:57.625180 19974 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.992s	user 0.008s	sys 0.020s
I20260811 16:05:57.661996 13824 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:57.662401 14578 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:57.662644 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.654031 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:57.663380 13709 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.826s (SENT)
I20260811 16:05:57.663964 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.649099 19436 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.651054 19845 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.664693 19436 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:57.664060 13709 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.654106 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.625948 19963 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:57.629590 19896 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.560829 19984 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:57.687769 14544 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.092s (SENT)
I20260811 16:05:57.688331 19928 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:57.688920 19984 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.670428 19963 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:57.689652 19963 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:57.689657 19896 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.692592 19896 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.668367 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.653002 19803 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:57.672223 13904 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:05:57.654826 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.657528 19929 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:57.674033 19926 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.553s	user 0.005s	sys 0.006s
I20260811 16:05:57.653162 19686 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:05:57.669334 19981 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:57.665679 20008 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.675428 19946 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:57.678913 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:05:57.629722 19922 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:57.681880 19899 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.001s
I20260811 16:05:57.682387 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.683468 19990 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260811 16:05:57.683588 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.667486 19977 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.685866 19436 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.821152 19436 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.672786 19974 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:57.688247 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:05:57.823009 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 135268us
W20260811 16:05:57.824111 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.225s (SENT)
I20260811 16:05:57.824587 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:57.825677 19926 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:57.667263 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:57.826531 19926 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:57.666677 13817 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:57.828223 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.829744 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.830806 13817 raft_consensus.cc:2396] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:05:57.574568 19438 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.652016 19911 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:57.835321 19899 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:57.836516 13907 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
W20260811 16:05:57.854640 19999 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
W20260811 16:05:57.694430 13709 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.950s (SENT)
I20260811 16:05:57.897998 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.612296 19685 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.696246 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.653509 19717 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election won for term 14
W20260811 16:05:57.709017 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54291.4us
I20260811 16:05:57.903245 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.714609 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:57.718405 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:57.593505 19884 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.727612 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:57.732496 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.795367 13739 raft_consensus.cc:595] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:05:57.699429 19813 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:57.696165 19937 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:57.706367 19803 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.916996 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.704615 20005 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:57.798779 13905 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:57.857141 19922 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.860723 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2129) took 1028 ms. Trace:
I20260811 16:05:57.929061 13826 rpcz_store.cc:276] 0811 16:05:56.832160 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.832366 (+   206us) service_pool.cc:227] Handling call
0811 16:05:56.839523 (+  7157us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:57.516161 (+676638us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.860371 (+344210us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:57.860636 (+   265us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1554379136}
I20260811 16:05:57.862954 19686 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.867363 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 968) took 1087 ms. Trace:
I20260811 16:05:57.934134 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.869249 19956 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:57.870213 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2122) took 1606 ms. Trace:
I20260811 16:05:57.872975 19889 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:57.873469 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.910974 19717 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:57.718676 19896 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:57.826754 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 159631us
I20260811 16:05:57.672305 13818 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:57.648345 19934 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.898090 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.653563 19962 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.901067 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.904654 13909 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:57.905366 13822 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:57.908452 13739 raft_consensus.cc:603] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:05:57.909112 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:57.907979 13735 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:05:57.892766 19974 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:57.912976 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
W20260811 16:05:57.972736 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 278301us
I20260811 16:05:57.972909 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:57.973376 13709 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.955s (SENT)
I20260811 16:05:57.973776 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:57.913878 13901 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:57.733145 19929 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:57.977952 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43906.2us
I20260811 16:05:57.919914 19937 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.921429 19966 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:05:57.923403 19803 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:05:57.984045 20004 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260811 16:05:57.984974 19972 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260811 16:05:57.972275 19974 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.985427 19972 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.985967 19974 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:57.987268 19763 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:05:57.987588 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:05:57.960134 19945 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260811 16:05:57.990311 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:05:57.924058 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:57.991652 13709 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.909s (SENT)
I20260811 16:05:57.924760 13904 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:05:57.917886 13736 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:05:57.927371 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.904222 19833 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.896168 19949 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.801189 20008 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:57.930451 20005 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:57.933013 13740 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:57.934419 13903 rpcz_store.cc:276] 0811 16:05:56.780392 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.780565 (+   173us) service_pool.cc:227] Handling call
0811 16:05:56.815444 (+ 34879us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:57.516850 (+701406us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.867106 (+350256us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:57.867298 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1609917824}
I20260811 16:05:58.003867 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:57.908977 19979 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:57.946676 13821 rpcz_store.cc:276] 0811 16:05:56.263473 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.265244 (+  1771us) service_pool.cc:227] Handling call
0811 16:05:56.265689 (+   445us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:57.253619 (+987930us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.869892 (+616273us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54002dc3d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:57.870124 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1756859776}
W20260811 16:05:57.874284 19947 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.030s	user 0.011s	sys 0.001s
I20260811 16:05:57.975570 19886 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:57.901376 19586 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.038852 13741 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:57.958638 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.959578 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:57.962726 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:05:57.934803 19914 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260811 16:05:57.965183 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:57.963323 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:57.965471 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:57.969002 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:58.043700 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80437.2us
I20260811 16:05:58.043699 13743 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260811 16:05:58.044469 13739 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:05:58.045563 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 80483.2us
I20260811 16:05:57.971457 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:57.948235 19686 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:57.912644 19913 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260811 16:05:57.972182 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.051945 13826 raft_consensus.cc:2362] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16. Re-sending same reply.
I20260811 16:05:57.916188 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.946055 19956 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:57.980906 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:57.946599 19977 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:57.967674 19922 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260811 16:05:57.993121 13709 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.082s (SENT)
I20260811 16:05:57.993844 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:57.999109 13820 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260811 16:05:58.001109 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1197) took 1075 ms. Trace:
I20260811 16:05:58.004704 13735 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:57.950985 13742 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:58.007781 20005 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.070653 13903 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:58.071856 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.072810 13818 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:05:58.011395 19937 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.012051 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.012194 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2438) took 1111 ms. Trace:
I20260811 16:05:58.012809 13902 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:58.013435 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.014187 13909 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:58.014868 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:58.015843 19972 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.020141 19685 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:57.970115 19946 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260811 16:05:58.061802 14581 rpcz_store.cc:276] 0811 16:05:56.925315 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.925588 (+   273us) service_pool.cc:227] Handling call
0811 16:05:56.959524 (+ 33936us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:57.051074 (+ 91550us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:57.051123 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:57.122992 (+ 71869us) log.cc:842] Serialized 26 byte log entry
0811 16:05:57.210857 (+ 87865us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:57.210898 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:57.293379 (+ 82481us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:57.293431 (+    52us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:57.853845 (+560414us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:05:58.000863 (+147018us) raft_consensus.cc:1671] finished
0811 16:05:58.000888 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:58.001048 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":468,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":3917,"spinlock_wait_cycles":215268352,"thread_start_us":76486,"threads_started":1,"wal-append.queue_time_us":207738}
I20260811 16:05:58.082403 13907 rpcz_store.cc:276] 0811 16:05:56.903045 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.917847 (+ 14802us) service_pool.cc:227] Handling call
0811 16:05:58.012014 (+1094167us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:58.012115 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1960339712}
I20260811 16:05:58.023131 19919 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.028648 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.031311 19934 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.031597 19803 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:57.979038 19962 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.103539 19803 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:58.033910 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 965) took 1345 ms. Trace:
I20260811 16:05:58.104373 13906 rpcz_store.cc:276] 0811 16:05:56.721522 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.745662 (+ 24140us) service_pool.cc:227] Handling call
0811 16:05:58.033707 (+1288045us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:58.033851 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1595187456}
I20260811 16:05:58.037062 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:57.969820 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.105891 19929 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:58.106292 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 136551us
I20260811 16:05:58.107532 19956 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.108965 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.109072 19956 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.046895 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:58.109848 19935 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:05:58.047585 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76185.4us
I20260811 16:05:58.110312 19935 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:58.110692 19935 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:58.111675 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.050359 19717 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.112358 19922 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:58.112814 19922 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:58.113168 19922 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:58.114120 19946 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:58.114687 19946 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:58.043038 19914 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.115495 19946 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.116901 19914 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:58.048290 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.014526 19963 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:58.117875 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 69682.8us
I20260811 16:05:58.118768 19963 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.119366 19963 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:05:58.119658 19979 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:05:58.119966 19963 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 16:05:58.120524 19907 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.003s
I20260811 16:05:58.120735 19897 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:05:58.085920 19687 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:58.121897 19897 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:05:58.122206 19992 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:58.122725 19897 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:58.122865 19992 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:58.122159 19935 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.052983 13817 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:58.041536 19886 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.056885 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.067355 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.087072 19436 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260811 16:05:58.083608 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 70247.2us
I20260811 16:05:58.022027 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:58.090019 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.052541 19955 raft_consensus.cc:2741] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260811 16:05:58.050523 19690 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:58.092824 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.050107 19657 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:58.050617 19899 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:58.060561 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:58.095894 13822 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:58.103597 20015 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260811 16:05:58.048460 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89891us
I20260811 16:05:58.166791 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.167454 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.086779 19975 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.170622 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.143851 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:58.171675 13742 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:58.158612 13826 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.048455 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:58.142803 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2440) took 1238 ms (client timeout 1621 ms). Trace:
W20260811 16:05:58.161433 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168334us
I20260811 16:05:58.176103 13825 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:58.176334 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.179391 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:58.174080 13902 rpcz_store.cc:269] 0811 16:05:56.903918 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:56.904301 (+   383us) service_pool.cc:227] Handling call
0811 16:05:58.142571 (+1238270us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:58.142719 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2405084416}
I20260811 16:05:58.178714 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.153645 13741 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:05:58.163774 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:58.156477 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.165450 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:58.183634 13906 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:58.095556 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:05:58.120994 19907 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:58.123621 19938 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:58.127578 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.195869 13827 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.188632 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:58.190305 13903 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:58.190912 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.197187 13744 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:58.182406 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.191715 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.185978 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.198693 13822 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.201452 13824 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:05:58.145157 19884 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:58.035125 19974 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.211237 19928 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260811 16:05:58.145655 19888 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:05:58.240191 19974 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.240562 19888 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:58.241636 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:58.241633 19888 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.242383 13901 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:58.140743 19961 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:58.171279 19929 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:58.202800 19972 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:58.206739 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.262910 13824 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:58.194319 19955 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:58.194515 19938 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:58.206977 19896 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:58.207257 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.208141 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.218094 14581 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:58.218448 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:58.216807 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:58.128225 19949 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.103613 19962 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.123101 19897 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:58.209236 19975 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.170419 19687 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260811 16:05:58.209496 19919 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:05:58.208318 19917 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.002s
I20260811 16:05:58.213465 19935 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:58.238446 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:58.340077 13740 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:05:58.203459 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 155086us
I20260811 16:05:58.341926 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.343307 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.252552 19899 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.273571 19183 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:58.211015 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:58.126713 20008 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:58.253906 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68017.1us
I20260811 16:05:58.351893 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.353646 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.256122 13738 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260811 16:05:58.195096 13821 raft_consensus.cc:2362] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13. Re-sending same reply.
I20260811 16:05:58.290535 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.292516 13825 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:05:58.356231 13906 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:58.294314 19938 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.204178 20014 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.297309 13739 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:58.376084 13906 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
W20260811 16:05:58.304790 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 100604us
I20260811 16:05:58.214763 19914 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:05:58.216930 19845 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:58.298256 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:05:58.189363 19436 consensus_queue.cc:1225] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:05:58.237008 19657 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.314445 13826 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:58.347656 19949 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:05:58.255601 19961 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.344796 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.404973 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.087661 19977 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.367642 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.418355 13825 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:58.418855 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.420147 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.357838 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.337638 19586 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.360312 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:58.364636 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.378773 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:58.372329 13737 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:05:58.375419 13822 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:58.262223 19686 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.477950 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.384690 13739 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:05:58.479975 13817 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:05:58.387075 13736 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:58.387899 13740 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
W20260811 16:05:58.394506 19911 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.003s
I20260811 16:05:58.213975 19992 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.399552 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.401863 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.324544 19687 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:05:58.352113 19896 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.404310 13741 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 5. Preceding OpId from leader: term: 17 index: 6. (index mismatch)
W20260811 16:05:58.405972 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 52407.7us
I20260811 16:05:58.421401 19845 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260811 16:05:58.366884 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.403888 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:58.423283 19914 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:58.477413 13904 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:05:58.477713 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 119995us
I20260811 16:05:58.482437 13818 raft_consensus.cc:2362] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15. Re-sending same reply.
I20260811 16:05:58.482477 13826 raft_consensus.cc:2362] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12. Re-sending same reply.
W20260811 16:05:58.486080 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122847us
I20260811 16:05:58.501314 13823 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:05:58.417436 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72681.5us
I20260811 16:05:58.367949 19897 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.502897 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.471118 19937 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:58.494415 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:05:58.490445 13900 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:05:58.491801 13827 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
W20260811 16:05:58.497305 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93574.6us
I20260811 16:05:58.521422 19889 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260811 16:05:58.532871 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.533820 13825 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:58.534317 19922 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:58.501012 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 140842us
I20260811 16:05:58.457087 19917 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:58.504453 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.486070 19586 raft_consensus.cc:2741] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260811 16:05:58.491490 13901 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:58.508678 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:58.509461 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:58.560705 13744 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:58.508757 13740 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:05:58.510511 13818 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:05:58.511358 19928 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:58.564083 13738 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:58.512177 19686 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.512564 19825 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:58.515043 19835 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:58.519444 19896 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:05:58.471647 19972 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.534788 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.540798 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:58.544808 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:58.549283 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44917.3us
I20260811 16:05:58.376446 19782 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:58.475921 19183 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:58.484889 19687 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:58.566653 19825 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.568013 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.571341 19657 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.416904 20014 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.132s
I20260811 16:05:58.502394 19984 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:58.584409 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.581662 13742 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:58.526413 19937 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:58.586632 13825 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:58.611836 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.613528 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.599059 19712 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.016s
I20260811 16:05:58.616197 19712 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:05:58.498798 19717 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
W20260811 16:05:58.603500 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62883.4us
I20260811 16:05:58.625190 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.564419 19978 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:58.580847 19914 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:58.608258 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2141) took 1477 ms. Trace:
W20260811 16:05:58.597354 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 96881.8us
I20260811 16:05:58.640115 13737 rpcz_store.cc:276] 0811 16:05:57.130586 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:57.310971 (+180385us) service_pool.cc:227] Handling call
0811 16:05:57.479302 (+168331us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:05:58.608049 (+1128747us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:58.608184 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2080321280}
I20260811 16:05:58.582267 19886 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.620249 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:58.601219 19782 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:58.623174 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.636521 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.629603 19946 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260811 16:05:58.649497 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.603665 19183 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:58.631513 19928 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.621788 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.672761 13818 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:05:58.502180 19899 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.658556 13825 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:58.662300 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:58.617316 19937 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:58.623840 19955 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:58.657989 19438 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:05:58.670935 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:05:58.707842 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 223129us
I20260811 16:05:58.663218 19763 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:58.639593 19974 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:58.663373 19946 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:05:58.716137 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.708308 13737 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:58.633635 19712 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.724964 13824 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:05:58.683995 19980 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:05:58.712544 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63125.9us
W20260811 16:05:58.716838 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 120803us
W20260811 16:05:58.713792 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77409.1us
I20260811 16:05:58.730793 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:58.732605 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.563666 19917 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.657809 19914 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.735457 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.738312 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.717058 19934 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.718065 19833 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:58.715067 19438 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.713915 19929 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:05:58.739964 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.710798 19928 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:58.724643 19946 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 8 FOLLOWER]: Advancing to term 9
I20260811 16:05:58.737193 19896 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:58.560264 19961 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.744509 19947 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:58.650870 19978 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.739436 19922 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:58.723917 19763 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:58.751762 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:05:58.730334 19974 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:05:58.757413 19888 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:58.756781 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.759011 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.737233 19913 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:58.724617 19977 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.757956 13818 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:05:58.763130 13900 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260811 16:05:58.688584 19687 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:58.768132 20033 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260811 16:05:58.780844 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.734447 19782 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.762300 19928 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:05:58.784731 20005 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.715s	user 0.015s	sys 0.000s
I20260811 16:05:58.785249 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:58.785557 19917 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.786454 19763 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.783918 19974 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.788129 13818 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:58.773597 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.788971 19913 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.740825 19980 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.756875 19183 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.754312 19833 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.793854 20043 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260811 16:05:58.779278 19929 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:58.797155 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2146) took 1185 ms. Trace:
I20260811 16:05:58.814913 19825 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.798921 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:58.778190 19947 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.799649 19712 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.778005 20044 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260811 16:05:58.802520 13909 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:58.801959 20005 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.776751 19896 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:05:58.891618 19896 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:58.892038 19896 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:58.893643 20005 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:58.894462 13821 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:58.826347 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:05:58.895993 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69782.9us
I20260811 16:05:58.896390 19586 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:58.772186 19984 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:05:58.897051 19586 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:58.897384 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2152) took 1008 ms. Trace:
I20260811 16:05:58.897665 19984 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.834559 13738 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:05:58.813093 20008 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:05:58.798197 20031 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260811 16:05:58.850912 19980 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.856290 19913 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:58.905117 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.857934 19833 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:58.859776 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:58.860719 20047 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:58.813172 19438 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.864148 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:58.846319 13822 rpcz_store.cc:276] 0811 16:05:57.611472 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.491988 (+880516us) service_pool.cc:227] Handling call
0811 16:05:58.492380 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:58.512972 (+ 20592us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:58.513004 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:58.513442 (+   438us) log.cc:842] Serialized 26 byte log entry
0811 16:05:58.595928 (+ 82486us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:05:58.595978 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:58.596064 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:58.796850 (+200786us) raft_consensus.cc:1671] finished
0811 16:05:58.796884 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:58.797071 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6138,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":38437,"thread_start_us":72688,"threads_started":1,"wal-append.queue_time_us":186490}
I20260811 16:05:58.917659 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.919901 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2149) took 1216 ms. Trace:
I20260811 16:05:58.878669 14581 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:05:58.896493 19956 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:05:58.898123 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2796) took 1277 ms. Trace:
I20260811 16:05:58.843761 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:58.836499 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.955533 13818 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 12
I20260811 16:05:58.910249 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:58.956239 13738 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.897864 13823 rpcz_store.cc:276] 0811 16:05:57.889319 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:57.897626 (+  8307us) service_pool.cc:227] Handling call
0811 16:05:58.897158 (+999532us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54000d5a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:58.897318 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1384673024}
I20260811 16:05:58.954593 13817 rpcz_store.cc:276] 0811 16:05:57.620451 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.158096 (+537645us) service_pool.cc:227] Handling call
0811 16:05:58.897907 (+739811us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002db9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:58.898051 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":646465408}
I20260811 16:05:58.912698 13739 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
W20260811 16:05:58.912293 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 154399us
I20260811 16:05:58.802610 19928 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:58.961167 13822 rpcz_store.cc:276] 0811 16:05:57.703988 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.918889 (+1214901us) service_pool.cc:227] Handling call
0811 16:05:58.919236 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:58.919484 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:58.919520 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:58.919594 (+    74us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:58.919640 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:58.919707 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:58.919831 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:58.964232 13902 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:58.967525 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:58.927345 14575 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:58.969493 13825 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260811 16:05:58.970346 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1018) took 1014 ms. Trace:
I20260811 16:05:58.928758 14577 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:58.970953 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:58.933892 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:58.937852 19963 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:58.897668 19586 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.939471 19835 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:58.982285 13817 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
W20260811 16:05:58.940214 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 224207us
I20260811 16:05:58.940531 19922 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:05:58.945806 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:58.844432 19981 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:58.901042 19897 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:05:58.972272 14583 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:58.963205 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:58.970758 13825 rpcz_store.cc:276] 0811 16:05:57.955425 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.964851 (+1009426us) service_pool.cc:227] Handling call
0811 16:05:58.965222 (+   371us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:58.969994 (+  4772us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:58.970278 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:58.911384 19929 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:05:58.983579 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2153) took 1064 ms. Trace:
I20260811 16:05:59.013628 13821 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:05:58.984555 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:58.993453 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1017) took 1038 ms. Trace:
I20260811 16:05:59.011682 13818 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:05:58.992518 13909 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:05:58.993312 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:58.962985 19956 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:59.011554 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2150) took 1306 ms (client timeout 1619 ms). Trace:
W20260811 16:05:59.024300 13827 rpcz_store.cc:269] 0811 16:05:57.705406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:57.718107 (+ 12701us) service_pool.cc:227] Handling call
0811 16:05:59.011383 (+1293276us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540029fc54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:59.011501 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":669470976}
I20260811 16:05:59.025640 13827 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:59.011827 13826 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 13. Ops: []
W20260811 16:05:59.014748 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50237.5us
I20260811 16:05:59.026816 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1021) took 1070 ms. Trace:
I20260811 16:05:59.020025 13817 rpcz_store.cc:276] 0811 16:05:57.955129 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.958994 (+1003865us) service_pool.cc:227] Handling call
0811 16:05:58.982039 (+ 23045us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:58.993159 (+ 11120us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:58.993386 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:58.994007 13822 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:59.018874 13823 rpcz_store.cc:276] 0811 16:05:57.894554 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.958107 (+1063553us) service_pool.cc:227] Handling call
0811 16:05:58.958549 (+   442us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:58.958771 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:58.958793 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:58.958851 (+    58us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:05:58.958897 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:58.958968 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:58.959102 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:59.013092 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1020) took 1057 ms. Trace:
I20260811 16:05:59.028609 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1019) took 1073 ms. Trace:
I20260811 16:05:59.027427 13821 rpcz_store.cc:276] 0811 16:05:57.956075 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.013129 (+1057054us) service_pool.cc:227] Handling call
0811 16:05:59.013452 (+   323us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.026417 (+ 12965us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.026733 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:59.029291 13822 rpcz_store.cc:276] 0811 16:05:57.955587 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.974062 (+1018475us) service_pool.cc:227] Handling call
0811 16:05:58.984828 (+ 10766us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.028374 (+ 43546us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.028554 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:59.029289 13825 rpcz_store.cc:276] 0811 16:05:57.955835 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.012381 (+1056546us) service_pool.cc:227] Handling call
0811 16:05:59.012661 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.012824 (+   163us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:59.012848 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:59.012887 (+    39us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:05:59.012913 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.012959 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:59.013040 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:59.032709 20056 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:05:58.992653 19438 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:58.951099 19980 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.059s
W20260811 16:05:59.044674 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 105108us
I20260811 16:05:59.047093 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.009553 20046 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:58.992398 19183 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.050346 14583 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:59.050160 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.057333 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.056339 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.058073 13900 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:05:59.058411 13901 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:05:59.051888 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67478us
I20260811 16:05:59.050173 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1023) took 1093 ms. Trace:
I20260811 16:05:59.052986 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:59.059319 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.053040 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.059665 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:59.059518 13827 rpcz_store.cc:276] 0811 16:05:57.956517 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.025188 (+1068671us) service_pool.cc:227] Handling call
0811 16:05:59.025477 (+   289us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.049894 (+ 24417us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.050107 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:59.060226 13908 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:05:59.040422 13822 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:05:59.048658 13738 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:05:59.055840 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1026) took 1098 ms. Trace:
I20260811 16:05:59.063436 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.063510 13817 rpcz_store.cc:276] 0811 16:05:57.957082 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.028167 (+1071085us) service_pool.cc:227] Handling call
0811 16:05:59.055266 (+ 27099us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.055472 (+   206us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:59.055503 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:05:59.055555 (+    52us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:05:59.055586 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.055652 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:05:59.055781 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:05:59.054936 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.057266 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.060763 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:58.951997 20008 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.066172 13827 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:59.067544 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.072639 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.075079 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.075568 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.078513 13901 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:05:59.080212 19917 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:59.081344 19917 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.081782 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.078986 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:05:59.010133 20048 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:59.087417 13901 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:59.035977 19914 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:59.090704 13821 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:59.100910 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.101662 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:58.994251 19963 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.105679 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2803) took 1409 ms. Trace:
I20260811 16:05:59.109004 13906 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260811 16:05:59.055783 19922 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:59.067466 19919 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:05:59.123412 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2154) took 1077 ms. Trace:
I20260811 16:05:59.139195 13821 rpcz_store.cc:276] 0811 16:05:58.045715 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.030156 (+984441us) service_pool.cc:227] Handling call
0811 16:05:59.090464 (+ 60308us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.106673 (+ 16209us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.123307 (+ 16634us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:05:59.129154 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50548.8us
I20260811 16:05:59.062484 19926 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:59.091194 19845 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:05:59.124258 13826 rpcz_store.cc:276] 0811 16:05:57.696658 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.501594 (+804936us) service_pool.cc:227] Handling call
0811 16:05:59.011626 (+510032us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.035964 (+ 24338us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.105354 (+ 69390us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540029fc50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:59.105593 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1149076864}
I20260811 16:05:59.055562 19911 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:58.953033 20047 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:59.101202 19884 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.810s	user 0.014s	sys 0.000s
I20260811 16:05:59.088048 19949 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:05:59.014014 19981 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.146306 13904 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:05:59.147899 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:59.117980 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.098920 19554 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:05:59.193431 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:05:59.194314 13826 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:05:59.097177 20048 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:59.088250 20040 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:05:59.156316 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:05:59.068207 19183 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:59.202960 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46760.6us
W20260811 16:05:59.203263 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134567us
I20260811 16:05:59.101580 19763 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:59.157442 13822 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260811 16:05:59.159257 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:05:59.160889 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.013973 19947 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:59.128094 19914 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.176348 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:59.138929 19803 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:05:59.139369 19937 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:59.245411 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:59.256333 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:05:59.168843 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.267915 20045 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.268594 20045 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:59.271872 20050 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260811 16:05:59.273475 20051 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260811 16:05:59.274107 19922 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.276906 14574 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
W20260811 16:05:59.279760 20055 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260811 16:05:59.281730 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:59.282091 19803 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:59.282768 13744 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:05:59.283619 20008 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.283325 19803 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.184494 19845 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:59.171808 13909 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
W20260811 16:05:59.133929 19975 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.821s	user 0.013s	sys 0.002s
I20260811 16:05:59.211937 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.213912 13743 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:05:59.378705 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78796.4us
I20260811 16:05:59.214449 14577 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:05:59.218899 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.223444 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:05:59.209657 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:59.161826 19919 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:59.162241 19917 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.244073 13739 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260811 16:05:59.242820 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.167379 19978 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.382858 13735 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:05:59.115649 13900 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
W20260811 16:05:59.297235 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80469us
I20260811 16:05:59.201865 20040 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:59.321295 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:59.167689 19911 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.380182 13904 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:05:59.209105 20048 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:59.387306 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 192974us
I20260811 16:05:59.150465 19835 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.388859 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.401880 13909 raft_consensus.cc:2354] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:59.212670 19949 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:05:59.392468 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 173710us
I20260811 16:05:59.282155 20043 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:59.420694 20043 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:59.421157 20043 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:59.144609 19956 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.382357 13871 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:05:59.423697 13871 leader_election.cc:401] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:05:59.423988 19183 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.397377 19763 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260811 16:05:59.425341 19763 consensus_queue.cc:1225] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 16:05:59.425396 20067 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 13
I20260811 16:05:59.257071 19914 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.428184 19914 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.429191 19937 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:59.400032 13820 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:05:59.388950 13906 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:59.430508 19963 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:59.286490 20045 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.242636 19554 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.393441 19975 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:59.411867 19949 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:59.302960 19974 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:05:59.214008 20005 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.182s
I20260811 16:05:59.420059 19981 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.419529 19845 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.401351 19686 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:05:59.436371 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:05:59.510690 13907 raft_consensus.cc:2362] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12. Re-sending same reply.
I20260811 16:05:59.393805 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:05:59.231007 19782 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.169s
I20260811 16:05:59.453413 13904 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:05:59.445277 19958 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:05:59.476255 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 483016us
I20260811 16:05:59.477356 13743 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:05:59.481709 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.525590 14577 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:05:59.527098 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:05:59.407123 19955 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
I20260811 16:05:59.529585 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:05:59.497985 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.496279 14580 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260811 16:05:59.501571 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.399191 20040 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:59.505208 13736 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:59.506297 14581 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:05:59.411031 19976 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.439670 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:59.480940 20035 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.552686 13907 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 5. Preceding OpId from leader: term: 17 index: 6. (index mismatch)
I20260811 16:05:59.554757 14573 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
W20260811 16:05:59.572165 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 132572us
I20260811 16:05:59.574751 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.513480 19938 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:05:59.517861 19946 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.756s	user 0.014s	sys 0.001s
I20260811 16:05:59.576539 20008 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.592881 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.594187 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.496467 19554 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.595811 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:59.595110 14575 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:59.560954 19989 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260811 16:05:59.558060 19955 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:05:59.557755 19958 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:05:59.577276 19686 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:59.601046 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:05:59.496229 20048 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:59.642171 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46444.9us
I20260811 16:05:59.596278 19962 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:59.646395 13817 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.014s	sys 0.029s
I20260811 16:05:59.597718 19183 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:05:59.595743 19984 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.649406 14577 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:05:59.579733 19935 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260811 16:05:59.672492 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71518us
I20260811 16:05:59.681211 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:05:59.577180 19976 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:59.676127 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 79434.4us
W20260811 16:05:59.645546 19896 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.011s
I20260811 16:05:59.683248 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.612540 20047 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.611442 19911 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:59.646812 13817 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.014s	sys 0.029s
I20260811 16:05:59.596035 20008 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.584163 20035 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.570359 19919 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.591341 19946 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.656213 19981 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:59.701846 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:59.646078 19657 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.027s	sys 0.020s
I20260811 16:05:59.609680 19963 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260811 16:05:59.712066 20076 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260811 16:05:59.714579 19586 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.003s
I20260811 16:05:59.715118 19586 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.717293 20049 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:59.717628 19586 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.719341 19958 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:05:59.720937 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2154) took 1213 ms. Trace:
I20260811 16:05:59.721350 13736 rpcz_store.cc:276] 0811 16:05:58.507465 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.543205 (+ 35740us) service_pool.cc:227] Handling call
0811 16:05:58.543702 (+   497us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.558894 (+1015192us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.720668 (+161774us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:05:59.720872 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2210611456}
I20260811 16:05:59.723986 13740 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:05:59.724743 19554 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:59.732761 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.684074 20074 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:05:59.684275 19978 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:05:59.709470 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:05:59.702632 19975 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:05:59.693038 19183 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:05:59.735348 14573 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
W20260811 16:05:59.741634 13823 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.013s	sys 0.010s
W20260811 16:05:59.761379 13823 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.013s	sys 0.010s
I20260811 16:05:59.689092 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:05:59.751020 14575 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:05:59.764011 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 75021.1us
I20260811 16:05:59.767630 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:05:59.750372 19978 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:05:59.772148 19978 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:05:59.775424 19975 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:05:59.780608 20059 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260811 16:05:59.762574 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:59.812069 20048 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.730326 19934 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:05:59.682376 19984 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:59.695484 19896 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:05:59.819312 19896 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:05:59.820310 19438 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.770s	user 0.014s	sys 0.000s
I20260811 16:05:59.820322 13901 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:05:59.821197 19934 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:05:59.821772 19934 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:05:59.823724 19992 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:05:59.788213 20074 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:05:59.702714 20069 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260811 16:05:59.810636 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48201.1us
I20260811 16:05:59.833726 13908 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260811 16:05:59.828848 20063 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260811 16:05:59.862031 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:59.868198 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1207) took 1697 ms (client timeout 1647 ms). Trace:
I20260811 16:05:59.872570 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2159) took 1676 ms. Trace:
I20260811 16:05:59.837236 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:05:59.855679 13709 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.863s (SENT)
I20260811 16:05:59.878710 13820 rpcz_store.cc:276] 0811 16:05:58.195987 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.366604 (+170617us) service_pool.cc:227] Handling call
0811 16:05:59.872301 (+1505697us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400240754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:59.872486 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2065727232}
I20260811 16:05:59.835130 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:05:59.877673 14574 rpcz_store.cc:269] 0811 16:05:58.170864 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.171352 (+   488us) service_pool.cc:227] Handling call
0811 16:05:59.867927 (+1696575us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54005401d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:05:59.868105 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2064542464}
W20260811 16:05:59.861919 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.031s
W20260811 16:05:59.884987 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.003s	sys 0.033s
W20260811 16:05:59.885069 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50036.5us
I20260811 16:05:59.764772 19886 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:05:59.785907 19962 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:05:59.885429 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 629175us
W20260811 16:05:59.832585 20058 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.548s	user 0.000s	sys 0.003s
I20260811 16:05:59.893999 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:05:59.864523 20038 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260811 16:05:59.888245 13789 leader_election.cc:398] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:05:59.812788 19946 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.834630 19955 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:05:59.733467 19981 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:05:59.902200 13744 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.054s	sys 0.082s
I20260811 16:05:59.882200 20035 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:05:59.945297 13744 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.054s	sys 0.082s
W20260811 16:05:59.808311 19657 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.027s	sys 0.020s
I20260811 16:05:59.909673 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:05:59.912247 14581 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 9: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:05:59.915347 13789 leader_election.cc:401] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:05:59.891852 19899 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.031s	sys 0.047s
I20260811 16:05:59.888831 19686 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:05:59.952965 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64865.4us
I20260811 16:05:59.916745 19975 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:05:59.912050 20048 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.964260 14580 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:05:59.994715 20070 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260811 16:05:59.862478 20005 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260811 16:06:00.031397 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.003496 19984 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:05:59.913467 19976 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:00.031347 19962 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:05:59.900156 19886 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.021747 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:05:59.997437 20035 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12.
I20260811 16:06:00.023831 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.024642 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.026104 13827 pending_rounds.cc:76] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 4
I20260811 16:06:00.091084 13827 pending_rounds.cc:97] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260811 16:06:00.091444 13827 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:00.087585 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65972.8us
I20260811 16:06:00.030010 13822 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
W20260811 16:05:59.953856 19899 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.031s	sys 0.048s
I20260811 16:05:59.879717 19183 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260811 16:05:59.932168 19955 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:00.022143 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:05:59.835294 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 625727us
I20260811 16:06:00.085934 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1215) took 1161 ms. Trace:
I20260811 16:06:00.099922 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.100063 14582 rpcz_store.cc:276] 0811 16:05:58.924109 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.930275 (+  6166us) service_pool.cc:227] Handling call
0811 16:05:58.930722 (+   447us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:58.931239 (+   517us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:05:58.931281 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:58.931926 (+   645us) log.cc:842] Serialized 26 byte log entry
0811 16:05:59.007711 (+ 75785us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:05:59.007856 (+   145us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:05:59.008054 (+   198us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:05:59.831715 (+823661us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:00.043057 (+211342us) raft_consensus.cc:1671] finished
0811 16:06:00.043087 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:00.085856 (+ 42769us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1846,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"spinlock_wait_cycles":187527040,"thread_start_us":75128,"threads_started":1,"wal-append.queue_time_us":228704}
I20260811 16:06:00.030355 20069 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:00.106010 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.093339 13821 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:06:00.088908 13825 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:06:00.107982 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:00.086110 19686 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.028400 19913 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.042980 19687 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:00.103703 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:00.141685 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 460587us
I20260811 16:06:00.040975 19962 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.094786 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.111361 14581 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:00.143990 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.111826 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:00.144918 13741 raft_consensus.cc:595] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:00.145327 13741 raft_consensus.cc:603] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:00.113369 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:00.075516 19984 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:00.039172 20048 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.104456 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:00.039346 19782 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260811 16:06:00.105058 20047 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260811 16:06:00.109604 20075 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260811 16:06:00.126498 19886 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.127032 19686 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:00.127883 20078 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260811 16:06:00.129153 19981 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:05:59.828869 20074 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.130292 20008 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.131078 19976 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.132277 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.133699 20049 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:00.096431 19975 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:00.094247 19917 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:00.142534 13871 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
W20260811 16:06:00.243722 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 101334us
I20260811 16:06:00.244498 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:00.102792 19955 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:00.111526 20084 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:00.114522 13825 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:00.152119 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.252238 14577 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 9.
W20260811 16:06:00.138427 19897 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.121s	user 0.004s	sys 0.005s
I20260811 16:06:00.257107 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.192220 13826 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260811 16:06:00.193138 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.924s (SENT) [suppressed 34 similar messages]
W20260811 16:06:00.150018 19835 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.010s	sys 0.005s
W20260811 16:06:00.154340 20067 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.005s
I20260811 16:06:00.279050 20067 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:06:00.280081 19922 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.280829 19922 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.206254 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:00.218016 13820 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:06:00.289264 13820 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:06:00.224959 13822 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 9.
I20260811 16:06:00.240736 14575 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:00.214516 19966 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.019s
I20260811 16:06:00.146725 19978 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.299371 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:00.259168 13825 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260811 16:06:00.300300 13740 raft_consensus.cc:595] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:00.145203 19913 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.325191 19913 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.212882 20083 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:00.326213 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2462) took 1259 ms. Trace:
I20260811 16:06:00.326050 20083 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.326671 13908 rpcz_store.cc:276] 0811 16:05:59.067091 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.067254 (+   163us) service_pool.cc:227] Handling call
0811 16:06:00.325950 (+1258696us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.326143 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1756062976}
I20260811 16:06:00.328117 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.328632 20083 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:00.241307 19712 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.024s	sys 0.033s
I20260811 16:06:00.276309 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:00.329358 19712 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.025s	sys 0.033s
I20260811 16:06:00.330529 13902 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:00.331382 13909 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:06:00.234760 19946 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.332279 19946 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.334648 19946 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:00.336971 20043 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.001s
I20260811 16:06:00.337467 20043 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.340901 19978 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:00.342540 20040 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.003s
W20260811 16:06:00.343423 19934 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260811 16:06:00.343891 19934 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.346168 19934 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:00.346771 19992 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260811 16:06:00.347470 19888 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:00.295197 19835 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.010s	sys 0.005s
I20260811 16:06:00.348690 14578 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:00.291292 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.304540 19962 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.310875 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2469) took 1235 ms. Trace:
I20260811 16:06:00.300776 13740 raft_consensus.cc:603] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:00.314486 19825 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:00.312455 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2159) took 1092 ms. Trace:
I20260811 16:06:00.352591 13738 rpcz_store.cc:276] 0811 16:05:59.219986 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.242354 (+ 22368us) service_pool.cc:227] Handling call
0811 16:05:59.299004 (+ 56650us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:59.390555 (+ 91551us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:05:59.390602 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:59.446085 (+ 55483us) log.cc:842] Serialized 26 byte log entry
0811 16:05:59.716505 (+270420us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b4800061a58. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:06:00.004279 (+287774us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:00.004343 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:00.004444 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:00.312148 (+307704us) raft_consensus.cc:1671] finished
0811 16:06:00.312171 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:00.312387 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":88804,"raft.run_cpu_time_us":3031,"raft.run_wall_time_us":319516,"spinlock_wait_cycles":81820544,"thread_start_us":445598,"threads_started":1,"wal-append.queue_time_us":695236}
I20260811 16:06:00.250622 19976 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.351629 13901 rpcz_store.cc:276] 0811 16:05:59.075622 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.122235 (+ 46613us) service_pool.cc:227] Handling call
0811 16:06:00.310613 (+1188378us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54000884d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.310799 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1228173056}
I20260811 16:06:00.349931 14575 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:00.357134 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:00.316386 20069 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:00.316553 14579 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
W20260811 16:06:00.316783 13708 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.016s	sys 0.029s
I20260811 16:06:00.250969 19917 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.370048 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:00.318977 19686 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.291635 19958 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.291922 20008 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:00.321889 19956 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:00.374522 13907 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:00.275185 20084 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.330425 14577 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:00.355341 19888 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.377767 20008 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:00.377945 19981 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:00.378444 20008 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:00.378620 19981 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.379547 19833 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:00.381531 19981 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.382246 13738 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:00.382879 13738 raft_consensus.cc:595] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:00.405588 13738 raft_consensus.cc:603] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:00.192986 19984 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.406210 19763 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:00.343067 20040 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.406687 19763 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:00.407512 14580 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260811 16:06:00.407686 19763 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.257679 19975 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:00.319056 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:00.360459 13708 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.017s	sys 0.029s
I20260811 16:06:00.409602 19975 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.411471 19946 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:00.411979 19984 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.413255 19833 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.413764 19833 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.415335 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1214) took 1491 ms. Trace:
I20260811 16:06:00.415517 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.415776 14578 rpcz_store.cc:276] 0811 16:05:58.923726 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.929254 (+  5528us) service_pool.cc:227] Handling call
0811 16:05:58.929615 (+   361us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:00.349119 (+1419504us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:00.415052 (+ 65933us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:00.415273 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3263061760}
I20260811 16:06:00.417313 20081 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.417550 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.417765 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.418902 13742 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260811 16:06:00.392351 19922 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:00.420239 19888 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:00.420384 19922 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:00.367447 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.368916 13901 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:00.422700 13908 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:00.385241 20084 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:00.296217 19966 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.020s
W20260811 16:06:00.389074 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 991) took 2172 ms (client timeout 2017 ms). Trace:
I20260811 16:06:00.369066 19935 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.390491 19958 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.395035 19917 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:00.395771 20048 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.396729 19835 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:00.400697 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2477) took 1234 ms. Trace:
I20260811 16:06:00.402894 19961 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:00.403738 20043 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:00.404919 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1188) took 1257 ms. Trace:
I20260811 16:06:00.358227 19825 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:00.423949 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.459918 14579 rpcz_store.cc:276] 0811 16:05:59.147950 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.150944 (+  2994us) service_pool.cc:227] Handling call
0811 16:06:00.404728 (+1253784us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.404854 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2417458560}
I20260811 16:06:00.427770 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:00.361676 14581 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:06:00.370221 13900 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
W20260811 16:06:00.444067 13903 rpcz_store.cc:269] 0811 16:05:58.216255 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.216426 (+   171us) service_pool.cc:227] Handling call
0811 16:06:00.388791 (+2172365us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400301e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.388953 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4162732288}
I20260811 16:06:00.432440 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:00.458766 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.468000 13740 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:00.450203 14575 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:00.455847 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.455204 13737 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:00.455271 13909 rpcz_store.cc:276] 0811 16:05:59.166433 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.402748 (+236315us) service_pool.cc:227] Handling call
0811 16:06:00.330961 (+928213us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:00.331832 (+   871us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:00.400524 (+ 68692us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b5400301450. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.400641 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2107188608}
I20260811 16:06:00.421653 19922 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:00.471843 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:00.472294 14577 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:00.409981 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.473471 13908 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:00.374171 20069 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:00.452530 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:00.468601 13818 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.036s
I20260811 16:06:00.469765 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:00.476962 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:00.471558 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.474886 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:00.474504 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:00.473305 13740 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260811 16:06:00.392629 19976 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:00.476387 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.503741 13902 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:00.504050 14579 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:00.444641 19984 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.484833 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.504194 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.506083 13737 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:06:00.444372 19438 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:00.449815 20076 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.505155 13909 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:00.501945 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.486330 13907 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:00.507411 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1187) took 1360 ms (client timeout 1506 ms). Trace:
I20260811 16:06:00.507488 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.517753 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:00.509236 13818 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.016s	sys 0.036s
I20260811 16:06:00.509486 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2480) took 1293 ms. Trace:
W20260811 16:06:00.517453 14583 rpcz_store.cc:269] 0811 16:05:59.147369 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.147606 (+   237us) service_pool.cc:227] Handling call
0811 16:06:00.506746 (+1359140us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.507355 (+   609us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2750259584}
I20260811 16:06:00.517759 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:00.519917 13735 raft_consensus.cc:595] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:00.520375 13735 raft_consensus.cc:603] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:00.518405 14573 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:06:00.518994 13737 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:00.502784 14580 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:00.519479 13900 rpcz_store.cc:276] 0811 16:05:59.215681 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.393504 (+177823us) service_pool.cc:227] Handling call
0811 16:06:00.508635 (+1115131us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400088ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:00.509413 (+   778us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1763192704}
I20260811 16:06:00.530649 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:00.531651 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.532756 13737 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260811 16:06:00.467007 20082 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:00.458909 19436 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:00.412014 19946 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.471474 19712 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.478298 19763 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:00.476245 20043 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:00.477970 19922 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:00.446030 20008 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.589564 14579 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:00.565598 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:00.568894 13902 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260811 16:06:00.632499 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.615063 13822 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:00.568300 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:00.612968 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69211.9us
I20260811 16:06:00.417855 20081 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.453972 19935 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.651109 13825 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260811 16:06:00.657832 13826 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:00.562939 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.674911 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.466969 19835 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.675896 13821 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:00.743752 13903 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
W20260811 16:06:00.744115 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60867.6us
I20260811 16:06:00.539106 19917 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:00.747087 13903 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:00.753188 13903 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.776281 13903 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:00.780009 20096 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260811 16:06:00.780902 19946 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:00.515113 19984 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.700702 19913 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.531348 19438 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.539508 20089 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:00.649897 20084 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:00.791771 13908 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:06:00.611649 19889 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:00.802649 20097 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260811 16:06:00.808187 19888 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:00.872038 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 398006us
I20260811 16:06:00.812844 20048 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:00.820202 19938 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.227s	user 0.011s	sys 0.003s
W20260811 16:06:00.824342 19955 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260811 16:06:00.825416 19922 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:00.841270 19687 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.000s
I20260811 16:06:00.843590 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:00.845381 13827 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:06:00.846407 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:00.899233 13821 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:00.847726 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.586416 19436 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:00.848061 20108 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:06:00.849658 19966 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:00.573139 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 344612us
I20260811 16:06:00.900609 13825 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 10.
I20260811 16:06:00.742498 19934 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:00.781852 19946 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:00.758219 19981 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:00.704628 19833 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:00.914594 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.033s	sys 0.077s
I20260811 16:06:00.611501 20082 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.883730 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:00.560959 20076 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.668843 19712 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.750213 19949 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260811 16:06:00.799899 20089 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:00.852341 20084 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.902109 14575 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260811 16:06:00.906558 13823 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.016s	sys 0.046s
I20260811 16:06:00.765838 19896 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.113s
W20260811 16:06:00.933449 13823 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.016s	sys 0.046s
I20260811 16:06:00.868357 20040 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:00.934185 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1028) took 2976 ms. Trace:
W20260811 16:06:00.914995 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.033s	sys 0.077s
I20260811 16:06:00.681352 19825 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:00.909749 20074 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.042s
I20260811 16:06:00.927935 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:00.919785 19990 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.010s	sys 0.039s
I20260811 16:06:00.853521 19913 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:00.931022 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.022s	sys 0.089s
W20260811 16:06:00.952423 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.022s	sys 0.089s
W20260811 16:06:00.952757 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 759623us
I20260811 16:06:00.932499 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2164) took 1710 ms. Trace:
I20260811 16:06:00.906874 19782 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:00.935287 13817 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.026s	sys 0.083s
I20260811 16:06:00.669386 20043 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.930962 19956 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:00.950953 13739 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:00.951210 13901 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
W20260811 16:06:00.955351 13817 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.026s	sys 0.084s
I20260811 16:06:00.956493 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.875090 19889 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.968343 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:00.933655 19979 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.933805 19958 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:00.954828 13744 rpcz_store.cc:276] 0811 16:05:59.221667 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.285001 (+ 63334us) service_pool.cc:227] Handling call
0811 16:05:59.285379 (+   378us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:05:59.945846 (+660467us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:05:59.945892 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:05:59.948783 (+  2891us) log.cc:842] Serialized 26 byte log entry
0811 16:06:00.460154 (+511371us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:00.931787 (+471633us) log.cc:842] Serialized 14 byte log entry
0811 16:06:00.932039 (+   252us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:00.932140 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:00.932206 (+    66us) raft_consensus.cc:1671] finished
0811 16:06:00.932230 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:00.932420 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":106423,"raft.queue_time_us":111528,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":38959,"thread_start_us":1420329,"threads_started":3,"wal-append.queue_time_us":689597}
I20260811 16:06:00.942945 13823 rpcz_store.cc:276] 0811 16:05:57.957503 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.029302 (+1071799us) service_pool.cc:227] Handling call
0811 16:05:59.029602 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.029797 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:05:59.779601 (+749804us) log.cc:842] Serialized 14 byte log entry
0811 16:06:00.933835 (+1154234us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:00.933892 (+    57us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:00.933933 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:00.934017 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:00.934131 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38900,"prepare.queue_time_us":367873,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":124972,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"thread_start_us":1846258,"threads_started":3,"wal-append.queue_time_us":728225}
I20260811 16:06:00.949245 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.023550 13742 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
W20260811 16:06:00.952152 20074 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.022s	sys 0.042s
I20260811 16:06:00.904456 19955 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.935024 20089 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:00.940655 19686 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:01.021595 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.022841 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:00.965478 19956 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:01.030987 13744 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:01.031075 19956 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:00.963986 20092 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:06:00.960103 19990 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.010s	sys 0.039s
I20260811 16:06:00.964253 19687 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.035245 19687 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.031862 20092 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:01.036635 20092 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:01.037225 19687 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.020247 19887 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260811 16:06:00.900053 20048 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.896484 19888 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.914443 19934 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:00.909600 20088 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260811 16:06:00.916193 19966 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:00.931628 19914 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260811 16:06:01.030646 13908 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:00.931408 19833 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:00.929363 19981 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.039553 19984 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:01.041353 13742 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:01.142762 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 112952us
I20260811 16:06:01.013865 20110 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.048324 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.051287 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.015046 19825 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:01.029004 20102 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:06:01.055902 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.062273 13744 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:01.157380 13744 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260811 16:06:01.136960 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.107287 13736 raft_consensus.cc:2354] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11.
I20260811 16:06:01.100744 20081 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.137081 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.160076 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:00.967348 19782 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.137753 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.143894 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:01.145979 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.148723 13823 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:01.044672 20103 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:01.148136 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.050s
W20260811 16:06:01.165033 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.000s	sys 0.051s
I20260811 16:06:01.037271 20043 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.098802 20074 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.137981 19835 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.164244 13908 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260811 16:06:01.099100 20118 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.026819 19979 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.163753 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.177256 13824 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:01.181730 13908 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260811 16:06:01.042578 19686 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.169119 19438 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.153476 19833 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.226167 19935 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:01.241894 13738 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.037s
W20260811 16:06:01.242338 13738 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.013s	sys 0.037s
I20260811 16:06:01.157217 20110 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.220714 19712 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.267026 13903 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
W20260811 16:06:01.267518 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 356010us
I20260811 16:06:01.285130 13903 pending_rounds.cc:76] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 13
I20260811 16:06:01.285480 13903 pending_rounds.cc:97] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260811 16:06:01.285912 13903 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:01.174377 20074 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:01.295032 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 336892us
I20260811 16:06:01.288787 13903 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:01.274312 19917 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:01.241251 20076 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.178581 20103 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.238456 20082 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.243254 20048 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.243463 20084 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.306568 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2776) took 1313 ms. Trace:
I20260811 16:06:01.283062 20088 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:01.310562 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 284944us
I20260811 16:06:01.327675 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:01.325160 13906 rpcz_store.cc:276] 0811 16:05:59.993413 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.997267 (+  3854us) service_pool.cc:227] Handling call
0811 16:05:59.997563 (+   296us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:05:59.997765 (+   202us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:06:00.508404 (+510639us) log.cc:842] Serialized 14 byte log entry
0811 16:06:01.226246 (+717842us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b18002a4000. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c557b4bcf 00007f5c4e9e47b6 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d
0811 16:06:01.306210 (+ 79964us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:01.306274 (+    64us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:01.306321 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:01.306388 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.306506 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18822,"prepare.queue_time_us":966540,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":20818,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6993,"spinlock_wait_cycles":116384768,"thread_start_us":1256357,"threads_started":3,"wal-append.queue_time_us":533488}
I20260811 16:06:01.176681 20118 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.301229 19935 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:01.320966 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:01.321568 19913 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:01.416431 20074 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.421543 19922 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:01.362092 19981 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.319536 19955 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.335433 19934 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.473363 20118 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.356704 19833 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:01.474547 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 153897us
I20260811 16:06:01.362805 20088 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.409176 20035 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:01.476049 20035 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:01.476730 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:01.380800 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 238540us
I20260811 16:06:01.383380 20005 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260811 16:06:01.338511 19966 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.365828 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1004) took 1226 ms. Trace:
W20260811 16:06:01.381640 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 237827us
I20260811 16:06:01.411339 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2787) took 1053 ms. Trace:
I20260811 16:06:01.477396 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.342730 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:01.376680 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1003) took 1281 ms. Trace:
I20260811 16:06:01.480324 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:01.428790 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 516206us
W20260811 16:06:01.426684 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2812) took 2923 ms (client timeout 1863 ms). Trace:
I20260811 16:06:01.528916 13822 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
W20260811 16:06:01.330420 20109 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260811 16:06:01.374377 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2785) took 1371 ms. Trace:
I20260811 16:06:01.335359 19888 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:01.549937 13739 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.009s
I20260811 16:06:01.382411 19958 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:01.351015 20069 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.004s
W20260811 16:06:01.348150 20127 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260811 16:06:01.349200 20119 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260811 16:06:01.530993 13821 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.001s
I20260811 16:06:01.431654 20138 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:01.432320 20008 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.644908 19887 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:01.528357 13901 rpcz_store.cc:276] 0811 16:06:00.357677 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.423109 (+ 65432us) service_pool.cc:227] Handling call
0811 16:06:01.411168 (+988059us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:01.411274 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1098276096}
I20260811 16:06:01.664573 19887 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.665166 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.666491 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.558321 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.668380 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.669060 13822 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:01.670032 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.527554 13902 rpcz_store.cc:276] 0811 16:06:00.139034 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.667522 (+528488us) service_pool.cc:227] Handling call
0811 16:06:00.754566 (+ 87044us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:00.929983 (+175417us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:00.930025 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:00.930076 (+    51us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:00.930113 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:01.365540 (+435427us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54002c1ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:01.365594 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.365756 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":402747264}
W20260811 16:06:01.527499 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.022s	sys 0.053s
W20260811 16:06:01.672106 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.024s	sys 0.054s
I20260811 16:06:01.673086 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:01.546216 13824 rpcz_store.cc:269] 0811 16:05:58.502922 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:58.743215 (+240293us) service_pool.cc:227] Handling call
0811 16:06:01.426430 (+2683215us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400241154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:01.426589 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5531055360}
I20260811 16:06:01.327996 19436 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:01.376420 20120 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260811 16:06:01.324393 20081 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:01.336942 20110 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.645459 20118 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.682134 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:01.331702 19763 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.662s	user 0.005s	sys 0.008s
I20260811 16:06:01.547282 13904 rpcz_store.cc:276] 0811 16:06:00.095582 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.612035 (+516453us) service_pool.cc:227] Handling call
0811 16:06:00.743379 (+131344us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:00.869203 (+125824us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:00.869235 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:00.869272 (+    37us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:00.869300 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:01.376402 (+507102us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000343d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:01.376470 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.376613 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":288907520}
I20260811 16:06:01.381412 19183 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:06:01.680979 19833 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:01.647926 13739 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.033s	sys 0.014s
I20260811 16:06:01.688470 19183 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:01.688591 19833 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.389447 19782 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.688715 20118 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.689539 19183 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.387284 19979 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:01.651397 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 105267us
I20260811 16:06:01.688508 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.690864 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.691941 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:01.693166 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:01.333163 20084 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:01.645493 19975 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.007s	sys 0.017s
I20260811 16:06:01.344801 19889 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.526645 19990 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:01.654755 13903 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260811 16:06:01.481138 20088 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:01.371122 19686 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.439883 20103 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.657531 13821 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:01.726651 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:01.547168 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 204528us
I20260811 16:06:01.478168 20074 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.171s
I20260811 16:06:01.659088 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:01.554688 13909 rpcz_store.cc:276] 0811 16:06:00.002916 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.515948 (+513032us) service_pool.cc:227] Handling call
0811 16:06:00.574548 (+ 58600us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:00.673457 (+ 98909us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:00.673496 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:00.674097 (+   601us) log.cc:842] Serialized 26 byte log entry
0811 16:06:01.044437 (+370340us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:06:01.044506 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:01.044794 (+   288us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:01.374053 (+329259us) raft_consensus.cc:1671] finished
0811 16:06:01.374085 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.374285 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":83719,"raft.queue_time_us":94414,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":69978,"thread_start_us":257541,"threads_started":1,"wal-append.queue_time_us":560921}
I20260811 16:06:01.542675 19913 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:01.675901 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.375985 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1005) took 1184 ms. Trace:
I20260811 16:06:01.749931 13900 rpcz_store.cc:276] 0811 16:06:00.191843 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.668925 (+477082us) service_pool.cc:227] Handling call
0811 16:06:00.744135 (+ 75210us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:00.948818 (+204683us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:00.948851 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:00.948893 (+    42us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:00.948925 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:01.375663 (+426738us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400300a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:01.375732 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.375905 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":470230400}
I20260811 16:06:01.655726 19958 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.332877 20134 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:01.390251 20076 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.265s
I20260811 16:06:01.567180 19938 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:01.679441 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:01.753585 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76588.9us
I20260811 16:06:01.708611 19896 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:01.754638 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:01.682941 13822 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 9.
I20260811 16:06:01.666882 19887 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.410864 19917 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.657608 20044 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.551362 20139 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:01.695744 13741 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:06:01.699607 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.699744 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.700541 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.774772 13737 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:01.659242 20082 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.779886 20082 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.551002 20040 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.133s
I20260811 16:06:01.705111 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.767781 20103 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.707566 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.783783 20103 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.569803 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.759065 19938 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:01.786298 19938 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:01.786476 20103 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.338225 19956 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.788084 19979 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:01.709649 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.789925 19956 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.717306 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.567385 19935 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.791779 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.684479 20081 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.743166 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:01.743950 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:01.747534 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:01.654835 20069 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.757628 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:01.677660 20138 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.760182 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.718276 19712 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260811 16:06:01.759589 19896 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:01.701540 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:01.783897 20133 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260811 16:06:01.789981 13902 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:01.758764 19833 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.770465 19438 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:01.738682 14541 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:01.824510 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 85932.3us
I20260811 16:06:01.826140 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:01.445709 20092 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.741914 19436 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:06:01.723037 19990 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.801133 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:01.749325 19913 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:01.677160 20104 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
W20260811 16:06:01.760744 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 102284us
I20260811 16:06:01.759392 20048 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260811 16:06:01.804940 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47395.5us
I20260811 16:06:01.881839 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:01.809139 13824 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:01.708406 20084 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.762181 19981 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Leader election won for term 9
W20260811 16:06:01.816583 13741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2423) took 1404 ms (client timeout 1791 ms). Trace:
W20260811 16:06:01.892033 13741 rpcz_store.cc:269] 0811 16:06:00.412584 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.449918 (+ 37334us) service_pool.cc:227] Handling call
0811 16:06:01.816290 (+1366372us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000302d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:01.816506 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2743563648}
W20260811 16:06:01.703641 19975 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.008s	sys 0.018s
I20260811 16:06:01.828356 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.818849 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1200) took 1562 ms. Trace:
I20260811 16:06:01.817953 19896 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:01.783802 20118 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:01.827557 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65850.6us
I20260811 16:06:01.476992 20035 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.763531 19955 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260811 16:06:01.880119 20127 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:06:01.807341 19763 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:06:01.822510 19961 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.355s	user 0.009s	sys 0.007s
W20260811 16:06:01.880839 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 54810us
I20260811 16:06:01.922911 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.924124 13902 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:01.925364 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.876678 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:01.884830 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:01.886051 20133 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:06:01.926762 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:01.795418 20044 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:01.927436 20043 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:06:01.927953 13902 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:06:01.928040 20043 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:01.929140 20044 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:01.929268 20043 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:01.894637 14582 rpcz_store.cc:276] 0811 16:06:00.256530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.256657 (+   127us) service_pool.cc:227] Handling call
0811 16:06:00.305566 (+ 48909us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:00.306010 (+   444us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:00.306065 (+    55us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:00.306731 (+   666us) log.cc:842] Serialized 52 byte log entry
0811 16:06:00.564647 (+257916us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:00.564685 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:00.564750 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:01.818625 (+1253875us) raft_consensus.cc:1671] finished
0811 16:06:01.818647 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.818792 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4282,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":94,"thread_start_us":208427,"threads_started":1,"wal-append.queue_time_us":636529}
I20260811 16:06:01.837476 20134 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260811 16:06:01.903203 20035 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:01.931561 20134 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:01.932116 20134 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 10
W20260811 16:06:01.933944 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57544.1us
I20260811 16:06:01.938426 13904 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:01.835304 19438 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:01.907977 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.059s	sys 0.060s
I20260811 16:06:01.870390 19913 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
W20260811 16:06:01.910470 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.063s	sys 0.090s
W20260811 16:06:01.972838 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.063s	sys 0.090s
I20260811 16:06:01.874033 20082 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:01.929186 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.890116 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:01.897204 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:01.929524 13903 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:01.975874 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:01.971810 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1022) took 4015 ms. Trace:
I20260811 16:06:01.978914 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:01.976541 14575 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:06:01.980022 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 95229.7us
W20260811 16:06:01.980353 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 83274.9us
I20260811 16:06:01.981148 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:01.862097 13821 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260811 16:06:01.942574 13826 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260811 16:06:01.981145 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:01.945611 13905 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260811 16:06:01.900241 19803 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:01.978837 13818 rpcz_store.cc:276] 0811 16:05:57.956317 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.022222 (+1065905us) service_pool.cc:227] Handling call
0811 16:05:59.022584 (+   362us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:05:59.023171 (+   587us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:05:59.930275 (+907104us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18003c7780. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c5191f435 00007f5c5191f3b8
0811 16:06:00.531159 (+600884us) log.cc:842] Serialized 14 byte log entry
0811 16:06:00.971246 (+440087us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:01.020182 (+ 48936us) log.cc:842] Serialized 52 byte log entry
0811 16:06:01.020337 (+   155us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:01.020575 (+   238us) log.cc:842] Serialized 14 byte log entry
0811 16:06:01.044488 (+ 23913us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:01.044619 (+   131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:01.380409 (+335790us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b18003c7780. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c557b4bcf 00007f5c4e9e47b6 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d
0811 16:06:01.390968 (+ 10559us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b18003c7780. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4799 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:01.971547 (+580579us) raft_consensus.cc:1671] finished
0811 16:06:01.971574 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:01.971743 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43308,"prepare.queue_time_us":221850,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":10035,"raft.queue_time_us":24332,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":74979,"spinlock_wait_cycles":109177856,"thread_start_us":878140,"threads_started":2,"wal-append.queue_time_us":584276}
I20260811 16:06:01.953456 14541 leader_election.cc:398] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11.
W20260811 16:06:01.956626 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.059s	sys 0.060s
W20260811 16:06:01.951335 20089 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.002s
I20260811 16:06:01.949507 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:01.858938 20140 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
W20260811 16:06:01.968446 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.000s	sys 0.024s
I20260811 16:06:01.914803 19981 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:01.901952 19436 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:01.979743 14577 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:01.957556 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:01.970216 19887 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260811 16:06:01.990084 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:01.984679 14541 leader_election.cc:401] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:02.068528 14575 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 9 FOLLOWER]: Advancing to term 11
I20260811 16:06:02.068663 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.069454 13821 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:01.967470 19888 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:01.969507 19438 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:02.073184 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 119941us
I20260811 16:06:01.802137 20139 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:02.013623 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64202.8us
I20260811 16:06:02.080382 13736 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:06:02.082098 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.082590 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:02.076741 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:02.018863 13903 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:02.006256 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.000s	sys 0.024s
I20260811 16:06:02.085651 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.009143 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.088627 13824 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:02.089986 13824 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:06:02.091807 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:02.092497 13821 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:02.092422 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.093305 13738 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:02.094103 20134 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.091976 20048 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:01.985536 20067 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:01.995895 19935 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:02.091611 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.130110 13741 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:02.018388 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:02.131287 13736 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:02.122120 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:02.131901 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 113655us
I20260811 16:06:02.132939 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:02.136029 14575 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:01.996846 20138 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:02.102375 20027 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.014s	sys 0.026s
I20260811 16:06:01.999034 19975 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:02.123440 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46845.4us
W20260811 16:06:02.124756 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 143717us
I20260811 16:06:02.184516 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:02.068266 20035 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:01.992484 19990 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:01.994372 20092 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:01.995579 20084 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.145502 19956 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:02.149504 13821 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:01.993326 19763 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:02.179747 20137 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:02.120096 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:02.008209 19955 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:02.067975 19919 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:02.095422 20048 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:02.179806 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57854us
W20260811 16:06:02.186373 13907 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.014s	sys 0.027s
I20260811 16:06:01.984467 19803 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:02.194069 20069 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.200218 19956 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:02.014770 19712 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:06:02.180936 20027 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.014s	sys 0.026s
I20260811 16:06:02.179443 19911 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:02.145813 20074 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11.
I20260811 16:06:02.177742 20099 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:02.178216 19935 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.201030 13821 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:06:02.216746 19763 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:01.979467 20040 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.118s
W20260811 16:06:02.203277 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.015s	sys 0.023s
W20260811 16:06:02.265952 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.015s	sys 0.023s
W20260811 16:06:02.266418 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 706482us
I20260811 16:06:02.181109 19958 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.017040 20089 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.213416 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:02.217259 13907 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.014s	sys 0.027s
W20260811 16:06:02.217518 13827 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.008s	sys 0.035s
W20260811 16:06:02.274698 13827 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.008s	sys 0.035s
I20260811 16:06:02.131817 19887 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:02.217705 13706 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:02.178597 19825 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.001s
I20260811 16:06:02.202702 20084 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:02.091696 19981 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:02.240365 13823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.041s	sys 0.024s
W20260811 16:06:02.287438 13823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.041s	sys 0.024s
I20260811 16:06:02.128432 19888 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.145627 20067 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:02.216779 19919 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:02.194017 20035 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:02.219794 20114 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.018s	sys 0.016s
W20260811 16:06:02.238679 19794 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.026s	sys 0.026s
I20260811 16:06:02.221081 19803 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:02.192816 19975 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.219971 20144 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.253139 19956 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:02.296119 19183 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.018s	sys 0.020s
I20260811 16:06:02.265883 19763 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:02.293800 19934 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:02.273566 20069 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.284768 20139 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.287873 13901 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:02.289156 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71531.4us
I20260811 16:06:02.325892 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:02.271986 20138 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.278779 19887 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:02.219177 19955 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.350258 19955 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:02.294564 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.006s	sys 0.037s
I20260811 16:06:02.218014 20137 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:02.303272 20113 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.012s	sys 0.023s
I20260811 16:06:02.272653 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:02.295615 20114 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.019s	sys 0.017s
I20260811 16:06:02.292665 19919 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:02.265923 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.003s	sys 0.031s
W20260811 16:06:02.384435 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.003s	sys 0.031s
W20260811 16:06:02.299430 19794 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.026s	sys 0.026s
I20260811 16:06:02.266968 19935 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.299465 20140 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.333045 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:02.337195 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:02.318058 19938 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.008s
I20260811 16:06:02.340471 20147 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.405679 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:02.341193 20142 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260811 16:06:02.315758 20144 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.342559 19975 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.322027 19763 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:02.320228 19934 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:02.347474 19887 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:02.316108 19183 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.018s	sys 0.021s
W20260811 16:06:02.359570 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.006s	sys 0.037s
W20260811 16:06:02.418056 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 742535us
I20260811 16:06:02.217415 19436 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.366364 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:02.375403 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 102887us
I20260811 16:06:02.434499 14582 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260811 16:06:02.376545 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 222904us
I20260811 16:06:02.338197 20084 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:06:02.330535 20134 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:02.388396 19825 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:02.446384 19825 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.448976 19825 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:02.388906 19990 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:02.449797 19990 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.389365 20040 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:02.451460 20040 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.453819 20040 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:02.390197 14579 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:02.390865 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.390110 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:02.373961 20113 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.012s	sys 0.024s
I20260811 16:06:02.455459 14578 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13. Re-sending same reply.
I20260811 16:06:02.455518 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.402848 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.405495 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:02.457894 14577 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:06:02.458052 20104 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:06:02.380393 20128 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:02.458817 20104 consensus_queue.cc:1225] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:06:02.413623 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:02.407531 20140 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.460273 19990 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:02.329936 20069 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.359894 20138 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.462231 20084 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:02.437455 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.414880 19975 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:02.412632 20147 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:02.489650 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.490501 13827 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:02.490839 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 310537us
I20260811 16:06:02.446843 13906 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260811 16:06:02.358057 20089 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:02.391716 19922 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.919s	user 0.014s	sys 0.000s
I20260811 16:06:02.458730 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.459491 20128 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:02.399585 20145 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260811 16:06:02.385072 19958 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:02.510972 13906 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:06:02.461145 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:02.469488 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:02.512612 13820 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:06:02.472203 13736 raft_consensus.cc:595] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:02.473495 20138 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:02.474078 20158 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260811 16:06:02.474740 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.475158 19888 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:02.476076 20133 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:02.478790 20148 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.345s	user 0.000s	sys 0.004s
W20260811 16:06:02.480110 20155 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:06:02.437074 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:02.484299 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.415585 20048 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:02.417032 19934 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:02.480784 19955 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260811 16:06:02.445317 20035 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:02.515349 13736 raft_consensus.cc:603] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:06:02.491417 19896 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.005s
I20260811 16:06:02.520206 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.568734 14578 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260811 16:06:02.410056 19938 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.529925 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:02.531649 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.531704 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.532855 13820 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
W20260811 16:06:02.530711 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 69643.4us
I20260811 16:06:02.449129 19438 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:02.518322 19958 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:02.561429 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 124444us
I20260811 16:06:02.577730 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:02.563669 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:02.571290 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:02.568375 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:02.531524 20139 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.486536 20104 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260811 16:06:02.583659 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.593040 13820 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:02.594254 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.584678 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.499123 19183 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260811 16:06:02.518910 19956 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:02.572414 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 188718us
I20260811 16:06:02.557276 20166 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:02.603786 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73956.7us
I20260811 16:06:02.618126 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:02.619652 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:02.605830 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:02.559617 20149 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:02.517685 19975 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.615607 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:02.571573 19888 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:02.560564 20154 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:02.572013 20134 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.571832 19990 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.625676 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.576524 20114 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:02.518652 19803 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.572191 19922 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:02.613942 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.579280 19958 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:02.588003 19979 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:02.615343 20074 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:02.641731 13820 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
W20260811 16:06:02.642099 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2180) took 1677 ms (client timeout 1503 ms). Trace:
W20260811 16:06:02.650451 13735 rpcz_store.cc:269] 0811 16:06:00.964932 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.968052 (+  3120us) service_pool.cc:227] Handling call
0811 16:06:02.641850 (+1673798us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400002b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:02.641998 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3695465728}
I20260811 16:06:02.650980 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.651505 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:02.537652 20133 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.648809 14575 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:02.617223 20088 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:02.645704 13904 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:02.653752 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:02.656834 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.656219 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.632468 19888 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:02.660319 13821 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:02.638239 20099 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:02.664963 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.665613 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.667325 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.576325 19896 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.660768 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2194) took 1142 ms. Trace:
I20260811 16:06:02.668030 13740 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 10.
I20260811 16:06:02.673568 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.635614 20069 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.633019 20168 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:02.672037 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:02.681047 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:02.681604 20088 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:02.681797 13820 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:02.671382 19888 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:02.684932 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:02.686563 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71047us
I20260811 16:06:02.687107 20043 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:02.687373 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:02.687574 20168 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:02.687726 20043 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:02.688015 20168 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:02.688876 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:02.688784 20043 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:02.691540 20069 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:02.691954 20069 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:02.692349 20069 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:02.680200 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69085.5us
I20260811 16:06:02.581001 20165 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.086s
I20260811 16:06:02.616235 20139 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.648726 20082 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:02.650527 20137 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:02.649974 20074 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:02.702826 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:02.699051 19935 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:02.785081 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.785821 14574 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:02.705824 14541 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:02.707487 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.673027 13825 rpcz_store.cc:276] 0811 16:06:01.518451 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.785867 (+267416us) service_pool.cc:227] Handling call
0811 16:06:01.786282 (+   415us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:01.786677 (+   395us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:01.786720 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:01.787786 (+  1066us) log.cc:842] Serialized 52 byte log entry
0811 16:06:02.139391 (+351605us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:02.183374 (+ 43983us) log.cc:842] Serialized 14 byte log entry
0811 16:06:02.194782 (+ 11408us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.194855 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:02.473443 (+278588us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:02.653118 (+179675us) raft_consensus.cc:1671] finished
0811 16:06:02.660535 (+  7417us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:02.660706 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9027,"prepare.queue_time_us":47731,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":4053,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":18894,"spinlock_wait_cycles":40262656,"thread_start_us":351180,"threads_started":1,"wal-append.queue_time_us":392564}
I20260811 16:06:02.644744 19990 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.633232 20149 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.641019 20154 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:02.692597 19438 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:02.768942 20158 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260811 16:06:02.775470 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 76032.4us
I20260811 16:06:02.891269 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:02.893187 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:02.640836 20134 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.747502 20089 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:02.781306 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1052) took 1124 ms. Trace:
I20260811 16:06:02.781190 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:02.904700 13824 rpcz_store.cc:276] 0811 16:06:01.657191 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.090583 (+433392us) service_pool.cc:227] Handling call
0811 16:06:02.090885 (+   302us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:02.097948 (+  7063us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:02.097996 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:02.178219 (+ 80223us) log.cc:842] Serialized 26 byte log entry
0811 16:06:02.570013 (+391794us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:02.570072 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.570165 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:02.781028 (+210863us) raft_consensus.cc:1671] finished
0811 16:06:02.781048 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:02.781244 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6739,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":24191,"thread_start_us":373046,"threads_started":1,"wal-append.queue_time_us":470071}
I20260811 16:06:02.782032 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:02.875912 19913 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.002s
I20260811 16:06:02.778693 20104 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:06:02.692543 20138 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:02.787714 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 82141.1us
I20260811 16:06:02.789537 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:02.795222 20074 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:02.929286 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.888336 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:02.922600 14573 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:02.787114 13821 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:02.636765 20035 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260811 16:06:02.898015 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.648214 19922 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.580577 20084 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.902814 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.790488 20118 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
W20260811 16:06:02.923542 20162 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260811 16:06:02.906023 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.920974 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:02.782765 13820 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:02.972187 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.973343 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.974629 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.633333 20166 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:02.790832 20137 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260811 16:06:02.929432 13901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1014) took 1278 ms (client timeout 1544 ms). Trace:
W20260811 16:06:02.790457 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 87368us
I20260811 16:06:02.985452 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.932340 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:02.987011 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.937996 13902 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260811 16:06:02.938565 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1012) took 1288 ms. Trace:
I20260811 16:06:02.980536 13820 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:02.894289 19712 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260811 16:06:02.948050 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1020) took 1072 ms. Trace:
I20260811 16:06:02.999271 13906 rpcz_store.cc:276] 0811 16:06:01.875336 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.521640 (+646304us) service_pool.cc:227] Handling call
0811 16:06:02.537018 (+ 15378us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:02.557826 (+ 20808us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:02.557875 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:02.558468 (+   593us) log.cc:842] Serialized 26 byte log entry
0811 16:06:02.650859 (+ 92391us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:02.650896 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.650955 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:02.947768 (+296813us) raft_consensus.cc:1671] finished
0811 16:06:02.947799 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:02.947972 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33295,"raft.queue_time_us":21605,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7837,"thread_start_us":92042,"threads_started":1,"wal-append.queue_time_us":221554}
W20260811 16:06:02.948678 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 237522us
I20260811 16:06:03.003209 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:02.953131 13743 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
W20260811 16:06:02.921651 20172 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
W20260811 16:06:02.902418 20178 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260811 16:06:02.954082 14583 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:03.020350 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1040) took 2998 ms. Trace:
I20260811 16:06:02.876330 19825 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:02.904615 20089 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:02.944808 20147 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:02.990437 13903 rpcz_store.cc:276] 0811 16:06:01.650102 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.712208 (+ 62106us) service_pool.cc:227] Handling call
0811 16:06:02.937401 (+1225193us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000c6f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:02.938478 (+  1077us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":296632704}
I20260811 16:06:03.057073 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.057297 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.058236 13903 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:02.943733 14574 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
I20260811 16:06:02.909600 19438 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260811 16:06:02.985006 13901 rpcz_store.cc:269] 0811 16:06:01.650628 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.666215 (+ 15587us) service_pool.cc:227] Handling call
0811 16:06:02.929203 (+1262988us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002c10d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:02.929355 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1427420544}
I20260811 16:06:03.060979 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:03.010389 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:02.953697 19833 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:03.011933 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.013315 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2486) took 1257 ms. Trace:
I20260811 16:06:02.965160 20170 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:03.019372 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2193) took 1541 ms. Trace:
I20260811 16:06:03.088052 13826 rpcz_store.cc:276] 0811 16:06:01.478073 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.479984 (+  1911us) service_pool.cc:227] Handling call
0811 16:06:03.019031 (+1539047us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:03.019284 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":913248512}
I20260811 16:06:02.899665 19934 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:03.020772 13817 rpcz_store.cc:276] 0811 16:06:00.022004 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.043499 (+ 21495us) service_pool.cc:227] Handling call
0811 16:06:00.095036 (+ 51537us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:01.016355 (+921319us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:01.016401 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:01.034595 (+ 18194us) log.cc:842] Serialized 26 byte log entry
0811 16:06:01.985250 (+950655us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:02.075219 (+ 89969us) log.cc:842] Serialized 14 byte log entry
0811 16:06:02.075485 (+   266us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.470134 (+394649us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18005081e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:02.950049 (+479915us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18005081e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:06:03.014405 (+ 64356us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540014e454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:03.014450 (+    45us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:03.014499 (+    49us) raft_consensus.cc:1671] finished
0811 16:06:03.014512 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.020278 (+  5766us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":89732,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":60766,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":211,"spinlock_wait_cycles":442473984,"thread_start_us":1545352,"threads_started":2,"wal-append.queue_time_us":1057184}
I20260811 16:06:03.023270 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:02.966497 20138 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:03.027984 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2466) took 3953 ms (client timeout 2830 ms). Trace:
I20260811 16:06:03.028381 13908 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260811 16:06:02.962738 20118 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:03.099005 13905 rpcz_store.cc:269] 0811 16:05:59.074698 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:59.074836 (+   138us) service_pool.cc:227] Handling call
0811 16:06:03.022066 (+3947230us) spinlock_profiling.cc:243] Waited 2.87 s on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:03.027889 (+  5823us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6599054720}
I20260811 16:06:03.112020 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.098193 13906 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:03.113508 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.113757 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:02.979682 20048 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260811 16:06:03.027364 19825 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:03.154502 19825 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:03.155097 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.044195 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2198) took 1524 ms. Trace:
I20260811 16:06:03.156121 13822 rpcz_store.cc:276] 0811 16:06:01.519905 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.806911 (+287006us) service_pool.cc:227] Handling call
0811 16:06:01.823012 (+ 16101us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:01.823298 (+   286us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:01.823336 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:01.823899 (+   563us) log.cc:842] Serialized 26 byte log entry
0811 16:06:02.299885 (+475986us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:06:02.299919 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.299987 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:03.043928 (+743941us) raft_consensus.cc:1671] finished
0811 16:06:03.043957 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.044123 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":420771,"threads_started":1,"wal-append.queue_time_us":718584}
I20260811 16:06:02.924479 19436 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260811 16:06:03.156998 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:02.996394 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:02.984704 20137 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:02.936354 19913 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:03.068675 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.070046 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:03.160759 19913 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.067034 13902 rpcz_store.cc:276] 0811 16:06:01.756300 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.218802 (+462502us) service_pool.cc:227] Handling call
0811 16:06:02.937658 (+718856us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:02.989802 (+ 52144us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.013087 (+ 23285us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54000c6f50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:03.013249 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1604882816}
I20260811 16:06:03.161418 13909 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:03.009938 19917 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:03.099277 13908 pending_rounds.cc:76] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 8
I20260811 16:06:03.164007 13908 pending_rounds.cc:97] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260811 16:06:03.104084 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.035285 19938 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.055923 20089 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:03.055653 19956 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:03.065511 19975 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.065970 19803 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:03.109375 20139 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.099722 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:03.233021 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:06:02.982379 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89237.9us
I20260811 16:06:03.159086 20137 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:03.138725 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:03.158071 20188 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260811 16:06:03.097678 20147 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260811 16:06:03.164130 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.164757 13743 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:03.032797 19896 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.104198 19981 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:03.166167 13908 raft_consensus.cc:2866] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:03.164235 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1015) took 1513 ms. Trace:
I20260811 16:06:03.087683 20128 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.163684 19917 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:03.218039 20187 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.164s	user 0.000s	sys 0.005s
I20260811 16:06:03.027855 20144 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.235441 13741 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:03.236199 20048 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:03.208547 20154 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.248646 13909 rpcz_store.cc:276] 0811 16:06:01.650902 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.743363 (+ 92461us) service_pool.cc:227] Handling call
0811 16:06:01.762796 (+ 19433us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:03.161908 (+1399112us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.163989 (+  2081us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:03.164173 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3216104320}
I20260811 16:06:03.250443 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.299510 13743 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:03.251276 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2205) took 1364 ms. Trace:
I20260811 16:06:03.065809 20189 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.208s
I20260811 16:06:03.235697 13906 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:03.300464 13823 rpcz_store.cc:276] 0811 16:06:01.887359 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.353691 (+466332us) service_pool.cc:227] Handling call
0811 16:06:02.353989 (+   298us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:02.360752 (+  6763us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:02.360798 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:02.371835 (+ 11037us) log.cc:842] Serialized 52 byte log entry
0811 16:06:02.565780 (+193945us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:02.591048 (+ 25268us) log.cc:842] Serialized 14 byte log entry
0811 16:06:02.603108 (+ 12060us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.603231 (+   123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:03.250996 (+647765us) raft_consensus.cc:1671] finished
0811 16:06:03.251023 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.251209 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33360,"prepare.queue_time_us":15420,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":18192,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":10768,"thread_start_us":153543,"threads_started":1,"wal-append.queue_time_us":257746}
I20260811 16:06:03.302778 20048 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:03.233559 20118 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:03.334600 20118 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:03.335472 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1162) took 1255 ms. Trace:
I20260811 16:06:03.335904 13742 rpcz_store.cc:276] 0811 16:06:02.080056 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.082106 (+  2050us) service_pool.cc:227] Handling call
0811 16:06:02.092048 (+  9942us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:02.323257 (+231209us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:02.323293 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:02.323347 (+    54us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:02.323379 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.331132 (+1007753us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540020a3d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:03.335254 (+  4122us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.335405 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":531091840}
I20260811 16:06:03.340327 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:03.336843 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:03.343642 20189 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:03.344094 20189 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:03.344240 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:03.344488 20189 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:03.347970 13736 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:03.349371 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.350462 13736 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:03.356801 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.357873 13742 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:03.360548 19833 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:03.367605 19833 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:03.378806 13735 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:06:03.395689 13742 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:03.311555 20048 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:03.407577 20048 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:03.417681 20181 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.398s	user 0.002s	sys 0.000s
I20260811 16:06:03.433528 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1000) took 3429 ms. Trace:
I20260811 16:06:03.434067 13907 rpcz_store.cc:276] 0811 16:06:00.003949 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:00.561475 (+557526us) service_pool.cc:227] Handling call
0811 16:06:00.673210 (+111735us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:01.028742 (+355532us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:06:01.551466 (+522724us) log.cc:842] Serialized 14 byte log entry
0811 16:06:02.279989 (+728523us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:02.280047 (+    58us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:02.280090 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.433156 (+1153066us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400007b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:03.433236 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.433421 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8900,"prepare.queue_time_us":71098,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6133,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5584,"spinlock_wait_cycles":817094400,"thread_start_us":1219954,"threads_started":2,"wal-append.queue_time_us":764400,"wal-append.run_cpu_time_us":1424,"wal-append.run_wall_time_us":1029277}
I20260811 16:06:03.439560 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1637) took 1042 ms. Trace:
I20260811 16:06:03.440136 14581 rpcz_store.cc:276] 0811 16:06:02.396686 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.396898 (+   212us) service_pool.cc:227] Handling call
0811 16:06:02.413139 (+ 16241us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:02.457491 (+ 44352us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:02.457528 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:02.457577 (+    49us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:02.457615 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.439196 (+981581us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54004e02d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:03.439261 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.439480 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":101447424}
I20260811 16:06:03.437287 19955 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:03.336093 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.137708 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:03.099128 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:03.528884 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 948639us
I20260811 16:06:03.337203 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:03.530403 13741 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:03.351858 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.532384 13736 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:03.534030 14573 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:06:03.534890 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 300294us
I20260811 16:06:03.537758 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:03.541069 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:03.544960 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:03.552099 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.053s	sys 0.139s
W20260811 16:06:03.552641 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.053s	sys 0.140s
W20260811 16:06:03.557286 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.018s
I20260811 16:06:03.566818 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:03.566712 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.013s
W20260811 16:06:03.569089 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.013s
W20260811 16:06:03.569553 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 566464us
I20260811 16:06:03.570576 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:03.567269 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.013s	sys 0.018s
W20260811 16:06:03.563788 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.006s
W20260811 16:06:03.572391 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 577972us
W20260811 16:06:03.572623 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.008s	sys 0.006s
W20260811 16:06:03.573884 14583 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.553s	user 0.020s	sys 0.015s
I20260811 16:06:03.574236 14583 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
W20260811 16:06:03.522380 20103 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.010s	sys 0.004s
I20260811 16:06:03.579032 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2485) took 1823 ms. Trace:
I20260811 16:06:03.594122 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:03.595690 13743 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:03.596896 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:03.587935 13741 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:03.592271 14581 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260811 16:06:03.567256 20099 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.014s	sys 0.000s
I20260811 16:06:03.593743 13900 rpcz_store.cc:276] 0811 16:06:01.755834 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.755992 (+   158us) service_pool.cc:227] Handling call
0811 16:06:01.786210 (+ 30218us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:01.858956 (+ 72746us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:01.859006 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:01.896954 (+ 37948us) log.cc:842] Serialized 26 byte log entry
0811 16:06:02.477601 (+580647us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b1800351400. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:02.645552 (+167951us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:02.645615 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:02.645741 (+   126us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:03.417050 (+771309us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:03.578745 (+161695us) raft_consensus.cc:1671] finished
0811 16:06:03.578777 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:03.578953 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":74337,"raft.queue_time_us":84166,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":16977,"spinlock_wait_cycles":25408512,"thread_start_us":167676,"threads_started":1,"wal-append.queue_time_us":1013178}
I20260811 16:06:03.563985 20147 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:03.538074 19934 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.539660 20133 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.538992 19922 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:03.610450 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:03.617997 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:03.602645 13818 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.016s
I20260811 16:06:03.613447 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:03.610586 13906 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:03.564057 19966 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:06:03.592450 20103 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.010s	sys 0.004s
I20260811 16:06:03.517920 19955 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:03.613926 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:03.624490 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2481) took 3189 ms. Trace:
I20260811 16:06:03.887631 14582 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:03.676931 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2496) took 1915 ms. Trace:
I20260811 16:06:03.622602 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1640) took 1210 ms. Trace:
I20260811 16:06:03.695240 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.886328 13900 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:03.932367 13901 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260811 16:06:03.929375 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 315545us
W20260811 16:06:03.612337 20099 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.015s	sys 0.000s
W20260811 16:06:03.612845 20043 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.015s	sys 0.003s
I20260811 16:06:03.922688 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:03.933619 14575 rpcz_store.cc:276] 0811 16:06:02.412574 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.413305 (+   731us) service_pool.cc:227] Handling call
0811 16:06:03.622329 (+1209024us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54003d13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:03.622523 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":424331136}
W20260811 16:06:03.580747 20035 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.009s	sys 0.005s
W20260811 16:06:03.953056 20035 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.010s	sys 0.010s
I20260811 16:06:03.924326 13904 rpcz_store.cc:276] 0811 16:06:01.761446 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.195092 (+433646us) service_pool.cc:227] Handling call
0811 16:06:03.676715 (+1481623us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:03.676868 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":842271616}
W20260811 16:06:03.954071 20069 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.247s	user 0.018s	sys 0.001s
I20260811 16:06:03.954476 20069 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:03.825932 19763 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.391s	user 0.014s	sys 0.017s
W20260811 16:06:03.820427 19888 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.136s	user 0.010s	sys 0.009s
W20260811 16:06:03.614282 20180 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.605s	user 0.001s	sys 0.001s
I20260811 16:06:03.579643 20194 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:06:03.704077 19958 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.046s	user 0.020s	sys 0.016s
W20260811 16:06:03.769243 19919 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.373s	user 0.017s	sys 0.015s
W20260811 16:06:03.767098 20179 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.758s	user 0.003s	sys 0.000s
I20260811 16:06:03.614027 20136 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:03.604463 20176 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:06:03.701756 20067 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:03.950964 20043 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.016s	sys 0.003s
I20260811 16:06:03.609103 20197 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:03.720024 20186 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:03.769747 20140 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:03.832170 20114 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:03.675190 20191 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:03.602558 20195 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:03.771620 20149 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.895186 20147 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:04.017817 20147 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:04.018364 20192 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Stepping down as leader of term 9
I20260811 16:06:04.018796 20192 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:04.002504 20197 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.021381 20069 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.755245 20134 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.748461 20081 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.748203 20166 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:03.758831 20169 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.222s
W20260811 16:06:03.997886 20168 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.309s	user 0.015s	sys 0.011s
W20260811 16:06:03.994390 20189 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.640s	user 0.017s	sys 0.000s
I20260811 16:06:04.021584 20197 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.001971 20176 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:04.039084 20168 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.040133 20189 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.045480 20168 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.004273 20186 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.045855 20189 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:04.047539 20216 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260811 16:06:04.047900 20186 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.049248 20147 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.050747 20176 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:04.105020 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.004s	sys 0.012s
I20260811 16:06:04.105582 13737 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:04.105019 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:04.108047 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.016s	sys 0.008s
W20260811 16:06:04.108655 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.016s	sys 0.008s
I20260811 16:06:04.108750 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:03.612663 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:04.111758 13744 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.004s	sys 0.014s
W20260811 16:06:04.112320 13744 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.004s	sys 0.014s
I20260811 16:06:04.112267 13741 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:04.113587 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:04.106051 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.005s	sys 0.012s
I20260811 16:06:04.114612 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:04.117084 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.118319 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2198) took 1432 ms. Trace:
I20260811 16:06:04.105818 13735 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
W20260811 16:06:03.615360 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.014s	sys 0.006s
W20260811 16:06:03.781647 13820 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.017s	sys 0.022s
W20260811 16:06:04.124141 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.017s	sys 0.028s
W20260811 16:06:04.124541 13820 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.028s	sys 0.029s
W20260811 16:06:04.125479 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 504781us
I20260811 16:06:03.676429 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.120675 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.110872 13743 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:04.156487 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.157560 13743 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
W20260811 16:06:04.157846 13818 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.010s	sys 0.016s
I20260811 16:06:03.931718 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:04.159530 13905 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.030s	sys 0.052s
W20260811 16:06:04.160117 13905 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.030s	sys 0.052s
I20260811 16:06:04.161880 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1021) took 2286 ms. Trace:
I20260811 16:06:04.162117 19955 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.935806 13908 rpcz_store.cc:276] 0811 16:06:00.435015 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.196751 (+761736us) service_pool.cc:227] Handling call
0811 16:06:03.022504 (+1825753us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:03.247930 (+225426us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.624214 (+376284us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54000c8850. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:03.624411 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4197956864}
I20260811 16:06:03.970443 19922 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:03.694046 19687 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:03.971511 19887 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.531s	user 0.011s	sys 0.020s
I20260811 16:06:03.755167 19917 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:03.602367 19979 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.347s
I20260811 16:06:03.784662 19990 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.122804 13741 rpcz_store.cc:276] 0811 16:06:02.685485 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:04.116760 (+1431275us) service_pool.cc:227] Handling call
0811 16:06:04.117415 (+   655us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:04.117903 (+   488us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.117940 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:04.118019 (+    79us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:04.118051 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.118113 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.118235 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:06:04.136983 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.011s
W20260811 16:06:04.142328 13742 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.001s	sys 0.000s
I20260811 16:06:04.143074 19981 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:04.149645 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.015s	sys 0.056s
I20260811 16:06:04.180258 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2427) took 1513 ms. Trace:
I20260811 16:06:04.150870 20147 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.152123 20084 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:04.153148 20133 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:04.206408 20133 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:04.207125 20133 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:04.208524 20138 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.209625 20138 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.149646 20081 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.211316 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.212373 20081 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:03.955183 13904 pending_rounds.cc:76] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 6
I20260811 16:06:04.214555 13904 pending_rounds.cc:97] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260811 16:06:04.215034 13904 raft_consensus.cc:2866] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:04.173377 19955 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:03.983330 19763 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:04.216835 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.012s
I20260811 16:06:04.216392 19955 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.217446 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1044) took 2669 ms. Trace:
W20260811 16:06:04.219419 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.008s	sys 0.016s
I20260811 16:06:04.219713 13740 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:04.219935 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.016s
W20260811 16:06:04.220531 13742 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.001s	sys 0.001s
W20260811 16:06:04.220494 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 628519us
W20260811 16:06:04.221290 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2433) took 1548 ms (client timeout 1877 ms). Trace:
I20260811 16:06:04.179598 20170 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:03.924043 19803 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:03.993803 19919 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:03.987607 19888 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.217929 13818 rpcz_store.cc:276] 0811 16:06:01.548372 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:01.984643 (+436271us) service_pool.cc:227] Handling call
0811 16:06:03.019915 (+1035272us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:04.158650 (+1138735us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.158733 (+    83us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:04.158812 (+    79us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:04.158845 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.158990 (+   145us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.217031 (+ 58041us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002ac1d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.217268 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":231827,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":2366555520,"thread_start_us":1137939,"threads_started":1}
W20260811 16:06:04.033281 20089 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.005s
I20260811 16:06:04.175638 20186 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.180431 20104 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:03.995584 19958 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:04.175978 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.008s	sys 0.015s
I20260811 16:06:04.181017 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:04.176690 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 248186us
I20260811 16:06:03.676832 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.222568 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:04.223237 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.016s	sys 0.057s
I20260811 16:06:04.239259 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1023) took 1681 ms. Trace:
I20260811 16:06:04.223671 19803 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.035965 20191 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.226111 14579 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:04.171383 13821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.000s	sys 0.008s
W20260811 16:06:04.244822 13821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.000s	sys 0.010s
I20260811 16:06:04.245779 20191 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:04.227419 19922 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.246039 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2843) took 1660 ms. Trace:
I20260811 16:06:04.225636 19183 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.230571 14580 raft_consensus.cc:2354] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16.
I20260811 16:06:04.234061 13827 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:04.236479 13823 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:04.233384 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.009s	sys 0.015s
I20260811 16:06:04.016043 20114 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:04.177793 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1171) took 1513 ms. Trace:
W20260811 16:06:04.221897 13740 rpcz_store.cc:269] 0811 16:06:02.673010 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.673335 (+   325us) service_pool.cc:227] Handling call
0811 16:06:04.220945 (+1547610us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.221175 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3552437504}
I20260811 16:06:04.178917 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2432) took 1506 ms. Trace:
I20260811 16:06:04.203367 13735 rpcz_store.cc:276] 0811 16:06:02.666506 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.398586 (+732080us) service_pool.cc:227] Handling call
0811 16:06:03.398866 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:04.123085 (+724219us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.179798 (+ 56713us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:04.180164 (+   366us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1624216320}
W20260811 16:06:04.238909 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 203393us
I20260811 16:06:04.247733 13906 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:04.264690 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:04.205298 20084 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:04.260239 14579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1214) took 1819 ms (client timeout 1748 ms). Trace:
I20260811 16:06:04.257328 13737 rpcz_store.cc:276] 0811 16:06:02.672754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.398487 (+725733us) service_pool.cc:227] Handling call
0811 16:06:03.398866 (+   379us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:04.106739 (+707873us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.178492 (+ 71753us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:04.178808 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1623689344}
I20260811 16:06:04.218922 19763 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.247768 20005 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:04.275506 20005 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:04.275825 19955 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:04.277263 20208 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.238s	user 0.000s	sys 0.002s
I20260811 16:06:04.236898 20069 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:04.279829 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:04.271332 20084 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:04.277308 20005 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.162472 13905 rpcz_store.cc:276] 0811 16:06:01.875662 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.158551 (+1282889us) service_pool.cc:227] Handling call
0811 16:06:03.158962 (+   411us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:03.221468 (+ 62506us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.221515 (+    47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:03.564402 (+342887us) log.cc:842] Serialized 52 byte log entry
0811 16:06:04.161012 (+596610us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:04.161135 (+   123us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.161334 (+   199us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.161428 (+    94us) raft_consensus.cc:1671] finished
0811 16:06:04.161454 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.161741 (+   287us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52031,"raft.queue_time_us":56224,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":3127,"thread_start_us":545953,"threads_started":1,"wal-append.queue_time_us":460780}
I20260811 16:06:04.229864 19888 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:04.269860 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 694396us
I20260811 16:06:04.263010 19958 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.230752 20185 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:04.223691 19981 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.176726 20189 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:04.178231 20166 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:04.268993 14579 rpcz_store.cc:269] 0811 16:06:02.429308 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.454983 (+ 25675us) service_pool.cc:227] Handling call
0811 16:06:04.247847 (+1792864us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54006cbe54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.248062 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3971191168}
I20260811 16:06:04.256971 13744 rpcz_store.cc:276] 0811 16:06:02.664250 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.667528 (+  3278us) service_pool.cc:227] Handling call
0811 16:06:02.667871 (+   343us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:03.055460 (+387589us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.055494 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:03.056296 (+   802us) log.cc:842] Serialized 52 byte log entry
0811 16:06:04.113309 (+1057013us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:04.142844 (+ 29535us) log.cc:842] Serialized 14 byte log entry
0811 16:06:04.176986 (+ 34142us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.177249 (+   263us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.177342 (+    93us) raft_consensus.cc:1671] finished
0811 16:06:04.177362 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.177678 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58245,"raft.queue_time_us":105176,"raft.run_cpu_time_us":459,"raft.run_wall_time_us":94215,"thread_start_us":1261587,"threads_started":3,"wal-append.queue_time_us":606386}
I20260811 16:06:04.297533 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:04.246505 13821 rpcz_store.cc:276] 0811 16:06:02.585798 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.986772 (+400974us) service_pool.cc:227] Handling call
0811 16:06:02.987229 (+   457us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:03.063395 (+ 76166us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.063441 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:03.523067 (+459626us) log.cc:842] Serialized 26 byte log entry
0811 16:06:04.245440 (+722373us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:06:04.245533 (+    93us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.245657 (+   124us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.245729 (+    72us) raft_consensus.cc:1671] finished
0811 16:06:04.245741 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.245961 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":248147,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":11044,"thread_start_us":727665,"threads_started":2,"wal-append.queue_time_us":481133}
W20260811 16:06:04.305156 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 184671us
I20260811 16:06:04.255278 19183 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.239744 13903 rpcz_store.cc:276] 0811 16:06:02.557928 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.159962 (+602034us) service_pool.cc:227] Handling call
0811 16:06:03.160375 (+   413us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:03.210877 (+ 50502us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.210905 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:03.218054 (+  7149us) log.cc:842] Serialized 26 byte log entry
0811 16:06:03.700157 (+482103us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:03.700212 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:03.700314 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.139089 (+438775us) raft_consensus.cc:1671] finished
0811 16:06:04.139163 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.238993 (+ 99830us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50026,"raft.queue_time_us":50356,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7191,"thread_start_us":442228,"threads_started":1,"wal-append.queue_time_us":763143}
I20260811 16:06:04.322084 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2199) took 1636 ms. Trace:
I20260811 16:06:04.323645 20185 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.324333 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2194) took 1639 ms. Trace:
I20260811 16:06:04.325140 20138 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.326270 20185 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.326931 19803 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.232106 20186 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.233062 20104 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.328810 20169 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:04.329368 20169 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:04.329787 20186 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:04.331262 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 108918us
I20260811 16:06:04.333997 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:04.335592 20081 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.336079 19981 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.337193 20005 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:04.337695 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.339426 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.340297 13740 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:04.345932 20205 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.346289 13821 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260811 16:06:04.346908 20205 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.350092 20205 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:04.313227 14580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1219) took 1792 ms (client timeout 1829 ms). Trace:
I20260811 16:06:04.322696 13735 rpcz_store.cc:276] 0811 16:06:02.685739 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:04.292656 (+1606917us) service_pool.cc:227] Handling call
0811 16:06:04.321169 (+ 28513us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:04.321576 (+   407us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.321602 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:04.321679 (+    77us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:04.321726 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.321792 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.321942 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:04.353076 13743 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:04.351907 14580 rpcz_store.cc:269] 0811 16:06:02.521275 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.538547 (+ 17272us) service_pool.cc:227] Handling call
0811 16:06:04.294125 (+1755578us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.313125 (+ 19000us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3789606656}
I20260811 16:06:04.176054 20177 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.179s
I20260811 16:06:04.329814 20169 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:04.231518 20089 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.324771 13742 rpcz_store.cc:276] 0811 16:06:02.684478 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.398289 (+713811us) service_pool.cc:227] Handling call
0811 16:06:03.443351 (+ 45062us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:03.443655 (+   304us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.443693 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:03.444617 (+   924us) log.cc:842] Serialized 26 byte log entry
0811 16:06:04.221479 (+776862us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:04.221581 (+   102us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.221705 (+   124us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.324088 (+102383us) raft_consensus.cc:1671] finished
0811 16:06:04.324109 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.324274 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":662515,"threads_started":1,"wal-append.queue_time_us":764364}
I20260811 16:06:04.365984 19803 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Leader election won for term 10
I20260811 16:06:04.372915 20170 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:04.373358 19803 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:04.373131 20166 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.375051 19887 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.376384 20166 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.377724 19887 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.379050 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.379765 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:04.380919 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:06:04.381155 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101761us
I20260811 16:06:04.383322 20204 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:04.384066 20204 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.374830 19803 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.393462 19183 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:04.395553 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61785.2us
I20260811 16:06:04.401472 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.401714 19922 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:04.402724 20189 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.403326 20205 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.404222 20205 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.405635 20189 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.406464 20205 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.407195 14575 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:04.407388 19919 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.410013 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.410269 20186 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:04.304876 19687 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.412868 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.413048 20035 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.413972 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.415978 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.416611 20185 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.451455 19687 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.451268 20185 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:04.416724 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2838) took 1834 ms (client timeout 1529 ms). Trace:
W20260811 16:06:04.420478 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57912.4us
I20260811 16:06:04.415040 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.425205 20205 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:04.428638 20103 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.438305 20089 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.389654 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:04.439471 20082 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.338s	user 0.005s	sys 0.014s
W20260811 16:06:04.442210 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61921.7us
I20260811 16:06:04.449793 20186 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.450011 20035 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.478821 20186 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.472282 13821 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260811 16:06:04.479811 13821 pending_rounds.cc:76] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 10
I20260811 16:06:04.480113 13821 pending_rounds.cc:97] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260811 16:06:04.480437 13821 raft_consensus.cc:2866] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:04.423476 20192 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.482795 20192 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 9 FOLLOWER]: Advancing to term 10
I20260811 16:06:04.447330 14577 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:06:04.487568 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 91127us
I20260811 16:06:04.467921 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.468151 20103 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.470017 20134 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:04.471215 19438 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:04.472257 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:04.473981 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:04.474720 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:04.453333 13827 rpcz_store.cc:269] 0811 16:06:02.582011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.605495 (+ 23484us) service_pool.cc:227] Handling call
0811 16:06:04.416372 (+1810877us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400219654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.416599 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3702411520}
I20260811 16:06:04.476672 20204 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.499500 14581 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16.
I20260811 16:06:04.457366 20205 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:04.462906 20082 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.005s	sys 0.014s
I20260811 16:06:04.478986 20035 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.499595 20134 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:04.530607 13818 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:04.515319 20205 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:04.533417 13909 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.593s	user 0.017s	sys 0.001s
I20260811 16:06:04.537820 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:04.524281 13709 connection.cc:232] RPC call timeout handler was delayed by -1.4295958229340613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260811 16:06:04.542799 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 68258.5us
I20260811 16:06:04.528760 20134 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:04.550468 20048 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.142s	user 0.004s	sys 0.021s
I20260811 16:06:04.531239 19438 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
W20260811 16:06:04.535692 20118 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.054s	user 0.021s	sys 0.010s
I20260811 16:06:04.564240 13909 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:04.572890 13741 raft_consensus.cc:2396] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:04.581991 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.560673 19438 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:04.566642 20185 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.593308 14581 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:04.596124 13706 leader_election.cc:398] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16.
I20260811 16:06:04.596735 13706 leader_election.cc:401] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260811 16:06:04.577576 20170 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:04.626641 20118 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:04.627717 20118 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.634670 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2505) took 1023 ms. Trace:
I20260811 16:06:04.635519 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.635248 13904 rpcz_store.cc:276] 0811 16:06:03.614273 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.953902 (+339629us) service_pool.cc:227] Handling call
0811 16:06:03.954943 (+  1041us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:04.333460 (+378517us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.333514 (+    54us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:04.334313 (+   799us) log.cc:842] Serialized 52 byte log entry
0811 16:06:04.457639 (+123326us) raft_consensus.cc:1631] Marking committed up to 5
0811 16:06:04.457694 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.488699 (+ 31005us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.634291 (+145592us) raft_consensus.cc:1671] finished
0811 16:06:04.634318 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.634580 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116645,"raft.queue_time_us":116992,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"thread_start_us":122837,"threads_started":1,"wal-append.queue_time_us":232774}
I20260811 16:06:04.637904 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:04.598366 20084 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.608492 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:04.611758 14577 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260811 16:06:04.616299 20074 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.662s	user 0.016s	sys 0.017s
I20260811 16:06:04.646018 14580 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:04.618002 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:04.648247 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 295969us
I20260811 16:06:04.650017 13740 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:04.658614 20237 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260811 16:06:04.652498 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:04.656363 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 155498us
I20260811 16:06:04.656049 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:04.665282 20185 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:04.666177 20185 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.667512 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2846) took 2080 ms. Trace:
I20260811 16:06:04.667946 13820 rpcz_store.cc:276] 0811 16:06:02.586981 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.990986 (+404005us) service_pool.cc:227] Handling call
0811 16:06:02.991326 (+   340us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:04.125474 (+1134148us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.125533 (+    59us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:04.126695 (+  1162us) log.cc:842] Serialized 26 byte log entry
0811 16:06:04.565413 (+438718us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:04.565465 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.565559 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.661104 (+ 95545us) raft_consensus.cc:1671] finished
0811 16:06:04.661148 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.667437 (+  6289us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":260248,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1570899,"threads_started":2,"wal-append.queue_time_us":531463}
I20260811 16:06:04.674939 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.676542 20103 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:04.679368 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 115649us
I20260811 16:06:04.679633 13823 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:04.680368 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.682380 19687 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:04.682910 19687 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:04.683586 19687 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:04.683414 20204 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260811 16:06:04.684796 20137 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.436s	user 0.013s	sys 0.016s
I20260811 16:06:04.685743 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.682802 20103 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260811 16:06:04.689670 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.695235 20082 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:04.696008 20137 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.696192 20082 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.691689 19438 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.706192 13738 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:04.700218 13735 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:04.701825 19438 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:04.711035 13818 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:04.703552 20082 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.661985 20074 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.718400 14573 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:04.701323 19825 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.546s	user 0.026s	sys 0.003s
I20260811 16:06:04.719627 20074 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:04.715691 20044 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:04.720785 20044 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.723519 20044 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.724905 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.719735 19825 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.735888 13744 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260811 16:06:04.735460 20035 raft_consensus.cc:2741] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260811 16:06:04.736661 14578 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260811 16:06:04.719873 20133 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.009s
I20260811 16:06:04.737491 13740 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:04.683054 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:04.745602 13823 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:06:04.749778 13743 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:04.753328 14579 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:04.754758 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:04.756227 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73353.9us
I20260811 16:06:04.722630 20134 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.735437 20185 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.694619 20114 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.758006 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:04.761034 13740 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:04.761245 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:04.763612 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91248.1us
I20260811 16:06:04.752801 19955 raft_consensus.cc:2741] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260811 16:06:04.766505 13789 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.791s (SENT)
I20260811 16:06:04.770376 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:04.758098 20118 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.778492 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:04.763080 20103 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:04.782799 13827 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:04.784576 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:04.786674 19833 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.304s	user 0.015s	sys 0.014s
I20260811 16:06:04.749079 20133 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:04.787288 19833 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.788718 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2499) took 1179 ms. Trace:
I20260811 16:06:04.789100 20133 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:04.789585 19833 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.804272 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.810091 20118 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260811 16:06:04.816903 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53594.9us
W20260811 16:06:04.819317 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 293925us
I20260811 16:06:04.819511 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.820183 20069 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16.
I20260811 16:06:04.820255 13820 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:04.789176 13907 rpcz_store.cc:276] 0811 16:06:03.609365 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.609591 (+   226us) service_pool.cc:227] Handling call
0811 16:06:03.609973 (+   382us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:04.156588 (+546615us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.156648 (+    60us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:04.157567 (+   919us) log.cc:842] Serialized 52 byte log entry
0811 16:06:04.354509 (+196942us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:04.375402 (+ 20893us) log.cc:842] Serialized 14 byte log entry
0811 16:06:04.375831 (+   429us) log.cc:842] Serialized 14 byte log entry
0811 16:06:04.376037 (+   206us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.788172 (+412135us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:04.788223 (+    51us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.788379 (+   156us) raft_consensus.cc:1671] finished
0811 16:06:04.788396 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.788549 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":23221,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":9423,"raft.run_cpu_time_us":579,"raft.run_wall_time_us":580,"spinlock_wait_cycles":1213471616,"thread_start_us":196452,"threads_started":1,"wal-append.queue_time_us":322241}
I20260811 16:06:04.800966 20137 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:04.841316 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 151762us
I20260811 16:06:04.841377 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.855965 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.856961 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.869206 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.872949 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1173) took 2208 ms. Trace:
I20260811 16:06:04.875982 20206 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:04.873445 13739 rpcz_store.cc:276] 0811 16:06:02.664830 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:02.668281 (+  3451us) service_pool.cc:227] Handling call
0811 16:06:02.668589 (+   308us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:03.065945 (+397356us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.065985 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:03.067175 (+  1190us) log.cc:842] Serialized 52 byte log entry
0811 16:06:04.109766 (+1042591us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:04.276096 (+166330us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:04.314068 (+ 37972us) log.cc:842] Serialized 14 byte log entry
0811 16:06:04.361405 (+ 47337us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.872510 (+511105us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54003471d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:04.872570 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.872662 (+    92us) raft_consensus.cc:1671] finished
0811 16:06:04.872674 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.872866 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54292,"prepare.queue_time_us":169647,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":42745,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":30646,"spinlock_wait_cycles":813254784,"thread_start_us":1146654,"threads_started":2,"wal-append.queue_time_us":875915}
I20260811 16:06:04.876856 20206 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.881950 20104 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.884222 20114 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.892082 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:04.893707 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2507) took 1278 ms. Trace:
I20260811 16:06:04.894173 13906 rpcz_store.cc:276] 0811 16:06:03.615012 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.922020 (+307008us) service_pool.cc:227] Handling call
0811 16:06:04.893467 (+971447us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400087ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.893637 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":680965504}
I20260811 16:06:04.898097 20084 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:04.908533 14574 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:06:04.903024 20192 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:04.910012 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.910492 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.911067 14574 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:04.822103 20186 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:04.943819 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:04.813431 19687 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:04.957333 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.957715 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:04.959110 13825 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:04.941411 20134 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:04.959786 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.960121 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.961066 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.961863 14574 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:04.962206 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2196) took 2277 ms. Trace:
I20260811 16:06:04.957381 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.911278 19833 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:04.907565 19825 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:04.827529 20169 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:04.942498 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 114344us
I20260811 16:06:04.968245 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:04.968868 13823 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:04.965858 13818 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:04.971731 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.972534 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:04.973507 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.974201 13817 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:04.975476 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.975801 14580 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:04.955557 20133 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:04.964426 20192 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:04.976970 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:04.977979 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:04.958514 20005 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260811 16:06:04.981189 14574 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:06:04.981235 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:04.975129 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.975505 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1652) took 1428 ms. Trace:
I20260811 16:06:04.979038 14581 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:06:04.865386 20204 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:04.984619 13817 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:04.989336 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.989790 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:04.962574 13736 rpcz_store.cc:276] 0811 16:06:02.684988 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.533297 (+848309us) service_pool.cc:227] Handling call
0811 16:06:03.533775 (+   478us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:03.534126 (+   351us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:03.534162 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:03.558839 (+ 24677us) log.cc:842] Serialized 26 byte log entry
0811 16:06:04.359428 (+800589us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:04.363890 (+  4462us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.369368 (+  5478us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:04.899030 (+529662us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54000792a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189a771 00007f5c518a5220 00007f5c518a51c8 00007f5c518a5148 00007f5c518a5103 00007f5c518a438c 00007f5c57915206 00007f5c5790d808 00007f5c518e138b 00007f5c518e3e80
0811 16:06:04.961696 (+ 62666us) raft_consensus.cc:1671] finished
0811 16:06:04.961735 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:04.962015 (+   280us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24281344,"thread_start_us":160663,"threads_started":1,"wal-append.queue_time_us":761526}
W20260811 16:06:04.913863 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65425.9us
I20260811 16:06:04.984063 14573 rpcz_store.cc:276] 0811 16:06:03.547129 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.547379 (+   250us) service_pool.cc:227] Handling call
0811 16:06:04.975234 (+1427855us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540052c954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:04.975430 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2576486656}
I20260811 16:06:05.001706 14583 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:04.966535 19833 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:05.006781 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:04.987004 20133 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:05.011703 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.017611 14581 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:05.009323 19687 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.005803 19833 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.007903 20177 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:05.033936 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.034757 14573 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:05.038447 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:05.039297 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58198.6us
I20260811 16:06:05.039680 13907 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:05.041980 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.042317 20149 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:05.043095 13904 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:04.996881 20192 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260811 16:06:04.997211 20205 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.050783 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.051918 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.001037 20204 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.038468 19955 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260811 16:06:05.057016 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.052417 20084 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:05.022783 20206 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.007879 20189 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260811 16:06:05.062150 13824 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:05.063354 13823 raft_consensus.cc:2396] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260811 16:06:05.045548 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:04.382303 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:05.069600 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.071751 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.072576 20170 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:05.074899 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.073925 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.085668 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1180) took 2096 ms. Trace:
W20260811 16:06:05.089774 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 309664us
I20260811 16:06:05.097610 13737 rpcz_store.cc:276] 0811 16:06:02.989427 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:04.300167 (+1310740us) service_pool.cc:227] Handling call
0811 16:06:04.367559 (+ 67392us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:04.419259 (+ 51700us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.419295 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:04.419362 (+    67us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:04.419396 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:05.085343 (+665947us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5400277ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:05.085412 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:05.085588 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":53611904}
I20260811 16:06:05.098769 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.093612 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.104540 13822 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [15.12-17.13]
W20260811 16:06:05.107784 13871 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.829s (SENT)
I20260811 16:06:05.108248 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.109144 13902 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:05.109709 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:05.111264 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.111001 20133 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.111577 20044 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:05.112072 13900 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:05.112269 20044 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:05.113018 13818 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 9. Current term is 10. Ops: []
W20260811 16:06:05.113688 20261 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260811 16:06:05.113538 20044 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.114120 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.115523 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.116079 13827 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
W20260811 16:06:05.111438 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87280.8us
I20260811 16:06:05.095079 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.117544 13823 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:05.118943 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.111286 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.121143 13826 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260811 16:06:05.114961 13821 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:05.132267 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.100543 20170 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:05.137938 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.043124 20149 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.142491 13909 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:05.141728 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.147667 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.120996 20220 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:05.147605 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:05.151499 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 71273.7us
I20260811 16:06:05.107829 19961 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:05.159348 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.159730 13825 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:05.161036 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.145747 19919 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:05.162297 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.158579 13826 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.168283 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.170866 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.179337 19961 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:05.181082 13900 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:05.181917 19961 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:05.182605 19896 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:05.183300 20149 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.184886 13907 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.186153 20204 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.155748 20169 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:05.188452 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.189253 13822 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:05.190923 19919 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:05.191365 20263 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260811 16:06:05.192090 19919 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:05.193462 13787 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.733s (SENT) [suppressed 26 similar messages]
I20260811 16:06:05.196288 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.197001 13906 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:05.199445 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.199985 13903 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260811 16:06:05.200203 13908 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:05.200562 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.201258 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.201473 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.201709 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.202488 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.208871 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.195744 13826 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:05.213356 20206 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:05.213858 20206 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:05.201258 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.220016 13903 raft_consensus.cc:2396] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260811 16:06:05.220440 13826 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:06:05.221504 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.222255 13826 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:05.223030 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.223733 13826 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:06:05.228345 20186 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:05.228958 20186 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:05.152539 20220 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:05.230842 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.157455 20185 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:05.244530 13902 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
W20260811 16:06:05.244582 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 827898us
I20260811 16:06:05.245275 14583 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:05.246049 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.215129 20206 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.251027 13904 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13. Re-sending same reply.
I20260811 16:06:05.260234 13907 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:05.265818 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.234102 20220 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.268153 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.270746 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.271000 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.250641 20185 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:05.273660 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.277674 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.279232 13908 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:05.279630 20166 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:05.287282 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2203) took 1167 ms. Trace:
I20260811 16:06:05.278457 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.276563 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:05.286226 13737 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:05.287789 13741 rpcz_store.cc:276] 0811 16:06:04.119615 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:04.265716 (+146101us) service_pool.cc:227] Handling call
0811 16:06:05.284180 (+1018464us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400002b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:05.287196 (+  3016us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":543958400}
I20260811 16:06:05.300254 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.301898 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:05.303465 14542 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.544s (SENT)
I20260811 16:06:05.304311 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:05.305648 19825 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:05.305912 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.306655 13903 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:05.311684 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2439) took 2628 ms (client timeout 2063 ms). Trace:
W20260811 16:06:05.312212 13738 rpcz_store.cc:269] 0811 16:06:02.682845 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:03.098205 (+415360us) service_pool.cc:227] Handling call
0811 16:06:05.311416 (+2213211us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000a8cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:05.311589 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3370067840}
I20260811 16:06:05.312084 19833 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.315801 13821 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260811 16:06:05.316001 19438 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.009s
I20260811 16:06:05.311460 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.317200 20147 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:05.317667 20147 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:05.318354 20168 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260811 16:06:05.318502 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.319420 19438 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:05.319651 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:05.319905 19438 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:05.321139 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1181) took 2307 ms. Trace:
I20260811 16:06:05.321036 19438 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.321529 13744 rpcz_store.cc:276] 0811 16:06:03.014002 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:04.326785 (+1312783us) service_pool.cc:227] Handling call
0811 16:06:04.327345 (+   560us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:04.739081 (+411736us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:05.320881 (+581800us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54002783d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:05.321074 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":914762112}
I20260811 16:06:05.322544 19438 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:05.319908 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.286761 20166 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:05.323833 20166 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:05.324059 20137 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:05.324687 20137 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:05.325739 20137 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.332036 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.318714 20147 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.303960 20170 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:05.333815 20147 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.335599 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.311460 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.337347 14573 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:05.337836 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.333647 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.278067 20185 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:05.304822 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.294766 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:05.343815 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.345112 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:05.347481 13736 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:05.347771 20170 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:05.350762 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.350904 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.353307 14583 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260811 16:06:05.353763 13908 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:06:05.354745 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.355495 13908 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16.
I20260811 16:06:05.356343 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.351832 14575 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
W20260811 16:06:05.358016 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70309.7us
I20260811 16:06:05.358228 20192 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:05.358839 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:05.359268 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:05.352780 13902 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:05.369220 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.371975 13825 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:05.359189 20205 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.383936 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.385182 13901 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:05.384730 13818 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:05.389564 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.389793 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:05.399313 13825 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:05.399739 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.400815 14583 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260811 16:06:05.402391 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.406643 13821 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:05.357950 19833 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.410614 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.409575 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:05.408277 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:05.412726 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.409031 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.408420 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.416476 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.419844 13904 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:05.421392 20205 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:05.422519 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.421694 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.422753 20205 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:05.425423 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.428781 13901 raft_consensus.cc:2396] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260811 16:06:05.424414 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.436851 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.428795 20205 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:05.442250 14575 raft_consensus.cc:2354] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:05.442761 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.443235 13903 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:05.443657 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.445501 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.446506 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.447391 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:05.447660 13908 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:05.449177 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90430.1us
I20260811 16:06:05.416160 20207 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:06:05.383008 20166 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:05.454540 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.462208 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.463091 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.448308 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.466316 13903 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:05.464213 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:05.442356 20082 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:05.384899 20186 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.6, Last appended by leader: 6, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:05.479807 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.476508 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.478201 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.482714 14573 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:05.483608 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.441916 20149 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260811 16:06:05.493690 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:05.484473 13905 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:05.487371 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:05.488128 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.495790 13909 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:05.489732 20204 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260811 16:06:05.479887 20207 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:05.456043 19833 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260811 16:06:05.521909 13907 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:05.521171 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:05.523782 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.528846 13709 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:06:05.530483 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.531488 14575 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:05.542660 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:05.543368 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 96120.1us
I20260811 16:06:05.552662 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.552515 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:05.563462 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:05.565495 13901 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:05.573546 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:05.575158 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:05.560540 19833 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:05.579272 14575 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:05.541347 20082 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.588661 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:05.592556 20166 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:05.593081 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:05.595467 19979 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260811 16:06:05.599970 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:05.558842 20205 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.605283 20205 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:05.607832 13904 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
W20260811 16:06:05.611919 20278 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260811 16:06:05.612342 20114 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:05.612939 20114 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:05.613404 20114 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.613986 20103 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:06:05.614496 20103 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:05.561326 20177 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260811 16:06:05.615581 20103 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.617194 20103 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:05.621014 20147 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:05.627414 20118 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:06:05.629506 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.629941 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.630427 13737 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:05.632786 20273 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260811 16:06:05.626546 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:05.631449 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:05.650116 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61592.7us
I20260811 16:06:05.651420 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:05.660148 13744 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:05.664503 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.665892 13907 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:05.581101 19955 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:05.659587 20149 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:05.669793 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.670327 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.645082 20192 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:05.647235 20186 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:05.689530 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:05.694430 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 264986us
I20260811 16:06:05.674583 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:05.694227 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.697515 13820 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.694847 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.690855 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.698252 13821 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260811 16:06:05.698772 13822 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.695276 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.650362 20206 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:05.659492 20177 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:05.702306 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 75891.2us
I20260811 16:06:05.703910 13824 raft_consensus.cc:2354] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14.
I20260811 16:06:05.667459 20166 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:05.687477 13908 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
W20260811 16:06:05.706017 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54704us
I20260811 16:06:05.708061 13818 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:05.629499 20118 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260811 16:06:05.711714 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:05.718636 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:05.672675 19687 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:05.688299 20005 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:05.726019 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.722735 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.699833 19955 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:05.756597 13736 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:05.690328 20192 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:05.757704 13744 raft_consensus.cc:2396] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260811 16:06:05.754767 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 91213.7us
I20260811 16:06:05.726045 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:05.706596 20170 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:05.759783 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.765570 13709 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:06:05.776721 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.779475 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:05.779687 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.708267 20149 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.768465 20137 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260811 16:06:05.795984 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 70339.9us
I20260811 16:06:05.801038 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.726009 20166 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:05.812479 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47099.1us
I20260811 16:06:05.813722 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:05.817682 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:05.765748 20005 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.764173 20177 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:05.798259 19955 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:05.847322 20192 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:05.788393 20170 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:05.851017 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71897.1us
W20260811 16:06:05.828732 20133 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.022s	sys 0.014s
W20260811 16:06:05.884240 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80261.7us
I20260811 16:06:05.885594 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:05.802914 20082 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.859928 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:05.865980 13822 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:05.827533 20147 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:05.903680 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:05.909911 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:05.903818 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 352791us
W20260811 16:06:05.882616 20220 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.593s	user 0.014s	sys 0.001s
W20260811 16:06:05.884578 20133 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.022s	sys 0.015s
I20260811 16:06:05.836444 20295 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:05.916716 13902 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
W20260811 16:06:05.925865 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 158311us
I20260811 16:06:05.895041 20147 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
W20260811 16:06:05.908120 20185 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.517s	user 0.014s	sys 0.000s
W20260811 16:06:05.936725 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44139.3us
I20260811 16:06:05.888844 20294 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:05.909317 19438 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:05.953119 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:05.892150 19955 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260811 16:06:05.941555 20082 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:06:05.973899 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 64123.9us
I20260811 16:06:05.947052 20192 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:05.980827 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 110031us
I20260811 16:06:05.951354 20147 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:05.984146 13739 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:05.930902 20220 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:05.991348 20287 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260811 16:06:05.995189 20177 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.996928 20005 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.948109 20185 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:06.000558 20281 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260811 16:06:06.003857 20290 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260811 16:06:06.004225 20283 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260811 16:06:06.064286 14580 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:06.011703 20286 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260811 16:06:06.012602 20293 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260811 16:06:06.015637 19990 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:06.021298 20114 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:05.981937 20294 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:06.027872 20170 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:05.970176 20008 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.237s
I20260811 16:06:06.029038 19825 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:06.036276 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46536.1us
I20260811 16:06:06.044171 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:06.068006 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 77930.8us
I20260811 16:06:06.065975 13820 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:06.075019 13823 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:06.039770 20166 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.121202 13787 leader_election.cc:398] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:06.121686 13787 leader_election.cc:401] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:06.121244 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.123834 13737 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:06.125742 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 414129us
I20260811 16:06:06.127497 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.076419 19990 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:06.108760 20149 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:06.146072 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 105721us
I20260811 16:06:06.146536 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:06.149273 20118 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:06.149819 20118 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:06.150213 20118 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:06.151010 20185 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:06.151298 20265 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.088s	user 0.006s	sys 0.004s
I20260811 16:06:06.133009 20186 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
W20260811 16:06:06.155350 20103 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.005s
I20260811 16:06:06.122139 20147 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:06.158283 20296 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260811 16:06:06.160750 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.162119 20220 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:06.163626 20118 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.165997 20118 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.118546 20170 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:06.167524 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.167811 20114 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:06.168452 13737 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:06.167855 20170 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.170733 20170 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.171588 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2211) took 1457 ms. Trace:
I20260811 16:06:06.143782 20298 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:06.139477 19990 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:06.172928 20205 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:06.173974 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:06.174798 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:06.175565 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:06.160158 20294 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:06.163048 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.117861 20082 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:06.185218 14578 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:06.189096 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.200203 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:06.200839 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:06.201567 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
W20260811 16:06:06.202097 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74692.1us
I20260811 16:06:06.205551 13909 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260811 16:06:06.188964 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.191814 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.179201 13743 rpcz_store.cc:276] 0811 16:06:04.713882 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:04.766023 (+ 52141us) service_pool.cc:227] Handling call
0811 16:06:04.791364 (+ 25341us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:04.791735 (+   371us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:04.791779 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:04.792317 (+   538us) log.cc:842] Serialized 26 byte log entry
0811 16:06:04.911663 (+119346us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:06:04.911697 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:04.911774 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:06.115225 (+1203451us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:06.171249 (+ 56024us) raft_consensus.cc:1671] finished
0811 16:06:06.171279 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:06.171524 (+   245us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":49011072,"thread_start_us":96469,"threads_started":1,"wal-append.queue_time_us":196183}
I20260811 16:06:06.207420 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.206882 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.203045 14573 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
W20260811 16:06:06.213555 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50571.7us
I20260811 16:06:06.181516 20149 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:06:06.220325 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:06.224368 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:06.228173 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:06.229568 14579 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
W20260811 16:06:06.233263 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 85063.3us
I20260811 16:06:06.234383 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.193781 20205 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:06.203630 20103 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:06.246879 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.248967 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:06.250782 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 390921us
I20260811 16:06:06.251518 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.253394 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.254326 13737 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:06.205142 20082 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:06.257198 20082 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:06.258601 19961 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:06.215405 20204 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:06.265151 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.219986 20298 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:06.233572 20084 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:06:06.274838 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58736.4us
W20260811 16:06:06.273102 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 94111.9us
I20260811 16:06:06.280277 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:06:06.284094 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 182141us
I20260811 16:06:06.278776 13826 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:06.290619 13737 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:06.265559 20307 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:06.270485 20149 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:06.273386 20084 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:06.281596 20207 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260811 16:06:06.331333 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54542.6us
I20260811 16:06:06.314392 20133 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:06:06.315066 20206 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:06.315879 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.321836 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:06.322037 13820 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:06.322826 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:06.322927 20312 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:06:06.327469 20316 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:06.328408 20205 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.284348 20166 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:06.367025 20166 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:06.367641 20166 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:06.369423 13742 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260811 16:06:06.369794 13742 pending_rounds.cc:76] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 7
I20260811 16:06:06.370051 13742 pending_rounds.cc:97] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260811 16:06:06.370298 13742 raft_consensus.cc:2866] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:06.313935 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1236) took 1014 ms. Trace:
I20260811 16:06:06.371903 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.372628 13739 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:06.333153 14544 leader_election.cc:398] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14.
I20260811 16:06:06.351368 13737 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:06.374699 14544 leader_election.cc:401] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260811 16:06:06.284889 20313 raft_consensus.cc:2741] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260811 16:06:06.375521 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:06.341934 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 381284us
I20260811 16:06:06.356329 20133 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:06.376369 20133 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:06.305253 20103 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:06.356592 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:06.364360 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.366191 20309 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:06.375628 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.352466 13908 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:06.310714 20307 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:06.329994 20207 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:06.384867 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.304378 20220 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:06.386722 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.379822 13825 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:06.390604 13744 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:06.366659 20206 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.407641 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.330579 20084 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:06.329598 20301 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260811 16:06:06.338943 19979 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260811 16:06:06.391238 19961 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:06.291250 20298 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.371340 14582 rpcz_store.cc:276] 0811 16:06:05.253717 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.253915 (+   198us) service_pool.cc:227] Handling call
0811 16:06:05.275367 (+ 21452us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:05.293949 (+ 18582us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:06:05.336846 (+ 42897us) log.cc:842] Serialized 14 byte log entry
0811 16:06:05.943633 (+606787us) log.cc:842] Serialized 14 byte log entry
0811 16:06:06.245055 (+301422us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:06.245136 (+    81us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:06.267276 (+ 22140us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:06.267352 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:06.267465 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29328,"prepare.queue_time_us":46598,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":113,"raft.queue_time_us":212202,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":12154,"thread_start_us":831798,"threads_started":3,"wal-append.queue_time_us":450987}
I20260811 16:06:06.420545 13908 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:06.394866 20207 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:06.391983 20307 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:06.440035 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:06.435351 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50564.8us
I20260811 16:06:06.435225 13739 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:06.445128 13741 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:06.423952 20103 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:06.453490 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.454303 20185 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:06.454861 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.453881 20103 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.455722 20312 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:06.456147 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:06.456503 13827 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.024s	sys 0.040s
I20260811 16:06:06.456265 20312 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:06.457516 20005 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:06.457589 20312 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.458230 20005 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:06.459682 13626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 309) took 42087 ms (client timeout 15000 ms). Trace:
I20260811 16:06:06.460059 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.460933 20005 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:06.456825 13737 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:06.414043 19438 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260811 16:06:06.456844 13827 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.024s	sys 0.040s
I20260811 16:06:06.463666 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.465824 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.461484 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:06.482201 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.428697 20170 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:06.490417 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:06.496778 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:06.499429 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122935us
I20260811 16:06:06.426860 19919 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260811 16:06:06.503724 19919 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:06.504200 19919 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:06.641232 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.505882 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:06.576467 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 79770.3us
I20260811 16:06:06.653656 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:06.655632 13707 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.514s (SENT)
I20260811 16:06:06.656169 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:06.488850 20005 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:06.482904 20186 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:06.393958 20133 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.493759 20316 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:06.675976 13739 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:06.573901 20311 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:06.498550 19979 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14.
I20260811 16:06:06.506857 20118 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:06.391402 20309 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.488512 20170 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:06.691054 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 378654us
I20260811 16:06:06.454909 20185 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.664577 19687 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:06:06.440310 20149 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:06.702819 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 325495us
I20260811 16:06:06.705380 13740 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:06:06.712267 13741 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:06.681106 19896 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:06.674721 20005 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.669291 20008 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:06.716168 20005 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.716452 20008 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.717729 20206 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.718297 20206 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:06.718626 20008 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.718793 20206 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:06.710614 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 281402us
I20260811 16:06:06.497974 20114 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.190s
I20260811 16:06:06.725965 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.659284 20192 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260811 16:06:06.731159 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 174595us
I20260811 16:06:06.688864 20118 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:06.680809 20316 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:06.707182 20311 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:06.707443 20170 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:06.745967 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:06.750590 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.747282 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.743559 20118 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:06.714810 19896 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.779601 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.754405 20008 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:06.753782 20206 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:06.793799 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 140248us
I20260811 16:06:06.801321 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.767576 20169 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:06:06.761149 19961 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:06.809851 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.756225 19438 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260811 16:06:06.782058 20168 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:06.766350 20335 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:06.740072 19919 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.809856 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1081) took 1145 ms. Trace:
I20260811 16:06:06.852401 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2870) took 1742 ms. Trace:
I20260811 16:06:06.855022 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.852867 13823 rpcz_store.cc:276] 0811 16:06:05.109756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.122294 (+ 12538us) service_pool.cc:227] Handling call
0811 16:06:05.265612 (+143318us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:06.852136 (+1586524us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54002dbed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:06.852324 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1863586432}
I20260811 16:06:06.852721 13826 rpcz_store.cc:276] 0811 16:06:05.664099 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.664233 (+   134us) service_pool.cc:227] Handling call
0811 16:06:06.809679 (+1145446us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400125054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:06.809789 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1175723776}
I20260811 16:06:06.805676 20206 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:06.874452 19955 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:06.874323 20206 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.875041 19955 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.875898 19438 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:06.876377 19438 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:06.876575 20206 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.877156 19955 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.877365 19438 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:06.880102 20317 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260811 16:06:06.881642 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2458) took 1051 ms. Trace:
I20260811 16:06:06.882030 13736 rpcz_store.cc:276] 0811 16:06:05.830130 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.830367 (+   237us) service_pool.cc:227] Handling call
0811 16:06:05.859260 (+ 28893us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:05.888365 (+ 29105us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:05.888401 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:05.904576 (+ 16175us) log.cc:842] Serialized 26 byte log entry
0811 16:06:06.267827 (+363251us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:06.267871 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:06.267932 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:06.881390 (+613458us) raft_consensus.cc:1671] finished
0811 16:06:06.881420 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:06.881574 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12856,"raft.queue_time_us":13104,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":29209,"thread_start_us":322886,"threads_started":1,"wal-append.queue_time_us":465937}
I20260811 16:06:06.883852 20114 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:06:06.884558 20114 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:06.869261 20298 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:06.886888 20185 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.888964 19896 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.889499 20313 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:06.889979 20313 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:06.809329 20294 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:06.854120 20315 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.200s
W20260811 16:06:06.460106 13626 rpcz_store.cc:269] 0811 16:05:24.372150 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:24.391615 (+ 19465us) service_pool.cc:227] Handling call
0811 16:06:06.459403 (+42067788us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:05:56.693421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:05:56.756897 (+ 63476us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:05:56.756979 (+    82us) write_op.cc:435] Acquired schema lock
0811 16:05:56.756999 (+    20us) tablet.cc:660] Decoding operations
0811 16:05:57.016638 (+259639us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:05:57.016747 (+   109us) write_op.cc:641] Partition lock acquired for write op
0811 16:05:57.016790 (+    43us) tablet.cc:683] Acquiring locks for 17 operations
0811 16:05:57.018092 (+  1302us) tablet.cc:699] Row locks acquired
0811 16:05:57.018131 (+    39us) write_op.cc:260] PREPARE: finished
0811 16:05:57.018313 (+   182us) write_op.cc:270] Start()
0811 16:05:57.018473 (+   160us) write_op.cc:276] Timestamp: P: 1786464357018248 usec, L: 0
0811 16:05:57.018509 (+    36us) op_driver.cc:331] REPLICATION: starting
0811 16:05:57.278485 (+259976us) log.cc:842] Serialized 6759 byte log entry
0811 16:05:58.187453 (+908968us) op_driver.cc:444] REPLICATION: finished
0811 16:05:58.496873 (+309420us) write_op.cc:301] APPLY: starting
0811 16:05:58.540344 (+ 43471us) tablet.cc:1365] starting BulkCheckPresence
0811 16:05:59.726699 (+1186355us) tablet.cc:1368] finished BulkCheckPresence
0811 16:05:59.726858 (+   159us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:06:01.359746 (+1632888us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:06:01.360263 (+   517us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0811 16:06:01.360354 (+    91us) write_op.cc:312] APPLY: finished
0811 16:06:01.360972 (+   618us) log.cc:842] Serialized 156 byte log entry
0811 16:06:02.268918 (+907946us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:02.278939 (+ 10021us) write_op.cc:454] Released schema lock
0811 16:06:02.293129 (+ 14190us) write_op.cc:341] FINISH: Updating metrics
0811 16:06:02.319465 (+ 26336us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:02.323301 (+  3836us) write_op.cc:454] Released schema lock
0811 16:06:02.478150 (+154849us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
Metrics: {"mutex_wait_us":224261,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":228273,"apply.run_cpu_time_us":81960,"apply.run_wall_time_us":3888890,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75051,"num_ops":17,"prepare.queue_time_us":378642,"prepare.run_cpu_time_us":17406,"prepare.run_wall_time_us":974158,"raft.queue_time_us":176187,"raft.run_cpu_time_us":8851,"raft.run_wall_time_us":172321,"replication_time_us":1157621,"spinlock_wait_cycles":30311168,"thread_start_us":1402865,"threads_started":5,"wal-append.queue_time_us":1151631,"wal-append.run_cpu_time_us":13953,"wal-append.run_wall_time_us":2739985}]]}
I20260811 16:06:06.879997 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2456) took 1104 ms. Trace:
I20260811 16:06:06.806087 20169 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:06.897536 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 111467us
I20260811 16:06:06.899196 13744 rpcz_store.cc:276] 0811 16:06:05.775271 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.788751 (+ 13480us) service_pool.cc:227] Handling call
0811 16:06:06.879775 (+1091024us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54002779d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:06.879929 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1353868672}
W20260811 16:06:06.900337 13707 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.664s (SENT)
W20260811 16:06:06.864073 20265 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260811 16:06:06.911928 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:06.911338 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:06.895694 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 135319us
I20260811 16:06:06.912616 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.915905 13907 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:06.897239 19438 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:06.883193 20309 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.811254 13628 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 4 to 8, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:06.884555 20204 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:06.924916 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:06.925626 13707 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.842s (SENT)
I20260811 16:06:06.925736 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:06.926319 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.927906 13909 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18. Re-sending same reply.
I20260811 16:06:06.935726 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:06.937265 20343 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260811 16:06:06.946581 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.947544 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.948372 13901 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:06.808753 20316 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.949891 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:06.950484 20316 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:06.953189 20166 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260811 16:06:06.953689 20166 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:06.956347 20302 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.838s	user 0.000s	sys 0.005s
I20260811 16:06:06.957863 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.959028 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:06.961405 20118 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:06.961992 19990 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.005s
W20260811 16:06:06.962668 20314 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.606s	user 0.000s	sys 0.002s
W20260811 16:06:06.962833 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44089.7us
I20260811 16:06:06.962568 19990 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:06.963889 13707 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.871s (SENT)
I20260811 16:06:06.965034 20177 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:06.965474 19990 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:06.965365 20345 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:06:06.965796 20177 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:06.950647 13904 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16.
W20260811 16:06:06.969859 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 268013us
I20260811 16:06:06.929520 19919 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:06.970780 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:06.971313 20137 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:06.972784 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:06.974001 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:06.974115 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:06.971941 20137 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:06.976436 20321 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:06.976712 20137 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:06.977111 20321 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:06.977715 20321 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:06.890935 20313 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:06.978912 20313 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:06.981048 13737 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.001s
I20260811 16:06:06.981421 13737 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:06.981637 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:06.982115 13738 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:06.947651 13907 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:06.974722 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:06.931588 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:06.988420 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57206.1us
W20260811 16:06:07.011101 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 156180us
I20260811 16:06:07.012080 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:07.013011 13822 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:07.013460 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.014370 13825 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260811 16:06:07.009217 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:07.019309 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:07.018110 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 344586us
I20260811 16:06:07.022874 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:07.011791 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.007s
W20260811 16:06:07.025910 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.003s	sys 0.007s
I20260811 16:06:07.026154 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:07.026494 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 649186us
I20260811 16:06:07.032123 13823 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:07.030463 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:07.039565 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48215.3us
I20260811 16:06:07.006978 20008 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:07.040860 13628 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:07.042775 13821 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:07.074754 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.076473 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.077212 13900 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:07.076469 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.080217 20349 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.081050 13909 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:06:07.082216 13628 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:07.083863 20344 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260811 16:06:07.085210 20305 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.058s
I20260811 16:06:07.011013 20169 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.086944 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.085819 13628 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:07.088671 13628 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 9 to 10, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 10 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:07.090597 20311 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:07.092257 13628 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:07.044710 20103 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:07.096237 13628 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 6 to 8, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 8 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:07.096968 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1083) took 1432 ms. Trace:
I20260811 16:06:07.097365 13827 rpcz_store.cc:276] 0811 16:06:05.664828 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.664955 (+   127us) service_pool.cc:227] Handling call
0811 16:06:05.695962 (+ 31007us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:05.696270 (+   308us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:05.696309 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:05.757351 (+ 61042us) log.cc:842] Serialized 26 byte log entry
0811 16:06:06.478384 (+721033us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:06.478438 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:06.478538 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:06.961900 (+483362us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:07.096662 (+134762us) raft_consensus.cc:1671] finished
0811 16:06:07.096682 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:07.096909 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2833280,"thread_start_us":683677,"threads_started":1,"wal-append.queue_time_us":528812}
W20260811 16:06:07.098426 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89316.7us
W20260811 16:06:07.101186 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 113391us
I20260811 16:06:07.012569 20220 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:07.105540 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.097877 13628 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 5 to 8, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 8 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:07.015019 20137 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:07.071552 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.077138 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:07.112887 13826 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:06:07.103843 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:07.045548 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.116051 13825 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:07.118484 19825 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:07.118989 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.119343 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.120023 13907 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:07.120947 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:07.121658 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:07.124701 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50069.4us
I20260811 16:06:07.126325 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.127218 13823 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
W20260811 16:06:07.122603 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43657.4us
I20260811 16:06:07.135116 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:07.138623 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.140815 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.142226 13628 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 4 to 6, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 6 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:07.144999 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.122159 20366 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260811 16:06:07.147378 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:07.147122 20311 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:07.148589 20311 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.150727 20311 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:07.151089 20361 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:07.151764 20361 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:07.152259 20361 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:07.153079 13821 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:07.154688 13821 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260811 16:06:07.156344 20311 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:07.156599 20118 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:07.156852 20311 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.159238 20311 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:07.160386 20205 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:07.161908 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.162633 14578 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:07.164417 13823 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:07.025693 20186 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:07.166285 20186 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:07.166740 20186 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:07.026167 20358 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260811 16:06:07.010320 20295 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260811 16:06:07.045042 20206 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:07.036569 20298 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260811 16:06:07.175067 20133 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:07.176640 20307 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260811 16:06:07.028128 20312 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:06:07.155067 13821 pending_rounds.cc:76] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 10
I20260811 16:06:07.182507 13821 pending_rounds.cc:97] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260811 16:06:07.182842 13821 raft_consensus.cc:2866] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:07.182850 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47836us
W20260811 16:06:07.131650 20147 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.009s	sys 0.037s
W20260811 16:06:07.179795 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 80725.2us
I20260811 16:06:07.190923 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:07.180586 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44812.8us
W20260811 16:06:07.178328 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 472868us
W20260811 16:06:07.181541 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77784.7us
I20260811 16:06:07.188766 13818 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
W20260811 16:06:07.192076 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 66441.2us
I20260811 16:06:07.194133 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.198374 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:07.199394 13737 raft_consensus.cc:2396] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260811 16:06:07.200508 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.200531 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:07.202179 14582 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260811 16:06:07.177877 20084 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.764s	user 0.014s	sys 0.000s
I20260811 16:06:07.209465 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.217621 20352 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:07.188359 20366 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:07.218621 20366 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:07.219205 20366 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:07.220584 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:07.222250 20362 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:07.222935 20362 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:07.223785 20362 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:07.223837 20310 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:07.224347 20310 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:07.225319 20310 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.226557 13743 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:07.198873 19687 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:07.230018 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.177084 20307 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.231554 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.232554 14573 raft_consensus.cc:2396] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260811 16:06:07.233037 20207 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.002s
I20260811 16:06:07.233471 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.180517 20206 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.233949 20307 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:07.235076 20307 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:07.235674 14579 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:07.235992 20206 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:07.188643 20082 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:07.236841 20082 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.233500 20207 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.241765 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:07.242426 13735 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:07.217734 20166 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:07.243764 13738 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:07.244105 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64690.4us
I20260811 16:06:07.238862 20082 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:07.192360 20147 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.009s	sys 0.038s
I20260811 16:06:07.180981 20349 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:07.123282 20137 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.196062 20220 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:07.185272 19825 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:07.184662 20301 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Stepping down as leader of term 11
W20260811 16:06:07.263273 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53948.4us
W20260811 16:06:07.264496 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70460us
I20260811 16:06:07.226930 20310 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:07.223882 20338 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:07.312849 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:07.314114 13825 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:07.316372 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.317574 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.297878 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:07.285784 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:07.287801 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 159560us
I20260811 16:06:07.322001 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.295912 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:07.300602 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:07.323901 13743 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:07.291342 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.325517 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:07.329780 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:07.251433 20206 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260811 16:06:07.331800 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47046.6us
I20260811 16:06:07.338860 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.329016 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:07.339915 13738 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:07.340206 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.321237 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:07.341440 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.323503 13825 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:07.332615 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:07.318462 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.343420 13737 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:07.344058 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:07.292577 20307 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260811 16:06:07.360385 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:07.292302 20332 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:06:07.345448 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.345932 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.346329 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:07.347177 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:07.204005 19961 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260811 16:06:07.287035 20103 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.304450 20301 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:07.244377 20084 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.365023 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.337214 20311 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:07.362648 13900 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:07.415431 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:07.367645 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.368048 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:07.416920 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49384.2us
I20260811 16:06:07.417842 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.282121 20352 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260811 16:06:07.367980 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:07.419366 13741 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:07.249156 20345 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260811 16:06:07.380020 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.364405 13825 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:07.386749 13901 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260811 16:06:07.424919 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.391043 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.391867 13907 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260811 16:06:07.392949 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.427011 13903 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:07.395386 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.371104 20192 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.369729 20338 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:07.438222 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:07.438501 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73561.8us
I20260811 16:06:07.364094 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:07.439679 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.406587 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:07.365829 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.337816 20313 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:07.346410 20206 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:07.336119 20220 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:07.421612 20332 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:07.280833 20149 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260811 16:06:07.363994 19896 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:07.364131 20295 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:07.494890 20294 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:07.418901 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:07.363725 20309 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.497062 20332 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.383821 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.432749 14573 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:07.382822 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2530) took 1174 ms. Trace:
I20260811 16:06:07.500698 13906 rpcz_store.cc:276] 0811 16:06:06.190848 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:06.190965 (+   117us) service_pool.cc:227] Handling call
0811 16:06:07.347103 (+1156138us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:07.365517 (+ 18414us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2261601024}
I20260811 16:06:07.407223 20166 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:07.387382 20207 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:07.415726 20311 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:07.461413 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:07.502553 20311 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:07.503659 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.505836 13707 leader_election.cc:398] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16.
I20260811 16:06:07.443163 20168 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:07.443204 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79831.8us
I20260811 16:06:07.465178 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:07.353597 20170 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.001s
I20260811 16:06:07.511327 13825 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:07.511286 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.460105 20307 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:07.423198 20186 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.458280 19833 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:07.460026 20192 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:07.425109 20008 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260811 16:06:07.485390 13741 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:07.514091 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.500129 20137 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:07.380473 19825 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.477774 20206 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:07.445182 20103 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.494782 19896 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:07.481761 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:07.491698 20364 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.546777 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:07.554257 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:07.608240 13820 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:07.520112 20315 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
W20260811 16:06:07.546958 20316 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.000s
I20260811 16:06:07.513622 20295 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:07.615736 13789 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.668s (SENT)
I20260811 16:06:07.662675 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.626500 20169 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:07.636771 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1249) took 1412 ms. Trace:
W20260811 16:06:07.611660 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57733.1us
I20260811 16:06:07.522064 20307 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:07.652190 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98052.4us
I20260811 16:06:07.674144 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:07.548729 20207 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:07.551182 20352 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:07.560036 19919 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:07.624585 20177 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:07.671979 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.611202 20374 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
W20260811 16:06:07.683506 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 243933us
I20260811 16:06:07.518417 20170 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.664536 14575 rpcz_store.cc:276] 0811 16:06:06.224312 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:06.224474 (+   162us) service_pool.cc:227] Handling call
0811 16:06:06.224755 (+   281us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:06.484182 (+259427us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:06.768154 (+283972us) log.cc:842] Serialized 14 byte log entry
0811 16:06:07.302482 (+534328us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:07.302558 (+    76us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:07.302612 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:07.636445 (+333833us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400490554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:07.636507 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:07.636648 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":176006,"prepare.queue_time_us":245616,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":7625,"raft.queue_time_us":213021,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14981,"spinlock_wait_cycles":596014976,"thread_start_us":611901,"threads_started":3,"wal-append.queue_time_us":147202}
I20260811 16:06:07.516626 20168 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.659603 20345 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:07.667718 20295 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:07.659065 19833 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:07.691071 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:07.693799 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78120.6us
I20260811 16:06:07.675554 20349 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:06:07.676635 20307 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:07.654946 19990 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260811 16:06:07.687458 19955 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:07.551610 20192 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.686273 20352 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:07.715314 20375 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260811 16:06:07.715863 20361 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.005s
I20260811 16:06:07.772096 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:07.491770 20301 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.688845 20177 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:07.690541 20374 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:07.770830 13818 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:07.708760 20316 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:07.718357 19687 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:07.709188 20008 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:07.715314 20369 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260811 16:06:07.721799 19833 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:07.776450 20352 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:07.739977 20084 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:07.786962 20205 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.003s
I20260811 16:06:07.819945 20118 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:07.820603 20118 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.812493 20168 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:07.811718 20374 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.824712 20374 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:07.801589 19833 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:07.825508 19833 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:07.722649 19955 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:07.815786 20373 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260811 16:06:07.815356 20177 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.834048 19955 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:07.701049 20345 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:07.840642 20345 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:07.816534 20376 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260811 16:06:07.833962 20177 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:07.690900 20220 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:07.852540 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 415470us
W20260811 16:06:07.818326 20326 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.149s	user 0.003s	sys 0.003s
I20260811 16:06:07.855911 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:07.684247 20338 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.792454 20344 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260811 16:06:07.935658 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 79841.4us
I20260811 16:06:07.778162 20361 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.941887 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.859236 20186 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:07.893774 20313 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:07.940395 20366 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.003s
I20260811 16:06:07.966514 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:07.967514 13908 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:07.959072 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.959421 13903 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:07.959710 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:07.960583 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:07.969265 13872 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.019s
W20260811 16:06:07.970508 13872 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.010s	sys 0.019s
I20260811 16:06:07.972090 13902 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:07.932102 20322 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:07.972112 13907 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:07.973100 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:07.955369 19438 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.028s	user 0.010s	sys 0.003s
I20260811 16:06:07.934589 20315 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:07.951887 19896 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:07.983124 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.018482 20192 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:08.036805 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 81059.8us
I20260811 16:06:07.991295 20170 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:08.038216 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:08.031985 20311 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260811 16:06:08.009313 20305 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:08.048589 20311 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.048787 20305 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.051013 20313 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.055344 19919 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:08.056664 20361 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.060530 20307 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.062071 20315 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 17.6, Last appended by leader: 6, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:08.065344 20310 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.003s
W20260811 16:06:08.065744 20362 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.841s	user 0.007s	sys 0.003s
I20260811 16:06:07.971442 20366 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.066170 20362 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.067811 20352 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:07.989566 20322 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.050920 20311 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:08.037038 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68472.8us
I20260811 16:06:08.063041 20307 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.079641 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.080613 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.084764 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.102002 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:08.050956 20305 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.110074 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:08.107067 20307 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:08.100065 20310 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:08.072757 19833 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.117787 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.109601 20386 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260811 16:06:08.144157 13908 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260811 16:06:08.125336 20133 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.948s	user 0.007s	sys 0.009s
I20260811 16:06:08.146355 20372 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:08.156644 20409 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:08.124521 19896 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.157635 20381 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260811 16:06:08.162423 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44805us
I20260811 16:06:08.123098 20362 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.166576 20338 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260811 16:06:08.169504 20407 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:06:08.177538 20322 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:08.128188 20307 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:08.170920 20401 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260811 16:06:08.210774 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.218037 13908 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:08.201781 20352 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.223222 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:08.232045 20414 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:06:08.180104 19896 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.222218 20374 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.220707 20366 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:08.247059 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 172123us
I20260811 16:06:08.240191 19833 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.249573 20372 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:08.252245 19896 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.248544 20374 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:08.258205 20206 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.003s
W20260811 16:06:08.260895 20295 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260811 16:06:08.260721 20206 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.265782 20206 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.261790 20295 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.272300 20044 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:08.272852 20044 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:08.273962 20044 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.274751 20295 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.267937 20177 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:08.270471 20169 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.001s
I20260811 16:06:08.275626 20177 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.292853 20177 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.297106 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.250247 20372 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.304811 14575 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:08.312477 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.313295 14575 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:08.326756 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.325436 20372 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:08.332278 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.013s
W20260811 16:06:08.332710 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.000s	sys 0.013s
W20260811 16:06:08.333310 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 659216us
I20260811 16:06:08.340417 19833 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.341540 19833 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.344568 19833 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.340452 20315 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260811 16:06:08.346233 20307 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:08.340617 13707 connection.cc:232] RPC call timeout handler was delayed by -1.1020157639868557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260811 16:06:08.347048 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2839) took 1436 ms. Trace:
I20260811 16:06:08.349258 19833 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.349998 19833 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.352499 19833 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.347697 13905 rpcz_store.cc:276] 0811 16:06:06.910929 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:06.911050 (+   121us) service_pool.cc:227] Handling call
0811 16:06:08.346840 (+1435790us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:08.346970 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2474400128}
W20260811 16:06:08.355492 20398 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.260s	user 0.003s	sys 0.000s
I20260811 16:06:08.358641 13736 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:08.378186 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.380350 13742 raft_consensus.cc:2396] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260811 16:06:08.378985 13735 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
W20260811 16:06:08.381415 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1205) took 2010 ms (client timeout 1887 ms). Trace:
I20260811 16:06:08.381711 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:08.381793 13742 rpcz_store.cc:269] 0811 16:06:06.370893 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:06.375386 (+  4493us) service_pool.cc:227] Handling call
0811 16:06:08.381213 (+2005827us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:08.381353 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4589388032}
I20260811 16:06:08.382668 13735 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:08.383123 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:08.388396 13742 raft_consensus.cc:2396] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260811 16:06:08.389689 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.391307 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.391896 13742 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:08.396507 13740 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:08.400900 13742 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:06:08.383785 13738 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:08.384267 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.406535 20207 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.406944 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.408187 19979 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:08.409479 20372 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:08.409978 20307 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:08.410213 20372 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:06:08.411265 20307 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:08.411685 20307 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:08.385488 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:08.412729 20307 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.417279 20307 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:08.416249 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2242) took 1305 ms. Trace:
I20260811 16:06:08.417805 13827 rpcz_store.cc:276] 0811 16:06:07.111383 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.112092 (+   709us) service_pool.cc:227] Handling call
0811 16:06:07.119452 (+  7360us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:07.130533 (+ 11081us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:07.130566 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:07.133292 (+  2726us) log.cc:842] Serialized 26 byte log entry
0811 16:06:07.262290 (+128998us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:07.262339 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:07.262420 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:08.415734 (+1153314us) raft_consensus.cc:1671] finished
0811 16:06:08.415760 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.416181 (+   421us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36030,"raft.queue_time_us":11276,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":39085,"thread_start_us":111432,"threads_started":1,"wal-append.queue_time_us":456139}
I20260811 16:06:08.407183 20207 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:08.427940 20371 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:08.428473 20371 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:08.429430 20371 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:08.432403 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 114752us
I20260811 16:06:08.433275 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.433828 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2245) took 1285 ms. Trace:
I20260811 16:06:08.433131 20384 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:08.434238 13820 rpcz_store.cc:276] 0811 16:06:07.148639 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.163366 (+ 14727us) service_pool.cc:227] Handling call
0811 16:06:07.163710 (+   344us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:07.653688 (+489978us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:08.433555 (+779867us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000d5054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:08.433764 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1021698304}
I20260811 16:06:08.435384 19896 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:08.435670 20170 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:08.435779 19896 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:08.436220 20170 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.436674 20170 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:08.436913 19896 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.438246 19896 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:08.440024 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.414650 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2886) took 2722 ms. Trace:
I20260811 16:06:08.441461 20384 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:08.442507 20315 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:08.442452 20384 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.443215 20315 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:08.447216 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.447086 20315 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.447852 13904 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:08.443778 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.443871 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.444377 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.444572 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.449586 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.450387 13906 raft_consensus.cc:2396] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:06:08.450531 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.445819 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:08.453034 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.454128 20410 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:08.454569 20410 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.454903 20410 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:08.455749 20384 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.460820 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.461095 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.449558 13909 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:08.452477 13904 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:08.469944 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.442157 13817 rpcz_store.cc:276] 0811 16:06:05.691777 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:05.703850 (+ 12073us) service_pool.cc:227] Handling call
0811 16:06:05.722798 (+ 18948us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:06.116740 (+393942us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:06.116793 (+    53us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:06.130810 (+ 14017us) log.cc:842] Serialized 52 byte log entry
0811 16:06:06.391850 (+261040us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:06.689273 (+297423us) log.cc:842] Serialized 14 byte log entry
0811 16:06:06.979558 (+290285us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:06.999670 (+ 20112us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:07.012154 (+ 12484us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:07.012224 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:07.817917 (+805693us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b2400138ed8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:06:08.414361 (+596444us) raft_consensus.cc:1671] finished
0811 16:06:08.414395 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.414562 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5145,"prepare.queue_time_us":411238,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":360548,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":19415,"spinlock_wait_cycles":145299840,"thread_start_us":1120990,"threads_started":4,"wal-append.queue_time_us":317150}
I20260811 16:06:08.472946 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.474025 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.474735 13900 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:08.477952 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.007s	sys 0.015s
W20260811 16:06:08.478500 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.007s	sys 0.015s
I20260811 16:06:08.478768 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:08.483116 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.008s	sys 0.005s
W20260811 16:06:08.483486 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.010s	sys 0.005s
I20260811 16:06:08.486965 19833 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:08.454806 20374 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:08.487574 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.003s	sys 0.015s
W20260811 16:06:08.487954 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.003s	sys 0.015s
I20260811 16:06:08.487630 19833 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.493502 13909 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:08.495395 20320 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.495958 20320 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.498588 20320 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:08.503276 13821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.009s	sys 0.008s
W20260811 16:06:08.503667 13821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.009s	sys 0.008s
I20260811 16:06:08.504812 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1090) took 1192 ms. Trace:
I20260811 16:06:08.495016 19833 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.505173 13821 rpcz_store.cc:276] 0811 16:06:07.312159 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.314336 (+  2177us) service_pool.cc:227] Handling call
0811 16:06:07.314821 (+   485us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:07.315104 (+   283us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:06:07.736970 (+421866us) log.cc:842] Serialized 14 byte log entry
0811 16:06:08.504269 (+767299us) log.cc:842] Serialized 14 byte log entry
0811 16:06:08.504449 (+   180us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:08.504497 (+    48us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:08.504544 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:08.504630 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.504756 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":282369,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":95,"raft.queue_time_us":173,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":169,"spinlock_wait_cycles":7776000,"thread_start_us":1097248,"threads_started":2,"wal-append.queue_time_us":309068}
W20260811 16:06:08.508854 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.008s	sys 0.012s
I20260811 16:06:08.534655 13743 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
W20260811 16:06:08.537704 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.008s	sys 0.012s
I20260811 16:06:08.538534 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1091) took 1226 ms. Trace:
I20260811 16:06:08.538703 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.539060 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2893) took 1502 ms. Trace:
I20260811 16:06:08.539559 13743 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:08.538952 13824 rpcz_store.cc:276] 0811 16:06:07.312490 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.317023 (+  4533us) service_pool.cc:227] Handling call
0811 16:06:07.369557 (+ 52534us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:07.369802 (+   245us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:07.691905 (+322103us) log.cc:842] Serialized 14 byte log entry
0811 16:06:08.538190 (+846285us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:08.538247 (+    57us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:08.538298 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:08.538368 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.538477 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31988,"prepare.queue_time_us":250604,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":309,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":1106449,"threads_started":2,"wal-append.queue_time_us":385846}
I20260811 16:06:08.540923 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.533529 13908 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:08.533282 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1692) took 1285 ms. Trace:
I20260811 16:06:08.532456 13904 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:08.542976 14580 rpcz_store.cc:276] 0811 16:06:07.247534 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.247714 (+   180us) service_pool.cc:227] Handling call
0811 16:06:08.533080 (+1285366us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400571f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:08.533218 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1844386176}
W20260811 16:06:08.543567 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55015us
I20260811 16:06:08.539575 13822 rpcz_store.cc:276] 0811 16:06:07.036284 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.036444 (+   160us) service_pool.cc:227] Handling call
0811 16:06:07.103902 (+ 67458us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:07.123426 (+ 19524us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:07.123474 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:07.136660 (+ 13186us) log.cc:842] Serialized 26 byte log entry
0811 16:06:07.317613 (+180953us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:07.317655 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:07.317722 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:08.538822 (+1221100us) raft_consensus.cc:1671] finished
0811 16:06:08.538843 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.539003 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":19684,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":42172,"thread_start_us":106430,"threads_started":1,"wal-append.queue_time_us":304276}
I20260811 16:06:08.545876 20366 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:08.546701 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.547035 20352 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.547653 20352 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.505932 20207 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:08.506930 13823 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.012s	sys 0.011s
W20260811 16:06:08.511907 20383 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.530s	user 0.003s	sys 0.000s
W20260811 16:06:08.478812 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.02545e+06us
I20260811 16:06:08.553292 13900 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:08.542748 20177 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:08.549430 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.549834 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.549453 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.560528 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.560762 14582 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:08.561157 13823 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.014s	sys 0.012s
I20260811 16:06:08.534830 13735 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:08.511056 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.561961 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.562645 13743 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:08.552647 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.558790 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.561520 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:08.565135 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.546934 20305 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:08.567982 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.569402 13743 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:08.569619 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.569453 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.571771 14574 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:08.553326 20301 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:08.583340 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.580974 13741 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260811 16:06:08.581548 13735 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260811 16:06:08.581929 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:08.595613 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.560295 19896 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.578895 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.601475 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.564347 20352 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.603677 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.579073 20185 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:08.609640 20204 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:08.521459 19979 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:08.579735 20320 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.611959 20354 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:08.612437 20354 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:08.612365 20320 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.612766 19979 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:06:08.613473 20354 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.614612 20320 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.616683 20295 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:08.564561 20307 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260811 16:06:08.620263 20307 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:08.620744 20307 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:08.621907 20307 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.627667 14577 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:08.601608 20322 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260811 16:06:08.606048 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.583310 20336 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:08.629648 20336 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.602803 14580 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:08.629910 20322 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:08.593469 20305 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.630381 20322 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:08.631083 20381 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:08.631582 20381 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.631963 20381 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:08.632324 20305 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.575271 19438 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.632938 20294 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:08.633055 19438 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.633496 20294 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.583808 20133 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:08.535808 20410 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.636247 20384 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:08.608641 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.605852 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.577560 20399 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:08.606441 19896 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.638011 14578 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:08.640290 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:08.635768 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55102.6us
I20260811 16:06:08.642341 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.647258 14582 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:08.599997 20366 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:08.649757 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.010s	sys 0.014s
W20260811 16:06:08.650192 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.010s	sys 0.014s
I20260811 16:06:08.651497 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.564038 20170 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.651835 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.567626 20177 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:08.657131 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59650.4us
I20260811 16:06:08.659132 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1207) took 1418 ms. Trace:
I20260811 16:06:08.660452 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.630014 20336 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:08.659614 13739 rpcz_store.cc:276] 0811 16:06:07.240754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.243161 (+  2407us) service_pool.cc:227] Handling call
0811 16:06:07.287593 (+ 44432us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:07.288005 (+   412us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:07.288037 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:07.288498 (+   461us) log.cc:842] Serialized 26 byte log entry
0811 16:06:07.632106 (+343608us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b1800457900. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:08.650623 (+1018517us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:06:08.650663 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:08.650752 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:08.650825 (+    73us) raft_consensus.cc:1671] finished
0811 16:06:08.650837 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.659060 (+  8223us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8756,"raft.queue_time_us":9506,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":24756,"spinlock_wait_cycles":19570432,"thread_start_us":1018266,"threads_started":1,"wal-append.queue_time_us":715047}
I20260811 16:06:08.672178 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.670809 20352 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:08.683436 20352 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:08.684489 20352 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.687697 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.688570 13740 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260811 16:06:08.641225 20133 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:08.689899 20177 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:08.655535 19438 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:08.662274 20361 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:08.691607 20361 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:08.678834 20315 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:08.692636 20361 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.694267 14579 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:08.676160 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.697194 13706 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.639863 20399 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:08.678236 20207 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.678926 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.679214 19896 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:08.678264 20410 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.680589 13902 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:08.694309 13628 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.009s	sys 0.006s
W20260811 16:06:08.707942 13628 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.010s	sys 0.006s
W20260811 16:06:08.708127 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65844us
I20260811 16:06:08.698555 13743 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260811 16:06:08.702437 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.709353 13909 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:08.698109 14581 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:08.700151 13907 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:08.654371 20147 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:08.655647 20384 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:08.658620 20204 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:08.711339 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.715682 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:08.674389 20307 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:08.718772 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:08.721778 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.726217 14583 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:08.726071 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 123715us
I20260811 16:06:08.699687 20315 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:08.709260 20177 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:08.738086 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.700201 20399 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:08.740105 14582 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:08.744156 20170 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.715742 20294 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.721131 20133 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:06:08.769836 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57446us
I20260811 16:06:08.752518 14583 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:06:08.761118 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52139.5us
I20260811 16:06:08.753798 14574 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:08.763931 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:08.771449 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:08.771579 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.773725 20204 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:08.746847 13739 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:08.774987 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37762
I20260811 16:06:08.775635 13739 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Received request to transfer leadership
I20260811 16:06:08.655452 20322 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.770792 13706 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.785192 20397 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:08.786135 20442 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260811 16:06:08.786481 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.785873 20397 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.787472 20397 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:08.720459 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:08.782972 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.785703 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.800896 13735 raft_consensus.cc:595] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:08.803164 13735 raft_consensus.cc:603] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:08.799196 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.810052 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:08.790690 20403 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.695s	user 0.000s	sys 0.003s
I20260811 16:06:08.769886 20133 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.814011 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.739996 20372 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260811 16:06:08.784721 20294 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:08.822454 20294 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.823017 20294 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:08.823427 20352 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:08.824122 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:08.825838 19833 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:08.826372 19833 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:08.816852 13742 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37762
I20260811 16:06:08.817407 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:08.828630 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:08.828979 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:08.829370 20170 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:08.830220 19896 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:08.830855 20352 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:08.827410 19833 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.831705 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.832460 20352 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.835587 13742 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Received request to transfer leadership
I20260811 16:06:08.835861 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:08.837025 13735 raft_consensus.cc:595] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.841419 13742 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:08.843300 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:08.844836 13742 raft_consensus.cc:595] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.846567 20352 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:08.848733 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:08.850478 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:08.850558 13706 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.851210 13735 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:08.809284 20206 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260811 16:06:08.857695 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 43781us
I20260811 16:06:08.853523 20177 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:08.851930 20133 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:08.869650 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:08.860075 20315 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:08.860634 20206 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:08.867376 20204 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:08.904630 20366 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:08.907912 20437 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260811 16:06:08.908751 20441 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260811 16:06:08.815442 20384 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.909832 20381 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:08.870464 20444 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260811 16:06:08.924083 13612 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 83722.9us
I20260811 16:06:08.950352 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1089) took 1638 ms. Trace:
I20260811 16:06:08.885854 20185 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:09.495453 20185 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:09.495798 20168 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.496022 20185 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.496450 20168 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:08.886960 20206 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:08.970237 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 100685us
I20260811 16:06:08.978952 20409 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:09.047376 20114 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.050673 13821 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:09.051880 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.054103 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.054629 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.055545 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.055915 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.056344 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:09.057647 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.059481 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:09.062297 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:09.063905 13907 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:09.074563 20455 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:09.076568 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 154923us
I20260811 16:06:09.555668 13820 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:09.111914 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1211) took 1648 ms. Trace:
I20260811 16:06:09.128499 20082 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.159906 20320 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:09.165401 20204 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.167037 20365 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:09.182957 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2236) took 1984 ms. Trace:
I20260811 16:06:09.190711 20464 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.191249 20466 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:09.196463 20467 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:09.208439 20468 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:08.941502 20170 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:09.244902 20354 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:09.253437 20133 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.279935 13823 rpcz_store.cc:276] 0811 16:06:07.311785 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.314184 (+  2399us) service_pool.cc:227] Handling call
0811 16:06:07.369064 (+ 54880us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:08.568014 (+1198950us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:08.568045 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:08.580140 (+ 12095us) log.cc:842] Serialized 26 byte log entry
0811 16:06:08.727349 (+147209us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:06:08.727398 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:08.728268 (+   870us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:08.950024 (+221756us) raft_consensus.cc:1671] finished
0811 16:06:08.950052 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:08.950257 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29971,"raft.queue_time_us":46071,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4598,"thread_start_us":1266840,"threads_started":2,"wal-append.queue_time_us":218024}
I20260811 16:06:09.283213 20381 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.286469 20321 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:09.294114 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1214) took 1230 ms. Trace:
I20260811 16:06:09.557654 20409 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:09.301614 13743 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37762
W20260811 16:06:09.309437 20399 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.003s
I20260811 16:06:09.310596 14579 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:09.301352 20177 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.356161 20371 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:09.378501 20147 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:09.392673 20322 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:09.396551 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:09.397850 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:09.622285 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 224534us
I20260811 16:06:09.603873 20467 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.611786 20361 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.403404 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:09.402698 20118 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.405835 20400 raft_consensus.cc:979] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:06:09.410148 13735 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:09.625061 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 221744us
I20260811 16:06:09.417335 20310 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.421859 20470 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:09.396422 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2238) took 1993 ms. Trace:
I20260811 16:06:09.627614 13736 rpcz_store.cc:276] 0811 16:06:07.403320 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.403501 (+   181us) service_pool.cc:227] Handling call
0811 16:06:07.419187 (+ 15686us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:08.360663 (+941476us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:09.396176 (+1035513us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54001045d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:09.396355 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2160039168}
I20260811 16:06:09.434783 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:09.448994 20475 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:09.632586 20483 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:09.633277 14579 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
W20260811 16:06:09.465725 20336 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.003s
W20260811 16:06:09.476210 20397 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.001s
I20260811 16:06:09.476595 20044 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:09.493278 20294 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.670s	user 0.016s	sys 0.000s
I20260811 16:06:09.498263 20185 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.636344 20315 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:08.876962 20339 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.739598 20339 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.741096 14575 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:06:09.553113 13826 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:09.744016 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:09.553220 13822 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:09.553846 13818 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:09.554208 13824 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:09.554278 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:09.558851 13738 rpcz_store.cc:276] 0811 16:06:07.463415 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.464896 (+  1481us) service_pool.cc:227] Handling call
0811 16:06:07.468713 (+  3817us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:08.404542 (+935829us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:09.111636 (+707094us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400344ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:09.111850 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2103938816}
I20260811 16:06:09.558851 13739 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260811 16:06:09.752113 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 197939us
I20260811 16:06:09.752647 20185 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:09.559620 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:09.522998 20301 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.020s	sys 0.008s
I20260811 16:06:09.563350 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:09.565788 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:09.573625 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.566062 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:09.753866 13740 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:09.565567 20082 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.754122 14573 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:09.570724 13744 rpcz_store.cc:276] 0811 16:06:07.198732 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:07.217602 (+ 18870us) service_pool.cc:227] Handling call
0811 16:06:07.217999 (+   397us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:07.336907 (+118908us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:07.336944 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:07.367300 (+ 30356us) log.cc:842] Serialized 26 byte log entry
0811 16:06:07.686868 (+319568us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:07.686910 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:08.511204 (+824294us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:09.182567 (+671363us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:09.182635 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:09.182686 (+    51us) raft_consensus.cc:1671] finished
0811 16:06:09.182700 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:09.182886 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20338,"raft.queue_time_us":95,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":19475,"spinlock_wait_cycles":288376320,"thread_start_us":261150,"threads_started":1,"wal-append.queue_time_us":491973}
I20260811 16:06:09.585569 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:09.560855 20309 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.609382 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:09.610070 13741 rpcz_store.cc:276] 0811 16:06:08.063612 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:08.535304 (+471692us) service_pool.cc:227] Handling call
0811 16:06:08.535685 (+   381us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:08.595067 (+ 59382us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:09.293781 (+698714us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54002774d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:09.294038 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":103625088}
I20260811 16:06:09.301295 20362 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:09.576363 20204 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.613245 13743 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Received request to transfer leadership
I20260811 16:06:09.764304 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:09.563339 20386 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:09.846228 14573 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:09.560104 20114 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.620671 13823 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:09.609906 20321 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:09.629647 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 194958us
I20260811 16:06:09.443370 20442 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:09.633169 20483 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:09.620913 20147 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:09.579718 20365 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:09.634994 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 575562us
I20260811 16:06:09.636178 20384 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260811 16:06:09.632772 20475 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.640298 14574 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:09.640120 20336 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.876137 20475 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.863746 20386 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.641604 14583 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:09.645431 20463 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:09.563702 20455 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.876822 20475 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:09.877774 20321 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.878840 20321 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:09.880226 20455 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.655267 20473 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260811 16:06:09.606365 20468 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.658354 14577 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:09.883948 13825 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:09.884191 20468 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.659896 20310 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.884918 20365 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.877580 20463 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.886197 20310 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.606878 20466 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.887377 20463 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.888540 20466 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.661110 20400 raft_consensus.cc:1067] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:06:09.500118 20168 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:09.579847 20320 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.893021 20320 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.670552 13736 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:09.895289 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:09.633358 20298 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:09.618057 20177 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.898546 20177 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.603456 20464 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.617020 20399 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.900879 20464 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.900942 20399 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.665557 19833 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.901698 13742 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:09.901854 19833 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.902510 13821 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:09.904796 19833 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.905478 19833 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:06:09.906584 13739 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:09.667308 20315 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:09.906921 14583 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:06:09.907450 20315 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:09.907639 14583 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:06:09.908147 14583 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:09.907871 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:09.905851 20400 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260811 16:06:09.908804 14574 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:09.661749 20397 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.633688 20361 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.912724 13737 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:09.912788 20361 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.913089 20386 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.674865 20467 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.636703 20470 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.690958 20472 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260811 16:06:09.928180 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:09.928930 13736 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:09.691345 20133 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.668363 20170 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.620739 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:09.709472 20206 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.681354 20409 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.722898 20332 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:09.752030 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.578220 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.575448 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:09.758790 13818 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:09.836886 20406 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260811 16:06:09.754050 13820 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:06:09.760991 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 151702us
I20260811 16:06:09.761545 13909 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:09.762459 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:09.837406 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0752778550377116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260811 16:06:09.950098 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0140778550412506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260811 16:06:09.950760 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:09.952762 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:09.789779 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for c390fd23cec5435d81b38a50b2988a60 already in progress
I20260811 16:06:09.759776 20185 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:09.791787 20301 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.023s	sys 0.008s
I20260811 16:06:09.956537 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:09.792304 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:09.816697 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:09.763520 20362 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:09.791309 20204 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.807443 13826 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:09.958603 13818 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:09.809679 13740 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:09.788796 20309 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:09.800838 20339 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.805773 13822 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
W20260811 16:06:09.815627 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52373.5us
I20260811 16:06:09.970963 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:09.841925 13743 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260811 16:06:09.852476 13623 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:09.972774 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.854413 20371 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:06:09.837011 20478 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.867514 20483 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:09.872164 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.876821 20336 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:09.640986 20471 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:09.885965 20396 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:06:09.637156 20453 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.667232 20294 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.910969 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:09.916756 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:09.866140 20118 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:09.932039 20082 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:09.935000 14583 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:10.031797 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 120917us
I20260811 16:06:09.945662 13817 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:09.958599 13735 raft_consensus.cc:2354] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:09.964366 13909 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:09.907827 20177 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260811 16:06:09.912828 20397 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.041791 14583 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.931484 20361 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:09.965570 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.042618 13824 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:09.964876 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c390fd23cec5435d81b38a50b2988a60 already in progress
I20260811 16:06:09.968724 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:09.974589 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800257d00 after lost signal to thread 12388
W20260811 16:06:10.046442 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08002af100 after lost signal to thread 13668
I20260811 16:06:10.046931 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:10.047945 13853 debug-util.cc:398] Leaking SignalData structure 0x7b080016d080 after lost signal to thread 13771
W20260811 16:06:10.048285 13853 debug-util.cc:398] Leaking SignalData structure 0x7b080016d060 after lost signal to thread 13772
W20260811 16:06:10.049469 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800114b40 after lost signal to thread 13856
W20260811 16:06:10.050734 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08003500e0 after lost signal to thread 13941
I20260811 16:06:09.959326 20185 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:09.974627 20469 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:09.975948 20114 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.977135 20470 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:09.977965 20362 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.052827 20185 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:09.959347 20467 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:06:10.064693 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 148012us
I20260811 16:06:09.977429 13623 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: config changed from index 2 to 7, term changed from 7 to 13, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193), VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194), VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195), VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:09.989336 13902 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:09.991081 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:10.072021 13906 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:09.992187 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.074047 13825 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:09.992496 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:09.993472 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.075729 13901 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:10.021510 20381 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:09.994437 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:09.994855 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:09.996043 20310 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:09.996337 20406 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:09.999300 20409 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:10.041524 20464 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:10.000676 20206 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.001268 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:10.001729 13628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 213) took 45543 ms (client timeout 15000 ms). Trace:
I20260811 16:06:10.002210 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.002782 20455 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:10.004009 13907 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 6. Preceding OpId from leader: term: 18 index: 7. (index mismatch)
I20260811 16:06:10.064838 20339 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:10.007763 20309 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:10.016446 20478 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.016083 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.018530 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.019243 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.019876 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:09.867707 20442 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.023463 13826 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:06:10.023420 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 268612us
I20260811 16:06:10.140514 14575 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:10.141734 20442 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.141928 19979 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.142449 19979 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.025739 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.144331 13822 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260811 16:06:10.029642 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.145428 14583 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260811 16:06:10.039755 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:10.146611 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 106959us
W20260811 16:06:10.050997 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800363e40 after lost signal to thread 13942
W20260811 16:06:10.067436 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 199461us
I20260811 16:06:10.067777 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:10.147959 14580 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:10.068481 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:10.148881 14578 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.069250 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.069473 13900 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:10.078763 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:10.150066 13735 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:10.150377 13735 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:10.150421 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:09.994211 13904 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260811 16:06:10.151276 13853 debug-util.cc:398] Leaking SignalData structure 0x7b080016f740 after lost signal to thread 14610
I20260811 16:06:10.034375 20168 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:09.946823 20332 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:10.100086 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 131426us
I20260811 16:06:10.090281 13818 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260811 16:06:10.152657 13853 debug-util.cc:398] Leaking SignalData structure 0x7b080040e3c0 after lost signal to thread 20314
I20260811 16:06:10.152563 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:06:10.153746 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08004358a0 after lost signal to thread 20367
I20260811 16:06:10.101377 13821 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:10.108489 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.109361 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:10.154764 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:10.156692 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.084751 20114 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.006649 13736 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:10.015306 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.076220 20185 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:10.161787 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.080437 20354 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.048430 20315 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.132668 20294 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.069816 20361 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.148761 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.044648 20133 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:10.127743 20455 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.204491 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.205411 13822 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:10.161731 20472 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.040792 20118 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:10.089818 13628 rpcz_store.cc:269] 0811 16:05:24.458051 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:24.458262 (+   211us) service_pool.cc:227] Handling call
0811 16:06:08.708317 (+44250055us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:08.708344 (+    27us) write_op.cc:454] Released schema lock
0811 16:06:10.001635 (+1293291us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:06:08.044925 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:06:08.045760 (+   835us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:06:08.045820 (+    60us) write_op.cc:435] Acquired schema lock
0811 16:06:08.045839 (+    19us) tablet.cc:660] Decoding operations
0811 16:06:08.078924 (+ 33085us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:06:08.099613 (+ 20689us) write_op.cc:641] Partition lock acquired for write op
0811 16:06:08.113680 (+ 14067us) tablet.cc:683] Acquiring locks for 9 operations
0811 16:06:08.237048 (+123368us) tablet.cc:699] Row locks acquired
0811 16:06:08.237121 (+    73us) write_op.cc:260] PREPARE: finished
0811 16:06:08.239223 (+  2102us) write_op.cc:270] Start()
0811 16:06:08.239459 (+   236us) write_op.cc:276] Timestamp: P: 1786464368239082 usec, L: 0
0811 16:06:08.239513 (+    54us) op_driver.cc:331] REPLICATION: starting
0811 16:06:08.240528 (+  1015us) log.cc:842] Serialized 3664 byte log entry
0811 16:06:08.356439 (+115911us) op_driver.cc:444] REPLICATION: finished
0811 16:06:08.359271 (+  2832us) write_op.cc:301] APPLY: starting
0811 16:06:08.359381 (+   110us) tablet.cc:1365] starting BulkCheckPresence
0811 16:06:08.372153 (+ 12772us) tablet.cc:1368] finished BulkCheckPresence
0811 16:06:08.372291 (+   138us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:06:08.398702 (+ 26411us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:06:08.399031 (+   329us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0811 16:06:08.399111 (+    80us) write_op.cc:312] APPLY: finished
0811 16:06:08.402091 (+  2980us) log.cc:842] Serialized 89 byte log entry
0811 16:06:08.402306 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:08.402440 (+   134us) write_op.cc:454] Released schema lock
0811 16:06:08.402507 (+    67us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1109908,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":2416,"apply.run_cpu_time_us":14104,"apply.run_wall_time_us":43686,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41675,"num_ops":9,"prepare.queue_time_us":536735,"prepare.run_cpu_time_us":16691,"prepare.run_wall_time_us":279243,"raft.queue_time_us":25200,"raft.run_cpu_time_us":1676,"raft.run_wall_time_us":2594,"replication_time_us":116816,"thread_start_us":1304694,"threads_started":4,"wal-append.queue_time_us":72147,"wal-append.run_cpu_time_us":8648,"wal-append.run_wall_time_us":1088021}]]}
I20260811 16:06:10.086023 20310 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:10.121925 20374 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260811 16:06:10.250125 20374 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
W20260811 16:06:10.179366 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70106.3us
I20260811 16:06:10.250577 20483 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.258421 13820 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:10.180711 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.259881 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.261145 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.182111 13821 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:06:10.261165 20483 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.263048 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.211053 20400 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.264525 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.264348 20400 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.265234 13821 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:10.266191 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.113600 20339 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:10.126197 14581 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:10.188592 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.168794 13735 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.195569 13743 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:10.112260 20406 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.042721 20453 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.156770 19979 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.160540 13741 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:10.203853 20177 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.103883 20204 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260811 16:06:10.164433 20468 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:10.166522 20309 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:10.092356 20381 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.172236 20206 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.197353 20133 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.172488 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:10.178311 20185 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.186013 20354 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.235847 20361 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.236158 13623 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 10, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:10.203058 20442 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:10.241474 14573 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260811 16:06:10.193608 20463 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:10.252274 20147 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.111625 20365 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:10.366609 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.256090 20118 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.257005 20467 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:10.199568 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:10.326185 14580 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:10.261763 13818 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:10.381708 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.327353 13735 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:10.328157 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:10.328514 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75137.5us
I20260811 16:06:10.288754 14578 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:10.314936 13906 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:06:10.332628 14544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.551s (SENT) [suppressed 25 similar messages]
W20260811 16:06:10.385385 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 52797.5us
I20260811 16:06:10.333541 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:10.341722 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1070) took 1559 ms (client timeout 1551 ms). Trace:
I20260811 16:06:10.343710 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.390030 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.186228 20301 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260811 16:06:10.233363 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.394387 13706 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.396065 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:10.397621 13823 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260811 16:06:10.350615 20386 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.162269 20168 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.353163 20486 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.334712 20466 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:10.365569 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.423885 14583 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:06:10.367446 13820 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:10.374445 13908 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:10.331182 20483 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:10.400595 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72504.3us
W20260811 16:06:10.387988 13900 rpcz_store.cc:269] 0811 16:06:08.781986 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:08.782143 (+   157us) service_pool.cc:227] Handling call
0811 16:06:10.341483 (+1559340us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000348d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:10.341644 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2948832512}
I20260811 16:06:10.267112 20400 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.390879 13826 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:10.340934 20177 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.341435 20470 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:10.361449 20309 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:10.406661 13623 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:10.397338 20118 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.430670 20386 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.464505 20386 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.464593 20354 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.466516 20455 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.424573 20361 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:10.360460 20133 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:10.366103 20463 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.345835 20468 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:10.412724 13740 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:10.414260 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:10.477960 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63791.1us
W20260811 16:06:10.412462 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 213014us
I20260811 16:06:10.412982 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:10.386801 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:10.268302 20310 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.228691 20472 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.437132 13824 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:10.435351 20321 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:10.445474 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.537292 13822 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.250550 20374 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:10.448731 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:10.449527 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.450081 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:10.444343 20336 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:10.399880 20442 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:10.444414 20315 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.457903 20470 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.459733 20453 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:10.460273 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.461226 20471 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:10.329424 20332 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.358897 20206 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.422287 20397 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:10.409294 20147 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.534961 20475 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.429250 20384 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.472438 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.429117 19979 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:10.584965 19979 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.585625 19979 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.479389 19990 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.587571 20168 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.589425 20472 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.485863 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2915) took 1428 ms. Trace:
I20260811 16:06:10.497900 13820 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:10.608825 13820 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:10.483615 13735 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:10.502524 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:10.609863 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 107458us
I20260811 16:06:10.611294 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:10.508371 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 409482us
I20260811 16:06:10.606015 13827 rpcz_store.cc:276] 0811 16:06:09.057269 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:09.562566 (+505297us) service_pool.cc:227] Handling call
0811 16:06:09.579755 (+ 17189us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:09.944466 (+364711us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:06:09.965631 (+ 21165us) log.cc:842] Serialized 14 byte log entry
0811 16:06:10.412759 (+447128us) log.cc:842] Serialized 14 byte log entry
0811 16:06:10.412922 (+   163us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:10.412964 (+    42us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:10.413010 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:10.463801 (+ 50791us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b18004e36a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:10.465329 (+  1528us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b18004e36a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f
0811 16:06:10.466484 (+  1155us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4800060cd8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:06:10.485636 (+ 19152us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400240754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:10.485691 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:10.485807 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":21404,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":4159,"raft.queue_time_us":1137,"raft.run_cpu_time_us":3189,"raft.run_wall_time_us":60181,"spinlock_wait_cycles":893224448,"thread_start_us":440053,"threads_started":1,"wal-append.queue_time_us":630258}
I20260811 16:06:10.589427 20177 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.511636 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.614737 13817 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:10.482614 20386 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:10.479977 20468 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:10.435343 20466 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.440192 20483 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.413169 20339 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.530933 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:10.532085 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 145389us
I20260811 16:06:10.436671 20486 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.539603 20455 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:10.540321 20185 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.544085 14581 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.640069 13908 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260811 16:06:10.603243 20397 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:06:10.641853 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 469434us
I20260811 16:06:10.642664 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.546435 13824 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:10.548388 13823 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:10.623749 20168 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:10.654536 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.486117 20361 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:10.504393 19961 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260811 16:06:10.666275 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.566444 13742 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:10.428686 20469 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.541082 20321 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:10.549309 20372 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:10.582017 20475 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.591089 20470 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.559029 20467 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:10.592337 13623 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 12, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 12 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:10.512640 20309 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.555425 20336 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:10.596760 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.597586 20362 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:10.587618 19990 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.716861 20400 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:10.717587 20400 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.496240 13826 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:10.621026 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.718401 20400 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:10.718892 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 97994.1us
I20260811 16:06:10.540961 20396 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260811 16:06:10.720539 20396 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:10.720681 14573 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:10.721210 20396 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:10.721644 20490 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:06:10.722038 20490 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:10.722934 20490 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.723404 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.724368 13826 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:10.726760 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2259) took 1116 ms. Trace:
I20260811 16:06:10.710119 20336 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.727274 13825 rpcz_store.cc:276] 0811 16:06:09.610570 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:10.084570 (+474000us) service_pool.cc:227] Handling call
0811 16:06:10.088880 (+  4310us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:10.182111 (+ 93231us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:10.182162 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:10.182724 (+   562us) log.cc:842] Serialized 26 byte log entry
0811 16:06:10.633368 (+450644us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:10.633426 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:10.653346 (+ 19920us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54002dd2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:10.653400 (+    54us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:10.726390 (+ 72990us) raft_consensus.cc:1671] finished
0811 16:06:10.726416 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:10.726684 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13206,"raft.queue_time_us":9276,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":17839,"spinlock_wait_cycles":194007424,"thread_start_us":389744,"threads_started":1,"wal-append.queue_time_us":488269}
I20260811 16:06:10.728902 20336 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:10.731264 20467 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.732645 20310 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:10.733697 20467 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.739420 20397 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.742733 20475 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.743817 13623 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:10.744988 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:10.630759 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 100123us
I20260811 16:06:10.631014 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:10.632037 13740 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:10.633275 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.633927 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:10.749553 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 118665us
I20260811 16:06:10.750046 13820 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:10.637622 13827 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260811 16:06:10.729522 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.646941 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.508422 20478 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.649645 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.649963 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:10.652119 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.653488 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.758432 13906 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:10.655480 13901 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:10.758857 13909 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260811 16:06:10.648948 13822 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:10.628808 20354 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:10.651990 14581 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:10.659298 13821 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:10.660682 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.661693 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.664108 20185 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:06:10.767275 13825 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260811 16:06:10.666990 13904 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:10.635882 20381 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:10.774258 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:10.667434 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.683476 13787 leader_election.cc:398] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:10.779815 13787 leader_election.cc:401] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260811 16:06:10.682341 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.780619 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:10.689342 20406 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.717492 19990 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.722401 20396 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:10.592375 20493 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260811 16:06:10.750885 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:10.763909 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:10.810631 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46863.6us
I20260811 16:06:10.679566 19833 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260811 16:06:10.762092 13818 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:10.768412 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.768662 13825 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:10.640599 20374 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.692360 20372 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:10.777940 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:10.632984 20384 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.775202 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:10.691926 20206 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.823472 19990 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:10.824015 19990 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:10.824430 19990 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.782219 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:10.825889 13820 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:10.827734 13820 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260811 16:06:10.827821 13908 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:10.782513 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 139938us
I20260811 16:06:10.664623 20361 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.480372 20463 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:10.684569 20118 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260811 16:06:10.782406 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.787582 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.659598 20442 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.799889 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:10.795934 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
W20260811 16:06:10.791976 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108712us
I20260811 16:06:10.789927 20354 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:10.766101 20301 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.803275 20464 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:10.812732 13818 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:10.870944 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.814487 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:10.871984 13742 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:10.814782 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63982.5us
I20260811 16:06:10.870291 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:10.872659 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58319.8us
I20260811 16:06:10.872709 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:10.787791 20472 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:10.834534 13902 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:10.853160 13827 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.880445 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.801113 20406 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.800253 20399 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.890184 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:10.868448 13821 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 10. Current term is 11. Ops: []
W20260811 16:06:10.869232 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 94166.3us
I20260811 16:06:10.869446 20332 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:10.870074 20339 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:10.745518 13623 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:10.909214 20170 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:10.875739 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:10.909490 20483 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:10.909955 20170 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.876598 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.912058 20348 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:10.912257 20170 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:10.912631 20409 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.810s	user 0.012s	sys 0.001s
I20260811 16:06:10.913959 20354 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.889087 20384 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:10.917924 20384 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.918470 20384 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:10.921525 20133 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.923306 20301 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:10.923800 20301 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.924160 20301 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:10.877018 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.724390 20490 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:10.883013 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:10.892027 13820 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:10.888767 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.816447 20495 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:10.893893 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64146.2us
I20260811 16:06:10.835325 20372 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:10.898895 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:10.880429 20472 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:10.951996 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.896596 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.954078 13740 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:10.896904 20374 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:10.907326 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:10.933907 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50979.1us
I20260811 16:06:10.874107 20504 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:10.890503 20371 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:10.970266 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.852933 19961 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:10.941048 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:10.976034 14581 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:10.934914 20466 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:10.946532 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.947265 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.947721 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.947991 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.949908 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.907111 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.004841 13742 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:11.002955 14583 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:10.955860 20472 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:10.958014 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:10.957558 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.958956 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.014894 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.960197 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.800055 20321 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.961467 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.963380 13906 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260811 16:06:10.963634 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.966751 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:10.969978 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.940953 20310 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:10.935454 20177 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260811 16:06:10.974961 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.975181 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.040395 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:10.945042 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.979720 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.929010 20204 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260811 16:06:10.964959 20206 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:10.974462 20409 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:10.985503 14581 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:10.952981 20483 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:10.895046 20386 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260811 16:06:10.999068 13741 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:11.010138 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.010295 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.956940 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.016957 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.017879 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.025174 13742 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:11.028741 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.029502 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:10.960852 20397 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260811 16:06:11.031631 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:10.954551 20320 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260811 16:06:10.974642 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.034207 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.021335 13902 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:10.905803 20406 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:10.905455 20399 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:10.978068 20371 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.039372 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:11.104538 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65282.2us
I20260811 16:06:10.977169 20170 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:10.973297 20486 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.045760 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:11.040328 13740 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:11.041465 13738 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:11.051990 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:10.965459 20361 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.073s
I20260811 16:06:10.962314 20298 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260811 16:06:11.096768 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.095966 13743 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:11.098680 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:11.097433 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:11.032538 20133 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.094465 13907 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:11.102306 13739 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:11.140904 14573 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:11.043846 20504 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:11.097721 20505 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.047811 20310 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.145998 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.146399 20521 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260811 16:06:11.174733 13742 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260811 16:06:11.174182 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.174855 13744 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:11.152935 13908 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260811 16:06:11.190526 13908 pending_rounds.cc:76] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 6
I20260811 16:06:11.190794 13908 pending_rounds.cc:97] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260811 16:06:11.191017 13908 raft_consensus.cc:2866] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:11.192999 14573 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:10.909569 13623 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 13, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 13 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:11.200721 20406 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:11.200237 13623 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 11, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:11.201932 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:11.205345 13827 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:11.207878 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.032810 20322 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260811 16:06:11.214046 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:11.216789 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71403.8us
I20260811 16:06:11.113973 20371 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:06:11.187862 20493 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260811 16:06:11.054309 20409 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.183295 20504 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.112324 20170 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:11.152667 20499 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:11.215541 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.241343 13909 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:11.173388 20507 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:11.218155 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 120764us
I20260811 16:06:11.249111 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.222589 20486 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:11.259415 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.267480 13906 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:11.265393 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:11.216835 20466 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:11.241396 20185 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:11.271154 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:11.274166 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53813.2us
I20260811 16:06:11.250250 20522 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:11.289450 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.269484 20486 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:11.291352 20515 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260811 16:06:11.291025 20486 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:11.292640 19979 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
W20260811 16:06:11.293447 20511 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260811 16:06:11.293186 19979 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:11.295226 20512 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260811 16:06:11.296245 20517 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260811 16:06:11.296346 20310 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:11.296661 14577 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:06:11.202766 13623 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 16, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 16 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:11.298339 13623 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 11, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 11 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:11.300679 13623 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 15, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:11.301880 20486 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.211875 20505 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.304492 20505 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.305248 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:11.305896 13738 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:11.308065 20409 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.315291 13738 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:11.315876 20315 raft_consensus.cc:979] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:06:11.316406 20315 raft_consensus.cc:1067] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Signalling peer 8d98491a0db549d0b671b60b90c9cdea to start an election
I20260811 16:06:11.316799 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.317595 20483 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:11.317375 20372 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.318181 20483 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:11.318753 20478 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:11.319177 20478 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:11.319199 20483 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.320117 20478 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.277456 19833 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260811 16:06:11.328174 19990 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.001s
I20260811 16:06:11.328655 20301 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.255818 20170 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:11.329905 20321 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:11.331713 14574 raft_consensus.cc:2354] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
W20260811 16:06:11.331950 20400 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.004s
I20260811 16:06:11.256115 20499 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.332438 20365 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:06:11.333463 20365 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:11.333845 20365 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:11.331614 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45424.1us
I20260811 16:06:11.336619 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.337881 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.338641 20204 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:11.339291 20204 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:11.339548 20301 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.340134 20301 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.340586 20301 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.341303 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:11.270171 20526 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260811 16:06:11.343806 20470 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260811 16:06:11.343924 20399 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.345075 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:11.326845 20336 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260811 16:06:11.332798 20499 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:11.288292 14573 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260811 16:06:11.344909 20463 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.367834 14575 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:11.275264 20185 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.276360 20506 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:11.348599 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.349356 14541 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.377635 20475 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:11.350425 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66323.6us
I20260811 16:06:11.351091 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:11.379534 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:11.379096 13744 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:11.353824 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:11.358237 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 400277us
I20260811 16:06:11.271771 20466 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.282438 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.266340 20206 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:11.328734 19990 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.378340 20475 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.441077 19990 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.441622 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.441927 20397 raft_consensus.cc:2741] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260811 16:06:11.442377 13909 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:06:11.443841 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.444487 13904 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 13
W20260811 16:06:11.384661 20528 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260811 16:06:11.384670 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:11.445642 13908 raft_consensus.cc:595] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:11.446107 13908 raft_consensus.cc:603] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:11.360343 20470 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:11.334700 20365 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.302904 13623 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 11, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 11 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:11.388415 19979 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.352598 20301 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:11.396497 20168 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260811 16:06:11.326903 20384 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.402316 20466 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:11.332485 20400 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.352465 20522 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:11.408432 20463 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:11.380460 20185 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:11.409548 20453 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:11.380648 20506 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:11.411450 13826 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260811 16:06:11.414402 20478 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:11.499773 20206 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:11.485400 20468 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.848s	user 0.008s	sys 0.004s
I20260811 16:06:11.502068 20468 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.406531 20170 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.423517 20507 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.503638 20507 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:11.504298 20468 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.504839 20170 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.505406 13904 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:11.506839 13737 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:11.506830 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.032s
I20260811 16:06:11.507261 13825 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
W20260811 16:06:11.507467 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.008s	sys 0.032s
I20260811 16:06:11.436054 13738 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260811 16:06:11.438491 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55544.8us
I20260811 16:06:11.398564 20371 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.473491 20168 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:11.514726 20400 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.515129 20371 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.441154 20475 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.515722 19979 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.515960 14579 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260811 16:06:11.516528 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:11.516289 19979 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.518677 19979 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.383973 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:11.474113 20490 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.005s
I20260811 16:06:11.449054 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.438855 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:11.452944 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104407us
W20260811 16:06:11.437846 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 161926us
I20260811 16:06:11.521703 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.521906 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:11.453342 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.522786 13823 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:11.434935 13744 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:11.453570 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 105608us
I20260811 16:06:11.454283 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.523988 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:11.524915 13742 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:11.462576 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.355204 20486 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.475723 13822 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260811 16:06:11.451189 20372 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:11.458312 20467 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:11.451272 20470 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:11.487600 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.484900 20365 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:11.491446 14573 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:06:11.475457 20522 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:11.495623 13623 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 4 to 11, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:11.497926 20506 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:11.505616 13906 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:11.508785 13902 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:11.511209 14574 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:43030
I20260811 16:06:11.576030 14574 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:06:11.518760 20384 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:11.525642 13738 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:06:11.573719 13905 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:11.467015 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:06:11.528800 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 66320.5us
I20260811 16:06:11.579167 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.579960 13909 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:11.530652 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:11.532611 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.556970 20471 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:11.529538 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:11.541589 20400 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:11.535629 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.536711 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.595762 13908 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:06:11.596210 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59602.7us
W20260811 16:06:11.596431 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66986.7us
W20260811 16:06:11.596902 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66332.4us
I20260811 16:06:11.597288 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:11.538177 20170 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.618986 20170 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.619853 20499 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.621274 20170 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.622030 20499 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.542404 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:11.507802 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 573013us
I20260811 16:06:11.559638 14575 raft_consensus.cc:2396] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260811 16:06:11.488643 20453 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.563014 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.576486 14574 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:11.579819 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:11.532886 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.534608 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:11.519474 20406 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:11.590351 13909 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:11.590955 13823 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:11.541549 20475 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:11.559007 20470 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:11.538395 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.598750 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.540659 20501 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260811 16:06:11.562644 20371 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.039s
I20260811 16:06:11.577453 20469 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.601420 13623 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 9 to 11, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 11 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:11.607496 20399 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:11.613497 20185 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.566112 20354 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260811 16:06:11.563267 20523 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260811 16:06:11.616892 19979 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:11.475359 20472 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.619444 20384 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:11.538920 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.540223 20168 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:06:11.729719 20523 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:11.730088 20523 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:11.730921 20523 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 18.7, Last appended by leader: 7, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.732161 20523 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:11.732892 20472 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.733695 13735 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:11.735538 20354 consensus_queue.cc:1225] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:06:11.736157 20354 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:11.736512 20354 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:11.623785 13824 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260811 16:06:11.737371 20354 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.625145 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:11.725965 20400 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:11.739113 20400 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.739528 20400 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:11.699689 20507 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.738652 20354 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:11.630932 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:11.633301 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:11.672977 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 151347us
I20260811 16:06:11.714600 20399 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:11.650429 20301 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.651633 20453 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:11.679189 13741 raft_consensus.cc:595] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:11.675750 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:11.684471 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 113912us
I20260811 16:06:11.685817 14577 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:06:11.649454 20397 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:11.742672 20507 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.692299 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.685000 14574 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:11.775043 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 99429.8us
W20260811 16:06:11.745074 20374 consensus_queue.cc:1159] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 14 status { last_received { term: 13 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:06:11.777655 20374 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:11.777576 20204 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:11.778189 14575 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:11.778427 20204 consensus_queue.cc:1225] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:06:11.698606 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:11.779541 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81025.7us
I20260811 16:06:11.767797 13623 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 11, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:11.780747 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.781299 13623 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:11.782003 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.703896 13904 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: [18.7-18.7]
I20260811 16:06:11.711345 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.782949 14578 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:06:11.783690 20463 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:06:11.712256 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.783617 13623 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:11.784798 14583 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:11.784734 20504 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:11.785861 20504 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:11.786286 20504 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:11.785514 13623 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 10, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:11.716050 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.682164 20499 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:11.694550 20471 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:11.704452 20321 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.808318 20321 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:11.721118 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122460us
I20260811 16:06:11.706869 20206 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:11.729455 19979 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:11.815207 19979 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.625952 14573 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:11.694839 20505 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260811 16:06:11.748456 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:11.826265 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 77898.5us
I20260811 16:06:11.827831 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:11.829083 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:11.675647 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50928.8us
I20260811 16:06:11.697119 20406 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:11.752563 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 119385us
I20260811 16:06:11.753961 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.771749 20381 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:11.768792 20466 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.782153 19438 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:11.783923 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.711757 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.785902 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.700852 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:11.789475 20470 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.790427 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.790818 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1255) took 1067 ms. Trace:
I20260811 16:06:11.791177 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.855893 13735 rpcz_store.cc:276] 0811 16:06:10.723919 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:10.768139 (+ 44220us) service_pool.cc:227] Handling call
0811 16:06:11.790645 (+1022506us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b5400277ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:11.790764 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2118867840}
I20260811 16:06:11.794145 20185 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:11.713052 20469 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.796222 13737 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260811 16:06:11.775179 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 82958.1us
I20260811 16:06:11.857786 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:11.859476 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.682839 20361 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election won for term 11
I20260811 16:06:11.777491 14574 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.797901 13741 raft_consensus.cc:603] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:11.798751 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.802330 14582 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260811 16:06:11.769824 20506 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:11.867479 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68826.4us
I20260811 16:06:11.869046 13738 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:11.803424 13623 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:11.803723 20499 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:11.805600 20471 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.771323 20490 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:11.774991 20545 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:11.811322 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.811371 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:11.829808 13823 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:11.831578 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:11.909562 13905 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:11.910070 13825 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260811 16:06:11.832690 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:11.755869 20399 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:11.916648 20362 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:11.917520 20362 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:11.919509 20506 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.920621 20490 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:11.920818 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:11.922145 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.921814 20490 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.923378 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.924119 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.924556 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.924772 13823 raft_consensus.cc:2362] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18. Re-sending same reply.
I20260811 16:06:11.925719 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:11.839087 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:11.927620 20499 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.875741 20501 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:11.868888 20396 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:11.841346 20381 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:11.931788 20396 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.850067 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.932449 20396 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:11.850272 14583 pending_rounds.cc:76] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 11
I20260811 16:06:11.935228 14583 pending_rounds.cc:97] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260811 16:06:11.935628 14583 raft_consensus.cc:2866] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:11.869298 20365 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:11.851323 20466 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.851955 13822 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:11.855242 14579 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:11.860833 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69760.1us
W20260811 16:06:11.861833 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71507.7us
I20260811 16:06:11.980901 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.982635 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.869681 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:11.842351 20204 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:11.983609 20204 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:11.984057 20204 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:11.983796 20533 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:06:11.874394 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.812827 20301 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:11.993350 20301 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.911995 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.995577 13818 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:11.997115 13818 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:06:11.912995 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:11.999794 13825 raft_consensus.cc:2354] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17.
W20260811 16:06:11.912846 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 101553us
I20260811 16:06:11.926592 13826 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:11.850358 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:11.927604 13904 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:11.941900 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:12.002826 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61059.3us
I20260811 16:06:12.003728 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:11.877442 20177 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:12.005254 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:12.006474 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:11.945102 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:06:12.007798 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 62817.1us
W20260811 16:06:11.911525 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71426us
I20260811 16:06:11.877272 20361 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:12.006683 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:11.976868 13738 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:11.826896 20206 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.002942 20545 raft_consensus.cc:2741] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260811 16:06:12.025108 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:12.025910 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 156328us
I20260811 16:06:12.027062 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:11.918547 20362 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.013543 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.035320 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:11.877023 19438 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:11.978806 20475 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.852324 20522 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.029896 13871 leader_election.cc:398] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:12.047425 13871 leader_election.cc:401] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:12.014230 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.048318 13743 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:12.048818 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.032236 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:12.033218 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:12.051434 13739 raft_consensus.cc:595] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:12.052009 13739 raft_consensus.cc:603] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:12.044104 13818 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:12.015784 13909 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260811 16:06:12.042961 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60400.9us
I20260811 16:06:12.003897 20397 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:11.980154 20321 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:11.916734 20547 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:11.797277 20504 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.014377 20177 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:12.009284 20530 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260811 16:06:11.932451 20381 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.079869 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:12.108204 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:12.159480 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:12.027169 20505 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:12.028976 20372 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:12.058924 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.113276 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:12.166790 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 107950us
I20260811 16:06:12.028179 20533 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:12.086156 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:12.176213 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:12.169056 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:06:12.168471 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 185835us
I20260811 16:06:12.180342 20365 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:12.046391 20371 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:12.045032 20455 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:12.171849 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.182096 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.066473 20044 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:12.184438 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.185340 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.186937 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.187301 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.186961 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.067299 20315 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:12.065672 20469 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:12.134339 20381 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:12.045682 20336 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:12.196516 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.188011 20384 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:12.197574 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.200361 13709 leader_election.cc:398] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17.
I20260811 16:06:12.130364 20309 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.079s
I20260811 16:06:12.209714 20365 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:12.197284 20133 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260811 16:06:12.196061 20372 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:12.226455 20372 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:12.132702 20147 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:12.110951 20475 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.227279 20147 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:12.228312 20147 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.229080 20475 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.229846 20147 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:12.230095 20301 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:12.197959 20521 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260811 16:06:12.203467 20396 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.236413 20396 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.213672 20545 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:12.154554 20524 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:12.187796 20409 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260811 16:06:12.204391 13901 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:12.066984 20406 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:12.205506 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.135754 20522 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.064467 20397 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.094463 20442 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260811 16:06:12.165477 20177 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:12.186792 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.065438 20470 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:12.078038 20473 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:12.212585 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:12.168521 20532 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:12.212373 13742 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:06:12.213231 13908 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:12.045385 20463 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.153s
I20260811 16:06:12.176622 19990 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:12.178009 20374 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:12.203783 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.217510 13740 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:12.196832 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.219201 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.187863 20170 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:12.188434 20505 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:12.224972 13709 leader_election.cc:401] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260811 16:06:12.282281 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97013.8us
I20260811 16:06:12.226931 20372 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:12.064594 20361 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.056741 20386 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:12.170979 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.309846 13739 raft_consensus.cc:2354] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:06:12.309582 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:12.311841 13739 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:12.239953 13822 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:12.227083 20469 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:12.209347 20504 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:12.244921 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:12.317366 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72535.4us
I20260811 16:06:12.110387 20547 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:12.157562 20206 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:12.211392 20455 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:12.238179 20309 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Stepping down as leader of term 11
W20260811 16:06:12.256762 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70056.4us
I20260811 16:06:12.145893 20453 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.154493 20400 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.237836 20524 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.068670 19438 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.269503 20397 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.239018 20336 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.271317 13743 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:12.273331 20399 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:12.254822 20354 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260811 16:06:12.277195 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:12.349228 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72127.5us
I20260811 16:06:12.350553 13871 leader_election.cc:398] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:06:12.281155 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.251608 20466 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:12.255764 20406 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:12.288616 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.289167 20470 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:12.275449 20374 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:12.266515 20473 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.067844 13623 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 11, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:12.266845 20321 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:12.244127 20384 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.294461 14573 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:12.290827 19961 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.005s
W20260811 16:06:12.403465 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 218878us
I20260811 16:06:12.304033 13908 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:12.328123 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.405262 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.406170 13739 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:12.334196 13901 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:12.407204 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:12.316378 13909 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:12.291270 20522 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17.
I20260811 16:06:12.346395 14575 raft_consensus.cc:2354] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13.
I20260811 16:06:12.350968 13871 leader_election.cc:401] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:12.331121 20499 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:12.331182 20547 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:12.387036 13737 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:12.409109 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58793.2us
I20260811 16:06:12.410790 13743 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:12.391345 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 384723us
I20260811 16:06:12.288288 20170 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.393826 13741 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:12.394074 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:12.263912 20365 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:12.418287 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.419778 13739 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:12.412881 19979 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.002s	sys 0.020s
W20260811 16:06:12.447523 19979 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.003s	sys 0.020s
I20260811 16:06:12.362775 13905 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260811 16:06:12.412870 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.364665 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:12.459165 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94630.6us
I20260811 16:06:12.359547 20310 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:12.394404 20374 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:12.461136 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:12.339919 20309 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:12.466216 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:12.471566 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:12.472631 14573 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:12.472844 13623 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 10, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 10 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:12.475878 13908 raft_consensus.cc:595] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:12.476385 13908 raft_consensus.cc:603] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:12.326915 20505 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.352921 20185 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260811 16:06:12.411962 20409 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
W20260811 16:06:12.487579 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 281890us
I20260811 16:06:12.460533 20294 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260811 16:06:12.493518 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:12.464737 20044 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:12.489606 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.509826 20490 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:12.439800 20365 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:12.514441 13739 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:12.526312 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:12.494163 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:12.520737 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 180037us
W20260811 16:06:12.512113 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 323099us
I20260811 16:06:12.386482 20406 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.522207 13901 raft_consensus.cc:2354] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17.
I20260811 16:06:12.523490 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.439708 20321 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.516614 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:12.515503 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:12.529762 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:12.539347 14581 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:12.476027 20522 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260811 16:06:12.412724 20470 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.484789 20310 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:12.538852 20309 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.532879 14579 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:12.556608 20470 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:12.491808 13623 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 11, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:06:12.536394 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 75334.4us
I20260811 16:06:12.557224 20470 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:12.511744 20362 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:12.492894 20564 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:12.524978 20044 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:12.523679 13904 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:06:12.527168 20365 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:12.557767 20470 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.547996 20442 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:12.540143 20490 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:12.617161 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 101914us
W20260811 16:06:12.641916 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 111802us
I20260811 16:06:12.690590 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:12.573956 20044 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:12.479610 20455 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.577239 20453 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:12.690286 20204 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.002s
W20260811 16:06:12.712160 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 196768us
I20260811 16:06:12.732043 14573 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260811 16:06:12.617704 20572 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:12.736605 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:12.619244 20442 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:12.813752 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80343.3us
W20260811 16:06:12.707937 20562 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.376s	user 0.001s	sys 0.001s
I20260811 16:06:12.697292 20310 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:12.580317 20362 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:12.826408 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48348us
I20260811 16:06:12.815989 20185 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260811 16:06:12.829813 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1288) took 1039 ms. Trace:
I20260811 16:06:12.812085 20400 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.775457 20399 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:12.691846 20490 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.829996 20170 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:12.815167 20336 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.816383 19979 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:12.774770 20580 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:12.845156 14583 rpcz_store.cc:276] 0811 16:06:11.789981 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.849652 (+ 59671us) service_pool.cc:227] Handling call
0811 16:06:11.850036 (+   384us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:11.936869 (+ 86833us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:11.936914 (+    45us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:11.965954 (+ 29040us) log.cc:842] Serialized 52 byte log entry
0811 16:06:12.166173 (+200219us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:12.166212 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:12.166287 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:12.829555 (+663268us) raft_consensus.cc:1671] finished
0811 16:06:12.829579 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:12.829740 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12270,"raft.queue_time_us":286,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":37215,"thread_start_us":199866,"threads_started":1,"wal-append.queue_time_us":300180}
I20260811 16:06:12.897181 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:12.879882 20384 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:12.811409 20453 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election won for term 17
W20260811 16:06:12.820488 20561 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.475s	user 0.002s	sys 0.000s
I20260811 16:06:12.879825 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:12.880275 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 237305us
I20260811 16:06:12.824519 20310 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.557942 13623 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 10, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 10 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:12.774276 20204 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:12.810925 20499 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260811 16:06:12.883334 20473 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:12.826637 20572 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.894374 20321 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:12.870404 20578 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:12.927073 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:12.939929 13818 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:12.891389 20170 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:12.885314 20583 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:12.846999 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.022s	sys 0.040s
W20260811 16:06:12.953914 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.022s	sys 0.048s
I20260811 16:06:12.955592 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:12.956327 13739 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:12.960602 13740 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:12.962317 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:12.925988 20177 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.004s
I20260811 16:06:12.969961 13740 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:06:12.972277 14583 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:12.985925 13823 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:12.977813 20177 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:12.991349 13739 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:12.940423 20406 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:12.901880 19979 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.015100 14541 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:12.951507 20453 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:13.020571 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.025861 13818 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:13.026016 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:12.889696 20442 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:12.996577 20560 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260811 16:06:12.989487 20177 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.035337 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:12.996353 20473 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.048789 14582 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:13.041333 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 209050us
I20260811 16:06:13.008608 20396 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.010480 20470 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:13.054476 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:13.068634 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:13.070425 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.007509 20321 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260811 16:06:12.908859 20580 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:13.040469 20372 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.737s	user 0.013s	sys 0.000s
W20260811 16:06:13.049728 20566 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.438s	user 0.001s	sys 0.001s
I20260811 16:06:12.975759 20170 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.094043 14581 raft_consensus.cc:2354] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:13.094136 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.095974 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.094666 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:13.103993 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49653.7us
I20260811 16:06:13.126575 14582 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:13.047415 20362 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.065495 19990 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:13.167423 13739 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:13.189018 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.190302 13739 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260811 16:06:13.167887 13740 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:13.146131 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45604us
W20260811 16:06:13.168978 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61484.5us
I20260811 16:06:13.192273 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:13.169600 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.011s
I20260811 16:06:12.971916 20583 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:13.193194 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.011s
W20260811 16:06:13.195036 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 181920us
I20260811 16:06:13.092283 20499 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:13.086454 20561 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260811 16:06:13.014998 20206 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
W20260811 16:06:13.091851 20577 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.384s	user 0.003s	sys 0.001s
I20260811 16:06:13.089313 20593 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:13.088224 20524 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:13.073923 20571 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260811 16:06:13.092074 20470 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:13.104074 20578 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:13.204281 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.231033 13901 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:13.205029 13906 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:06:13.213595 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.202385 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.097484 20580 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.218022 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.218887 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.122891 20533 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:13.233786 13742 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:13.101073 20372 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.243466 20575 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.244298 20524 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.244189 20575 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.245514 20579 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260811 16:06:13.245098 20524 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.247507 20584 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:13.248026 20584 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:13.247756 20533 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.075229 13623 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 12 to 15, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:13.248535 20584 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:13.248948 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2289) took 1078 ms. Trace:
I20260811 16:06:13.249351 13737 rpcz_store.cc:276] 0811 16:06:12.170166 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.170356 (+   190us) service_pool.cc:227] Handling call
0811 16:06:13.248738 (+1078382us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000a96d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:13.248883 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":254579968}
I20260811 16:06:13.250305 20533 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:13.219726 20499 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:13.251482 20573 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260811 16:06:13.221457 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:13.223112 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.020s	sys 0.025s
I20260811 16:06:13.041247 20576 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.174s
I20260811 16:06:13.226536 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.085908 20473 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.106601 20396 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.157037 20177 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.268224 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1125) took 1433 ms. Trace:
W20260811 16:06:13.255771 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.021s	sys 0.025s
I20260811 16:06:13.255298 14581 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:13.224261 20593 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:13.246914 20575 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:13.310283 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 155414us
I20260811 16:06:13.317610 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:13.249841 13623 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 15, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:06:13.289520 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.005s	sys 0.036s
I20260811 16:06:13.252517 20580 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:13.253510 20490 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:13.272411 13817 rpcz_store.cc:276] 0811 16:06:11.834277 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.933245 (+ 98968us) service_pool.cc:227] Handling call
0811 16:06:11.933658 (+   413us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:11.934060 (+   402us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:11.934090 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:11.934535 (+   445us) log.cc:842] Serialized 26 byte log entry
0811 16:06:12.175043 (+240508us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:12.208560 (+ 33517us) log.cc:842] Serialized 14 byte log entry
0811 16:06:12.208783 (+   223us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:12.208860 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:13.267914 (+1059054us) raft_consensus.cc:1671] finished
0811 16:06:13.267946 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:13.268141 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":33184,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":4997,"raft.queue_time_us":3566,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":5078,"thread_start_us":240088,"threads_started":1,"wal-append.queue_time_us":341666}
W20260811 16:06:13.321417 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 117566us
I20260811 16:06:13.269521 20204 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:13.323163 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.015s	sys 0.047s
I20260811 16:06:13.327924 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1270) took 1316 ms. Trace:
I20260811 16:06:13.311090 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:13.353361 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 822721us
I20260811 16:06:13.329221 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.330482 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:13.332054 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.011s
I20260811 16:06:13.356863 13906 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:13.260330 20591 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:13.359694 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.282267 20475 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.334395 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.337447 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.214579 20453 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.431907 13742 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:13.451828 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:13.353408 13744 rpcz_store.cc:276] 0811 16:06:12.011707 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.013194 (+  1487us) service_pool.cc:227] Handling call
0811 16:06:12.013565 (+   371us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:12.026468 (+ 12903us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:12.026499 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:12.026948 (+   449us) log.cc:842] Serialized 26 byte log entry
0811 16:06:12.102781 (+ 75833us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4800061a58. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:06:12.480063 (+377282us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:12.480105 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:12.480174 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:13.313452 (+833278us) raft_consensus.cc:1671] finished
0811 16:06:13.313479 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:13.327863 (+ 14384us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12426,"raft.queue_time_us":13192,"raft.run_cpu_time_us":1327,"raft.run_wall_time_us":75022,"spinlock_wait_cycles":28724480,"thread_start_us":310281,"threads_started":1,"wal-append.queue_time_us":509850}
I20260811 16:06:13.325259 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1265) took 1315 ms. Trace:
I20260811 16:06:13.455236 13741 rpcz_store.cc:276] 0811 16:06:12.010095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.012280 (+  2185us) service_pool.cc:227] Handling call
0811 16:06:12.012671 (+   391us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:12.439507 (+426836us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:13.324976 (+885469us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:13.325194 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":876021504}
W20260811 16:06:13.456022 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 96426.9us
I20260811 16:06:13.409901 13707 leader_election.cc:398] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17.
I20260811 16:06:13.311169 20310 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.333212 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.457917 13904 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:13.461501 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.464249 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:13.478101 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68430us
I20260811 16:06:13.487819 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.488950 13826 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:13.493186 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.494199 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:13.497936 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.503351 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:13.506224 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.507216 13825 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:06:13.518996 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 198190us
I20260811 16:06:13.333688 20572 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:13.522574 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:13.527604 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:13.528417 13818 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 13
W20260811 16:06:13.529935 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 331098us
I20260811 16:06:13.532150 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.313530 20177 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:13.536011 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:13.425508 20591 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:13.540486 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.540930 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.560453 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:13.576072 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.598449 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.603782 13904 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:13.609313 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68999.8us
I20260811 16:06:13.605363 13818 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:13.451618 19979 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:13.690019 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2575) took 1505 ms (client timeout 1792 ms). Trace:
I20260811 16:06:13.646781 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:13.647327 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:13.656255 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1268) took 1645 ms. Trace:
I20260811 16:06:13.606974 20591 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:13.605873 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.661751 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:13.664209 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1282) took 1961 ms (client timeout 2246 ms). Trace:
I20260811 16:06:13.695022 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:13.695473 14575 rpcz_store.cc:269] 0811 16:06:11.702450 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.781769 (+ 79319us) service_pool.cc:227] Handling call
0811 16:06:13.663895 (+1882126us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540063e2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:13.664120 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1292046592}
I20260811 16:06:13.519232 20533 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.670539 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2941) took 1815 ms. Trace:
I20260811 16:06:13.667894 20495 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:06:13.690536 13909 rpcz_store.cc:269] 0811 16:06:12.184977 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.185090 (+   113us) service_pool.cc:227] Handling call
0811 16:06:13.689794 (+1504704us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:13.689935 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":220290304}
I20260811 16:06:13.696497 13823 rpcz_store.cc:276] 0811 16:06:11.855220 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.925401 (+ 70181us) service_pool.cc:227] Handling call
0811 16:06:12.086025 (+160624us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:13.670305 (+1584280us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400219154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:13.670465 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1879005568}
I20260811 16:06:13.686645 20309 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:13.688539 20185 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:13.689565 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2291) took 1518 ms. Trace:
I20260811 16:06:13.717056 13743 rpcz_store.cc:276] 0811 16:06:12.170991 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.171599 (+   608us) service_pool.cc:227] Handling call
0811 16:06:13.689342 (+1517743us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:13.689493 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":180548352}
I20260811 16:06:13.693953 13818 raft_consensus.cc:2379] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:13.518466 20294 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.691905 13736 rpcz_store.cc:276] 0811 16:06:12.011087 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.012997 (+  1910us) service_pool.cc:227] Handling call
0811 16:06:12.021367 (+  8370us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:06:12.021998 (+   631us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:12.022028 (+    30us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:06:12.028859 (+  6831us) log.cc:842] Serialized 78 byte log entry
0811 16:06:12.420972 (+392113us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:12.421038 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:12.421153 (+   115us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:13.609785 (+1188632us) raft_consensus.cc:1671] finished
0811 16:06:13.609817 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:13.656138 (+ 46321us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2724,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13837,"thread_start_us":246523,"threads_started":1,"wal-append.queue_time_us":411323}
W20260811 16:06:13.651690 20147 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.421s	user 0.021s	sys 0.000s
I20260811 16:06:13.704691 20583 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.519665 13623 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:13.695246 20499 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.749368 13817 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 16
I20260811 16:06:13.690083 20614 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:13.761791 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.004s
W20260811 16:06:13.762318 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.005s	sys 0.004s
W20260811 16:06:13.763154 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.004s
W20260811 16:06:13.763942 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.004s
I20260811 16:06:13.693518 20617 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:13.712109 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 374705us
W20260811 16:06:13.715791 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104427us
I20260811 16:06:13.716298 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:13.672915 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1747) took 1938 ms. Trace:
W20260811 16:06:13.720496 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58869.9us
I20260811 16:06:13.574864 20572 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:13.451086 20475 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:13.765046 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 242598us
I20260811 16:06:13.789126 13787 leader_election.cc:398] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
W20260811 16:06:13.709336 20569 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.152s	user 0.000s	sys 0.005s
I20260811 16:06:13.416096 20578 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:13.776595 14577 rpcz_store.cc:276] 0811 16:06:11.734812 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.812646 (+ 77834us) service_pool.cc:227] Handling call
0811 16:06:13.672544 (+1859898us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54004c0c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:13.672804 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1464486272}
I20260811 16:06:13.724237 19979 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:13.749063 20170 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.777197 20499 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:13.752327 20576 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:13.764694 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:13.789637 13787 leader_election.cc:401] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:06:13.784786 20592 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260811 16:06:13.718114 20533 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.765247 20614 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:13.804980 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.773074 20583 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:13.817015 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.820770 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.877528 20583 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:13.877797 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72911.6us
W20260811 16:06:13.870024 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 94489.8us
I20260811 16:06:13.878824 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:13.823802 13822 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:13.797364 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:13.825253 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:13.827867 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63262us
I20260811 16:06:13.880731 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:13.787514 20204 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:13.885180 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 96281.3us
I20260811 16:06:13.827358 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:13.724846 20294 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:13.885584 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.880774 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:13.807914 19979 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:13.935076 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54393.7us
I20260811 16:06:13.926469 13904 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19. Re-sending same reply.
I20260811 16:06:13.927654 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.805073 20372 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:13.805016 20524 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:13.946024 20524 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.947026 20581 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:13.529330 20593 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.822865 20576 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:13.826589 20620 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:13.940081 20622 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260811 16:06:13.940761 20612 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:13.976646 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.941735 20475 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:13.789397 20206 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260811 16:06:13.942510 20495 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:13.882972 20614 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:13.943827 20374 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.471s	user 0.014s	sys 0.003s
W20260811 16:06:13.944343 20582 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.005s
I20260811 16:06:13.944155 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:13.944669 20590 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.686s	user 0.002s	sys 0.000s
I20260811 16:06:13.827394 20170 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:13.945281 20372 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:14.022006 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2938) took 2167 ms. Trace:
I20260811 16:06:13.946703 20524 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.808126 20386 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:13.872327 19990 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.002s
I20260811 16:06:13.953861 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:14.031414 13904 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:13.954111 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1305) took 1424 ms. Trace:
W20260811 16:06:13.925644 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 128385us
I20260811 16:06:13.963614 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:14.032409 13739 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:14.033411 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:13.981272 20586 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.593s	user 0.001s	sys 0.001s
I20260811 16:06:14.034278 13739 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:13.981662 20600 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260811 16:06:13.964390 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.965051 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:13.872367 19438 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:13.794698 20572 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.995527 20495 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:13.948562 19979 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:13.982096 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1111) took 1085 ms. Trace:
I20260811 16:06:13.995285 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:13.943994 20575 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260811 16:06:14.019620 20533 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.076128 13736 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:14.012528 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.014s	sys 0.004s
I20260811 16:06:13.980860 20631 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:14.019538 20619 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.020028 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1301) took 1548 ms. Trace:
I20260811 16:06:13.947671 20581 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.026383 13820 rpcz_store.cc:276] 0811 16:06:11.854383 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.989272 (+134889us) service_pool.cc:227] Handling call
0811 16:06:11.989686 (+   414us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:11.990184 (+   498us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:11.990222 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:11.990844 (+   622us) log.cc:842] Serialized 26 byte log entry
0811 16:06:12.954505 (+963661us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:12.954574 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:12.954677 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:14.021765 (+1067088us) raft_consensus.cc:1671] finished
0811 16:06:14.021794 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.021939 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":963153,"threads_started":1,"wal-append.queue_time_us":930455}
I20260811 16:06:13.977895 20501 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:13.977602 13743 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:13.936098 20204 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:13.985585 20583 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.031944 14578 rpcz_store.cc:276] 0811 16:06:12.529819 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.530308 (+   489us) service_pool.cc:227] Handling call
0811 16:06:12.545476 (+ 15168us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:12.545973 (+   497us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:12.546019 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:12.612045 (+ 66026us) log.cc:842] Serialized 52 byte log entry
0811 16:06:12.929747 (+317702us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:13.091477 (+161730us) log.cc:842] Serialized 14 byte log entry
0811 16:06:13.123131 (+ 31654us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:13.123282 (+   151us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:13.953817 (+830535us) raft_consensus.cc:1671] finished
0811 16:06:13.953848 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:13.954039 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31246,"prepare.queue_time_us":262852,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5983,"raft.queue_time_us":102339,"raft.run_cpu_time_us":15013,"raft.run_wall_time_us":136140,"thread_start_us":274265,"threads_started":2,"wal-append.queue_time_us":602665}
W20260811 16:06:14.044001 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 164721us
I20260811 16:06:13.982069 20612 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:06:14.022284 20582 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.003s	sys 0.006s
I20260811 16:06:13.980516 20627 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:13.969856 20576 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:14.046729 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:14.037518 20170 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:14.077308 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.015s	sys 0.005s
I20260811 16:06:14.077354 13907 rpcz_store.cc:276] 0811 16:06:12.896549 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.896665 (+   116us) service_pool.cc:227] Handling call
0811 16:06:12.910743 (+ 14078us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:13.064976 (+154233us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:13.065012 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:13.066704 (+  1692us) log.cc:842] Serialized 26 byte log entry
0811 16:06:13.309818 (+243114us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:13.309883 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:13.309990 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:13.981753 (+671763us) raft_consensus.cc:1671] finished
0811 16:06:13.981786 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:13.981996 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":132498,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":15943,"thread_start_us":335752,"threads_started":2,"wal-append.queue_time_us":360826}
I20260811 16:06:14.047744 20495 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:14.038429 19990 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.000s	sys 0.002s
I20260811 16:06:14.037716 20607 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.082295 14573 rpcz_store.cc:276] 0811 16:06:12.478807 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.522027 (+ 43220us) service_pool.cc:227] Handling call
0811 16:06:12.522401 (+   374us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:12.732563 (+210162us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.019721 (+1287158us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:14.019951 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":481141632}
I20260811 16:06:13.827656 20499 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.085460 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36246 (request call id 54) took 1781 ms. Trace:
W20260811 16:06:14.040079 20504 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.708s	user 0.016s	sys 0.002s
W20260811 16:06:14.091905 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 125882us
W20260811 16:06:14.098086 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 277408us
I20260811 16:06:14.106830 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:14.116660 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:14.048535 20177 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.023303 20374 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.046144 20621 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:14.149580 13908 rpcz_store.cc:276] 0811 16:06:12.303754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.303894 (+   140us) service_pool.cc:227] Handling call
0811 16:06:14.085149 (+1781255us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:14.085330 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":164386688}
W20260811 16:06:14.194483 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 258358us
I20260811 16:06:14.045189 20386 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.210791 13906 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260811 16:06:14.211495 13906 pending_rounds.cc:76] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 6
I20260811 16:06:14.211755 13906 pending_rounds.cc:97] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260811 16:06:14.161355 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1753) took 1602 ms. Trace:
I20260811 16:06:14.212086 13906 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:14.171958 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65170.3us
I20260811 16:06:14.159723 13818 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:14.113358 20315 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:14.098793 20631 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:14.152299 20505 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.019s	sys 0.010s
I20260811 16:06:14.224010 13902 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:14.225849 14573 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:06:14.226843 13735 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:14.212437 14579 rpcz_store.cc:276] 0811 16:06:12.559133 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.559968 (+   835us) service_pool.cc:227] Handling call
0811 16:06:12.560342 (+   374us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:12.613702 (+ 53360us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:12.613732 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:12.614314 (+   582us) log.cc:842] Serialized 26 byte log entry
0811 16:06:12.870621 (+256307us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:12.870822 (+   201us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:12.871322 (+   500us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:14.161118 (+1289796us) raft_consensus.cc:1671] finished
0811 16:06:14.161144 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.161293 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52893,"raft.queue_time_us":148653,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":255433,"threads_started":1,"wal-append.queue_time_us":407057}
I20260811 16:06:14.204185 13736 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:06:14.158103 13826 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.003s	sys 0.023s
W20260811 16:06:14.238832 13826 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.003s	sys 0.024s
I20260811 16:06:14.154145 19990 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:14.150780 20532 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Stepping down as leader of term 11
W20260811 16:06:14.215915 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2572) took 2032 ms (client timeout 1864 ms). Trace:
W20260811 16:06:14.280517 13905 rpcz_store.cc:269] 0811 16:06:12.183604 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.184107 (+   503us) service_pool.cc:227] Handling call
0811 16:06:14.210053 (+2025946us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400087ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:14.215731 (+  5678us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":357311360}
I20260811 16:06:14.281836 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:14.216282 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.016s	sys 0.012s
I20260811 16:06:14.045282 19438 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.199856 20627 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:14.214118 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:14.123517 20206 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:14.236116 20505 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.019s	sys 0.010s
I20260811 16:06:14.246105 13817 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:14.188212 20621 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:14.214742 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:14.217808 13820 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260811 16:06:14.283085 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.016s	sys 0.013s
W20260811 16:06:14.304204 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 824451us
I20260811 16:06:14.304929 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:14.309794 13905 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:14.239830 20575 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:14.318643 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 103977us
I20260811 16:06:14.319995 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:14.283057 20504 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.178416 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:14.107470 20501 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:14.335821 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 157487us
I20260811 16:06:14.338485 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:14.339016 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:14.291015 20044 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.581s	user 0.015s	sys 0.020s
I20260811 16:06:14.093981 20619 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.293102 20294 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.293495 20532 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:14.354223 14578 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260811 16:06:14.332188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 170491us
I20260811 16:06:14.332346 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:06:14.308187 20365 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.689s	user 0.014s	sys 0.003s
I20260811 16:06:14.299753 20533 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:14.341408 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:14.298486 20597 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.313136 20621 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:14.325995 20505 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:14.337785 20618 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:14.158102 20607 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.335296 20168 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.331419 20627 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:14.308560 20617 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:14.363678 13902 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:14.353380 20642 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:06:14.362706 20584 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.114s	user 0.013s	sys 0.006s
I20260811 16:06:14.383112 20597 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.307636 20206 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.383034 20301 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.342417 20504 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.397056 20618 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:14.446491 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:14.429512 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:14.433034 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.025s
W20260811 16:06:14.447803 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.005s	sys 0.025s
I20260811 16:06:14.336227 20575 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.345532 20044 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:14.419245 20644 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.369s	user 0.000s	sys 0.002s
I20260811 16:06:14.403451 20572 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.412901 20668 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.431771 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:14.408524 20524 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.369656 20365 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.450903 20618 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:14.426198 20547 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.961s	user 0.017s	sys 0.000s
I20260811 16:06:14.424146 20475 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:14.453884 20499 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.427656 20647 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.444506 20627 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:14.434350 20567 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:14.451166 14575 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:14.475980 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:14.316465 20612 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.415378 20168 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.453696 20204 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.383777 20533 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.454329 20374 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.456354 20609 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.448506 20301 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.454648 20656 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:14.462329 20170 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.433964 20584 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.591353 20409 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:14.526510 20206 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.690258 20475 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:14.579555 20473 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.527930 20533 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.693362 20301 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:14.541101 20309 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.004s
I20260811 16:06:14.415869 19990 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:14.670783 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 329311us
I20260811 16:06:14.696157 20455 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.697085 20455 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.525288 20501 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.530539 20365 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.532081 20504 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.531625 20607 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.529772 20609 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.484956 20547 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.694067 20533 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:14.549345 20545 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.773s	user 0.008s	sys 0.037s
W20260811 16:06:14.722561 20545 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.013s	user 0.009s	sys 0.037s
W20260811 16:06:14.575263 20568 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.019s	user 0.000s	sys 0.006s
I20260811 16:06:14.723809 13824 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:14.585657 20574 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.757s	user 0.000s	sys 0.015s
W20260811 16:06:14.664887 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 287863us
I20260811 16:06:14.528663 20619 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.434643 20532 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.739778 20532 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:14.742537 13903 raft_consensus.cc:2354] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:14.743044 13820 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260811 16:06:14.508136 20567 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:14.744836 20612 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:14.745347 20567 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:14.500867 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.027s	sys 0.010s
W20260811 16:06:14.751691 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.027s	sys 0.011s
W20260811 16:06:14.754053 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 875240us
W20260811 16:06:14.608037 20594 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.378s	user 0.002s	sys 0.008s
I20260811 16:06:14.774199 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:14.525637 20386 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:14.781203 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 416735us
I20260811 16:06:14.533984 20597 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.743106 20547 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.786077 20612 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.782929 20044 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.614066 20618 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.788537 20612 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.789623 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:14.610239 20621 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.791702 20612 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:14.528944 20626 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.325s	user 0.000s	sys 0.002s
W20260811 16:06:14.796381 13904 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.011s
W20260811 16:06:14.797029 13904 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.007s	sys 0.011s
I20260811 16:06:14.382591 20631 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.528277 20575 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.501199 20581 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:14.539093 20453 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.010s
W20260811 16:06:14.800813 20453 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.006s	sys 0.010s
I20260811 16:06:14.475684 13909 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:14.802280 14583 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260811 16:06:14.561127 20591 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.000s
I20260811 16:06:14.804009 20591 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.602373 20593 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:14.809526 13901 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:14.505064 20613 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:14.527977 20614 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.002s
I20260811 16:06:14.812568 20614 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.519593 20627 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:14.814963 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:14.816447 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2343) took 1216 ms (client timeout 1530 ms). Trace:
W20260811 16:06:14.816907 13821 rpcz_store.cc:269] 0811 16:06:13.599552 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.600394 (+   842us) service_pool.cc:227] Handling call
0811 16:06:14.814638 (+1214244us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:14.816244 (+  1606us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18051712}
I20260811 16:06:14.816980 20627 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.532150 20204 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.821285 20204 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.688788 20409 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:14.824620 20409 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.825889 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:14.676188 14581 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:14.686297 19438 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:14.670571 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 331979us
I20260811 16:06:14.531338 20635 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
W20260811 16:06:14.532567 20636 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260811 16:06:14.525151 20638 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:14.527073 20643 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260811 16:06:14.508282 20647 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.526190 20651 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.836426 20504 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:14.852686 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:14.853888 20647 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.854285 20204 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.855176 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2582) took 1038 ms. Trace:
I20260811 16:06:14.855701 13906 rpcz_store.cc:276] 0811 16:06:13.816880 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.817008 (+   128us) service_pool.cc:227] Handling call
0811 16:06:14.210279 (+393271us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:14.212772 (+  2493us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.831045 (+618273us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400087ad0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:14.854842 (+ 23797us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":903603584}
I20260811 16:06:14.829103 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2916) took 1499 ms. Trace:
I20260811 16:06:14.857393 20591 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.834854 20692 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260811 16:06:14.594849 20658 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260811 16:06:14.479130 20668 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.717218 20168 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.893821 20668 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.720322 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2945) took 1220 ms. Trace:
I20260811 16:06:14.895084 20651 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.885267 20638 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.897215 20442 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:14.895351 13826 rpcz_store.cc:276] 0811 16:06:13.499768 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.501353 (+  1585us) service_pool.cc:227] Handling call
0811 16:06:13.501826 (+   473us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:14.239566 (+737740us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:14.239619 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:14.240317 (+   698us) log.cc:842] Serialized 26 byte log entry
0811 16:06:14.399963 (+159646us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:14.710103 (+310140us) log.cc:842] Serialized 14 byte log entry
0811 16:06:14.710740 (+   637us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.710942 (+   202us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:14.711037 (+    95us) raft_consensus.cc:1671] finished
0811 16:06:14.711050 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.720001 (+  8951us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32171,"prepare.queue_time_us":148003,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":216677,"raft.run_cpu_time_us":647,"raft.run_wall_time_us":25103,"thread_start_us":1203206,"threads_started":3,"wal-append.queue_time_us":361209}
I20260811 16:06:14.693184 20475 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.6, Last appended by leader: 6, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.898088 20651 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.720645 20688 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.721443 13736 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:14.909309 13736 raft_consensus.cc:603] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:14.733753 20533 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.908804 13824 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:14.717176 20607 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:14.768682 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:14.772029 13708 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.007s	sys 0.013s
I20260811 16:06:14.771847 20619 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:14.771934 20687 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.772794 20365 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:14.722981 20495 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.568s	user 0.015s	sys 0.000s
I20260811 16:06:14.790740 20618 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.790783 14575 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:06:14.830403 14579 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:14.932350 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:14.835937 20206 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260811 16:06:14.856837 20614 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:14.928910 19979 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.853s	user 0.017s	sys 0.008s
I20260811 16:06:14.456386 20659 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:14.936383 20455 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:14.938998 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2574) took 2754 ms. Trace:
I20260811 16:06:14.939224 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1306) took 2013 ms. Trace:
I20260811 16:06:14.828078 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:14.939507 13900 rpcz_store.cc:276] 0811 16:06:12.184246 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.184673 (+   427us) service_pool.cc:227] Handling call
0811 16:06:12.209496 (+ 24823us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:12.480185 (+270689us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:12.480235 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:12.480290 (+    55us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:12.480335 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.938421 (+2458086us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:14.938507 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.938788 (+   281us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":621888768}
I20260811 16:06:14.857432 13902 rpcz_store.cc:276] 0811 16:06:13.329925 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.451525 (+121600us) service_pool.cc:227] Handling call
0811 16:06:14.828612 (+1377087us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54000339d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:14.828886 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1774103424}
I20260811 16:06:14.826920 20621 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.842011 20584 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:14.882885 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.15223e+06us
I20260811 16:06:14.898833 20638 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:14.500903 20578 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.023s
I20260811 16:06:14.894797 20396 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:14.911388 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1267) took 2875 ms (client timeout 1651 ms). Trace:
I20260811 16:06:14.913638 20533 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:14.915505 20688 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.906762 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:14.836709 20473 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260811 16:06:14.919901 13708 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.008s	sys 0.013s
I20260811 16:06:14.921775 20499 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:14.925917 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1290) took 1110 ms. Trace:
I20260811 16:06:14.798833 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1282) took 1695 ms. Trace:
I20260811 16:06:14.937013 20659 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.532099 20662 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:14.972124 20662 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.973454 20168 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:14.974421 20168 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.967296 13740 rpcz_store.cc:276] 0811 16:06:13.102756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.233895 (+131139us) service_pool.cc:227] Handling call
0811 16:06:13.234361 (+   466us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:13.234791 (+   430us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:13.234835 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:13.270658 (+ 35823us) log.cc:842] Serialized 26 byte log entry
0811 16:06:13.660461 (+389803us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:13.660502 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:13.660573 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:14.798250 (+1137677us) raft_consensus.cc:1671] finished
0811 16:06:14.798293 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.798551 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":101963,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":86615,"thread_start_us":320102,"threads_started":1,"wal-append.queue_time_us":748668}
I20260811 16:06:14.940275 13820 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:14.977779 20168 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:14.979382 20614 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:14.980350 20607 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.826850 20409 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:14.939714 14574 rpcz_store.cc:276] 0811 16:06:12.925349 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.925593 (+   244us) service_pool.cc:227] Handling call
0811 16:06:12.926058 (+   465us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:12.984665 (+ 58607us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:12.984694 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:12.984747 (+    53us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:12.984777 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.938679 (+1953902us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:14.938753 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.939002 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":134287744}
I20260811 16:06:14.852742 20504 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.950165 20495 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.951953 20365 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:14.936215 19979 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:14.954625 13735 rpcz_store.cc:269] 0811 16:06:12.010780 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.012892 (+  2112us) service_pool.cc:227] Handling call
0811 16:06:14.860629 (+2847737us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400281ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:14.885762 (+ 25133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4854577536}
W20260811 16:06:14.970835 20578 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.003s	sys 0.023s
I20260811 16:06:15.002092 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.012225 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.013006 13826 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 10.
I20260811 16:06:15.022086 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:15.023825 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 255508us
I20260811 16:06:15.024361 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2952) took 1465 ms. Trace:
I20260811 16:06:15.017123 20499 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.026804 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2951) took 1467 ms. Trace:
I20260811 16:06:15.027386 13822 rpcz_store.cc:276] 0811 16:06:13.558746 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.691305 (+132559us) service_pool.cc:227] Handling call
0811 16:06:13.724545 (+ 33240us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:13.879581 (+155036us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.026069 (+1146488us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b5400380ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.026531 (+   462us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":227414912}
I20260811 16:06:15.028898 20499 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.030035 14573 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260811 16:06:15.031505 20362 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.032017 20504 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.032292 20362 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.035779 13821 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260811 16:06:15.036314 13821 pending_rounds.cc:76] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 11
I20260811 16:06:15.036602 13821 pending_rounds.cc:97] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260811 16:06:15.036917 13821 raft_consensus.cc:2866] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:14.965315 20619 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.024582 14580 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:15.039292 20619 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.039748 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1307) took 1939 ms. Trace:
I20260811 16:06:14.998116 20607 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.024987 13823 rpcz_store.cc:276] 0811 16:06:13.559049 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.697918 (+138869us) service_pool.cc:227] Handling call
0811 16:06:13.698314 (+   396us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:13.783084 (+ 84770us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:13.783132 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:13.783205 (+    73us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:13.783244 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.023703 (+1240459us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b5400219b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.023799 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:15.024120 (+   321us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":194293504}
I20260811 16:06:15.026739 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:15.040272 14580 rpcz_store.cc:276] 0811 16:06:13.100196 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.100410 (+   214us) service_pool.cc:227] Handling call
0811 16:06:14.852180 (+1751770us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:15.039479 (+187299us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400571f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:15.039635 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":388566784}
I20260811 16:06:15.034914 20362 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.044412 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:14.965092 20687 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:14.966936 13737 rpcz_store.cc:276] 0811 16:06:13.815704 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.819288 (+  3584us) service_pool.cc:227] Handling call
0811 16:06:13.886889 (+ 67601us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:13.924912 (+ 38023us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:13.924946 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:13.925335 (+   389us) log.cc:842] Serialized 26 byte log entry
0811 16:06:14.092271 (+166936us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:14.092317 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.092375 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:14.593755 (+501380us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:14.925346 (+331591us) raft_consensus.cc:1671] finished
0811 16:06:14.925388 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.925681 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":101972,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":12176,"spinlock_wait_cycles":30454656,"thread_start_us":95121,"threads_started":1,"wal-append.queue_time_us":233155}
I20260811 16:06:15.051501 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:15.065802 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.072348 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:15.074364 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.076956 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:15.077333 20687 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.046835 20621 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:15.078274 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1289) took 1262 ms. Trace:
I20260811 16:06:15.078382 20621 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.078758 13742 rpcz_store.cc:276] 0811 16:06:13.815426 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.816442 (+  1016us) service_pool.cc:227] Handling call
0811 16:06:13.885033 (+ 68591us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:14.148150 (+263117us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:14.148193 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:14.148244 (+    51us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:14.148288 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.077745 (+929457us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540020a8d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.077826 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:15.078082 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":449187712}
W20260811 16:06:15.074153 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47622.3us
I20260811 16:06:15.074899 20638 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:15.063094 20365 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:15.088129 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78370.7us
I20260811 16:06:15.052908 20455 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.045086 20567 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.095752 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2949) took 1463 ms. Trace:
I20260811 16:06:15.115515 20471 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260811 16:06:15.115926 20455 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.117077 20471 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:15.117507 20677 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.122020 13818 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260811 16:06:15.122153 20507 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:15.123313 20507 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.124174 20455 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:15.126504 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65547.1us
I20260811 16:06:15.126617 20504 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:15.127429 20504 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:15.127950 20504 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:15.127851 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:15.130493 20630 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:15.130692 20204 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:15.131207 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89497.6us
I20260811 16:06:15.134028 20406 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.134995 20406 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.137529 20406 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:15.127895 20624 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:15.141011 20624 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:15.141961 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.143008 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.143952 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.144309 13743 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260811 16:06:15.144728 13741 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:15.130457 20619 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:15.144690 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.145766 20619 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:15.146267 20619 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:15.147953 13822 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260811 16:06:15.149057 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.150283 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:15.151381 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2948) took 1643 ms. Trace:
I20260811 16:06:15.151499 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.151674 20495 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:15.152977 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:15.151947 13825 rpcz_store.cc:276] 0811 16:06:13.507997 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.527222 (+ 19225us) service_pool.cc:227] Handling call
0811 16:06:14.819333 (+1292111us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:06:14.819715 (+   382us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:14.820371 (+   656us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:14.820401 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:14.820985 (+   584us) log.cc:842] Serialized 26 byte log entry
0811 16:06:14.918763 (+ 97778us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:14.918806 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.918891 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:15.150906 (+232015us) raft_consensus.cc:1671] finished
0811 16:06:15.150931 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:15.151198 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4321,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":467,"spinlock_wait_cycles":4337920,"thread_start_us":96913,"threads_started":1,"wal-append.queue_time_us":325782}
I20260811 16:06:15.154021 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:15.089293 20607 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:15.154680 13825 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:15.130699 19979 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:15.156175 20576 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.936s	user 0.008s	sys 0.020s
I20260811 16:06:15.155079 20607 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.131516 20630 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.164938 20630 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.142336 20624 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.118373 20677 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.171643 20677 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.158033 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:15.173323 20651 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:15.173938 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89937.5us
I20260811 16:06:15.175309 20659 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.175089 20576 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.175879 20621 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.177547 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:15.103535 13827 rpcz_store.cc:276] 0811 16:06:13.526151 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.526998 (+   847us) service_pool.cc:227] Handling call
0811 16:06:14.462896 (+935898us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:06:14.464347 (+  1451us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:14.733925 (+269578us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:14.734012 (+    87us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:14.747116 (+ 13104us) log.cc:842] Serialized 52 byte log entry
0811 16:06:14.865404 (+118288us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:14.865457 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:14.880277 (+ 14820us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:14.930851 (+ 50574us) raft_consensus.cc:1671] finished
0811 16:06:14.930865 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:14.988896 (+ 58031us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":110924,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"spinlock_wait_cycles":4752640,"thread_start_us":366072,"threads_started":2,"wal-append.queue_time_us":175687}
I20260811 16:06:15.175670 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:15.182539 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73683.2us
I20260811 16:06:15.117601 20471 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:15.237833 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.180943 20687 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:15.262615 14577 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:15.188148 20662 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.222173 20651 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:15.262768 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70768.9us
I20260811 16:06:15.220605 20455 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.260088 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2585) took 1442 ms. Trace:
I20260811 16:06:15.246213 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:15.257833 20576 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:15.280748 13901 rpcz_store.cc:276] 0811 16:06:13.817866 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.880428 (+ 62562us) service_pool.cc:227] Handling call
0811 16:06:15.190383 (+1309955us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400320d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:15.260001 (+ 69618us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2133099392}
I20260811 16:06:15.298139 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.285796 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:15.300846 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2299) took 3105 ms (client timeout 1798 ms). Trace:
W20260811 16:06:15.301470 13738 rpcz_store.cc:269] 0811 16:06:12.185497 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.200181 (+ 14684us) service_pool.cc:227] Handling call
0811 16:06:15.223866 (+3023685us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54001045d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:15.290628 (+ 66762us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4684069760}
I20260811 16:06:15.303486 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.303730 20507 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.304840 20687 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.306087 13822 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:15.263270 20365 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.271929 20627 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:15.322922 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:15.327931 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.329363 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.330636 20354 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:15.332855 13741 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:15.313589 20455 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.336669 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:15.337749 20455 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:15.337930 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:15.280774 20621 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:15.339556 20621 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.341904 20621 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.344732 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1765) took 1035 ms. Trace:
I20260811 16:06:15.345320 14577 rpcz_store.cc:276] 0811 16:06:14.309640 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.309794 (+   154us) service_pool.cc:227] Handling call
0811 16:06:14.331995 (+ 22201us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:15.271623 (+939628us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.344325 (+ 72702us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54006d38d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.344611 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1946619136}
I20260811 16:06:15.320868 20567 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.347774 20365 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.349416 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.351640 13827 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:15.352861 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.353642 13827 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:15.354976 20702 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260811 16:06:15.356467 13737 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:15.358098 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.359490 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.360803 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.310321 20471 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.297511 20668 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:15.371693 20668 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.375312 20695 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:15.376282 20695 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.379791 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.380749 13739 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:15.381433 20386 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.297637 20688 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.382803 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.354483 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.391196 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.393540 13825 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:15.396138 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:15.382853 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65475.7us
I20260811 16:06:15.389355 13827 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:06:15.362311 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.383737 13901 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:15.492300 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.374881 20668 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.382153 20386 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.516243 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.525823 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:15.536440 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 209187us
I20260811 16:06:15.523072 13743 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260811 16:06:15.522812 13823 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:15.527804 13740 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:15.493243 13825 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:06:15.515777 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2579) took 3319 ms (client timeout 1915 ms). Trace:
W20260811 16:06:15.524730 20409 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.008s
I20260811 16:06:15.523380 20206 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:15.560700 13903 rpcz_store.cc:269] 0811 16:06:12.196436 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:12.196582 (+   146us) service_pool.cc:227] Handling call
0811 16:06:15.515354 (+3318772us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:15.515644 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5669222656}
I20260811 16:06:15.503202 20567 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:15.568524 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.415282 20695 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.551550 20677 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.580519 13900 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:15.527704 20662 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:15.527454 20688 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:15.582618 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.526867 20593 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:15.527900 20659 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:15.567293 20651 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.596858 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.592612 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.568002 20365 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.604106 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1313) took 1166 ms. Trace:
I20260811 16:06:15.604383 20593 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.605476 13871 leader_election.cc:398] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:15.623128 13871 leader_election.cc:401] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:15.607244 20206 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.605502 20659 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.628356 13826 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:15.611310 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.611872 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.612741 20677 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.633283 20593 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:15.634136 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71407.8us
I20260811 16:06:15.635558 13871 leader_election.cc:398] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:06:15.635962 13871 leader_election.cc:401] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260811 16:06:15.636896 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:15.614992 20607 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.637480 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:15.614907 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2953) took 2055 ms (client timeout 2529 ms). Trace:
W20260811 16:06:15.638401 13824 rpcz_store.cc:269] 0811 16:06:13.559373 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:13.606348 (+ 46975us) service_pool.cc:227] Handling call
0811 16:06:15.614701 (+2008353us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400125a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:15.614849 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2128223104}
I20260811 16:06:15.639474 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.640164 13741 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 10.
I20260811 16:06:15.640933 20659 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.642123 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.642863 13744 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:06:15.644867 20660 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13.
I20260811 16:06:15.645936 20660 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:15.646396 20660 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:15.646837 20660 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:15.623592 20651 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.652828 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.653599 20651 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:15.653751 14578 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:15.605492 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.654090 20688 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.620874 14583 rpcz_store.cc:276] 0811 16:06:14.438337 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.440280 (+  1943us) service_pool.cc:227] Handling call
0811 16:06:14.440685 (+   405us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:14.802959 (+362274us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.596273 (+793314us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.604027 (+  7754us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":829511040}
I20260811 16:06:15.625828 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.635020 20619 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.614135 20386 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:15.648564 13686 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 5088cdd3f79d4c47ba826dc820b3cfaf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:15.648710 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:15.502362 20627 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:15.642961 20630 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:06:15.592800 19979 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:15.639065 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.589162 20687 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.663694 14577 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:15.663971 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.663750 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.664637 13822 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:15.664927 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.663699 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:15.673552 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.675017 13736 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:15.676203 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.678550 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1763) took 1389 ms. Trace:
I20260811 16:06:15.683661 14578 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:15.681068 14579 rpcz_store.cc:276] 0811 16:06:14.288853 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.289166 (+   313us) service_pool.cc:227] Handling call
0811 16:06:14.289625 (+   459us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:14.931885 (+642260us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.676068 (+744183us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400526054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.678484 (+  2416us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1242546432}
I20260811 16:06:15.691504 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.695452 13738 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:15.701368 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.666982 19979 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.669611 20567 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.704828 13736 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:15.664451 20662 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.708855 13900 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:15.711647 13907 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260811 16:06:15.702845 20504 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.003s
I20260811 16:06:15.723460 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:15.720973 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.738437 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.739673 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:15.742682 20688 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.748364 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2583) took 1927 ms. Trace:
I20260811 16:06:15.755950 13736 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:15.756567 20206 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.748925 13904 rpcz_store.cc:276] 0811 16:06:13.817242 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.045586 (+228344us) service_pool.cc:227] Handling call
0811 16:06:14.046020 (+   434us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:14.165914 (+119894us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:14.165946 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:14.166369 (+   423us) log.cc:842] Serialized 26 byte log entry
0811 16:06:14.797931 (+631562us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:14.895773 (+ 97842us) log.cc:842] Serialized 14 byte log entry
0811 16:06:14.942521 (+ 46748us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.726281 (+783760us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002c0bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:15.726346 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:15.741664 (+ 15318us) raft_consensus.cc:1671] finished
0811 16:06:15.744745 (+  3081us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:15.744930 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41137,"prepare.queue_time_us":557,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":212775,"raft.run_cpu_time_us":657,"raft.run_wall_time_us":74960,"spinlock_wait_cycles":274883840,"thread_start_us":550244,"threads_started":1,"wal-append.queue_time_us":678221}
I20260811 16:06:15.726471 20619 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:15.717725 13787 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.747s (SENT) [suppressed 8 similar messages]
I20260811 16:06:15.762370 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.746258 13738 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:15.758100 20651 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:15.768620 13901 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:15.771032 14575 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260811 16:06:15.776652 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.774752 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.719697 20504 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.784070 19979 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.785210 20627 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:15.786994 20651 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:15.789671 20609 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.790357 20567 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:15.793545 13821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.018s	sys 0.044s
W20260811 16:06:15.766762 20624 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.042s	sys 0.087s
W20260811 16:06:15.840550 13821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.018s	sys 0.044s
W20260811 16:06:15.812826 14581 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.030s	sys 0.041s
W20260811 16:06:15.841641 14581 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.030s	sys 0.041s
I20260811 16:06:15.841594 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:15.796440 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.017s	sys 0.044s
W20260811 16:06:15.842612 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.017s	sys 0.045s
W20260811 16:06:15.843833 20624 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.042s	sys 0.087s
I20260811 16:06:15.862998 14583 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:15.871228 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.872677 20504 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.893951 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:15.891659 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.898638 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:15.898494 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 188768us
I20260811 16:06:15.875022 20677 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:15.904862 13744 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:15.905217 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.902462 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.908632 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.913159 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.892551 20651 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:15.914822 14574 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
W20260811 16:06:15.920032 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.010s	sys 0.008s
I20260811 16:06:15.924309 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:15.937283 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:15.947374 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.008s
I20260811 16:06:15.880595 13738 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:15.937760 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:15.949329 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:15.924481 20362 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.009s
I20260811 16:06:15.954290 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.955015 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.951598 13907 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
W20260811 16:06:15.959455 13623 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.012s
W20260811 16:06:15.960001 13623 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.005s	sys 0.013s
I20260811 16:06:15.962674 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.964025 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.964640 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.964915 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:15.969489 14579 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:15.969815 13903 raft_consensus.cc:2354] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:15.966126 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:15.967689 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:15.981727 14577 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:15.981544 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:15.958696 20362 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.011s
I20260811 16:06:15.923234 20455 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:15.995345 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:15.982393 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.000641 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.002750 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.004750 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:16.008119 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:16.010955 20655 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:16.011667 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.012532 13908 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:16.012255 20655 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.013849 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.014479 13908 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:16.011025 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.016556 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.009827 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.015928 14574 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:16.023893 13906 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:16.024174 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.024628 13826 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260811 16:06:16.027002 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:16.027308 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.027765 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.028391 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.028726 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.029032 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.029589 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.029788 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:16.029997 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.031436 20471 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:16.030776 13908 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:16.035665 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:16.036077 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.036885 13905 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260811 16:06:16.037005 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:15.995527 20409 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260811 16:06:16.039342 20409 consensus_queue.cc:1225] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260811 16:06:16.039901 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:16.040149 20409 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:16.040616 20409 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:16.040676 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:16.035699 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:16.042110 20631 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.010s	sys 0.037s
I20260811 16:06:16.041810 20409 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.042312 13735 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:16.043747 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:16.044407 13736 raft_consensus.cc:2362] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15. Re-sending same reply.
I20260811 16:06:16.044499 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:16.045258 14578 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:16.047307 13909 raft_consensus.cc:2354] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13.
I20260811 16:06:16.046677 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.048610 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.014883 20655 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.030712 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.025115 13900 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
W20260811 16:06:16.042529 20631 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.010s	sys 0.038s
I20260811 16:06:16.050279 14579 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:16.053651 13742 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:16.058471 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:16.051671 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2968) took 1053 ms. Trace:
I20260811 16:06:16.054476 13901 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:16.059839 13818 rpcz_store.cc:276] 0811 16:06:14.997995 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.998495 (+   500us) service_pool.cc:227] Handling call
0811 16:06:15.006393 (+  7898us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:15.122684 (+116291us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:16.023663 (+900979us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5400124654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:16.051607 (+ 27944us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11398400}
I20260811 16:06:16.062294 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.065227 14577 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:16.066756 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:16.070225 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:16.070399 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.072137 13905 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:16.075904 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.074752 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:16.078766 13901 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:16.073935 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.076838 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.081156 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:16.082029 13742 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:16.083230 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.084789 13900 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:16.092240 13909 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:16.093266 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.093802 20660 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.094338 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.095008 13908 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:16.095050 13907 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:16.099835 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:16.100658 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:16.101823 20631 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:16.102311 13736 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:16.102517 20655 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:06:16.103400 13905 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:16.104416 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.105548 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:16.106597 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.109189 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.109881 13740 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:16.111274 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.111677 20677 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:16.112133 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.112584 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.112895 20473 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:16.113376 20473 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:16.113744 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.114614 13909 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260811 16:06:16.115427 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.114420 20473 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.116173 13909 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:16.117003 20473 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:16.118227 13789 leader_election.cc:398] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:16.118582 13789 leader_election.cc:401] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260811 16:06:16.062819 20455 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.124645 20504 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:16.125033 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:16.125607 20455 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.126219 20618 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:16.063330 20409 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:16.092387 20576 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:16.064114 20668 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:16.117017 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.126464 20655 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:16.129793 13905 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:16.155484 14582 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.032s	sys 0.027s
W20260811 16:06:16.156584 14582 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.033s	sys 0.027s
I20260811 16:06:16.069008 20630 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
W20260811 16:06:16.155123 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.049s
W20260811 16:06:16.178586 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.049s
I20260811 16:06:16.180250 13900 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:06:16.184178 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.126673 20618 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:16.148095 20576 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:16.198173 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:16.201848 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.203392 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:16.205540 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.209537 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.211068 13740 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:16.082026 20147 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.125s
I20260811 16:06:16.220989 13901 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:16.195959 20504 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:16.167999 20662 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.225059 13909 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:16.197773 20618 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:16.230849 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.200661 20576 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:16.235503 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.236343 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.236754 13740 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:16.241250 13741 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:16.242432 13735 raft_consensus.cc:2396] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260811 16:06:16.247488 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:16.250413 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.262872 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.267179 13736 raft_consensus.cc:2396] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260811 16:06:16.268563 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.020s	sys 0.020s
I20260811 16:06:16.264061 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.274369 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.278081 13741 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
W20260811 16:06:16.279098 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81020.1us
I20260811 16:06:16.280061 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:06:16.273905 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.020s	sys 0.020s
I20260811 16:06:16.281013 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:16.282160 13900 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:16.272485 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:16.274828 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 156777us
W20260811 16:06:16.280890 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 1.06118e+06us
I20260811 16:06:16.271678 13901 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:16.295688 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:16.248548 20504 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:16.309123 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:16.292655 20624 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:16.319089 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:16.323452 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:16.331836 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:16.312366 20660 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.292032 20455 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
W20260811 16:06:16.340592 14580 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.019s
W20260811 16:06:16.343631 14580 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.019s	sys 0.019s
I20260811 16:06:16.343751 13743 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260811 16:06:16.320125 20624 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:16.329648 20655 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:16.347807 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:16.338124 20662 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:16.402634 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:16.409590 20630 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:16.410158 20630 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:16.410553 20630 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:16.413784 20362 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:16.419546 20490 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:16.420195 20490 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:16.420620 20490 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:16.427842 20711 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260811 16:06:16.430641 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2969) took 1388 ms. Trace:
I20260811 16:06:16.431077 13821 rpcz_store.cc:276] 0811 16:06:15.042162 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.042359 (+   197us) service_pool.cc:227] Handling call
0811 16:06:15.085165 (+ 42806us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:15.132347 (+ 47182us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:15.132394 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:15.133169 (+   775us) log.cc:842] Serialized 26 byte log entry
0811 16:06:15.841058 (+707889us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:15.841107 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.841190 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:16.430377 (+589187us) raft_consensus.cc:1671] finished
0811 16:06:16.430402 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.430572 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22111,"raft.queue_time_us":25051,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"thread_start_us":707373,"threads_started":1,"wal-append.queue_time_us":1096238}
I20260811 16:06:16.341820 20688 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:16.350919 20471 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:16.388070 20624 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:16.453761 13906 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:16.401705 20655 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:16.404958 20662 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:16.446821 20545 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.008s	sys 0.023s
W20260811 16:06:16.485562 20545 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.008s	sys 0.024s
I20260811 16:06:16.463442 20655 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
W20260811 16:06:16.489187 13787 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.024s	sys 0.012s
I20260811 16:06:16.487571 13735 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:16.404831 20607 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260811 16:06:16.451967 20471 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:16.489552 13787 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.024s	sys 0.012s
I20260811 16:06:16.487794 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:16.495900 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 778162us
I20260811 16:06:16.488502 20662 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:16.500099 20455 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:16.497790 20471 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:16.460407 20688 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.528505 20688 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.512887 20504 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:16.514495 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173211us
W20260811 16:06:16.525209 20721 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260811 16:06:16.510479 20631 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:16.511001 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:16.522863 20709 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.644s	user 0.011s	sys 0.009s
I20260811 16:06:16.559850 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.561893 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.562911 13741 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:16.565240 13903 raft_consensus.cc:2396] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260811 16:06:16.511981 20619 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:16.565989 20619 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:16.566390 20619 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:16.572288 20490 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:16.575562 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67032.3us
I20260811 16:06:16.577222 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:16.559216 20455 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:16.584996 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46479.6us
I20260811 16:06:16.579044 20618 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.579855 20607 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:16.585865 20607 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:16.585916 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:16.586419 20607 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:16.586949 20710 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260811 16:06:16.580701 20386 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:16.587637 20386 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:16.588024 20386 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:16.561074 13740 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:16.583398 20631 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:16.597015 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:16.598064 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:16.579046 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2970) took 1421 ms. Trace:
I20260811 16:06:16.579530 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1775) took 1687 ms. Trace:
I20260811 16:06:16.598708 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2967) took 1608 ms. Trace:
I20260811 16:06:16.607864 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:16.605504 13737 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.019s	sys 0.061s
W20260811 16:06:16.612574 13737 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.020s	sys 0.062s
I20260811 16:06:16.616420 20631 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:16.618554 13909 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:16.620474 19979 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:16.621114 19979 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.580420 20609 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:16.599736 13817 rpcz_store.cc:276] 0811 16:06:15.157397 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.537711 (+380314us) service_pool.cc:227] Handling call
0811 16:06:15.538085 (+   374us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:15.538610 (+   525us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:15.538636 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:15.544459 (+  5823us) log.cc:842] Serialized 26 byte log entry
0811 16:06:16.188799 (+644340us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:16.188857 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:16.188967 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:16.524383 (+335416us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:16.578741 (+ 54358us) raft_consensus.cc:1671] finished
0811 16:06:16.578766 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.578985 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":93,"spinlock_wait_cycles":6279040,"thread_start_us":587634,"threads_started":1,"wal-append.queue_time_us":706681}
W20260811 16:06:16.612677 14575 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.027s
I20260811 16:06:16.599893 14573 rpcz_store.cc:276] 0811 16:06:14.891749 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.033584 (+141835us) service_pool.cc:227] Handling call
0811 16:06:15.034037 (+   453us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:15.048181 (+ 14144us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:15.048229 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:15.083190 (+ 34961us) log.cc:842] Serialized 26 byte log entry
0811 16:06:15.285325 (+202135us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:15.285465 (+   140us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.285677 (+   212us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:16.521843 (+1236166us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:16.579212 (+ 57369us) raft_consensus.cc:1671] finished
0811 16:06:16.579233 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.579437 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6784,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":10248,"spinlock_wait_cycles":42235264,"thread_start_us":180458,"threads_started":1,"wal-append.queue_time_us":758243}
W20260811 16:06:16.626931 14575 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.027s
W20260811 16:06:16.610955 14541 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.013s	sys 0.024s
W20260811 16:06:16.629698 14541 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.014s	sys 0.025s
W20260811 16:06:16.631465 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 785404us
I20260811 16:06:16.599713 20490 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:16.586967 20668 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:16.604866 13820 rpcz_store.cc:276] 0811 16:06:14.990348 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.990500 (+   152us) service_pool.cc:227] Handling call
0811 16:06:15.017753 (+ 27253us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:15.132131 (+114378us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:15.132180 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:15.132957 (+   777us) log.cc:842] Serialized 26 byte log entry
0811 16:06:15.843092 (+710135us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:15.843182 (+    90us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:15.843266 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:16.586154 (+742888us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:16.588324 (+  2170us) raft_consensus.cc:1671] finished
0811 16:06:16.588345 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.598627 (+ 10282us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27212,"raft.queue_time_us":29965,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":169,"spinlock_wait_cycles":3479296,"thread_start_us":709569,"threads_started":1,"wal-append.queue_time_us":1129602}
I20260811 16:06:16.625710 20609 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:16.618836 20631 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:16.611430 20409 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260811 16:06:16.636327 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:16.640530 20504 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:16.657018 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:16.584805 20455 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.655503 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2530) took 1032 ms. Trace:
I20260811 16:06:16.664548 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:16.657707 13740 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:16.642431 19979 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:16.610525 20630 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.656873 20631 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:16.662137 20668 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:06:16.668294 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.028s	sys 0.025s
W20260811 16:06:16.683450 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.029s	sys 0.026s
I20260811 16:06:16.664542 13737 rpcz_store.cc:276] 0811 16:06:15.616477 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.616644 (+   167us) service_pool.cc:227] Handling call
0811 16:06:15.617089 (+   445us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:15.693158 (+ 76069us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:06:15.715005 (+ 21847us) log.cc:842] Serialized 14 byte log entry
0811 16:06:16.624584 (+909579us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:16.624679 (+    95us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:16.624742 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:16.648320 (+ 23578us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:16.648402 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.648592 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":19305,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":125,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":115,"spinlock_wait_cycles":147458304,"thread_start_us":852527,"threads_started":1}
I20260811 16:06:16.663437 20504 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.701494 13735 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:16.688885 20631 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260811 16:06:16.716732 20624 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.683013 20668 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:16.722729 13902 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.016s	sys 0.048s
W20260811 16:06:16.725419 13902 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.017s	sys 0.048s
W20260811 16:06:16.701500 14581 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.019s	sys 0.026s
W20260811 16:06:16.729718 14581 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.020s	sys 0.027s
I20260811 16:06:16.729029 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2919) took 1351 ms. Trace:
I20260811 16:06:16.724033 20668 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:16.741823 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:16.720507 20631 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:16.724462 20618 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.740664 13902 rpcz_store.cc:276] 0811 16:06:15.378072 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.378273 (+   201us) service_pool.cc:227] Handling call
0811 16:06:15.378900 (+   627us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:15.379639 (+   739us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:15.379681 (+    42us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:15.380567 (+   886us) log.cc:842] Serialized 52 byte log entry
0811 16:06:15.953690 (+573123us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:16.728150 (+774460us) log.cc:842] Serialized 14 byte log entry
0811 16:06:16.728482 (+   332us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:16.728677 (+   195us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:16.728738 (+    61us) raft_consensus.cc:1671] finished
0811 16:06:16.728756 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.728948 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3393,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":1319634,"threads_started":2,"wal-append.queue_time_us":1023485}
I20260811 16:06:16.786108 20631 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:16.800159 20624 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:16.741052 20386 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:16.813061 20386 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:16.814599 20504 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:16.817134 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:16.817016 20471 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:16.818676 13740 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:16.714159 20609 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.788885 20576 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.826391 20409 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:06:16.867527 14582 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.016s	sys 0.023s
W20260811 16:06:16.869944 14582 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.016s	sys 0.023s
I20260811 16:06:16.873003 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1317) took 1900 ms. Trace:
I20260811 16:06:16.876572 20619 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.852197 20471 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:16.856243 20504 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:16.880571 20609 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:16.879993 14582 rpcz_store.cc:276] 0811 16:06:14.973039 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.064906 (+ 91867us) service_pool.cc:227] Handling call
0811 16:06:15.104356 (+ 39450us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:15.235706 (+131350us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:06:16.165689 (+929983us) log.cc:842] Serialized 14 byte log entry
0811 16:06:16.872589 (+706900us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:16.872655 (+    66us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:16.872702 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:16.872788 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:16.872934 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":787798,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1547195,"threads_started":2}
I20260811 16:06:16.892023 20662 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.894297 20655 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:16.925513 20630 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:16.955423 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.013s	sys 0.033s
W20260811 16:06:16.955945 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.013s	sys 0.033s
W20260811 16:06:16.956414 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 675428us
I20260811 16:06:16.912320 20504 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:16.955760 20737 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
W20260811 16:06:16.997529 13905 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.027s	sys 0.030s
W20260811 16:06:17.027495 13905 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.027s	sys 0.030s
I20260811 16:06:17.028852 20631 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:16.970351 20607 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:17.036034 20545 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.001s	sys 0.018s
W20260811 16:06:17.036569 20545 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.001s	sys 0.018s
I20260811 16:06:17.036662 20607 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:17.037534 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.010s
W20260811 16:06:17.037961 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.009s	sys 0.010s
W20260811 16:06:17.038290 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 635774us
W20260811 16:06:17.040028 13738 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.003s	sys 0.016s
W20260811 16:06:17.040498 13738 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.003s	sys 0.016s
W20260811 16:06:17.041414 14580 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.017s	sys 0.024s
W20260811 16:06:17.041894 14580 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.017s	sys 0.024s
W20260811 16:06:17.061322 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.013s	sys 0.014s
W20260811 16:06:17.062067 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.013s	sys 0.014s
I20260811 16:06:17.047240 20631 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:17.067870 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 489451us
I20260811 16:06:17.073966 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:17.062450 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 687664us
I20260811 16:06:17.038436 20576 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:17.039213 20619 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:17.084314 20715 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.015s
W20260811 16:06:17.093291 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 390438us
W20260811 16:06:17.099093 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 426562us
W20260811 16:06:17.151994 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50478.1us
I20260811 16:06:17.153263 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.137511 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1299) took 1104 ms. Trace:
W20260811 16:06:17.186187 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 587199us
I20260811 16:06:17.187258 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.188503 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1771) took 2307 ms. Trace:
I20260811 16:06:17.180497 13738 rpcz_store.cc:276] 0811 16:06:16.032923 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:16.054523 (+ 21600us) service_pool.cc:227] Handling call
0811 16:06:16.054961 (+   438us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:16.071956 (+ 16995us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:06:16.095503 (+ 23547us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.136868 (+1041365us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.137126 (+   258us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:17.137190 (+    64us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:17.137240 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.137318 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.137446 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7353,"prepare.queue_time_us":517,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":27465,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":18944,"thread_start_us":1040424,"threads_started":3,"wal-append.queue_time_us":694846}
W20260811 16:06:17.101377 20715 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.011s	sys 0.016s
I20260811 16:06:17.205129 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1132) took 1103 ms. Trace:
I20260811 16:06:17.206286 13901 rpcz_store.cc:276] 0811 16:06:16.101964 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:16.327413 (+225449us) service_pool.cc:227] Handling call
0811 16:06:16.623911 (+296498us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:17.088111 (+464200us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:06:17.088145 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:17.088191 (+    46us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:17.088218 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.089530 (+  1312us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.204937 (+115407us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000875d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:17.205063 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2057,"raft.queue_time_us":200494,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":3877,"spinlock_wait_cycles":639646464,"thread_start_us":454765,"threads_started":1}
I20260811 16:06:17.209372 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:17.178839 20630 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:17.228468 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:17.236122 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 196991us
I20260811 16:06:17.219237 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:17.190230 14581 rpcz_store.cc:276] 0811 16:06:14.792814 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:14.940040 (+147226us) service_pool.cc:227] Handling call
0811 16:06:14.940551 (+   511us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:14.941038 (+   487us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:15.842372 (+901334us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.096784 (+1254412us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:17.096857 (+    73us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:17.096927 (+    70us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.097019 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.099818 (+  2799us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13741,"prepare.queue_time_us":1010702,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4751,"spinlock_wait_cycles":3766016,"thread_start_us":2048078,"threads_started":3,"wal-append.queue_time_us":1181187}
I20260811 16:06:17.235786 13823 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:17.189460 20409 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:17.243103 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55985.1us
I20260811 16:06:17.253254 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.243970 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:17.264006 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:17.252096 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.266296 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:17.237838 20737 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:06:17.273327 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:17.179108 20619 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260811 16:06:17.212076 20662 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:17.271905 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50429.1us
W20260811 16:06:17.283757 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 326171us
I20260811 16:06:17.276304 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:17.284668 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:17.285188 13908 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:17.286686 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:17.276955 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:17.278071 13789 leader_election.cc:398] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13.
I20260811 16:06:17.288031 13789 leader_election.cc:401] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260811 16:06:17.278568 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:17.289002 13909 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:17.274041 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:17.269366 20735 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260811 16:06:17.292073 13901 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260811 16:06:17.185875 20668 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:17.243165 20624 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:17.287510 13907 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:17.285301 13904 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20. Re-sending same reply.
I20260811 16:06:17.254715 20655 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:17.304610 14573 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.001s
I20260811 16:06:17.308012 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:17.309083 14573 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:17.304745 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1306) took 1411 ms. Trace:
W20260811 16:06:17.305580 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 152365us
I20260811 16:06:17.316457 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:17.318265 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:17.335912 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:06:17.345701 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 126561us
I20260811 16:06:17.329979 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1139) took 1119 ms. Trace:
I20260811 16:06:17.352610 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:17.311273 14575 rpcz_store.cc:276] 0811 16:06:15.892829 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.898284 (+  5455us) service_pool.cc:227] Handling call
0811 16:06:15.909620 (+ 11336us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:15.909912 (+   292us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:16.627533 (+717621us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.279618 (+652085us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.294081 (+ 14463us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:17.294409 (+   328us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:17.294576 (+   167us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.294848 (+   272us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.304625 (+  9777us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20880,"prepare.queue_time_us":133299,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"thread_start_us":1257060,"threads_started":3}
W20260811 16:06:17.353368 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 123472us
I20260811 16:06:17.295984 20745 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:17.360313 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:17.362871 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:17.371031 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.372040 13818 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:17.322552 20409 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:17.314594 20630 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:17.350785 13900 rpcz_store.cc:276] 0811 16:06:16.210523 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:16.550398 (+339875us) service_pool.cc:227] Handling call
0811 16:06:16.567235 (+ 16837us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:16.567573 (+   338us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:17.068074 (+500501us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.329070 (+260996us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:17.329220 (+   150us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:17.329354 (+   134us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.329544 (+   190us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.329839 (+   295us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51912,"prepare.queue_time_us":522948,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"thread_start_us":682616,"threads_started":2}
I20260811 16:06:17.331542 20655 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 12. Current term is 13.
W20260811 16:06:17.393599 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77275us
I20260811 16:06:17.382503 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.394436 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.398465 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:17.392894 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 108474us
I20260811 16:06:17.402038 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:17.368021 20745 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:17.315624 20624 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:17.314944 20147 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260811 16:06:17.377599 19979 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:17.415057 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:17.404057 20739 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260811 16:06:17.396376 20688 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:17.413939 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53697.1us
I20260811 16:06:17.428925 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.429848 13821 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:17.410993 20745 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:17.408973 20504 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:17.344717 20744 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
W20260811 16:06:17.414494 20742 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260811 16:06:17.439958 20732 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.341s	user 0.001s	sys 0.002s
W20260811 16:06:17.441804 20743 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260811 16:06:17.414585 20749 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:17.444977 20504 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:17.423413 20651 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:17.480345 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86001.5us
I20260811 16:06:17.442333 20147 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:17.420066 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1780) took 1648 ms. Trace:
I20260811 16:06:17.434316 14541 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:17.414561 20607 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:17.477947 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:17.434963 20772 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:17.445524 20780 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:17.478374 20741 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260811 16:06:17.497599 14580 rpcz_store.cc:276] 0811 16:06:15.771886 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:15.772046 (+   160us) service_pool.cc:227] Handling call
0811 16:06:15.773922 (+  1876us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:15.774166 (+   244us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:16.349614 (+575448us) log.cc:842] Serialized 14 byte log entry
0811 16:06:17.419529 (+1069915us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:17.419647 (+   118us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:17.419713 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.419811 (+    98us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.419991 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":315,"prepare.queue_time_us":261276,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":305997,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9096,"thread_start_us":1630232,"threads_started":3,"wal-append.queue_time_us":882238}
W20260811 16:06:17.510924 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 112553us
I20260811 16:06:17.513862 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:17.513541 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 201678us
I20260811 16:06:17.523629 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:17.522111 14575 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:17.480568 20749 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:17.544227 20545 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:17.464035 20688 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:17.528976 20738 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.328s	user 0.001s	sys 0.001s
I20260811 16:06:17.513257 20147 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:17.509898 20772 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:17.615753 20772 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:17.621189 20147 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:17.623574 20677 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:17.624073 20677 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:17.624450 20677 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:17.628188 20757 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260811 16:06:17.629103 20757 consensus_queue.cc:1225] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 18.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:06:17.630431 20757 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:17.630842 20757 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:17.609028 20668 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:17.611348 20688 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:17.612910 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 244622us
W20260811 16:06:17.613420 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 211503us
I20260811 16:06:17.681300 20757 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:17.614035 20765 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:17.552100 20545 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:17.552728 20749 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:17.681370 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:17.685075 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:17.686296 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:17.687220 20765 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:17.687322 20545 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:17.637603 20624 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:17.687995 20765 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:17.642520 13909 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
W20260811 16:06:17.644007 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 235603us
I20260811 16:06:17.637424 20770 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:17.561477 20630 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:17.646009 20758 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:17.690080 20778 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:17.691504 20758 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:17.692700 20758 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:17.693490 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 112341us
I20260811 16:06:17.567245 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:17.696465 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129402us
I20260811 16:06:17.696934 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1124) took 1614 ms. Trace:
I20260811 16:06:17.697333 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.697535 13905 rpcz_store.cc:276] 0811 16:06:16.082455 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:16.195481 (+113026us) service_pool.cc:227] Handling call
0811 16:06:16.214170 (+ 18689us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:16.237932 (+ 23762us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:16.237976 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:16.274366 (+ 36390us) log.cc:842] Serialized 26 byte log entry
0811 16:06:17.028176 (+753810us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:17.028234 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.028332 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:17.696633 (+668301us) raft_consensus.cc:1671] finished
0811 16:06:17.696664 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:17.696854 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":716069,"threads_started":1,"wal-append.queue_time_us":911945}
I20260811 16:06:17.699780 13822 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:17.699713 20409 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:17.700660 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:17.700802 20409 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:17.665621 20750 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260811 16:06:17.614581 19979 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:17.562384 20780 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:17.690135 14541 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:17.665017 20764 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.282s	user 0.000s	sys 0.003s
I20260811 16:06:17.714438 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:17.704843 20651 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:17.715477 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.784076 13821 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:17.784390 13823 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:17.713075 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.718453 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:17.704308 20760 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:17.716321 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:17.730496 20765 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:17.729429 13822 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260811 16:06:17.786392 13825 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:17.701587 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:17.695739 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.788681 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:17.702309 20624 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260811 16:06:17.741453 20609 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.004s
I20260811 16:06:17.670468 20745 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:17.742129 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.747874 13818 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:17.690317 20770 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:17.717195 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:17.760406 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 283114us
W20260811 16:06:17.784843 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 94772.6us
W20260811 16:06:17.822395 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 120875us
I20260811 16:06:17.835740 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.836625 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.826025 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:17.838044 13821 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:17.827491 14581 raft_consensus.cc:2354] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:17.833402 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:17.833739 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:17.760115 19979 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:17.762653 20780 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:17.878122 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:17.879626 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46014.1us
W20260811 16:06:17.842022 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 318602us
I20260811 16:06:17.881699 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:17.881050 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:17.884814 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49157.8us
I20260811 16:06:17.888873 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:17.890264 13824 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:17.891116 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:17.834362 20778 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:17.885952 13822 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
W20260811 16:06:17.884814 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 142838us
I20260811 16:06:17.830328 20624 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:17.896325 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:17.900293 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 366068us
I20260811 16:06:17.832051 20761 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:17.832976 20751 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:17.875188 19979 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:17.903899 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.908915 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.910655 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:17.913055 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:17.877243 20660 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:17.884070 20386 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:17.927383 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:17.899986 20784 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:17.895164 20662 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:17.903891 20688 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:17.905158 20624 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:17.900787 20789 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:17.911458 20576 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:17.928102 20618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.032s	sys 0.067s
I20260811 16:06:17.841248 20651 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:17.895915 20785 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:17.916177 20655 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:17.951731 13823 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:17.966576 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:17.947618 20784 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:17.941123 20504 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:18.065316 20784 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:17.906906 20473 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260811 16:06:17.833209 20765 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:17.873289 20759 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260811 16:06:17.948571 20386 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:17.832440 20760 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:17.932991 20791 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:17.992816 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:17.993932 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:17.950004 20778 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:17.948939 20660 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:17.965319 20147 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:17.980885 20618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.032s	sys 0.068s
I20260811 16:06:18.012650 13738 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:18.096129 13738 raft_consensus.cc:595] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:18.002810 20775 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:17.941484 20770 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 19.7, Last appended by leader: 7, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:17.948877 20630 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260811 16:06:17.986441 20754 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.293s
I20260811 16:06:18.013854 20795 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:18.012650 20779 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.088s
W20260811 16:06:18.032413 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 143267us
I20260811 16:06:17.992508 20619 raft_consensus.cc:2741] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260811 16:06:18.111366 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:17.985373 20785 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:18.058917 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 145949us
I20260811 16:06:17.987118 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:18.014586 20794 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:17.997215 20740 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.094s
W20260811 16:06:18.101636 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 203386us
W20260811 16:06:18.106326 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 112519us
I20260811 16:06:17.994030 20662 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.096171 20471 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:18.115276 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:18.067456 20490 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260811 16:06:18.117164 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 130130us
I20260811 16:06:17.977582 20789 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:17.969292 20780 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:18.146299 20802 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260811 16:06:18.145745 20471 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.123346 20778 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:18.129102 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:18.176302 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 219055us
I20260811 16:06:18.114347 13823 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:18.032195 20772 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.155493 20607 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:18.109511 20798 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:18.156215 20740 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Stepping down as leader of term 13
W20260811 16:06:18.158844 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43728.1us
I20260811 16:06:18.108101 20795 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:18.160203 13827 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:06:18.119693 20775 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260811 16:06:18.206717 20772 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:18.165025 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44282.7us
I20260811 16:06:18.211853 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:18.164794 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 246639us
I20260811 16:06:18.126425 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:18.155758 20779 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:18.117532 20791 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:18.193670 20607 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:18.231698 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.093607 20749 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.118549 20785 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:18.197316 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.198114 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:18.234193 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.235782 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:18.199726 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.236953 14575 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:18.199851 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:18.221078 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 216968us
I20260811 16:06:18.120296 20770 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:18.201857 20800 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260811 16:06:18.262662 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.263484 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:06:18.256438 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56241.4us
I20260811 16:06:18.183801 20745 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:18.134496 20386 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.266212 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.197235 20798 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:18.266556 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.196751 20740 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:18.208989 20655 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:18.259867 20754 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:18.270186 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.108737 20504 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.269930 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:18.285672 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55026.8us
I20260811 16:06:18.276685 13823 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:18.277235 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.209758 20795 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:18.231988 20772 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.208621 20778 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:18.256520 20607 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:18.328316 14573 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260811 16:06:18.299212 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:18.280668 20781 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:06:18.274226 20798 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:18.320348 13822 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 20 because replica has last-logged OpId of term: 19 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 7.
I20260811 16:06:18.261502 20779 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:18.324843 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:18.278926 20147 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:18.330650 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 100790us
I20260811 16:06:18.300815 14575 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:18.273990 20809 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:18.283851 20754 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:18.273874 20807 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:18.284287 20576 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.300302 20745 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:18.324122 20794 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:18.343158 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 82339.9us
W20260811 16:06:18.337404 20677 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.008s
I20260811 16:06:18.368093 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.369057 13818 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:18.337173 20651 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:18.374960 13826 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:18.343209 20809 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:18.346601 20754 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:18.283905 20811 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260811 16:06:18.332326 20772 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.344091 20789 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:18.389569 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.392768 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:18.380034 20545 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.003s
I20260811 16:06:18.393469 13818 raft_consensus.cc:2362] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13. Re-sending same reply.
I20260811 16:06:18.375294 20814 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.403105 20814 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.403537 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:18.404718 13824 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:18.381489 20809 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:18.410017 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.412201 20770 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:18.414152 20668 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Stepping down as leader of term 10
I20260811 16:06:18.414602 20668 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:18.416399 20794 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.394145 20812 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.361660 20576 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.420321 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:18.342753 20147 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.431064 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.393303 20745 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:18.435127 20778 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.386222 20801 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.232s
I20260811 16:06:18.436513 20812 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.419845 20662 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.438272 20819 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:18.439255 20810 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260811 16:06:18.365940 20779 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.444725 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:18.438086 20752 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:18.372788 20677 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.419786 20816 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:18.457949 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:18.466149 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:18.361804 20740 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.439977 20818 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:18.488689 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.489043 20818 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:18.489667 20818 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:18.484333 13824 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 11: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:18.451360 20788 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:18.456450 20409 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.457868 20789 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:18.400754 20545 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.370826 20791 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 18.7, Last appended by leader: 7, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:18.483251 20757 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.760s	user 0.013s	sys 0.001s
W20260811 16:06:18.494410 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 258728us
I20260811 16:06:18.492542 20789 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:18.488093 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.514890 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:18.382019 20760 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:18.501555 20782 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.459268 20819 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:18.463645 20749 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:18.493602 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 237088us
I20260811 16:06:18.405710 20814 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.525290 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:18.469025 20662 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:18.505154 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 185284us
I20260811 16:06:18.488282 13826 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:18.518404 13787 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:18.443446 20784 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.528882 13902 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:18.530107 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.530793 14573 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:18.531672 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:18.532315 13907 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:18.532924 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:18.525127 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:18.466866 20752 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:18.540764 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.541530 14578 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:18.541213 20752 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.543254 13908 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:18.544364 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.544972 14580 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:18.546476 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.526979 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:18.547778 13787 leader_election.cc:398] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:18.548645 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.499507 20409 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.539731 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.596635 14574 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:18.539984 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:18.545008 13818 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:18.548799 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.598783 14577 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:18.549350 20821 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.550777 14579 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260811 16:06:18.551962 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c3ac106c3df9431c9323c322b9f8118b, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.552475 20770 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260811 16:06:18.553434 20833 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260811 16:06:18.553756 20787 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:18.522853 20819 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:18.555759 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:18.612178 13738 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:18.613044 13738 raft_consensus.cc:595] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:06:18.613184 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57514.7us
I20260811 16:06:18.613498 13738 raft_consensus.cc:603] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:18.492174 20788 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.527284 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:18.506906 20801 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:18.614473 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:18.522339 20815 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:18.619488 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.619931 13902 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
W20260811 16:06:18.604138 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c3ac106c3df9431c9323c322b9f8118b, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.616247 20772 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:18.594790 13871 connection.cc:232] RPC call timeout handler was delayed by -2.0944213139591739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260811 16:06:18.622363 14575 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:18.623111 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.526963 20745 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:18.624019 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.624809 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.500765 20816 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.604303 20662 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:18.614507 20789 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:18.635088 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0259480818640441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260811 16:06:18.673985 14577 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
W20260811 16:06:18.624925 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 256808us
I20260811 16:06:18.678933 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.617655 20490 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260811 16:06:18.622120 20751 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.023s	sys 0.032s
I20260811 16:06:18.680210 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.610383 20770 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:18.681841 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.513828 20757 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.691407 14578 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:18.697759 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.533155 20782 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.619576 20815 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:18.692464 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.617273 20749 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:18.700933 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.701675 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.740048 13740 raft_consensus.cc:2396] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260811 16:06:18.634579 20775 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:18.617095 20631 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260811 16:06:18.750263 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.762135 14579 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:18.692943 20751 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.024s	sys 0.032s
I20260811 16:06:18.755927 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.768360 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.768673 13743 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:18.769606 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.695721 20823 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.759598 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.774056 13817 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:18.774555 13736 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:18.700650 20770 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:18.757634 13827 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:18.766115 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.770561 14575 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:18.755242 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:18.778970 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.778970 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.790917 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.792318 13902 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:18.792999 13737 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 11: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:18.756683 20833 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:06:18.672349 20662 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.793855 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.633994 20801 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.758570 20576 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:18.745533 20815 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:18.805426 13743 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:18.815337 20816 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.816151 20784 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.816341 20409 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.816969 20409 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:18.802412 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.775818 20751 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:18.810473 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:18.795099 20820 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:18.789922 20823 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.776584 20775 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:18.754227 20749 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.619346 20821 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:18.789517 20827 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.840549 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.841354 13737 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:18.838841 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.832207 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.845135 13744 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:18.817548 20409 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.802281 20147 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:18.805460 20812 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:18.853111 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.854559 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.848395 14580 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:18.861214 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.863111 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:18.869031 13738 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:18.825620 20545 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.837528 20816 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:18.816926 20801 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:18.887234 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.877501 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.888849 13739 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:18.846544 20779 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:18.848480 20843 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:18.912995 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:18.915198 13739 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:18.913053 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:18.916997 14577 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:18.917610 13818 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:18.917788 13827 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:18.919072 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:18.935217 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:18.936537 14574 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:18.977761 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:18.860785 20827 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.907286 20816 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:18.938371 20788 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:18.989894 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.033s	sys 0.023s
I20260811 16:06:18.901629 20820 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260811 16:06:19.000026 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.033s	sys 0.023s
W20260811 16:06:19.001830 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 300238us
I20260811 16:06:19.003970 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.005306 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:19.006009 13744 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:18.876405 20775 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.010247 14541 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:18.990065 20754 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.002s
I20260811 16:06:19.007011 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:19.018676 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:19.022468 14541 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.023913 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:18.937244 20831 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260811 16:06:19.045976 20782 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.049247 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:19.029271 20758 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260811 16:06:19.051635 20845 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260811 16:06:18.964471 20850 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260811 16:06:19.054239 20850 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:19.051530 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.061046 13743 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:19.061560 13907 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:19.022893 20576 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:19.016098 20821 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.041378 20820 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:19.073691 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.073931 20749 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.026806 20760 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:06:19.044770 19979 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.112s	user 0.012s	sys 0.003s
I20260811 16:06:19.051591 20758 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:19.075083 20758 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:19.074738 19979 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.077073 19979 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.074120 20782 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:19.055590 20847 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260811 16:06:19.054263 20848 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260811 16:06:19.073685 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.086263 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.088553 13736 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:18.925545 20751 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.095865 20820 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:19.094919 13743 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:19.096485 20816 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.097203 20749 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.097352 20823 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.097740 20749 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:19.098697 20809 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.691s	user 0.005s	sys 0.005s
I20260811 16:06:19.099222 20809 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.099993 20749 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.100368 13740 raft_consensus.cc:2354] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:19.090605 14573 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:19.102159 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:19.096060 20849 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260811 16:06:19.044377 20841 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:19.096624 20820 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.098605 20843 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.113045 20843 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.113487 20827 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.089494 20782 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:19.115703 20782 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:19.093250 13739 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:19.068037 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:19.093555 13907 raft_consensus.cc:2362] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18. Re-sending same reply.
I20260811 16:06:19.102846 14574 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:19.109740 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:19.092397 20624 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.113s	user 0.013s	sys 0.002s
W20260811 16:06:19.110086 20818 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.613s	user 0.000s	sys 0.013s
I20260811 16:06:19.089946 20759 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.110683 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.130040 14582 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:19.133188 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.133890 13907 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
W20260811 16:06:19.134889 20853 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260811 16:06:19.118738 13909 raft_consensus.cc:2362] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14. Re-sending same reply.
I20260811 16:06:19.092372 20812 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260811 16:06:19.143365 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.028407 20754 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.071236 20662 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.145502 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.117014 20409 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.152266 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.154353 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.155025 13907 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:19.129205 20757 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.162712 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.143234 20471 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.169947 20765 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.117779 20841 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.172542 20815 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.173133 20841 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.173575 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.156262 20827 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:19.138496 20843 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.160470 20812 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:19.180495 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.167052 13909 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:19.148002 20759 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.127322 20624 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.174810 13823 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:19.168973 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.181694 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1805) took 1195 ms. Trace:
I20260811 16:06:19.197646 14581 rpcz_store.cc:276] 0811 16:06:17.986222 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:17.986387 (+   165us) service_pool.cc:227] Handling call
0811 16:06:18.008708 (+ 22321us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:18.108006 (+ 99298us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:18.108053 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:18.108097 (+    44us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:18.108130 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:19.181404 (+1073274us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b54006dfbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:19.181468 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:19.181620 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":227838848}
I20260811 16:06:19.200515 13737 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:19.191291 13905 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
W20260811 16:06:19.167093 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58150.5us
I20260811 16:06:19.203387 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:19.163409 20867 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260811 16:06:19.198061 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:19.119414 20820 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.207381 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:19.176754 20819 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.005s
W20260811 16:06:19.183257 20798 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.838s	user 0.013s	sys 0.000s
I20260811 16:06:19.236238 14577 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:19.238615 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.239367 13907 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:19.241473 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.175799 20827 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:19.130108 20818 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.178525 20809 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.174718 20815 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.177417 20754 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.177698 20812 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:19.226439 20785 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.947s	user 0.008s	sys 0.006s
I20260811 16:06:19.222211 20147 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:19.235077 20816 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:06:19.275542 13827 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:19.266311 13737 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:19.266395 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.276723 13907 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:19.264468 13909 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:19.279817 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.280632 13909 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:19.281953 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:19.294983 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 51557.6us
I20260811 16:06:19.255810 20827 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:19.293704 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.252574 20856 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260811 16:06:19.260430 20812 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:19.280220 20759 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.305675 13825 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260811 16:06:19.301280 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2982) took 1016 ms. Trace:
I20260811 16:06:19.329766 13826 rpcz_store.cc:276] 0811 16:06:18.285016 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.285338 (+   322us) service_pool.cc:227] Handling call
0811 16:06:19.300996 (+1015658us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b5400219654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:19.301178 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":84540160}
W20260811 16:06:19.295547 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 97588.2us
I20260811 16:06:19.310694 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.322290 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:19.325493 13737 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:19.296607 13909 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:19.334014 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:19.342657 13907 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:19.345304 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:19.299891 20857 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260811 16:06:19.307191 20795 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.968s	user 0.014s	sys 0.000s
I20260811 16:06:19.303169 20745 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:19.347631 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.351570 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.245095 20819 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.308058 20740 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:19.305140 20677 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.328189 20749 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.338836 20576 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260811 16:06:19.245568 20798 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.348352 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:19.353313 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 346371us
I20260811 16:06:19.354976 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.293874 20837 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:19.360839 13907 raft_consensus.cc:2396] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260811 16:06:19.352084 20745 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:19.347250 20784 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:19.364557 13907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:19.365298 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:19.374293 13907 raft_consensus.cc:595] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:19.374753 13907 raft_consensus.cc:603] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:19.375316 20751 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:19.375794 20751 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.376348 20751 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:19.377712 20576 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:19.349860 20759 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:19.375856 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.380234 13907 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:19.380817 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.352465 20795 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.368335 13902 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:19.368201 20819 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:19.369236 20607 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.004s
I20260811 16:06:19.388263 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.388881 20607 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.390292 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.391553 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.369102 20624 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:19.361123 20770 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.000s
W20260811 16:06:19.393282 20871 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260811 16:06:19.393652 20770 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.396723 20770 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.372164 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.398656 13826 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:19.267908 20785 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.373371 13909 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:19.399490 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.400180 13909 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:19.400789 20785 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.401430 13909 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:19.382062 13735 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260811 16:06:19.402629 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.405318 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:19.401430 14583 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:19.306175 20758 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.406669 20785 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:19.407261 20820 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.403793 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:19.408499 20758 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.409343 14575 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:19.409288 20795 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.410552 13741 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:19.415496 13908 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260811 16:06:19.415771 20751 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.419533 20751 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.421658 20818 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.378542 20843 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260811 16:06:19.390816 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:19.424273 20798 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.425402 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:19.426635 13739 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:19.373966 20784 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:19.427672 20784 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:19.378162 20576 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:19.429172 20576 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.432067 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:19.356817 20775 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260811 16:06:19.378055 20754 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260811 16:06:19.437110 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.438583 20820 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:19.439050 20820 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.439780 20820 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:19.439085 20843 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
W20260811 16:06:19.440302 20799 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.431s	user 0.001s	sys 0.003s
I20260811 16:06:19.440315 20843 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:19.441947 20819 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.441504 20843 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.442523 20819 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.443528 20843 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:19.445917 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.446514 20607 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.447460 20819 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.449486 20851 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260811 16:06:19.451956 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 594637us
I20260811 16:06:19.453049 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.456849 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:19.459844 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.445982 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.469537 13824 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:19.471131 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:19.471232 13907 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:19.473230 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.476063 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:19.478114 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.478314 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:19.479504 13743 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:19.361696 20749 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.481451 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:19.483839 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:19.487505 20879 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:19.455127 20631 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:19.507910 20631 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:19.508432 20631 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:19.508502 20762 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:19.509049 20762 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:19.485095 20757 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.510145 20762 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.511720 20757 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.512117 20762 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:19.497977 20881 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260811 16:06:19.504558 20827 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.507364 20749 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.506888 20820 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.507727 20624 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:19.499023 20758 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:19.540761 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2625) took 1029 ms. Trace:
I20260811 16:06:19.555510 13900 rpcz_store.cc:276] 0811 16:06:18.511104 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.607575 (+ 96471us) service_pool.cc:227] Handling call
0811 16:06:18.629687 (+ 22112us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:18.879737 (+250050us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:18.879788 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:18.879846 (+    58us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:18.879895 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:19.540391 (+660496us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002c0bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:19.540477 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:19.540662 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":574346496}
I20260811 16:06:19.524771 13739 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260811 16:06:19.539984 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:19.497957 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.567651 14578 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:19.550504 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1336) took 1033 ms. Trace:
I20260811 16:06:19.553946 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:19.562407 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.568773 14583 rpcz_store.cc:276] 0811 16:06:18.516887 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.517073 (+   186us) service_pool.cc:227] Handling call
0811 16:06:18.533955 (+ 16882us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:19.406765 (+872810us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:19.550121 (+143356us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54005401d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:19.550419 (+   298us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1994616064}
I20260811 16:06:19.524556 20879 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:19.538105 20841 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:19.571760 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 118790us
I20260811 16:06:19.579864 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.584511 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.504594 20782 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.587126 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.587579 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.591173 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 2975) took 1479 ms. Trace:
I20260811 16:06:19.591398 20655 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:19.591930 20655 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.591636 13822 rpcz_store.cc:276] 0811 16:06:18.111610 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.111764 (+   154us) service_pool.cc:227] Handling call
0811 16:06:19.583949 (+1472185us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400385c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:19.591087 (+  7138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":231849728}
I20260811 16:06:19.588898 13818 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:19.586304 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.592594 20655 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:19.572283 20757 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.598052 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.597370 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.574311 20758 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:19.596889 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.576051 20749 raft_consensus.cc:2741] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260811 16:06:19.491526 20745 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.600426 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.603909 13822 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:19.602622 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:19.606613 13907 raft_consensus.cc:2354] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:19.606793 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.606657 13818 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:19.609745 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.610035 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.610519 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:19.614794 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.614960 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.600806 20841 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.619822 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.621846 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:19.611382 20884 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:19.623379 20787 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:19.623828 20884 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:19.624073 20787 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.624969 20884 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.626557 20787 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:19.613351 20789 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.937s	user 0.014s	sys 0.000s
I20260811 16:06:19.619369 20879 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.629294 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:19.630008 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.630643 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.633206 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2623) took 1122 ms. Trace:
I20260811 16:06:19.633651 13823 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:19.633895 20147 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:19.636922 13908 rpcz_store.cc:276] 0811 16:06:18.510495 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.544049 (+ 33554us) service_pool.cc:227] Handling call
0811 16:06:18.544420 (+   371us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:19.416067 (+871647us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:19.632953 (+216886us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:19.633148 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1945540992}
I20260811 16:06:19.614199 20757 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:19.641003 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:19.644793 13822 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:19.642274 13818 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260811 16:06:19.637984 20607 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.638289 20789 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:19.645627 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.646966 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.647245 13827 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 10. Current term is 11. Ops: []
I20260811 16:06:19.618410 20751 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:19.649757 13826 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:19.648789 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.643754 20819 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
W20260811 16:06:19.657872 20790 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.761s	user 0.004s	sys 0.007s
I20260811 16:06:19.649356 20607 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.635466 20841 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.661726 20607 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.662128 20827 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.662472 20607 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:19.663131 20818 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:19.668772 20784 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.670235 13908 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260811 16:06:19.671754 20782 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.661768 13823 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:19.675411 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.676699 20607 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:06:19.680665 20607 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:19.683080 13826 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:19.678522 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:19.685101 13823 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260811 16:06:19.683399 20607 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:19.662639 20757 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:19.687549 20803 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.532s	user 0.004s	sys 0.000s
I20260811 16:06:19.686411 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:19.689411 13908 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:19.650141 20751 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:19.661831 20841 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:19.707060 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58392.2us
I20260811 16:06:19.711687 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:19.714169 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.714571 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.687991 20607 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.717669 20607 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:19.657900 20819 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:19.720053 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2379) took 2440 ms. Trace:
I20260811 16:06:19.715266 13908 raft_consensus.cc:2362] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13. Re-sending same reply.
I20260811 16:06:19.720712 13823 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:06:19.709621 20758 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.730315 20876 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:19.688025 20757 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.737432 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:19.725459 13820 rpcz_store.cc:276] 0811 16:06:17.269305 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:17.270147 (+   842us) service_pool.cc:227] Handling call
0811 16:06:17.296468 (+ 26321us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:17.308725 (+ 12257us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:17.308764 (+    39us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:17.322525 (+ 13761us) log.cc:842] Serialized 52 byte log entry
0811 16:06:17.534956 (+212431us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:17.535005 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:17.535080 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:19.657188 (+2122108us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:19.688676 (+ 31488us) raft_consensus.cc:1671] finished
0811 16:06:19.688699 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:19.709805 (+ 21106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":423,"raft.queue_time_us":1121,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10092,"spinlock_wait_cycles":282217216,"thread_start_us":161036,"threads_started":1,"wal-append.queue_time_us":482816}
I20260811 16:06:19.740191 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.705088 20751 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:19.723600 13822 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:19.742106 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.719978 20887 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:19.745209 13908 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:19.745617 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:19.746320 13822 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:19.725219 20819 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:19.769135 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.734047 20820 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:19.736256 20624 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260811 16:06:19.788164 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49521.2us
I20260811 16:06:19.778352 20655 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.773670 13822 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:19.752657 20887 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:19.792862 13822 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:19.794209 14581 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:19.758467 20818 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:19.757491 20662 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.799928 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:19.807888 20662 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.810508 20662 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.786867 20794 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:19.810995 20651 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:19.811491 20651 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:19.811359 20794 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.812425 20651 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.708420 20668 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.720469 20815 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260811 16:06:19.813720 20794 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:19.817361 14575 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:19.751588 20789 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260811 16:06:19.792459 20545 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:19.822906 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.795948 20887 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:19.818470 20784 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:19.862763 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:19.823230 20807 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260811 16:06:19.870765 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:19.878954 13789 leader_election.cc:398] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:19.889380 13789 leader_election.cc:401] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260811 16:06:19.845891 20812 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.895404 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.836397 20819 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:19.900992 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:19.859668 20631 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:19.954241 13737 raft_consensus.cc:2354] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
I20260811 16:06:19.954530 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:19.955708 13909 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:19.969972 13822 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:19.873389 20818 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260811 16:06:19.984871 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:19.990358 20902 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260811 16:06:19.997179 13907 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:20.017191 20754 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:20.017999 20754 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:20.018352 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:20.019047 13823 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:20.020336 20754 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:20.025516 20893 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260811 16:06:20.027750 20812 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:20.036659 20631 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:20.038411 20668 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 10 FOLLOWER]: Advancing to term 11
I20260811 16:06:20.039837 20780 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:20.041059 13901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2620) took 1531 ms (client timeout 1957 ms). Trace:
W20260811 16:06:20.041486 13901 rpcz_store.cc:269] 0811 16:06:18.509389 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.509634 (+   245us) service_pool.cc:227] Handling call
0811 16:06:20.040840 (+1531206us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:20.040990 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1837707008}
I20260811 16:06:20.043047 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:20.045039 13901 pending_rounds.cc:76] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:06:20.045379 13901 pending_rounds.cc:97] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260811 16:06:20.045615 13901 raft_consensus.cc:2866] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:20.047904 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1152) took 1342 ms. Trace:
I20260811 16:06:20.048324 13906 rpcz_store.cc:276] 0811 16:06:18.705093 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.432979 (+727886us) service_pool.cc:227] Handling call
0811 16:06:19.446565 (+ 13586us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:19.457500 (+ 10935us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:19.457537 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:19.458059 (+   522us) log.cc:842] Serialized 26 byte log entry
0811 16:06:19.704709 (+246650us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:19.704751 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:19.704824 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:20.047211 (+342387us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b540019dfa0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189a771 00007f5c518a5220 00007f5c518a51c8 00007f5c518a5148 00007f5c518a5103 00007f5c518a438c 00007f5c57915206 00007f5c5790d808 00007f5c518e138b 00007f5c518e3e80
0811 16:06:20.047609 (+   398us) raft_consensus.cc:1671] finished
0811 16:06:20.047630 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:20.047844 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10108,"raft.queue_time_us":10230,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":12247424,"thread_start_us":231558,"threads_started":1,"wal-append.queue_time_us":239711}
I20260811 16:06:20.050661 20858 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:19.999774 20819 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:20.051296 20858 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.053429 20858 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:20.061841 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:20.061872 13823 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:06:20.065055 13906 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:20.065905 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:20.066718 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:20.067757 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:20.068221 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 710242us
I20260811 16:06:20.069792 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1157) took 2364 ms. Trace:
I20260811 16:06:20.070183 13817 rpcz_store.cc:276] 0811 16:06:17.705410 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:17.706129 (+   719us) service_pool.cc:227] Handling call
0811 16:06:17.718121 (+ 11992us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:18.779966 (+1061845us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.069527 (+1289561us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:20.069736 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2427944832}
I20260811 16:06:20.075613 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1317) took 1323 ms. Trace:
I20260811 16:06:20.077445 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:20.078173 13907 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
W20260811 16:06:20.041508 20762 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.003s
I20260811 16:06:20.076164 13744 rpcz_store.cc:276] 0811 16:06:18.752042 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.124008 (+371966us) service_pool.cc:227] Handling call
0811 16:06:19.124526 (+   518us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:19.128067 (+  3541us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:19.128100 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:19.154442 (+ 26342us) log.cc:842] Serialized 52 byte log entry
0811 16:06:19.342569 (+188127us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:19.357690 (+ 15121us) log.cc:842] Serialized 14 byte log entry
0811 16:06:20.067949 (+710259us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b18003e5a20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:06:20.068193 (+   244us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.068270 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:20.070590 (+  2320us) raft_consensus.cc:1671] finished
0811 16:06:20.075395 (+  4805us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:20.075551 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4887,"prepare.queue_time_us":15834,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":717999,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9229,"spinlock_wait_cycles":3508096,"thread_start_us":133440,"threads_started":1,"wal-append.queue_time_us":170977}
I20260811 16:06:20.084321 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.077370 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:20.097663 14575 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:20.099720 13823 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:20.121426 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 773114us
I20260811 16:06:20.122437 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.143872 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2548) took 1385 ms. Trace:
I20260811 16:06:20.144387 13738 rpcz_store.cc:276] 0811 16:06:18.700064 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.702312 (+  2248us) service_pool.cc:227] Handling call
0811 16:06:20.084987 (+1382675us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:20.085070 (+    83us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":229287680}
I20260811 16:06:20.057605 20655 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:20.146286 13823 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:20.154773 13909 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
W20260811 16:06:20.155046 13740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2558) took 1449 ms (client timeout 1626 ms). Trace:
W20260811 16:06:20.155646 13740 rpcz_store.cc:269] 0811 16:06:18.705489 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.754438 (+ 48949us) service_pool.cc:227] Handling call
0811 16:06:20.154769 (+1400331us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:20.154970 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":719844736}
I20260811 16:06:20.156364 13909 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:06:20.165226 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.168903 13818 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:20.171440 13907 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:20.174616 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1166) took 1558 ms. Trace:
I20260811 16:06:20.175065 13825 rpcz_store.cc:276] 0811 16:06:18.616562 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.617553 (+   991us) service_pool.cc:227] Handling call
0811 16:06:19.305409 (+687856us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:19.329738 (+ 24329us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.174420 (+844682us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400219650. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:20.174558 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1580960000}
I20260811 16:06:20.177026 13818 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:20.177692 13825 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:20.175800 13909 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260811 16:06:20.178691 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1315) took 1436 ms. Trace:
I20260811 16:06:20.181257 13823 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:06:20.182547 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.181246 13736 rpcz_store.cc:276] 0811 16:06:18.742161 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.094636 (+352475us) service_pool.cc:227] Handling call
0811 16:06:19.118420 (+ 23784us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:19.118631 (+   211us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:06:19.252544 (+133913us) log.cc:842] Serialized 14 byte log entry
0811 16:06:20.178366 (+925822us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:20.178422 (+    56us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:20.178468 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.178531 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:20.178639 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":746491,"prepare.queue_time_us":125261,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":746627,"thread_start_us":259457,"threads_started":2,"wal-append.queue_time_us":248888}
I20260811 16:06:20.172469 20829 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:20.172676 20814 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:20.146114 20740 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:20.215480 13827 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:20.172186 20662 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:20.153026 20886 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260811 16:06:20.178892 20772 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260811 16:06:20.216678 20884 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:20.287163 20884 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:20.287822 20884 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:06:20.220590 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98239.5us
I20260811 16:06:20.290321 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:20.287266 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2614) took 1780 ms (client timeout 1808 ms). Trace:
W20260811 16:06:20.293754 13905 rpcz_store.cc:269] 0811 16:06:18.507288 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.508075 (+   787us) service_pool.cc:227] Handling call
0811 16:06:20.286983 (+1778908us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:20.287183 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1267449216}
I20260811 16:06:20.295077 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:20.224341 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.296515 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.224714 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:20.298724 13736 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:20.299088 13736 raft_consensus.cc:603] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:20.225297 20839 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260811 16:06:20.303683 20747 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:20.220527 20829 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:20.305785 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81548.5us
I20260811 16:06:20.306617 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.307070 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.190686 20826 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:20.304666 20814 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:20.309855 20804 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:20.310627 20747 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:20.311403 20780 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:20.311684 20752 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:20.278116 20794 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:20.216040 20631 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:06:20.280825 20894 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.382s	user 0.003s	sys 0.000s
I20260811 16:06:20.320950 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:20.320727 13908 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:20.314157 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:20.281909 20821 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:20.219225 20789 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
W20260811 16:06:20.324370 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 175626us
I20260811 16:06:20.223433 20677 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:20.326053 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "defa959376494546a5395f8a56cef106"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:20.326301 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 2992) took 1316 ms. Trace:
I20260811 16:06:20.356622 13905 raft_consensus.cc:595] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:20.329977 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:20.357481 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 478718us
I20260811 16:06:20.358448 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:20.359365 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:20.359437 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:20.360514 20811 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:20.361035 20811 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:20.361569 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:06:20.355779 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 211802us
I20260811 16:06:20.362284 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.362028 20811 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.362727 20630 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
W20260811 16:06:20.364398 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50341.5us
I20260811 16:06:20.362339 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:20.319125 20814 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:20.338395 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1807) took 1801 ms. Trace:
I20260811 16:06:20.371490 14573 rpcz_store.cc:276] 0811 16:06:18.536686 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.536854 (+   168us) service_pool.cc:227] Handling call
0811 16:06:18.609561 (+ 72707us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:19.102016 (+492455us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.338010 (+1235994us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540052b7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:20.338311 (+   301us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1096432896}
I20260811 16:06:20.307132 20740 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.326884 20832 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:20.392099 13904 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:06:20.327448 20794 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:20.323899 20839 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:20.352352 20850 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:20.356845 13821 rpcz_store.cc:276] 0811 16:06:19.009564 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.009698 (+   134us) service_pool.cc:227] Handling call
0811 16:06:19.010020 (+   322us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:19.605824 (+595804us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:06:19.773843 (+168019us) log.cc:842] Serialized 14 byte log entry
0811 16:06:19.942133 (+168290us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:19.974967 (+ 32834us) log.cc:842] Serialized 26 byte log entry
0811 16:06:19.987207 (+ 12240us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:19.995679 (+  8472us) log.cc:842] Serialized 14 byte log entry
0811 16:06:20.166902 (+171223us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18004433e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:20.321319 (+154417us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.322566 (+  1247us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:20.326039 (+  3473us) raft_consensus.cc:1671] finished
0811 16:06:20.326067 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:20.326230 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":745024,"prepare.queue_time_us":222089,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"raft.queue_time_us":754980,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":66183,"spinlock_wait_cycles":5074176,"thread_start_us":567194,"threads_started":5,"wal-append.queue_time_us":99350}
I20260811 16:06:20.351212 20780 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:20.364852 20677 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:20.416144 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46060.8us
I20260811 16:06:20.363469 20631 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:20.422013 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.355783 20821 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:20.380156 20801 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:20.400874 20749 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:20.321856 20826 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.389282 20607 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:20.389767 20858 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260811 16:06:20.380649 20814 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:20.404381 20668 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
W20260811 16:06:20.412113 20787 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.032s	sys 0.044s
I20260811 16:06:20.411701 20832 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:20.390586 20808 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260811 16:06:20.424923 20677 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:20.416697 20850 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:20.446095 20887 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260811 16:06:20.407169 20624 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260811 16:06:20.407469 20788 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260811 16:06:20.431170 20784 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:20.412124 20504 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260811 16:06:20.426430 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.439996 20780 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:06:20.463105 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60625us
W20260811 16:06:20.458434 20787 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.032s	sys 0.044s
I20260811 16:06:20.480258 13902 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:20.484206 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:20.491432 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72852.4us
I20260811 16:06:20.461782 20844 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:20.441397 20749 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:20.492640 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 103064us
I20260811 16:06:20.464771 20668 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:20.494033 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.492087 20630 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:20.527823 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.542001 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.542616 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.461261 20607 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260811 16:06:20.544898 13737 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:20.488979 20784 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:20.440843 20747 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.540191 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.533751 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.585210 13738 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:20.543979 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.490921 20757 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:20.586349 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.586649 20757 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.560562 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:20.536566 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.587783 13909 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:20.588006 13740 raft_consensus.cc:2379] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:20.546201 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:20.589324 13908 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:20.584358 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 106556us
I20260811 16:06:20.590583 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.591287 13737 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:20.587095 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:20.589205 20757 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:20.594146 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.594440 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.594961 13737 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:20.599857 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.602721 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.603497 13740 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260811 16:06:20.604895 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.605912 13737 raft_consensus.cc:2354] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:20.606505 13909 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:20.606973 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.608844 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.609165 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.612516 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.617403 13744 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:20.619765 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.619474 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.620855 13737 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260811 16:06:20.622697 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 138580us
I20260811 16:06:20.623265 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:20.479770 20887 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:20.633718 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 207346us
I20260811 16:06:20.632949 13906 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260811 16:06:20.628752 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.542382 20915 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:20.642762 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:20.642976 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:20.492447 20830 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.093s
W20260811 16:06:20.643827 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 99932.7us
I20260811 16:06:20.645023 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.655648 13823 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:20.645251 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:20.656451 13907 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:20.582471 20784 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:20.646341 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.646978 13737 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260811 16:06:20.648598 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:20.562850 20843 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:20.563196 20829 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:20.676786 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:20.656746 13871 leader_election.cc:398] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
I20260811 16:06:20.646343 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.677469 13820 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 16
I20260811 16:06:20.621685 20923 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:20.680251 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.562764 20619 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260811 16:06:20.661541 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:20.665350 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:20.692715 14575 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:20.532528 20844 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.667537 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:20.652552 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.673336 13909 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:20.701818 13906 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:20.487720 20913 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.155s
I20260811 16:06:20.675872 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:20.710173 14581 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:20.655841 13709 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:20.711195 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55440us
I20260811 16:06:20.677496 13871 leader_election.cc:401] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260811 16:06:20.542944 20908 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:20.656817 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91005.5us
I20260811 16:06:20.679865 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.680864 13825 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:20.533934 20909 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260811 16:06:20.721010 20619 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260811 16:06:20.721807 20909 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:20.721895 20619 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:20.722398 20909 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:20.664124 20915 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.723388 20909 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:20.724987 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.725437 20915 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:20.725553 20630 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:20.726301 20915 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:20.687625 13744 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:20.658463 13738 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:20.490180 20631 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.665642 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:20.686023 20607 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260811 16:06:20.695665 13908 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 6. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
I20260811 16:06:20.662838 20798 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:20.737887 13907 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260811 16:06:20.708647 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:20.742238 13817 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:20.656814 20740 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:20.663273 20770 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:20.656592 20791 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:20.714447 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57826.5us
I20260811 16:06:20.745321 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.747159 14574 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:20.712707 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:20.464545 20794 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.729700 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:20.693292 20906 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260811 16:06:20.666709 13824 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260811 16:06:20.765198 13907 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:20.703728 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:20.688823 20922 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:20.711405 20930 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:20.762924 13738 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:20.737883 20915 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:20.745182 20843 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:20.643945 20850 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.623971 20832 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.785717 13907 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260811 16:06:20.777058 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73443.6us
W20260811 16:06:20.774436 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 183197us
W20260811 16:06:20.767872 20912 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260811 16:06:20.790622 13744 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:20.788195 20850 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:20.756459 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.760036 20826 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:20.796221 13737 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:20.805370 13906 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:20.692616 20780 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:20.770300 20858 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:20.774010 20830 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:20.843098 13738 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:20.849421 13738 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:20.856459 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:20.859702 13744 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260811 16:06:20.872110 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 225824us
I20260811 16:06:20.726239 20908 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.812515 20923 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
W20260811 16:06:20.852067 20918 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260811 16:06:20.874989 13738 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:20.881299 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 121291us
I20260811 16:06:20.827126 20386 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:20.885033 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:20.875526 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:20.888476 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2421) took 1175 ms. Trace:
I20260811 16:06:20.865945 20829 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260811 16:06:20.879918 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 134694us
I20260811 16:06:20.908511 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.764889 20791 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.785948 20922 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260811 16:06:20.910897 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:20.785496 20843 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.866767 20913 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:06:20.889132 20751 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.117s	user 0.006s	sys 0.019s
I20260811 16:06:20.901590 13826 rpcz_store.cc:276] 0811 16:06:19.713538 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.806402 (+ 92864us) service_pool.cc:227] Handling call
0811 16:06:19.806820 (+   418us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:19.820117 (+ 13297us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:19.820149 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:19.840522 (+ 20373us) log.cc:842] Serialized 26 byte log entry
0811 16:06:19.900309 (+ 59787us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:19.900351 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.714427 (+814076us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b540014dcd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:20.714487 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:20.876123 (+161636us) raft_consensus.cc:1671] finished
0811 16:06:20.876152 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:20.888391 (+ 12239us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23264,"raft.queue_time_us":5194,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":17919,"spinlock_wait_cycles":18766592,"thread_start_us":40568,"threads_started":1,"wal-append.queue_time_us":470035}
I20260811 16:06:20.918361 13738 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:20.928507 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2636) took 1237 ms. Trace:
W20260811 16:06:20.929049 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44172.5us
I20260811 16:06:20.930171 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2422) took 1192 ms. Trace:
I20260811 16:06:20.728770 20668 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.929093 13902 rpcz_store.cc:276] 0811 16:06:19.691214 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.822617 (+131403us) service_pool.cc:227] Handling call
0811 16:06:20.928240 (+1105623us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400007b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:20.928424 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1019431168}
W20260811 16:06:20.901691 20920 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260811 16:06:20.933338 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:20.930657 13824 rpcz_store.cc:276] 0811 16:06:19.737526 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.163783 (+426257us) service_pool.cc:227] Handling call
0811 16:06:20.164165 (+   382us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:20.765507 (+601342us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.929800 (+164293us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400125554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:20.930093 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1155122944}
I20260811 16:06:20.941563 14581 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:20.937063 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1157) took 1957 ms. Trace:
I20260811 16:06:20.943841 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:20.942375 13901 rpcz_store.cc:276] 0811 16:06:18.980095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.044249 (+1064154us) service_pool.cc:227] Handling call
0811 16:06:20.044855 (+   606us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:20.046147 (+  1292us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:20.046187 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:20.046594 (+   407us) log.cc:842] Serialized 26 byte log entry
0811 16:06:20.174506 (+127912us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:20.174544 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:20.174611 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:20.936805 (+762194us) raft_consensus.cc:1671] finished
0811 16:06:20.936831 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:20.937001 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":127514,"threads_started":1,"wal-append.queue_time_us":279216}
I20260811 16:06:20.868073 20858 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.950273 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.955009 13826 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260811 16:06:20.849821 20924 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260811 16:06:20.910307 20770 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:20.960343 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.971669 13905 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:20.972144 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58368.9us
I20260811 16:06:20.973023 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.916127 20887 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:20.909657 20386 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:20.904215 20830 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.058s
I20260811 16:06:20.976511 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:20.989189 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:20.946707 20812 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:20.948668 20829 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:20.965137 20770 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:20.927321 20907 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260811 16:06:20.995739 13826 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260811 16:06:21.005663 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 508699us
I20260811 16:06:20.888738 20915 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:20.914443 20801 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260811 16:06:20.963376 20913 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:20.936036 20740 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260811 16:06:20.934496 20751 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.009054 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2413) took 1539 ms. Trace:
I20260811 16:06:21.018029 13827 rpcz_store.cc:276] 0811 16:06:19.469672 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.652902 (+183230us) service_pool.cc:227] Handling call
0811 16:06:19.656950 (+  4048us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:20.306338 (+649388us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.008809 (+702471us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54000d5a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:21.008992 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1284053888}
I20260811 16:06:21.009668 13738 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:06:21.014549 13820 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:21.024729 20941 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:21.003369 20942 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260811 16:06:21.028868 20942 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:21.031718 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 112859us
I20260811 16:06:21.038828 20908 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.040298 20843 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.040512 20774 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:21.043506 14575 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:21.012035 20770 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:21.019233 20812 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:21.004674 20844 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.052964 13900 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260811 16:06:21.113297 20910 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.875s	user 0.002s	sys 0.000s
I20260811 16:06:21.117638 20909 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:21.119894 20796 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:21.121398 20759 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
W20260811 16:06:21.125392 13904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2618) took 2616 ms (client timeout 1871 ms). Trace:
W20260811 16:06:21.135104 13904 rpcz_store.cc:269] 0811 16:06:18.508613 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:18.508734 (+   121us) service_pool.cc:227] Handling call
0811 16:06:21.125105 (+2616371us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400142b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:21.125282 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4007050112}
I20260811 16:06:21.135834 20784 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.136620 20887 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.137364 20887 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.138526 20784 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:21.139823 20926 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260811 16:06:21.034819 20829 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260811 16:06:21.135661 20940 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.152464 20913 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.153136 20940 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.142736 20948 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:21.146241 20791 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.127626 20490 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:21.156877 20490 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.157291 20940 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.176987 14578 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260811 16:06:21.147944 20947 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260811 16:06:21.141350 20759 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:21.152206 20386 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:21.156195 20752 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.821s	user 0.017s	sys 0.000s
I20260811 16:06:21.172505 20952 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.187947 20952 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.190764 20952 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.191107 13903 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:21.133816 20796 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:21.166119 20858 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:21.159009 20490 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.158896 20751 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:21.169742 20884 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.000s
W20260811 16:06:21.197574 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 144147us
I20260811 16:06:21.164942 20955 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:06:21.196696 20677 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.005s
I20260811 16:06:21.140864 20844 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260811 16:06:21.221323 20887 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.220088 20796 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.227391 20490 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.205961 20955 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:21.219365 20925 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
W20260811 16:06:21.231081 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.033s	sys 0.013s
W20260811 16:06:21.287720 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.033s	sys 0.013s
W20260811 16:06:21.288157 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 617389us
I20260811 16:06:21.289074 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:21.133029 20762 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260811 16:06:21.218945 20798 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:21.194203 20759 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.228879 20770 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.297288 20770 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.298067 20770 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:21.290691 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:21.311616 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 367766us
I20260811 16:06:21.216382 20884 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.300424 20925 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:21.240918 20677 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.409279 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:21.419339 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:21.421051 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.737s (SENT) [suppressed 21 similar messages]
W20260811 16:06:21.421667 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 83122.6us
I20260811 16:06:21.422676 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:21.409319 13740 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:21.427217 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:21.310925 20762 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.420202 13826 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:21.428021 13817 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:21.473899 20770 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:21.335722 20887 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:21.438933 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:06:21.486069 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47239.7us
I20260811 16:06:21.490088 13743 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:21.302515 20490 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.342203 20956 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:21.465648 20798 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.427968 20951 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.509604 13787 leader_election.cc:398] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:21.510314 13787 leader_election.cc:401] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:21.512655 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:21.501739 20630 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:21.476012 20909 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260811 16:06:21.490298 20762 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.517073 20887 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:21.515303 20619 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260811 16:06:21.555630 20677 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.557974 20490 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:21.566102 20774 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260811 16:06:21.508030 20951 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.477185 20955 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.567562 20688 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:21.508229 20798 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.678251 20951 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.682300 20651 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:21.683540 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:21.526494 20814 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.066s	user 0.015s	sys 0.000s
I20260811 16:06:21.685002 20814 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.685518 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1325) took 1033 ms. Trace:
I20260811 16:06:21.686115 13741 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:21.687222 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2567) took 1192 ms. Trace:
I20260811 16:06:21.687533 13741 rpcz_store.cc:276] 0811 16:06:20.495057 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.495221 (+   164us) service_pool.cc:227] Handling call
0811 16:06:20.545315 (+ 50094us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:21.686487 (+1141172us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.686979 (+   492us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:21.687133 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2623138688}
I20260811 16:06:21.690187 20814 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.576781 20884 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.583896 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2956) took 2775 ms. Trace:
I20260811 16:06:21.691977 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1329) took 1039 ms. Trace:
I20260811 16:06:21.512202 20925 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:21.586634 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74112.7us
I20260811 16:06:21.588724 13817 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260811 16:06:21.594815 20843 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.599009 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:21.599982 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:21.601540 13908 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:21.602434 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:21.605118 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.016s	sys 0.041s
I20260811 16:06:21.582978 20545 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:21.671042 20787 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:21.672803 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 2972) took 1121 ms. Trace:
W20260811 16:06:21.678907 20744 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260811 16:06:21.585553 20630 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:21.680279 20955 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:21.680721 20688 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:21.503882 20956 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.681501 20745 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:21.681933 20798 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.685909 13743 rpcz_store.cc:276] 0811 16:06:20.651668 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.654172 (+  2504us) service_pool.cc:227] Handling call
0811 16:06:20.654539 (+   367us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:21.491263 (+836724us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.685288 (+194025us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:21.685460 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1921150848}
I20260811 16:06:21.691545 13826 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260811 16:06:21.584939 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.002s	sys 0.010s
I20260811 16:06:21.694497 14573 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260811 16:06:21.759639 13905 rpcz_store.cc:276] 0811 16:06:20.551737 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.551900 (+   163us) service_pool.cc:227] Handling call
0811 16:06:20.627794 (+ 75894us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:20.972294 (+344500us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.672547 (+700253us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54001b1554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:21.672740 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":790253312}
I20260811 16:06:21.760828 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1356) took 1170 ms. Trace:
I20260811 16:06:21.761267 14573 rpcz_store.cc:276] 0811 16:06:20.590378 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.590570 (+   192us) service_pool.cc:227] Handling call
0811 16:06:20.590979 (+   409us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:21.760042 (+1169063us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.760578 (+   536us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54005c6cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:21.760766 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2536852864}
I20260811 16:06:21.692317 13900 rpcz_store.cc:276] 0811 16:06:18.808293 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.709148 (+900855us) service_pool.cc:227] Handling call
0811 16:06:19.739922 (+ 30774us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:21.126953 (+1387031us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.583614 (+456661us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400034dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:21.583825 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3016694656}
I20260811 16:06:21.763926 20545 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:21.693384 20762 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:21.765940 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.020s	sys 0.046s
W20260811 16:06:21.759461 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.002s	sys 0.015s
W20260811 16:06:21.767210 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 731568us
I20260811 16:06:21.767453 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:21.769019 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 457636us
I20260811 16:06:21.770212 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:21.692392 13740 rpcz_store.cc:276] 0811 16:06:20.652769 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.709339 (+ 56570us) service_pool.cc:227] Handling call
0811 16:06:21.691810 (+982471us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:21.691920 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1303823744}
I20260811 16:06:21.784724 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:21.785682 13901 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:21.772081 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:21.769743 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.013s	sys 0.008s
W20260811 16:06:21.799435 13736 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.010s	sys 0.014s
W20260811 16:06:21.799953 13736 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.010s	sys 0.014s
I20260811 16:06:21.799372 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:21.798538 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.013s	sys 0.009s
W20260811 16:06:21.787993 20832 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.017s
I20260811 16:06:21.785399 20751 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.799492 20655 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:21.801786 20832 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.005s	sys 0.018s
I20260811 16:06:21.801936 20751 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.802155 20655 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.804946 20751 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.805608 20490 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:21.806715 20688 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.799039 20651 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260811 16:06:21.794061 20884 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.807916 20688 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:21.808306 20884 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.810428 20884 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.805039 20655 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.811259 20651 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:21.798615 20798 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:21.811903 20651 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:21.812335 20798 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:21.793871 20774 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:21.784842 20789 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:21.812795 20651 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.813200 20789 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.813589 20798 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.815083 20782 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:21.815701 20782 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:21.792760 20843 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.868799 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:21.871613 14573 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:21.872189 14573 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:21.801432 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 824962us
W20260811 16:06:21.880085 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79348.6us
W20260811 16:06:21.817953 20819 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.056s	sys 0.050s
W20260811 16:06:21.888885 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.022s	sys 0.049s
I20260811 16:06:21.882737 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:06:21.890393 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.022s	sys 0.050s
W20260811 16:06:21.877835 20812 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.008s
I20260811 16:06:21.793179 20951 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:21.873292 14573 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.911439 14573 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:21.817078 20908 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.905833 13909 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260811 16:06:21.765029 20545 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.868311 20787 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:21.918077 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:21.904526 20819 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.437s	user 0.057s	sys 0.050s
W20260811 16:06:21.888741 20780 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.006s	sys 0.021s
I20260811 16:06:21.880164 20884 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:21.901491 20812 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.008s	sys 0.008s
I20260811 16:06:21.926746 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:21.880146 20959 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.932235 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:21.933420 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:21.887555 20745 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.903400 20789 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:21.935985 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:21.915351 20504 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.007s	sys 0.023s
I20260811 16:06:21.937005 13901 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:21.958428 14583 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:21.949257 13908 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:21.949934 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:21.952519 14577 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:21.912554 20751 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.956398 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:21.937422 20780 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.006s	sys 0.021s
I20260811 16:06:21.974145 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:21.914744 20965 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:21.967402 20504 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.007s	sys 0.023s
I20260811 16:06:21.959530 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:21.973970 20956 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:21.935468 20774 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:21.931803 20924 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.932415 20948 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:21.963708 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:21.942157 20812 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:21.962066 14580 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15. Re-sending same reply.
W20260811 16:06:21.992110 13789 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.031s
W20260811 16:06:22.003687 13789 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.010s	sys 0.031s
W20260811 16:06:22.004096 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 583070us
I20260811 16:06:21.800902 20630 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:21.994170 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:22.009039 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2963) took 3170 ms (client timeout 1715 ms). Trace:
W20260811 16:06:22.009485 13903 rpcz_store.cc:269] 0811 16:06:18.838358 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.073373 (+235015us) service_pool.cc:227] Handling call
0811 16:06:22.008840 (+2935467us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:22.008966 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4825873280}
I20260811 16:06:21.967958 20913 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:22.011813 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:21.924007 20908 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.013378 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:21.955427 20545 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:21.948504 20762 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.014638 13817 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:22.009371 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:21.979568 20971 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:21.908937 20782 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.021121 20630 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:22.030874 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:22.022271 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2432) took 1083 ms. Trace:
I20260811 16:06:21.958066 20959 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.948163 20884 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.033772 13905 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260811 16:06:22.064162 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:22.064956 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:22.065981 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:22.025672 13708 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.000s	sys 0.013s
I20260811 16:06:22.023027 20812 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.037547 20969 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.038749 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:22.074244 13817 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:22.039369 20789 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:22.040275 20843 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.087759 20884 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.087517 20789 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.088105 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "20ad41e4f434442792e36eb47449b101"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:22.088769 13740 raft_consensus.cc:595] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.089102 13740 raft_consensus.cc:603] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:22.089758 20789 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.090394 13903 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260811 16:06:22.091506 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:22.092625 20908 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:22.041057 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1334) took 1365 ms (client timeout 1531 ms). Trace:
I20260811 16:06:22.041409 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:22.006706 20924 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.050889 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:22.093358 14574 rpcz_store.cc:269] 0811 16:06:20.676095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.676610 (+   515us) service_pool.cc:227] Handling call
0811 16:06:22.040841 (+1364231us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:22.040982 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11028352}
I20260811 16:06:22.094141 13823 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
W20260811 16:06:22.025966 20879 consensus_queue.cc:1159] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 16 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260811 16:06:22.053848 20949 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.925s	user 0.008s	sys 0.013s
I20260811 16:06:22.032505 13825 rpcz_store.cc:276] 0811 16:06:20.938943 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.939076 (+   133us) service_pool.cc:227] Handling call
0811 16:06:20.939477 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:20.948927 (+  9450us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:20.948963 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:20.973296 (+ 24333us) log.cc:842] Serialized 26 byte log entry
0811 16:06:21.525473 (+552177us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:21.525535 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:21.525648 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:22.022018 (+496370us) raft_consensus.cc:1671] finished
0811 16:06:22.022040 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:22.022205 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9015,"raft.queue_time_us":19755,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8816,"thread_start_us":479948,"threads_started":1,"wal-append.queue_time_us":894786}
I20260811 16:06:21.993315 20965 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.056530 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:22.026381 20787 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.000833 20774 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:21.958680 20745 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.061210 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.095906 20782 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:22.069679 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:22.066751 13905 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:21.984550 20751 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.012521 20948 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:22.069264 20875 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260811 16:06:22.083424 20967 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:22.085180 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.34484e+06us
I20260811 16:06:22.092556 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:22.096168 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:22.138019 13903 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:22.139827 13821 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:22.040478 20821 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.100522 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:22.101235 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:22.101718 13904 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.046s
W20260811 16:06:22.118347 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57239.6us
W20260811 16:06:22.068542 13708 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.000s	sys 0.014s
I20260811 16:06:22.061472 20971 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.027822 20762 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:22.126224 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56661.1us
I20260811 16:06:22.152978 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:22.126813 20843 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:22.130374 13905 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
W20260811 16:06:22.129487 13824 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.012s	sys 0.011s
I20260811 16:06:22.123343 13825 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:22.147869 13823 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
W20260811 16:06:22.160890 13824 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.012s	sys 0.012s
W20260811 16:06:22.148394 13904 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.011s	sys 0.046s
W20260811 16:06:22.100288 20824 consensus_queue.cc:1159] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f46150fac70458986206ec7af67a403" responder_term: 16 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: [15.9-15.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:06:22.126040 20927 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:22.157790 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.166069 14574 pending_rounds.cc:76] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 9
I20260811 16:06:22.171638 14574 pending_rounds.cc:97] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260811 16:06:22.171968 14574 raft_consensus.cc:2866] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:22.087841 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:22.174126 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:52448 (request call id 0) took 2342 ms. Trace:
I20260811 16:06:22.174503 13818 rpcz_store.cc:276] 0811 16:06:19.816673 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.184908 (+368235us) service_pool.cc:227] Handling call
0811 16:06:22.116152 (+1931244us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:22.156688 (+ 40536us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3051684224}
I20260811 16:06:22.175437 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:22.176349 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:22.178725 13737 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:22.176324 13905 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:22.179162 13737 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:22.180150 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:22.173803 13612 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86182.2us
I20260811 16:06:22.183918 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.095559 20969 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.185009 13909 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:22.186038 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.151943 20808 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:22.142582 20924 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.151225 20780 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:22.205546 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.206602 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:22.214974 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.210871 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:22.215093 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:22.219756 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ffb6122695854eb8a6ab98b508c17b30, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:22.220259 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ffb6122695854eb8a6ab98b508c17b30, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.183027 20609 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.224472 20609 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.215547 13818 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:22.228315 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.131872 14581 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:22.232082 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:22.232452 13740 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:22.170908 20942 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:22.238631 13817 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:22.216243 13737 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.239692 13737 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:22.184525 20819 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:22.172931 20744 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:22.243047 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:22.243554 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:22.252959 13909 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:06:22.210232 20821 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:22.209537 20808 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:22.203181 20959 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.201355 20751 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:22.214500 20884 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.294817 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.228919 20843 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:22.191561 20677 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:22.272694 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.294644 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.301180 13738 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:22.182767 20789 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260811 16:06:22.310678 13817 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [15.12-20.15]
I20260811 16:06:22.204501 20829 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260811 16:06:22.189957 20961 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
W20260811 16:06:22.315362 13736 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.002s	sys 0.028s
I20260811 16:06:22.146660 20967 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.188424 20754 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.111s
I20260811 16:06:22.314257 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:22.348237 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:22.362474 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.272270 20981 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:22.230769 20927 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260811 16:06:22.309155 20808 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:22.235464 20780 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.370939 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:22.321220 20819 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:22.309523 20807 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:22.357942 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2358) took 1749 ms. Trace:
I20260811 16:06:22.554735 13736 rpcz_store.cc:276] 0811 16:06:20.608804 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.609620 (+   816us) service_pool.cc:227] Handling call
0811 16:06:20.609934 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:20.610163 (+   229us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:06:21.801096 (+1190933us) log.cc:842] Serialized 14 byte log entry
0811 16:06:22.356328 (+555232us) log.cc:842] Serialized 14 byte log entry
0811 16:06:22.356701 (+   373us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:22.356835 (+   134us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:22.356964 (+   129us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.357383 (+   419us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:22.357783 (+   400us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19057,"prepare.queue_time_us":1359852,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"thread_start_us":1696216,"threads_started":2}
I20260811 16:06:22.557267 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.438200 20688 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:22.382978 20955 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.619s	user 0.004s	sys 0.009s
I20260811 16:06:22.339777 20804 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:22.383929 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:22.494407 20826 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:22.410518 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.603663 13908 raft_consensus.cc:2396] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260811 16:06:22.341392 20843 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:22.359390 20827 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:22.304762 20744 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.361611 20677 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.467965 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.470588 20780 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.386425 20819 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:22.473871 13904 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:22.642583 13904 raft_consensus.cc:595] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.643108 13904 raft_consensus.cc:603] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:22.493639 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.373524 20981 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.430565 20789 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.431007 20668 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.381668 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.634212 13739 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:22.352265 20884 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.595623 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:22.599747 13737 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:22.651437 20668 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:22.642190 20913 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260811 16:06:22.555444 20965 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:22.631520 20829 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:22.617475 20798 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.032s	sys 0.037s
W20260811 16:06:22.508548 20973 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.503s	user 0.000s	sys 0.001s
I20260811 16:06:22.607066 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.660971 13818 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:22.665809 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:22.672869 13821 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:22.543450 20504 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.015s	sys 0.042s
I20260811 16:06:22.495410 20751 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.611294 20826 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:22.601382 13905 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
I20260811 16:06:22.504673 20745 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.475320 20941 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:22.498099 20651 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:22.485018 20794 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:22.488168 20942 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:22.504361 20969 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.496433 20576 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:22.535557 20908 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.726908 20908 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.539811 20774 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.724277 20965 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.729027 20965 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.635033 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:22.731472 13744 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:22.629508 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1335) took 1953 ms. Trace:
I20260811 16:06:22.550586 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:22.618718 20762 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:22.664791 20967 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.670691 13736 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:22.481165 20915 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:22.658867 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.660029 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:22.740176 14580 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.024s	sys 0.019s
I20260811 16:06:22.660961 13904 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
W20260811 16:06:22.740590 14580 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.024s	sys 0.019s
W20260811 16:06:22.675837 13903 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260811 16:06:22.448403 20749 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:22.682857 13821 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:22.630190 20744 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:22.662338 20830 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260811 16:06:22.702651 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:22.665896 20798 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.032s	sys 0.037s
W20260811 16:06:22.677876 20504 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.015s	sys 0.043s
I20260811 16:06:22.655436 20819 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:22.764767 20677 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.703594 20824 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:22.766345 20824 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.663089 20759 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:22.769467 20824 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.771791 20965 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:22.665916 20829 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.776737 20829 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.636652 20948 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.657133 20884 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.659443 20913 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:22.662077 20609 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.617516 20843 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:22.779595 20992 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260811 16:06:22.658216 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.655100 20668 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.621874 20807 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:22.670182 20971 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:22.668915 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.031s	sys 0.011s
I20260811 16:06:22.740614 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:22.793423 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.031s	sys 0.011s
I20260811 16:06:22.739522 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:22.746596 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.794718 13736 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:22.742259 13903 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:22.724627 20942 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:22.655409 20789 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:22.797287 20807 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.798346 20789 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.798774 14573 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:22.799005 13825 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 11.
W20260811 16:06:22.738691 20747 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.694s	user 0.002s	sys 0.053s
W20260811 16:06:22.799847 20747 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.764s	user 0.002s	sys 0.053s
I20260811 16:06:22.799933 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.800194 20935 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.686620 20751 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.619679 20688 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:22.801163 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.025s	sys 0.038s
I20260811 16:06:22.732223 14578 rpcz_store.cc:276] 0811 16:06:20.676434 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.676686 (+   252us) service_pool.cc:227] Handling call
0811 16:06:20.676963 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:21.177510 (+500547us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.629130 (+1451620us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400571054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:22.629423 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1148994816}
I20260811 16:06:22.809185 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.802718 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.811722 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.809329 13818 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:22.813685 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:22.802877 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63479.6us
I20260811 16:06:22.799556 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:22.805970 13737 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260811 16:06:22.815091 14583 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:22.815964 13737 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:22.807931 13742 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:22.817137 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.817832 13737 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:22.818737 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.819684 13737 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
W20260811 16:06:22.817437 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.025s	sys 0.038s
I20260811 16:06:22.822746 13736 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260811 16:06:22.822949 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1179) took 1179 ms. Trace:
I20260811 16:06:22.823637 13738 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:22.823541 13902 rpcz_store.cc:276] 0811 16:06:21.643601 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.760359 (+116758us) service_pool.cc:227] Handling call
0811 16:06:21.762731 (+  2372us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:21.763005 (+   274us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:22.145830 (+382825us) log.cc:842] Serialized 14 byte log entry
0811 16:06:22.822616 (+676786us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:22.822676 (+    60us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:22.822724 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.822785 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:22.822895 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":394003,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":6906,"thread_start_us":1015017,"threads_started":2}
I20260811 16:06:22.825001 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.820659 13744 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:22.828533 13744 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260811 16:06:22.830960 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:22.834519 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:22.838650 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:22.845335 13907 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.025s	sys 0.035s
I20260811 16:06:22.723173 20941 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:22.851755 13907 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.025s	sys 0.035s
I20260811 16:06:22.861927 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1178) took 1261 ms. Trace:
W20260811 16:06:22.864058 13789 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.957s (SENT)
I20260811 16:06:22.868924 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:22.807729 20958 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:22.800809 20935 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.898205 20935 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.898908 14575 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:22.884094 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:22.899582 20545 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.879s	user 0.004s	sys 0.010s
I20260811 16:06:22.900364 20545 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:22.900574 13826 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:22.900856 20545 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:22.901387 20545 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:22.884320 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.902732 14579 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:22.890070 20688 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.793179 20826 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.903798 20688 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:22.891603 20981 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.883128 20958 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.891929 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.846501 20745 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:22.905675 20941 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:22.906059 20745 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:22.906441 20745 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:22.866775 20801 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.038s	sys 0.012s
I20260811 16:06:22.913312 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:22.868777 13907 rpcz_store.cc:276] 0811 16:06:21.600631 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.638028 (+ 37397us) service_pool.cc:227] Handling call
0811 16:06:21.671120 (+ 33092us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:21.671558 (+   438us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:21.671587 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:21.672203 (+   616us) log.cc:842] Serialized 52 byte log entry
0811 16:06:22.134026 (+461823us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:22.855895 (+721869us) log.cc:842] Serialized 14 byte log entry
0811 16:06:22.859593 (+  3698us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.861508 (+  1915us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:22.861592 (+    84us) raft_consensus.cc:1671] finished
0811 16:06:22.861611 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:22.861847 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":101663,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":2362,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":1161352,"threads_started":2,"wal-append.queue_time_us":744080}
I20260811 16:06:22.853929 20908 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.931730 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:22.920840 20913 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:22.934052 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:22.920895 20801 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.039s	sys 0.013s
I20260811 16:06:22.937827 20935 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:22.937453 20913 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.848199 20789 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260811 16:06:22.929996 20688 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:22.935370 20924 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:22.950872 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:06:22.944765 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.015s	sys 0.039s
W20260811 16:06:22.959839 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.015s	sys 0.039s
W20260811 16:06:22.946035 20812 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.014s	sys 0.023s
I20260811 16:06:22.945117 20958 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:22.944082 20935 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:22.960822 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1324) took 2305 ms. Trace:
W20260811 16:06:22.950549 20630 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.894s	user 0.014s	sys 0.002s
W20260811 16:06:22.948201 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.016s	sys 0.016s
I20260811 16:06:22.948109 20967 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:22.951537 14583 raft_consensus.cc:2396] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
W20260811 16:06:22.963698 20782 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.005s
I20260811 16:06:22.967747 13742 rpcz_store.cc:276] 0811 16:06:20.650969 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:20.651276 (+   307us) service_pool.cc:227] Handling call
0811 16:06:20.678699 (+ 27423us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:22.821976 (+2143277us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.955555 (+133579us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:22.955819 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4881258752}
W20260811 16:06:22.969354 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.012s	sys 0.025s
W20260811 16:06:22.980770 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.012s	sys 0.025s
I20260811 16:06:22.981940 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2438) took 1641 ms. Trace:
W20260811 16:06:22.973290 14577 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.020s	sys 0.036s
I20260811 16:06:22.977701 13900 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260811 16:06:22.978295 13901 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.032s	sys 0.030s
W20260811 16:06:22.983637 14577 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.020s	sys 0.036s
W20260811 16:06:22.983876 13901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.032s	sys 0.030s
W20260811 16:06:22.970397 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.017s	sys 0.016s
I20260811 16:06:22.971568 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:06:22.964035 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.013s	sys 0.057s
W20260811 16:06:22.988297 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.013s	sys 0.057s
W20260811 16:06:22.988780 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 832670us
I20260811 16:06:22.911302 20942 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.982528 13824 rpcz_store.cc:276] 0811 16:06:21.340719 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.340921 (+   202us) service_pool.cc:227] Handling call
0811 16:06:21.428399 (+ 87478us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:21.428639 (+   240us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:06:22.167352 (+738713us) log.cc:842] Serialized 14 byte log entry
0811 16:06:22.981489 (+814137us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:22.981559 (+    70us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:22.981611 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.981709 (+    98us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:22.981871 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":119207,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":1481905,"threads_started":2}
I20260811 16:06:23.000590 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2445) took 1016 ms. Trace:
I20260811 16:06:23.002943 13820 rpcz_store.cc:276] 0811 16:06:21.983947 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.984324 (+   377us) service_pool.cc:227] Handling call
0811 16:06:22.004546 (+ 20222us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:22.004768 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:06:22.022306 (+ 17538us) log.cc:842] Serialized 14 byte log entry
0811 16:06:22.991472 (+969166us) log.cc:842] Serialized 14 byte log entry
0811 16:06:23.000237 (+  8765us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:23.000297 (+    60us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:23.000340 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.000408 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.000534 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13742,"prepare.queue_time_us":26771,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":47,"thread_start_us":962288,"threads_started":1}
I20260811 16:06:23.000802 13739 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260811 16:06:23.005038 13739 pending_rounds.cc:76] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 14
I20260811 16:06:23.005334 13739 pending_rounds.cc:97] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260811 16:06:23.005628 13739 raft_consensus.cc:2866] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:22.970881 20935 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:22.967104 20930 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.006s	sys 0.029s
I20260811 16:06:23.007581 20762 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260811 16:06:23.012531 20942 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:22.962635 20812 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.014s	sys 0.023s
I20260811 16:06:23.030359 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:22.971421 20751 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:22.985446 20958 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:22.952390 20688 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:22.990938 20770 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:23.036892 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:22.999509 20832 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:23.028595 20930 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.007s	sys 0.029s
I20260811 16:06:23.041875 13744 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:23.050851 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.028s	sys 0.014s
W20260811 16:06:23.051240 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.028s	sys 0.014s
I20260811 16:06:23.042639 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:23.044502 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.051s	sys 0.064s
I20260811 16:06:23.036440 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:23.054726 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.051s	sys 0.065s
I20260811 16:06:23.015255 20884 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:23.047432 13822 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.023s	sys 0.037s
W20260811 16:06:23.059471 13822 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.024s	sys 0.037s
W20260811 16:06:23.055437 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 849935us
W20260811 16:06:23.060242 13735 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.006s	sys 0.014s
I20260811 16:06:23.055027 14579 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:06:23.061252 13735 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.014s
W20260811 16:06:23.061794 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.016s	sys 0.004s
W20260811 16:06:23.062270 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.016s	sys 0.004s
I20260811 16:06:23.036442 20630 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.037582 20958 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:23.065114 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:23.062948 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 879077us
I20260811 16:06:23.069284 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:23.072757 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:23.073755 14574 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.009s	sys 0.018s
W20260811 16:06:23.074359 14574 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.009s	sys 0.018s
I20260811 16:06:23.073344 13744 raft_consensus.cc:595] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:23.070007 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.013s	sys 0.016s
W20260811 16:06:23.085091 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.013s	sys 0.017s
I20260811 16:06:23.054426 20677 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:23.084553 20821 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.011s	sys 0.015s
W20260811 16:06:23.084156 13743 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.007s	sys 0.015s
W20260811 16:06:23.130439 13743 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.007s	sys 0.015s
I20260811 16:06:23.086091 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.073932 20958 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:23.093340 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2651) took 1054 ms. Trace:
I20260811 16:06:23.132792 13908 rpcz_store.cc:276] 0811 16:06:22.038499 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.041106 (+  2607us) service_pool.cc:227] Handling call
0811 16:06:23.093103 (+1051997us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:23.093276 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1171935104}
W20260811 16:06:23.131839 20821 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.011s	sys 0.016s
I20260811 16:06:23.134949 20821 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:23.136260 20821 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.142393 20942 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.143251 20942 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.146096 20942 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.146838 20959 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:23.147481 20959 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:23.148578 20959 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.097536 14582 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260811 16:06:23.150101 20951 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:23.151011 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1347) took 3716 ms (client timeout 3339 ms). Trace:
W20260811 16:06:23.151588 14582 rpcz_store.cc:269] 0811 16:06:19.434476 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:19.434635 (+   159us) service_pool.cc:227] Handling call
0811 16:06:23.150717 (+3716082us) spinlock_profiling.cc:243] Waited 3.66 s on lock 0x7b54007e13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:23.150895 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8415914368}
I20260811 16:06:23.102133 20782 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:06:23.153456 20782 consensus_queue.cc:1225] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 19.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260811 16:06:23.154165 20782 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:23.154583 20782 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:23.155674 20782 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 20.8, Last appended by leader: 8, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.157404 20782 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:23.099510 20913 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:23.109611 20996 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260811 16:06:23.111004 20997 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:06:23.113358 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:23.168871 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55615.8us
I20260811 16:06:23.169662 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.119690 20688 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.116084 13827 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:23.171787 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.075623 13744 raft_consensus.cc:603] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:23.091387 20745 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:23.132252 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 900216us
I20260811 16:06:23.059027 20832 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.150645 20951 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.094192 20843 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.104328 20827 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:23.161989 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.079120 20924 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:23.176903 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:23.177771 20824 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:23.177934 20941 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260811 16:06:23.149361 20995 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260811 16:06:23.179494 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.180249 20745 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:23.167413 20751 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.181782 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2368) took 1007 ms. Trace:
I20260811 16:06:23.074436 20630 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.184540 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.177690 20754 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:23.200536 13741 rpcz_store.cc:276] 0811 16:06:22.174595 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.174720 (+   125us) service_pool.cc:227] Handling call
0811 16:06:22.200697 (+ 25977us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.226360 (+ 25663us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.226391 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.226888 (+   497us) log.cc:842] Serialized 26 byte log entry
0811 16:06:22.679974 (+453086us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:22.680016 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.680089 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:23.181539 (+501450us) raft_consensus.cc:1671] finished
0811 16:06:23.181558 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.181694 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25243,"raft.queue_time_us":143943,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15901,"thread_start_us":438905,"threads_started":1,"wal-append.queue_time_us":945442}
I20260811 16:06:23.204370 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:23.205101 13904 raft_consensus.cc:2362] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17. Re-sending same reply.
I20260811 16:06:23.177042 20959 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:23.190063 13739 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 11.
I20260811 16:06:23.214726 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.215608 13739 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260811 16:06:23.216348 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.195648 20948 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.172377 20818 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.239732 20818 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.232448 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.199491 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.188643 20668 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.243484 20668 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.244131 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.245342 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.216861 20941 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:23.246172 20941 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:23.246517 20941 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:23.246547 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.166373 20677 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.201277 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.201628 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.250164 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.251852 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.189646 20819 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.218487 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.203656 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:23.279484 13909 raft_consensus.cc:2362] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13. Re-sending same reply.
I20260811 16:06:23.191090 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.207929 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.282037 13821 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:23.210590 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.212217 13903 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:23.283560 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:23.285328 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.286509 13906 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:23.289265 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.289536 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.290376 13744 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:23.290808 13902 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:23.291947 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.217988 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.292934 14578 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:23.293941 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.198088 20758 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:23.192013 20927 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.227967 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.313300 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.229254 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2652) took 1190 ms. Trace:
I20260811 16:06:23.314062 13905 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 11.
I20260811 16:06:23.314801 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.314150 13901 rpcz_store.cc:276] 0811 16:06:22.038836 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.038962 (+   126us) service_pool.cc:227] Handling call
0811 16:06:22.039352 (+   390us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.039743 (+   391us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.039781 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.040282 (+   501us) log.cc:842] Serialized 26 byte log entry
0811 16:06:22.984559 (+944277us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:22.984617 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:22.984711 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:23.229026 (+244315us) raft_consensus.cc:1671] finished
0811 16:06:23.229049 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.229188 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1129,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":943804,"threads_started":1,"wal-append.queue_time_us":1162700}
I20260811 16:06:23.229992 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2442) took 1450 ms. Trace:
I20260811 16:06:23.316834 13827 rpcz_store.cc:276] 0811 16:06:21.779727 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.779929 (+   202us) service_pool.cc:227] Handling call
0811 16:06:21.800310 (+ 20381us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:23.171453 (+1371143us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.229681 (+ 58228us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:23.229910 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3024768256}
I20260811 16:06:23.231428 20925 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:23.320755 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.197953 20576 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:23.320917 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 486487us
I20260811 16:06:23.232972 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1850) took 1145 ms. Trace:
I20260811 16:06:23.318958 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:23.321170 13742 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:23.237033 20843 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.237314 20545 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.340523 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:23.238888 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.200556 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.213732 20751 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.188884 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1337) took 1009 ms. Trace:
I20260811 16:06:23.351665 13740 rpcz_store.cc:276] 0811 16:06:22.179102 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.757768 (+578666us) service_pool.cc:227] Handling call
0811 16:06:22.758121 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:22.758369 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:22.758636 (+   267us) log.cc:842] Serialized 14 byte log entry
0811 16:06:23.188479 (+429843us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:23.188540 (+    61us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:23.188591 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.188658 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.188813 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":295,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":112,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":16878,"thread_start_us":428071,"threads_started":1}
I20260811 16:06:23.277315 13824 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:23.255882 20832 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.288038 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.294767 14578 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:23.319866 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.316118 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.313532 13826 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
W20260811 16:06:23.293694 20964 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.026s	sys 0.019s
I20260811 16:06:23.232509 20827 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:23.231488 20630 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:23.235412 20490 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:23.310695 20808 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.883s	user 0.013s	sys 0.003s
I20260811 16:06:23.326452 14577 rpcz_store.cc:276] 0811 16:06:22.087669 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.099016 (+ 11347us) service_pool.cc:227] Handling call
0811 16:06:22.121151 (+ 22135us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.136009 (+ 14858us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.136069 (+    60us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.148729 (+ 12660us) log.cc:842] Serialized 26 byte log entry
0811 16:06:22.984172 (+835443us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:22.984224 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.083082 (+ 98858us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b540057fdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:23.083165 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:23.232585 (+149420us) raft_consensus.cc:1671] finished
0811 16:06:23.232613 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.232896 (+   283us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":33395456,"thread_start_us":782236,"threads_started":1,"wal-append.queue_time_us":998663}
I20260811 16:06:23.329245 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.331457 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.245664 20668 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:23.324859 14580 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.004s	sys 0.019s
W20260811 16:06:23.427961 14580 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.004s	sys 0.019s
I20260811 16:06:23.428776 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1848) took 1414 ms. Trace:
W20260811 16:06:23.339638 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 475619us
I20260811 16:06:23.330931 13905 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:23.347400 13907 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:23.277058 20971 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:23.348675 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:23.352636 13823 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260811 16:06:23.213045 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 140402us
I20260811 16:06:23.254518 20923 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:06:23.321264 20956 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:23.381721 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:23.382270 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:23.321450 20942 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:23.391342 13821 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:23.463891 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.396809 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:23.414865 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:06:23.415184 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58149.2us
I20260811 16:06:23.420269 13825 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:23.468747 13737 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.020s	sys 0.037s
I20260811 16:06:23.336901 20951 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:23.357266 13906 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
W20260811 16:06:23.383091 20964 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.026s	sys 0.019s
I20260811 16:06:23.296530 20948 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.465497 13709 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:23.469659 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:23.469193 13737 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.020s	sys 0.037s
I20260811 16:06:23.468456 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:23.471016 20789 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:23.471180 20948 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:23.471508 20789 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:23.358400 20745 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:23.473389 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.474485 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.429178 14580 rpcz_store.cc:276] 0811 16:06:22.014342 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.015113 (+   771us) service_pool.cc:227] Handling call
0811 16:06:22.021484 (+  6371us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:22.021712 (+   228us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:06:22.752243 (+730531us) log.cc:842] Serialized 14 byte log entry
0811 16:06:23.428444 (+676201us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:23.428499 (+    55us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:23.428544 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.428608 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.428724 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1040507,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":1674,"raft.queue_time_us":1482,"thread_start_us":1394750,"threads_started":2}
I20260811 16:06:23.437755 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.429600 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.465411 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:23.489915 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.494972 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.495535 14577 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
W20260811 16:06:23.488858 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 106692us
I20260811 16:06:23.327641 20927 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.477097 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:23.510929 13826 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:23.479228 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:23.490810 14583 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:23.490173 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1358) took 1558 ms (client timeout 1807 ms). Trace:
W20260811 16:06:23.515625 14581 rpcz_store.cc:269] 0811 16:06:21.931590 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.931716 (+   126us) service_pool.cc:227] Handling call
0811 16:06:23.488414 (+1556698us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54005c6cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:23.490112 (+  1698us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":243624832}
I20260811 16:06:23.517119 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.416733 20824 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:23.471954 20789 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:23.356678 20913 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260811 16:06:23.491199 13818 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:23.523463 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46557.3us
I20260811 16:06:23.520582 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:23.520612 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55286.5us
I20260811 16:06:23.524485 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:23.429847 20794 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.536669 14581 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:23.508369 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.506532 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:23.422971 20688 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:23.491688 20942 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.544639 20791 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:23.545049 20908 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:23.545851 20908 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:23.546643 20942 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.548044 20677 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.476601 20971 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.550513 20971 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:23.550997 20794 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.551389 20935 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.553212 20794 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.553395 20935 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:23.553828 20794 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:23.554368 20794 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:23.555411 20818 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.555791 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2367) took 1381 ms. Trace:
I20260811 16:06:23.556077 20818 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:23.556676 20818 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.556157 13743 rpcz_store.cc:276] 0811 16:06:22.174250 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.175102 (+   852us) service_pool.cc:227] Handling call
0811 16:06:22.175604 (+   502us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.202552 (+ 26948us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.202586 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.202998 (+   412us) log.cc:842] Serialized 26 byte log entry
0811 16:06:23.130884 (+927886us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:23.130927 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.131006 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:23.554958 (+423952us) raft_consensus.cc:1671] finished
0811 16:06:23.554980 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.555711 (+   731us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9176,"raft.queue_time_us":50188,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":927462,"threads_started":1,"wal-append.queue_time_us":1344117}
I20260811 16:06:23.558224 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.429898 20758 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.131s
I20260811 16:06:23.558841 13743 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:23.496637 21014 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260811 16:06:23.562458 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:23.563433 13743 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:06:23.479945 20915 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260811 16:06:23.344292 20576 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.568228 20576 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:23.539767 20787 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:23.571401 20545 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:23.575910 21023 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260811 16:06:23.583130 20924 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:23.583599 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63085.9us
W20260811 16:06:23.584235 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51945.9us
I20260811 16:06:23.585949 20827 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:23.520934 21008 raft_consensus.cc:2741] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260811 16:06:23.588660 20787 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:23.590459 20913 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:23.559677 20819 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:23.561053 20927 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:23.592800 20770 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:23.596314 20884 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:23.673405 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1851) took 1529 ms. Trace:
I20260811 16:06:23.685614 14574 rpcz_store.cc:276] 0811 16:06:22.143917 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.144107 (+   190us) service_pool.cc:227] Handling call
0811 16:06:22.165799 (+ 21692us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.173000 (+  7201us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.173033 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.183871 (+ 10838us) log.cc:842] Serialized 26 byte log entry
0811 16:06:23.074948 (+891077us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:23.075005 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.075108 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:23.673169 (+598061us) raft_consensus.cc:1671] finished
0811 16:06:23.673201 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.673348 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":890563,"threads_started":1,"wal-append.queue_time_us":1203868}
I20260811 16:06:23.687575 13743 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:23.603694 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.604647 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.558930 20818 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.606036 20796 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:23.619827 21017 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:23.627933 14575 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:23.628963 14573 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:23.629593 20923 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:23.610630 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2643) took 1720 ms (client timeout 1939 ms). Trace:
W20260811 16:06:23.709793 13900 rpcz_store.cc:269] 0811 16:06:21.890725 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:21.912249 (+ 21524us) service_pool.cc:227] Handling call
0811 16:06:23.610291 (+1698042us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:23.610532 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2375323392}
I20260811 16:06:23.654201 20827 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:23.613472 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1336) took 1434 ms. Trace:
I20260811 16:06:23.521914 20824 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:23.521579 20630 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:23.429709 20490 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.534458 20747 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
W20260811 16:06:23.631052 20930 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.028s	sys 0.055s
I20260811 16:06:23.432847 20808 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.708524 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:23.656736 20924 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:23.648276 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:23.726136 20827 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:23.717092 13735 rpcz_store.cc:276] 0811 16:06:22.178757 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.179960 (+  1203us) service_pool.cc:227] Handling call
0811 16:06:22.217132 (+ 37172us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:22.453426 (+236294us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:22.453909 (+   483us) log.cc:842] Serialized 14 byte log entry
0811 16:06:23.066982 (+613073us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:23.067072 (+    90us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:23.067126 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.613114 (+545988us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:23.613191 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.613388 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33300,"prepare.queue_time_us":1682,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":19736,"raft.queue_time_us":5125,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6907,"spinlock_wait_cycles":542644608,"thread_start_us":607505,"threads_started":1,"wal-append.queue_time_us":963953}
I20260811 16:06:23.761132 14583 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:23.665206 20942 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:23.770115 14579 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.030s	sys 0.020s
I20260811 16:06:23.747530 13740 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:23.748754 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.772202 13743 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:23.773129 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:23.684432 20961 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:23.669718 20758 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:23.669373 20913 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:23.748463 14581 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:23.705178 21017 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:23.684847 20770 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:23.701725 20884 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:23.669658 20787 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:23.770556 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62136.3us
I20260811 16:06:23.609158 20794 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 19.7, Last appended by leader: 7, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:23.775324 13736 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.074s	sys 0.125s
W20260811 16:06:23.802601 13736 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.074s	sys 0.125s
W20260811 16:06:23.775934 14579 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.031s	sys 0.020s
I20260811 16:06:23.697356 20751 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:23.649315 20688 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:23.805486 20688 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:23.806003 21005 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260811 16:06:23.807665 20941 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.014s
I20260811 16:06:23.808233 20941 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.721081 20923 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:23.811941 21028 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260811 16:06:23.813508 20923 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.781215 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.784247 20758 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.820638 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1183) took 1809 ms. Trace:
I20260811 16:06:23.821193 13822 rpcz_store.cc:276] 0811 16:06:22.010941 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.011179 (+   238us) service_pool.cc:227] Handling call
0811 16:06:22.011620 (+   441us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.018529 (+  6909us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.018580 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.027509 (+  8929us) log.cc:842] Serialized 26 byte log entry
0811 16:06:23.059882 (+1032373us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:23.059928 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.060012 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:23.820264 (+760252us) raft_consensus.cc:1671] finished
0811 16:06:23.820299 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:23.820551 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3100,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4034,"thread_start_us":966599,"threads_started":1,"wal-append.queue_time_us":1273173}
I20260811 16:06:23.822510 20758 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:23.784619 13909 raft_consensus.cc:2354] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:23.824126 20812 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:23.825767 20913 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.827438 20913 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:23.783073 20961 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.829919 20961 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:23.685431 20826 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:23.833112 20808 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:23.759940 20930 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.028s	sys 0.055s
I20260811 16:06:23.789880 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.723560 20824 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:23.795888 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.799361 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:23.792950 20814 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:23.811328 20941 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:23.847764 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.003s	sys 0.049s
I20260811 16:06:23.819674 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:23.781924 20839 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:23.784785 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:23.843217 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44007.4us
I20260811 16:06:23.854084 13735 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:23.854360 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:23.775450 21024 raft_consensus.cc:2741] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260811 16:06:23.721350 20981 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260811 16:06:23.848239 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.004s	sys 0.050s
W20260811 16:06:23.760257 21001 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.043s
W20260811 16:06:23.867213 21001 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.006s	sys 0.043s
I20260811 16:06:23.856633 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:23.854313 20821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.019s	sys 0.038s
I20260811 16:06:23.861769 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:23.763801 20630 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.871208 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:23.863226 20959 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.004s
I20260811 16:06:23.869910 20832 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:23.874209 20791 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:23.861083 20839 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:23.893515 20821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.019s	sys 0.038s
I20260811 16:06:23.889891 20801 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:23.852275 20814 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:23.964392 13739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.002s	sys 0.010s
W20260811 16:06:23.965327 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.002s	sys 0.011s
I20260811 16:06:23.966197 13741 raft_consensus.cc:595] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:23.966722 13741 raft_consensus.cc:603] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:23.898101 20832 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:23.898303 21024 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:23.925823 20981 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260811 16:06:23.990204 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.002s	sys 0.022s
W20260811 16:06:23.990727 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 500700us
I20260811 16:06:23.991637 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.003296 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:23.984325 20958 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.007s
I20260811 16:06:23.978109 21008 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.019582 21008 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.022920 21008 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:24.024164 20839 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.025557 20490 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.031433 20789 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.032248 20884 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.034193 20884 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.034364 20789 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:24.010471 20958 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:23.993235 20959 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:24.005955 20965 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.035914 20965 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.036717 14582 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:24.037747 20958 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:24.038096 20965 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:24.015038 21034 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260811 16:06:24.016875 20630 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:23.989436 21001 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.040331 21001 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.046893 20787 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.047777 13738 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:24.049239 20779 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.049391 20787 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.049772 20779 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.034782 20884 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.050963 20884 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.049250 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1346) took 1022 ms. Trace:
W20260811 16:06:24.052444 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49244.2us
I20260811 16:06:24.052322 13738 rpcz_store.cc:276] 0811 16:06:23.026426 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.026610 (+   184us) service_pool.cc:227] Handling call
0811 16:06:24.049042 (+1022432us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400002b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:24.049177 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2287206272}
I20260811 16:06:24.053656 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:24.064620 21035 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260811 16:06:24.064911 20959 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:24.066951 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.072661 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.043000 21001 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:24.079870 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.077819 20789 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:24.078063 20832 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.089553 20924 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.054247 20908 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:24.091747 20814 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:24.093727 20827 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.086862 20770 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:24.103070 21033 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260811 16:06:24.072532 20959 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:24.111900 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.010s	sys 0.036s
W20260811 16:06:24.112344 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.010s	sys 0.036s
W20260811 16:06:24.098713 20925 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.003s
W20260811 16:06:24.113070 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 618152us
I20260811 16:06:24.114703 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:24.098809 20827 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.122711 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:24.128481 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:24.129776 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:24.112757 20782 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.955s	user 0.013s	sys 0.004s
I20260811 16:06:24.129189 14579 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:24.133626 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:24.138633 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:24.139505 14579 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:24.140530 13744 raft_consensus.cc:2396] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 20 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 6.
W20260811 16:06:24.141391 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.001s	sys 0.018s
W20260811 16:06:24.141847 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.001s	sys 0.018s
W20260811 16:06:24.113354 21019 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.013s
I20260811 16:06:24.142774 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.143924 20925 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:24.118538 20789 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:24.144546 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:24.122256 20879 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.145772 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:24.120690 20924 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:24.077896 21017 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.152948 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:24.144399 21019 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.010s	sys 0.014s
I20260811 16:06:24.139190 20818 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:24.158004 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:24.142110 20908 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:24.178128 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:24.145174 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 620747us
I20260811 16:06:24.207516 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:24.135339 20774 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.011s
W20260811 16:06:24.216832 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72065.1us
I20260811 16:06:24.153585 20948 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:24.167102 20745 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.013s	sys 0.018s
I20260811 16:06:24.221509 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2378) took 1100 ms. Trace:
I20260811 16:06:24.241552 13744 rpcz_store.cc:276] 0811 16:06:23.121040 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.291349 (+170309us) service_pool.cc:227] Handling call
0811 16:06:24.221301 (+929952us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:24.221448 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1641727744}
I20260811 16:06:24.221575 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2588) took 1857 ms. Trace:
I20260811 16:06:24.217039 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.223548 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:24.242486 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:24.243573 13736 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:24.226768 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.242759 13737 rpcz_store.cc:276] 0811 16:06:22.364179 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:22.820299 (+456120us) service_pool.cc:227] Handling call
0811 16:06:22.820640 (+   341us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:22.820992 (+   352us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:22.821035 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:22.827652 (+  6617us) log.cc:842] Serialized 26 byte log entry
0811 16:06:23.470676 (+643024us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:23.470719 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.470786 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:24.102260 (+631474us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:24.194887 (+ 92627us) raft_consensus.cc:1671] finished
0811 16:06:24.194922 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:24.221511 (+ 26589us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1322,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":34567,"spinlock_wait_cycles":95103872,"thread_start_us":591421,"threads_started":1,"wal-append.queue_time_us":1031139}
I20260811 16:06:24.175570 20789 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:24.212518 20787 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:24.212950 20688 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election won for term 13
W20260811 16:06:24.241433 20774 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.011s
I20260811 16:06:24.212143 20908 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:24.177031 20925 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:24.261411 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:24.262102 13737 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:24.224998 20962 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260811 16:06:24.152832 20959 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:24.223261 21017 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:24.201473 20747 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:24.239490 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:24.226639 20794 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.246328 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.247023 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.249042 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:24.263968 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.291006 13821 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:24.249254 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:24.230496 20545 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:24.159294 20879 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:24.241274 20745 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.016s	sys 0.020s
I20260811 16:06:24.161041 20818 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.256834 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.253319 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.335072 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.335430 13825 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:24.335932 13820 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.257579 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1350) took 1061 ms. Trace:
I20260811 16:06:24.152729 21031 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.111s
I20260811 16:06:24.250517 20630 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:24.232558 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 356385us
I20260811 16:06:24.336241 13739 rpcz_store.cc:276] 0811 16:06:23.195800 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.298582 (+102782us) service_pool.cc:227] Handling call
0811 16:06:23.302386 (+  3804us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:23.331756 (+ 29370us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:23.331819 (+    63us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:23.332600 (+   781us) log.cc:842] Serialized 26 byte log entry
0811 16:06:23.965893 (+633293us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:23.966041 (+   148us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:23.967439 (+  1398us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:24.257331 (+289892us) raft_consensus.cc:1671] finished
0811 16:06:24.257360 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:24.257513 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28649,"raft.queue_time_us":28878,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":149,"thread_start_us":542486,"threads_started":1,"wal-append.queue_time_us":799333}
I20260811 16:06:24.342504 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.343436 13739 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:24.344599 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:24.259395 20770 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.251356 21001 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:24.247670 21043 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:24.339902 20941 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:24.358050 13825 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:06:24.358608 21043 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.339612 20745 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:24.358592 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:24.360376 21031 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:24.360893 21031 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.360641 20745 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.361174 21043 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.360565 13824 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.358660 20941 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.362169 20941 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:24.264755 20925 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:24.363209 20824 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
I20260811 16:06:24.363673 20824 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.365306 20925 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:24.365885 20824 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:24.366806 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.368292 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.368541 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.358188 21001 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:24.370301 21001 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:24.317198 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:24.371491 20779 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:24.372318 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:24.322736 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73587.9us
I20260811 16:06:24.373991 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.257328 13627 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:24.340214 20818 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:24.376423 20824 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:24.377194 20824 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:06:24.321679 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.378990 13821 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.264195 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.382128 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:24.383001 21057 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:24.383458 21057 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.383774 21057 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:24.317797 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:24.387316 13742 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:24.354314 13820 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:24.333346 20794 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.354100 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:24.387358 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:24.322476 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 83123us
I20260811 16:06:24.372318 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.369585 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:24.288722 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.375128 20747 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.397562 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:24.336897 13737 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
W20260811 16:06:24.263054 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 485359us
I20260811 16:06:24.400199 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.400882 13820 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:24.403376 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.403625 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:24.261677 20908 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:24.316407 20545 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.423893 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.411206 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.425161 13822 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:24.286099 20884 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.420786 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:24.421458 14579 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260811 16:06:24.245100 20948 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.451713 13822 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:24.361342 21031 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:24.421355 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.407429 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:24.465965 13825 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:24.426900 13821 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.452801 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:24.387802 20959 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:24.358740 21055 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:24.449687 14583 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:24.461258 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:24.468264 13822 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:24.467841 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.388278 21046 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:24.488396 13821 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.477316 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:24.405045 20925 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:24.480523 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.482868 13824 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260811 16:06:24.406270 20958 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:24.503037 13820 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.423475 21021 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:24.428800 20545 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:24.522588 13822 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:24.523948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.526365 13822 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:24.517447 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:24.531697 13821 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 16
I20260811 16:06:24.517772 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.478713 20913 raft_consensus.cc:2741] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260811 16:06:24.545861 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.550590 13824 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:24.428613 21008 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.107s
I20260811 16:06:24.506044 20824 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:24.484174 21055 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.517899 20925 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.508944 21046 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:24.516906 20958 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:24.563719 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.570829 13909 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:24.529672 20962 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:24.573202 13909 raft_consensus.cc:595] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:06:24.557636 21042 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260811 16:06:24.579538 13822 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:24.575802 20958 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:24.542785 20924 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:24.548017 13825 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:24.603206 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.604070 13825 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:24.567809 21038 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:06:24.612799 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:24.614504 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.615449 13821 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:24.618368 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:24.621579 21059 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260811 16:06:24.625174 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:24.626197 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:24.599251 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.577119 20925 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:24.571632 21055 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:24.576175 21046 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:24.679317 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1377) took 1355 ms. Trace:
W20260811 16:06:24.679594 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56158.9us
W20260811 16:06:24.658676 21052 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260811 16:06:24.606817 20787 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:24.679853 14574 rpcz_store.cc:276] 0811 16:06:23.326268 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.686907 (+360639us) service_pool.cc:227] Handling call
0811 16:06:23.721794 (+ 34887us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:23.722400 (+   606us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:23.722442 (+    42us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:23.762127 (+ 39685us) log.cc:842] Serialized 52 byte log entry
0811 16:06:24.193805 (+431678us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:24.221049 (+ 27244us) log.cc:842] Serialized 14 byte log entry
0811 16:06:24.221303 (+   254us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.221377 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:24.381315 (+159938us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b18000f7f60. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:24.641357 (+260042us) raft_consensus.cc:1671] finished
0811 16:06:24.672700 (+ 31343us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:24.679228 (+  6528us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":27005,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1880,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":30178,"spinlock_wait_cycles":6305536,"thread_start_us":353029,"threads_started":1,"wal-append.queue_time_us":618128}
W20260811 16:06:24.675288 21064 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260811 16:06:24.721670 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1369) took 1501 ms. Trace:
I20260811 16:06:24.722177 14578 rpcz_store.cc:276] 0811 16:06:23.219812 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.541079 (+321267us) service_pool.cc:227] Handling call
0811 16:06:23.541502 (+   423us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:23.667301 (+125799us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:23.667349 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:23.694853 (+ 27504us) log.cc:842] Serialized 26 byte log entry
0811 16:06:24.259781 (+564928us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:24.259822 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.260595 (+   773us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:24.721441 (+460846us) raft_consensus.cc:1671] finished
0811 16:06:24.721463 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:24.721608 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58054,"raft.queue_time_us":123091,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":19058,"thread_start_us":479799,"threads_started":1,"wal-append.queue_time_us":832019}
I20260811 16:06:24.730762 14574 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:06:24.731712 21053 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:24.736045 20794 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:24.737643 21019 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260811 16:06:24.740042 21066 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260811 16:06:24.741611 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2387) took 1200 ms. Trace:
I20260811 16:06:24.713855 20814 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260811 16:06:24.743003 20814 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:24.743649 20814 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:24.742175 13743 rpcz_store.cc:276] 0811 16:06:23.541492 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.849744 (+308252us) service_pool.cc:227] Handling call
0811 16:06:23.850135 (+   391us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:23.850546 (+   411us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:23.850583 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:23.851363 (+   780us) log.cc:842] Serialized 26 byte log entry
0811 16:06:24.346374 (+495011us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:24.346437 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.346528 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:24.741290 (+394762us) raft_consensus.cc:1671] finished
0811 16:06:24.741328 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:24.741530 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":23143,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12392,"thread_start_us":494587,"threads_started":1,"wal-append.queue_time_us":690420}
W20260811 16:06:24.778574 21068 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260811 16:06:24.784788 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 535838us
I20260811 16:06:24.601068 20962 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:24.834679 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.624926 20924 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:24.848443 20688 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.050s
I20260811 16:06:24.854008 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:24.860546 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:24.846872 20812 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:24.880860 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:24.881763 13822 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:24.850248 20794 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:24.850536 20789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.025s	sys 0.048s
I20260811 16:06:24.888612 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:24.859699 20884 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:24.859965 20688 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.018s	sys 0.050s
I20260811 16:06:24.744897 20814 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:24.904209 13741 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.045s	sys 0.020s
I20260811 16:06:24.907104 13822 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:06:24.920612 13741 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.045s	sys 0.020s
W20260811 16:06:24.894063 20789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.026s	sys 0.048s
I20260811 16:06:24.897356 20794 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.922091 20789 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:24.889914 20824 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:24.956871 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:24.964066 13742 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.000s
I20260811 16:06:24.964607 13742 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:24.906905 20688 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:24.975711 13821 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:24.983425 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.052s
W20260811 16:06:24.991560 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.052s
I20260811 16:06:24.983785 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:24.921286 20948 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:25.008672 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.021s	sys 0.042s
I20260811 16:06:25.008562 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:25.009142 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.021s	sys 0.042s
I20260811 16:06:24.994813 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.010325 13904 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:24.891870 20812 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.047649 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.049595 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:25.056545 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.004s	sys 0.011s
W20260811 16:06:25.057251 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.011s
W20260811 16:06:25.058368 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 637037us
I20260811 16:06:25.060752 14577 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:25.061216 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.061601 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.062481 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.063395 13900 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:24.995848 20814 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:24.919726 20884 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.070921 13908 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:24.966728 20824 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:24.899946 20787 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.089712 21021 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:25.085778 21018 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.033s
I20260811 16:06:25.090063 20924 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:25.091269 21001 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.720s	user 0.014s	sys 0.000s
W20260811 16:06:25.086099 21067 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260811 16:06:25.085975 21044 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
W20260811 16:06:25.096048 21018 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.009s	sys 0.033s
W20260811 16:06:25.096064 21057 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.006s
I20260811 16:06:25.085458 21045 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:25.133788 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.012s	sys 0.006s
I20260811 16:06:25.127619 21018 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:25.125015 20688 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.136130 21018 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:25.137054 21018 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.138171 21018 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.124040 21044 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:25.139518 20794 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.140496 21044 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.126045 20962 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:25.128507 20948 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:25.144723 20948 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.092075 20789 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.156417 20948 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.098977 21001 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.167503 20924 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:25.098711 21021 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.168231 20924 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.169878 21021 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.170260 20924 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.171985 20832 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:25.178107 20958 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
W20260811 16:06:25.130751 20941 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.001s
I20260811 16:06:25.180831 20941 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.123437 21057 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.184230 20941 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.184846 21057 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:25.186174 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.018s
W20260811 16:06:25.186744 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.000s	sys 0.018s
I20260811 16:06:25.164960 21001 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.192852 20824 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:25.202795 21008 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.017s
W20260811 16:06:25.215503 21055 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.004s
W20260811 16:06:25.217877 21031 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.009s
I20260811 16:06:25.213948 20879 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.422096 20948 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.423897 20924 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:25.423650 20948 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.425385 20924 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:25.302311 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.011s	sys 0.000s
W20260811 16:06:25.431080 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.011s	sys 0.000s
I20260811 16:06:25.303454 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2603) took 1886 ms. Trace:
I20260811 16:06:25.432530 13740 rpcz_store.cc:276] 0811 16:06:23.417086 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.847668 (+430582us) service_pool.cc:227] Handling call
0811 16:06:23.848057 (+   389us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:23.872939 (+ 24882us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:23.872974 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:23.873436 (+   462us) log.cc:842] Serialized 26 byte log entry
0811 16:06:24.285448 (+412012us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:24.285509 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.989812 (+704303us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54003430d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:24.989905 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:24.989989 (+    84us) raft_consensus.cc:1671] finished
0811 16:06:24.990009 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:25.302962 (+312953us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3622,"raft.queue_time_us":25441,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7593,"spinlock_wait_cycles":47875968,"thread_start_us":380609,"threads_started":1,"wal-append.queue_time_us":598409}
I20260811 16:06:25.303817 13736 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260811 16:06:25.306615 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:25.232956 21055 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.316946 13822 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:25.476469 13902 raft_consensus.cc:2354] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:06:25.320181 13821 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:25.324342 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 263386us
W20260811 16:06:25.326575 13789 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.531s (SENT)
I20260811 16:06:25.339012 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:25.340308 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.341991 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.478718 21055 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.344157 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.360545 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:25.481969 20884 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.483305 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:25.484598 13737 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:25.486245 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:25.486510 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.487352 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:25.488986 20879 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:25.489033 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.490228 13905 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
W20260811 16:06:25.370033 20545 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.009s
I20260811 16:06:25.490320 20879 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:25.491555 13901 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:25.491302 20545 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.492955 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.494179 13901 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:25.494686 20545 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.391625 20824 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.374704 20745 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.498381 20824 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.499087 13742 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:25.500459 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:25.501495 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:25.502133 21017 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.153s	user 0.011s	sys 0.008s
I20260811 16:06:25.502274 20824 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:25.191514 20958 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.517247 21061 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:25.518230 21061 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:25.226897 21008 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.002s	sys 0.018s
I20260811 16:06:25.519855 20958 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.308738 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:25.431814 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 827589us
I20260811 16:06:25.478412 13824 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:25.519381 13740 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260811 16:06:25.342904 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.482065 13906 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:25.487713 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:25.490428 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:25.362453 20490 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.380899 20774 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:25.495867 13818 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 15. Ops: []
I20260811 16:06:25.498567 20745 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:25.393622 20818 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.017s	user 0.011s	sys 0.003s
I20260811 16:06:25.390573 20812 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.504944 21079 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:25.396106 14583 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260811 16:06:25.508297 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:25.512549 13742 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.512804 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.511485 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.516197 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:25.431768 20924 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.535923 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:25.537202 14583 pending_rounds.cc:76] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 10
I20260811 16:06:25.557248 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:25.556736 14583 pending_rounds.cc:97] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260811 16:06:25.530418 21017 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:25.571543 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52018us
I20260811 16:06:25.573019 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:25.575172 20958 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:25.575745 20958 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:25.576186 20958 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:25.576268 13905 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:25.566560 14583 raft_consensus.cc:2866] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:25.582861 20925 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.901s	user 0.019s	sys 0.000s
I20260811 16:06:25.583331 20490 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.584905 20745 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.583459 20925 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.586608 20490 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.593350 13906 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
W20260811 16:06:25.593796 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 92461.4us
W20260811 16:06:25.594419 13909 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.021s	sys 0.016s
W20260811 16:06:25.594880 13909 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.021s	sys 0.016s
W20260811 16:06:25.596493 20630 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.200s	user 0.023s	sys 0.008s
I20260811 16:06:25.597038 20630 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:25.569886 20818 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.600797 13826 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:25.601898 20818 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:25.603770 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 95872.7us
I20260811 16:06:25.554143 20884 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260811 16:06:25.609923 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 94095.2us
I20260811 16:06:25.615274 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:25.617825 13821 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:25.615094 20812 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.234545 21031 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.640790 21014 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.641685 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:25.586552 21060 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260811 16:06:25.575234 20774 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.658541 21074 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:25.658293 21014 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.661650 21014 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.662690 20812 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.663906 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:25.664806 13738 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:25.665679 20812 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.630316 20832 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.666482 21031 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.666754 20832 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:25.667793 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58335.1us
I20260811 16:06:25.669983 21061 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:25.672928 21046 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.961s	user 0.017s	sys 0.002s
I20260811 16:06:25.674007 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1204) took 1059 ms. Trace:
I20260811 16:06:25.674440 13825 rpcz_store.cc:276] 0811 16:06:24.614084 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.614238 (+   154us) service_pool.cc:227] Handling call
0811 16:06:25.673600 (+1059362us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540025f154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:25.673783 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1746186624}
I20260811 16:06:25.675007 13823 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:25.670332 20832 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.673557 21046 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:25.687354 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 453237us
I20260811 16:06:25.688824 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:25.689869 21071 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.616s	user 0.004s	sys 0.000s
I20260811 16:06:25.690583 13907 raft_consensus.cc:2354] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18.
W20260811 16:06:25.695029 21078 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.494s	user 0.000s	sys 0.001s
I20260811 16:06:25.696933 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1355) took 2039 ms. Trace:
I20260811 16:06:25.697412 13735 rpcz_store.cc:276] 0811 16:06:23.668717 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:23.855024 (+186307us) service_pool.cc:227] Handling call
0811 16:06:23.855534 (+   510us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:24.233081 (+377547us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:24.233130 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:24.241787 (+  8657us) log.cc:842] Serialized 26 byte log entry
0811 16:06:24.562318 (+320531us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:24.562356 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.562432 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:25.688763 (+1126331us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:25.696405 (+  7642us) raft_consensus.cc:1671] finished
0811 16:06:25.696430 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:25.696731 (+   301us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":33420,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2036,"spinlock_wait_cycles":335562624,"thread_start_us":685246,"threads_started":2,"wal-append.queue_time_us":731170}
W20260811 16:06:25.699465 20908 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.249s	user 0.010s	sys 0.016s
I20260811 16:06:25.700081 20908 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.700938 21061 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:25.663955 21019 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:25.703066 20747 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:25.703892 13827 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:25.704180 20747 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:25.704394 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1360) took 1418 ms. Trace:
I20260811 16:06:25.704824 13736 rpcz_store.cc:276] 0811 16:06:24.285967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.381142 (+ 95175us) service_pool.cc:227] Handling call
0811 16:06:24.381445 (+   303us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:25.479803 (+1098358us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:25.704052 (+224249us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b5400311d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:25.704331 (+   279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2118752128}
I20260811 16:06:25.705437 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2474) took 1246 ms. Trace:
I20260811 16:06:25.705921 13827 rpcz_store.cc:276] 0811 16:06:24.458859 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.529011 (+ 70152us) service_pool.cc:227] Handling call
0811 16:06:24.556901 (+ 27890us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:25.704427 (+1147526us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:25.705094 (+   667us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002ab7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:25.705362 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2636885760}
W20260811 16:06:25.707989 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 381769us
I20260811 16:06:25.708632 21008 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.709353 21008 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.710393 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:25.711627 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:25.712093 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:25.712393 13824 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:25.714686 21094 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:25.651175 20948 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.682104 21079 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:25.715927 21079 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:25.716380 21079 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:25.716813 20826 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:25.717267 20826 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:25.647711 21017 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.718326 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:25.719303 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3040) took 1402 ms. Trace:
I20260811 16:06:25.718395 20826 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.719722 13818 rpcz_store.cc:276] 0811 16:06:24.317095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.319577 (+  2482us) service_pool.cc:227] Handling call
0811 16:06:24.362494 (+ 42917us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:25.569211 (+1206717us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:25.718935 (+149724us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400125a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:25.719238 (+   303us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2605451520}
I20260811 16:06:25.720211 21017 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.720929 20826 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.721391 20774 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:25.721773 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2468) took 1307 ms. Trace:
I20260811 16:06:25.655781 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:25.681058 13740 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:25.722270 13826 rpcz_store.cc:276] 0811 16:06:24.414222 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.414380 (+   158us) service_pool.cc:227] Handling call
0811 16:06:24.450261 (+ 35881us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:25.601503 (+1151242us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:25.721491 (+119988us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002db4d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:25.721707 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2644575104}
I20260811 16:06:25.725422 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:25.702917 20908 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:25.689957 14577 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:25.726295 13821 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:25.743841 21031 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:25.744094 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:25.744849 13736 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.755105 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:25.756107 13743 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:25.762620 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:25.763878 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 154760us
I20260811 16:06:25.764137 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:25.766080 21008 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:25.766857 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:25.767063 20879 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:25.768765 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:25.769953 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:25.770166 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:25.770313 20913 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:25.769964 20824 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260811 16:06:25.771503 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 154527us
I20260811 16:06:25.715313 21093 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:25.703910 21019 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:25.775214 13824 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:25.715258 20925 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:25.781039 20490 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:25.781562 21014 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:25.784155 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 161114us
I20260811 16:06:25.785181 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:25.766978 21055 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:25.786645 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58321.6us
I20260811 16:06:25.787063 21055 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:25.787608 21055 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:25.788058 21008 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:25.788528 21008 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:25.788865 21008 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:25.774585 13737 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:25.744735 21031 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:25.705418 20747 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:25.798314 20782 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:25.800709 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:25.801761 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:25.771967 21095 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:25.803490 20908 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:25.802875 20924 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:25.798842 20782 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:25.813063 13737 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 21 index: 8. (term mismatch)
I20260811 16:06:25.813618 13737 pending_rounds.cc:76] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 7
I20260811 16:06:25.813935 13737 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 20.8
I20260811 16:06:25.814366 13737 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:25.815330 21018 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.668s	user 0.017s	sys 0.010s
W20260811 16:06:25.815092 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45104.1us
I20260811 16:06:25.818293 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:25.820551 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:25.779188 21019 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:25.812724 20747 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.796572 21060 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:25.813733 20782 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.807614 20908 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:25.816794 20913 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:25.829321 20924 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:25.890719 13744 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.848461 20908 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:25.834869 21060 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:25.854650 20925 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:25.908268 13743 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:25.914362 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:25.906698 21060 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:25.941963 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2614) took 1144 ms. Trace:
I20260811 16:06:25.852809 21074 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:25.942637 13743 rpcz_store.cc:276] 0811 16:06:24.788311 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.789566 (+  1255us) service_pool.cc:227] Handling call
0811 16:06:25.754663 (+965097us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:25.933090 (+178427us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":104469888}
I20260811 16:06:25.938300 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:25.950543 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130085us
I20260811 16:06:25.907516 20884 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:25.956647 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 185789us
I20260811 16:06:25.967702 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:25.972817 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:25.986423 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 192321us
I20260811 16:06:25.989399 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:25.995162 20832 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:25.995790 20832 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:25.996205 20832 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:25.970722 20913 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.006369 20688 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:26.007256 20688 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.008457 20794 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.093s
I20260811 16:06:26.009245 20794 consensus_queue.cc:1225] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 18.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260811 16:06:26.009653 20688 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.010696 20787 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:26.011515 20787 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.013831 20787 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.022482 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:26.022814 20789 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:26.023288 20789 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:26.023662 20789 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:26.029026 21069 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.940s	user 0.004s	sys 0.002s
I20260811 16:06:26.023558 20818 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:25.979007 20490 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:26.045688 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190752us
I20260811 16:06:25.980093 21046 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.059355 20913 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.062588 20545 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.063205 20688 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:26.055563 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:26.078926 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 289001us
I20260811 16:06:26.064824 13736 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:26.087615 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:26.083928 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 93033us
W20260811 16:06:26.076516 21071 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260811 16:06:25.990947 20812 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260811 16:06:26.107805 13740 raft_consensus.cc:1203] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.5->[17.6-21.8]   Dedup: 17.6->[19.7-21.8]
I20260811 16:06:26.109309 13740 pending_rounds.cc:76] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 6
I20260811 16:06:26.109552 13740 pending_rounds.cc:97] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 18.7
I20260811 16:06:26.076485 21095 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:26.109783 13740 raft_consensus.cc:2866] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:26.002779 20924 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:26.112814 13742 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.005s
I20260811 16:06:26.084331 21031 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.094570 20794 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:26.113343 13742 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
W20260811 16:06:26.116919 21107 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260811 16:06:26.117287 13739 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:26.120153 20545 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.124835 20688 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:26.126943 21086 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.893s	user 0.000s	sys 0.002s
I20260811 16:06:26.133677 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:26.135326 21058 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.138557 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.042426 21055 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.140069 21008 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.149080 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1357) took 1895 ms. Trace:
I20260811 16:06:26.132172 20818 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.150475 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.152110 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.151865 21095 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.153810 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.157990 20824 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260811 16:06:26.157829 20958 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.003s
I20260811 16:06:26.158563 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.212930 13900 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.083328 20884 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.155435 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.167966 13902 raft_consensus.cc:2354] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17.
W20260811 16:06:26.167815 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 417234us
W20260811 16:06:26.235816 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 253900us
I20260811 16:06:26.237145 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.162838 14582 rpcz_store.cc:276] 0811 16:06:24.181285 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.181551 (+   266us) service_pool.cc:227] Handling call
0811 16:06:24.182013 (+   462us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:24.182338 (+   325us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:24.182375 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:24.212342 (+ 29967us) log.cc:842] Serialized 26 byte log entry
0811 16:06:24.672453 (+460111us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:24.672511 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.672613 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:26.027997 (+1355384us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:26.030769 (+  2772us) raft_consensus.cc:1671] finished
0811 16:06:26.030790 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:26.076071 (+ 45281us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":301972352,"thread_start_us":431631,"threads_started":1,"wal-append.queue_time_us":814263}
I20260811 16:06:26.253530 13908 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.167598 21018 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:26.158435 20794 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:26.200170 21071 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260811 16:06:26.275862 13904 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.264308 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.277047 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.198185 20824 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:26.278765 13744 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:26.263990 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.173197 21031 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260811 16:06:26.262477 21018 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:26.255601 20490 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:26.284529 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:26.325855 13902 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:26.283957 20824 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:26.340310 13789 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.939s (SENT)
I20260811 16:06:26.337069 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.163935 21058 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.351356 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:26.349596 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86124.2us
W20260811 16:06:26.329476 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 2996) took 1311 ms (client timeout 1718 ms). Trace:
W20260811 16:06:26.343665 13735 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.041s	sys 0.024s
W20260811 16:06:26.354984 13735 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.041s	sys 0.024s
W20260811 16:06:26.355448 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 259754us
I20260811 16:06:26.356069 13822 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260811 16:06:26.247766 20958 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:26.362247 13823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3037) took 2074 ms (client timeout 1622 ms). Trace:
W20260811 16:06:26.353601 13907 rpcz_store.cc:269] 0811 16:06:25.007817 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.009570 (+  1753us) service_pool.cc:227] Handling call
0811 16:06:26.279696 (+1270126us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:26.319171 (+ 39475us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1231245184}
W20260811 16:06:26.348400 21079 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.011s
W20260811 16:06:26.370426 13823 rpcz_store.cc:269] 0811 16:06:24.288113 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.288302 (+   189us) service_pool.cc:227] Handling call
0811 16:06:26.344745 (+2056443us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:26.362149 (+ 17404us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2939642112}
I20260811 16:06:26.382856 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.349579 21046 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.258795 21074 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:26.390857 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73345.8us
I20260811 16:06:26.394892 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2478) took 1771 ms. Trace:
W20260811 16:06:26.417778 21044 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.005s	sys 0.015s
W20260811 16:06:26.443228 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48469us
I20260811 16:06:26.361238 20925 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:26.398975 21073 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.019s	sys 0.074s
I20260811 16:06:26.417824 21072 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:26.458454 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:26.447988 21044 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.006s	sys 0.015s
I20260811 16:06:26.384760 21079 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:26.435721 14542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.380s (SENT) [suppressed 20 similar messages]
I20260811 16:06:26.422170 13820 rpcz_store.cc:276] 0811 16:06:24.471107 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.540774 (+ 69667us) service_pool.cc:227] Handling call
0811 16:06:24.541101 (+   327us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:24.541533 (+   432us) raft_consensus.cc:1520] Early marking committed up to index 7
0811 16:06:24.541570 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:24.542144 (+   574us) log.cc:842] Serialized 26 byte log entry
0811 16:06:25.667225 (+1125081us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b18004f70e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:25.955755 (+288530us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:25.955827 (+    72us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:25.985216 (+ 29389us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:26.148544 (+163328us) raft_consensus.cc:1671] finished
0811 16:06:26.148573 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:26.242270 (+ 93697us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":15220,"spinlock_wait_cycles":12484480,"thread_start_us":223323,"threads_started":1,"wal-append.queue_time_us":1497938}
W20260811 16:06:26.465061 21073 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.019s	sys 0.075s
I20260811 16:06:26.480602 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.454108 21055 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:26.454838 21008 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.494841 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:26.494961 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59296.8us
I20260811 16:06:26.496472 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:26.497408 13824 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260811 16:06:26.479612 20490 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:26.443899 21060 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:26.494369 21075 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.175s	user 0.007s	sys 0.002s
I20260811 16:06:26.458237 20794 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.464658 21046 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:26.546344 20826 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.007s
I20260811 16:06:26.537256 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.508977 13744 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
W20260811 16:06:26.501302 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 192195us
W20260811 16:06:26.510028 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 225650us
I20260811 16:06:26.594413 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.596433 13902 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:26.597182 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.597841 21126 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:26.598068 13905 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:26.598335 21126 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:26.598760 21126 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:26.597078 21121 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.103s
I20260811 16:06:26.602156 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2621) took 1104 ms. Trace:
I20260811 16:06:26.599057 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:26.547073 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 159379us
I20260811 16:06:26.540212 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.545400 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.610658 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.487922 21018 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.632215 13738 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:26.629329 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:26.544427 21019 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.707s	user 0.012s	sys 0.000s
I20260811 16:06:26.603334 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2479) took 1195 ms. Trace:
W20260811 16:06:26.501305 13817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3033) took 2107 ms (client timeout 1718 ms). Trace:
I20260811 16:06:26.597591 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.539655 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.599494 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.502399 13823 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:26.512626 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:26.522424 21070 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.018s	sys 0.015s
I20260811 16:06:26.629773 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:26.628559 13742 rpcz_store.cc:276] 0811 16:06:25.497710 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.500043 (+  2333us) service_pool.cc:227] Handling call
0811 16:06:26.601950 (+1101907us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54000a96d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:26.602084 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25953536}
I20260811 16:06:26.597609 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.523278 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:26.614236 20782 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.003s
I20260811 16:06:26.600879 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.602586 20630 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:26.666921 20787 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:26.666575 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.634943 13900 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:26.636747 13824 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:06:26.675974 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:26.676642 13742 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:26.667567 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.599784 20879 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:26.682608 20879 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:26.683840 20879 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.685343 20879 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:26.636857 21018 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:26.666785 21060 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.611589 21055 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:26.679849 13901 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:26.633911 13822 rpcz_store.cc:276] 0811 16:06:25.407671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.476503 (+ 68832us) service_pool.cc:227] Handling call
0811 16:06:26.355743 (+879240us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:26.363673 (+  7930us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:26.603043 (+239370us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400200b50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:26.603248 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2019930880}
I20260811 16:06:26.528057 20832 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.595196 20490 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:26.696089 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.697685 20832 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.698501 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:26.699169 13735 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:26.673552 20787 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:26.542312 21074 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.690218 13907 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260811 16:06:26.535842 20545 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:26.635432 13817 rpcz_store.cc:269] 0811 16:06:24.250134 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.256492 (+  6358us) service_pool.cc:227] Handling call
0811 16:06:26.340106 (+2083614us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000d6454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:26.357230 (+ 17124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2889047424}
I20260811 16:06:26.697212 20490 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:26.524183 21109 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260811 16:06:26.679706 13906 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.636466 20924 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.723827 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:26.680868 21070 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.591s	user 0.018s	sys 0.024s
I20260811 16:06:26.707491 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:26.544436 20818 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.511471 20884 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.512401 20688 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.706265 21055 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.759742 21055 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.711279 20787 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:26.763480 13736 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:26.763877 13907 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260811 16:06:26.765024 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.607322 13627 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:26.765493 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1888) took 1057 ms. Trace:
I20260811 16:06:26.766358 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.766013 14583 rpcz_store.cc:276] 0811 16:06:25.708130 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.708594 (+   464us) service_pool.cc:227] Handling call
0811 16:06:25.709050 (+   456us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:25.711545 (+  2495us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:25.711574 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:25.712091 (+   517us) log.cc:842] Serialized 26 byte log entry
0811 16:06:26.173916 (+461825us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:26.173968 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:26.601589 (+427621us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b54003d13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:26.601648 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:26.765119 (+163471us) raft_consensus.cc:1671] finished
0811 16:06:26.765145 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:26.765421 (+   276us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3333,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"spinlock_wait_cycles":4828544,"thread_start_us":461327,"threads_started":1,"wal-append.queue_time_us":602767}
I20260811 16:06:26.767549 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.763361 13742 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:26.673261 20630 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:26.777206 21014 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.995s	user 0.016s	sys 0.000s
I20260811 16:06:26.777807 21014 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:26.779204 20630 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.537067 20958 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.532614 21134 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.780573 20630 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:26.774657 21008 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260811 16:06:26.780843 21134 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.781744 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.782441 13904 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:26.538947 20913 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.723707 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:26.783799 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62009.7us
I20260811 16:06:26.785144 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.673147 20782 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.786370 20545 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:26.786617 13739 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:26.786988 20545 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:26.786432 21134 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.788455 20782 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.788131 20545 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:26.788807 20908 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.002s
I20260811 16:06:26.789566 13903 raft_consensus.cc:2354] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18.
I20260811 16:06:26.789113 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.779021 21046 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:26.791348 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109988us
I20260811 16:06:26.791769 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.792213 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:26.793295 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.793351 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:26.793857 20958 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:26.794348 20958 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:26.794703 21143 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:26.737874 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.739601 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.740549 21058 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.740413 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.800689 13827 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
W20260811 16:06:26.803839 20789 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.000s
I20260811 16:06:26.804625 13904 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:26.806063 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.808405 13826 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:26.741314 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.743837 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.742167 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.750844 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:26.751843 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2606) took 2527 ms. Trace:
I20260811 16:06:26.755285 21060 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:26.756345 21127 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260811 16:06:26.770802 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.540776 21079 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:26.725662 21124 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:26.768293 20779 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.779318 20924 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.779703 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.524348 21125 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.282s
I20260811 16:06:26.794842 20958 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:26.795274 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:26.794391 21093 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:26.795579 20913 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:06:26.796787 21008 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:26.844910 21008 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:26.846019 21008 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.796998 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:26.797852 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:26.730069 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.836678 21124 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:26.848347 13736 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:26.839572 21060 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.849190 21124 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.850724 21124 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:26.851888 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56735.1us
I20260811 16:06:26.852223 13826 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260811 16:06:26.852499 21143 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:26.853147 21143 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:26.854084 21143 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.856732 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:26.857609 14582 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:26.851917 21125 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:26.858916 21125 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:26.859983 20924 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.859836 21125 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.861266 21125 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:26.746134 21126 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.808507 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.779204 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.779255 13735 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:26.798436 20824 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.863776 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:26.541229 21119 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:26.864904 21119 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:26.866133 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.866578 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:26.789255 20908 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.867892 13744 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:26.869473 13824 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:26.804343 20789 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.838461 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:26.839026 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.871037 14583 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:26.793370 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 580037905a064c08b39df9f9843b5448, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:26.871740 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 580037905a064c08b39df9f9843b5448, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.872504 13823 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:26.524962 20925 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.838068 13820 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:26.809700 13741 rpcz_store.cc:276] 0811 16:06:24.224049 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:24.238043 (+ 13994us) service_pool.cc:227] Handling call
0811 16:06:24.253941 (+ 15898us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:24.254291 (+   350us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:24.254330 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:24.262348 (+  8018us) log.cc:842] Serialized 26 byte log entry
0811 16:06:24.921378 (+659030us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:24.921436 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:24.921534 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:26.121637 (+1200103us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:26.751243 (+629606us) raft_consensus.cc:1671] finished
0811 16:06:26.751278 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:26.751631 (+   353us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":162563328,"thread_start_us":580184,"threads_started":1,"wal-append.queue_time_us":882567}
I20260811 16:06:26.843452 21093 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:26.855458 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:26.875291 21093 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:26.876187 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:26.840613 20779 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.863399 13818 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:26.863333 13908 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:26.864413 14574 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:26.882287 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:26.878957 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:26.884202 21060 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.889537 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:26.866230 21119 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.681175 21019 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.835888 13901 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:26.904716 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.905546 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:26.905611 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:26.908834 13826 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:06:26.909183 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:26.917968 13739 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:26.918550 20913 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:26.913895 14582 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260811 16:06:26.919179 20913 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:26.920562 20913 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.927783 14577 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:26.941974 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:26.945935 13820 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.949729 13825 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:26.955981 13743 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:26.936655 21008 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:26.948046 20794 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:26.970678 20794 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:26.972906 20794 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:26.975455 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:26.976354 13739 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:26.978448 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.979125 13902 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:06:26.979537 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.980237 13906 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:26.980705 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.981089 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.981455 13907 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.982251 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.982926 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:26.982327 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.983299 20908 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.983575 13735 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:26.984465 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.985275 13907 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:26.986043 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.987589 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.945242 20789 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:26.987082 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:26.988914 20787 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:26.990960 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:26.966363 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.001192 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.010828 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:26.952176 20924 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:27.009263 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:27.019678 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.023069 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.024173 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.025506 13735 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:27.026108 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.028468 13817 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:27.029585 13903 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:27.025288 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.037034 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.041137 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.042029 13900 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:27.045188 13902 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:27.045888 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.044310 14582 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:27.046666 13906 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:27.049641 13738 raft_consensus.cc:2354] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:06:27.050819 13908 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:27.050345 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.021425 21126 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:27.058786 13826 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:27.054409 13902 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:27.026247 20824 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.061317 13706 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:27.070483 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.071467 13901 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:27.079564 13826 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:27.040613 20490 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:27.082510 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 69769.5us
W20260811 16:06:27.086117 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57810.7us
I20260811 16:06:27.093490 14574 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:27.094739 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:27.096432 21150 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260811 16:06:27.098033 13857 heartbeater.cc:644] Failed to heartbeat to 127.12.23.254:34613 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.23.254:34613 timed out after 15.000s (SENT)
I20260811 16:06:27.098111 20824 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:27.099049 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.103279 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:27.105633 13709 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.551s (SENT)
I20260811 16:06:27.094492 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:27.107945 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.109269 13824 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:27.111655 20688 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:27.112283 20688 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:27.113162 20688 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:27.117075 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150824us
I20260811 16:06:27.092821 21058 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:27.132424 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48314us
I20260811 16:06:27.136401 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.147483 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.130808 20824 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:27.149098 21148 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260811 16:06:27.149379 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.149681 20826 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:27.149968 20824 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:27.151437 21145 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260811 16:06:27.153484 21151 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260811 16:06:27.155071 21142 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260811 16:06:27.155421 20774 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:27.128049 21058 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:27.156137 20774 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:27.156543 21058 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:27.157328 20774 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.160085 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:27.161238 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62689.7us
I20260811 16:06:27.160563 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2633) took 1083 ms. Trace:
I20260811 16:06:27.192718 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.181715 13740 rpcz_store.cc:276] 0811 16:06:26.076847 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:26.082828 (+  5981us) service_pool.cc:227] Handling call
0811 16:06:26.098838 (+ 16010us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:06:26.306576 (+207738us) raft_consensus.cc:1520] Early marking committed up to index 6
0811 16:06:26.343368 (+ 36792us) log.cc:842] Serialized 14 byte log entry
0811 16:06:26.906351 (+562983us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18004c86a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b
0811 16:06:26.906561 (+   210us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:26.912572 (+  6011us) log.cc:842] Serialized 52 byte log entry
0811 16:06:26.930304 (+ 17732us) raft_consensus.cc:1631] Marking committed up to 6
0811 16:06:26.930366 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:26.930469 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:27.160204 (+229735us) raft_consensus.cc:1671] finished
0811 16:06:27.160323 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:27.160488 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40377,"prepare.queue_time_us":166821,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":38674,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":16776,"spinlock_wait_cycles":5430144,"thread_start_us":272490,"threads_started":2,"wal-append.queue_time_us":497598}
I20260811 16:06:27.130414 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:27.151006 21149 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:06:27.197384 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2629) took 1269 ms. Trace:
I20260811 16:06:27.137267 20747 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:27.216142 13743 rpcz_store.cc:276] 0811 16:06:25.927910 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.991105 (+ 63195us) service_pool.cc:227] Handling call
0811 16:06:25.991588 (+   483us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:26.961867 (+970279us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:27.197023 (+235156us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:27.197304 (+   281us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2212896512}
I20260811 16:06:27.215435 13826 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:27.230324 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89308.8us
W20260811 16:06:27.237080 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67364us
I20260811 16:06:27.240780 14583 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:27.183811 21044 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:27.251941 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68263us
I20260811 16:06:27.247501 13739 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:27.192270 20826 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:27.266657 14577 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:27.262347 13824 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:27.230430 21019 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:27.272503 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.256852 20824 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:27.245591 21095 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:27.280494 13824 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
W20260811 16:06:27.293889 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 101251us
I20260811 16:06:27.285650 13820 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:27.301043 21031 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:27.301112 21116 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:27.301746 21031 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.302114 21116 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.304168 21031 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.304211 21116 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:27.294216 21018 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.608s	user 0.014s	sys 0.000s
I20260811 16:06:27.314750 13742 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260811 16:06:27.315393 21095 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.318542 21095 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:27.263545 21044 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.323252 21044 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:27.328367 13825 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:27.329262 13907 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:06:27.339094 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:27.339355 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:27.341596 21046 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:27.342211 21046 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:27.343801 21157 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260811 16:06:27.343317 21046 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.344735 20826 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.285362 21093 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.351701 20924 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:27.354135 21093 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:27.275936 20787 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:27.359570 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.364032 13822 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:06:27.359954 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.267738 20779 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.265002 20794 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260811 16:06:27.355536 13907 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:27.370741 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:27.326933 21146 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.168s	user 0.003s	sys 0.000s
W20260811 16:06:27.393685 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 201840us
I20260811 16:06:27.396617 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.396989 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.390522 13826 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:27.397411 14579 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:27.407166 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.408031 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:27.408231 13907 raft_consensus.cc:2354] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:06:27.408824 13908 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:27.407182 13871 connection.cc:232] RPC call timeout handler was delayed by -1.675050888909027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260811 16:06:27.409802 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.410205 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.410864 13823 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:27.411085 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.412001 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.412616 14577 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:27.415380 20925 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:27.416816 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.417474 13902 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
W20260811 16:06:27.421767 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 157109us
W20260811 16:06:27.422016 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 151414us
I20260811 16:06:27.425009 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.428994 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:27.430147 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:27.432338 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:27.433071 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:27.380493 21044 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:27.443738 13739 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 12: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:27.366993 20789 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260811 16:06:27.447608 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.448549 13743 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:27.449208 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.450054 13740 raft_consensus.cc:2354] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
I20260811 16:06:27.440611 21018 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260811 16:06:27.451547 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:27.452276 21124 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.008s
I20260811 16:06:27.452713 21018 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:27.453198 20832 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:27.453665 20832 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:27.454072 20832 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:27.458252 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.459262 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.459450 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.461351 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:27.463521 21019 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:27.467475 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:27.468125 13744 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:27.416045 20925 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.471413 21117 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:27.471268 20779 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:27.472064 21117 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:27.454989 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.472870 21060 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:27.473562 21060 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:27.474578 21060 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.476812 21060 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:27.459033 14573 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:27.471434 20925 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:27.486326 20630 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.006s
I20260811 16:06:27.487090 21044 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.488875 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.489353 21044 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.491061 20747 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:27.490530 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:27.492101 21008 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260811 16:06:27.492352 21138 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:27.492738 14578 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:27.493853 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2637) took 1004 ms. Trace:
I20260811 16:06:27.494204 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.494251 13737 rpcz_store.cc:276] 0811 16:06:26.489520 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:26.489670 (+   150us) service_pool.cc:227] Handling call
0811 16:06:26.501785 (+ 12115us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:26.614782 (+112997us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:26.614823 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:26.629431 (+ 14608us) log.cc:842] Serialized 26 byte log entry
0811 16:06:26.954662 (+325231us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:26.954705 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:26.954772 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:27.326006 (+371234us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:27.493558 (+167552us) raft_consensus.cc:1671] finished
0811 16:06:27.493582 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:27.493795 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59024,"raft.queue_time_us":78587,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":46471,"spinlock_wait_cycles":4662144,"thread_start_us":235661,"threads_started":1,"wal-append.queue_time_us":396381}
I20260811 16:06:27.496613 21138 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:27.495903 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:27.498754 21134 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:27.499168 21134 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:27.499519 21134 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:27.365675 20958 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.499915 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.439280 14577 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:27.501775 20958 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:27.502311 21121 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:27.504046 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:27.504703 21152 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260811 16:06:27.361877 20824 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.508248 20832 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.509428 13825 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:27.509615 20824 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:27.510114 21121 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:27.510861 20789 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:27.511327 20789 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:27.512267 20789 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.473048 21117 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:27.517397 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46279.1us
I20260811 16:06:27.498050 21138 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:27.416457 21126 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260811 16:06:27.447043 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.514730 14574 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:27.441545 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:27.522152 13744 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:27.422890 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.494000 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.523978 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:27.525056 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:27.525692 13744 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:27.526822 20747 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:27.525475 20779 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:27.466940 13820 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:27.523435 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:27.530134 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.531272 13737 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:27.537247 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 96021.8us
I20260811 16:06:27.540795 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.515887 20789 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:27.549441 14575 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:27.550477 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:27.556675 13744 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:27.557715 13822 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:27.519448 20787 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:27.561766 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:27.565465 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 69689.2us
I20260811 16:06:27.570227 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2690) took 1032 ms. Trace:
I20260811 16:06:27.575929 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.582540 13744 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:27.582670 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.583804 13820 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:27.585841 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.576792 13909 rpcz_store.cc:276] 0811 16:06:26.538286 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:26.687608 (+149322us) service_pool.cc:227] Handling call
0811 16:06:26.714962 (+ 27354us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:27.298045 (+583083us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b540026c8a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a00d8 00007f5c5190bfed 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c
0811 16:06:27.298114 (+    69us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:27.298146 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:27.298188 (+    42us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:27.298249 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:27.569976 (+271727us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:27.570041 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:27.570165 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8386,"raft.queue_time_us":8684,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5929,"spinlock_wait_cycles":919955968}
W20260811 16:06:27.589560 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 184610us
I20260811 16:06:27.595589 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.596832 13707 leader_election.cc:398] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18.
I20260811 16:06:27.597205 13707 leader_election.cc:401] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:27.598309 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.517027 21018 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260811 16:06:27.569730 21017 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:27.544868 20824 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:27.599078 13871 leader_election.cc:398] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:06:27.613147 13871 leader_election.cc:401] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:27.603554 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.604162 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.616995 14575 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:27.613829 13737 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260811 16:06:27.604502 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.604030 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:27.618435 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.622707 20787 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.607625 21124 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:27.625427 20787 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.625531 14579 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:27.624652 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.629262 13740 raft_consensus.cc:2396] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260811 16:06:27.561291 20747 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:27.626117 20832 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:27.616814 20958 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:27.538307 21058 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.636272 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:27.602659 21125 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.006s
I20260811 16:06:27.644837 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.648267 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.532369 21138 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:27.651790 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52897.4us
I20260811 16:06:27.549919 20630 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260811 16:06:27.620002 20824 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:27.603050 21060 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18.
I20260811 16:06:27.669732 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.606033 20782 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:27.670967 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.619877 21143 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:27.632923 21095 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:27.676246 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.687860 13738 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:27.630548 21124 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:27.683132 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:27.694949 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.696126 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.698431 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:27.709334 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.673144 21116 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15.
I20260811 16:06:27.710580 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.695674 13824 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:27.716914 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:27.680047 20824 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:27.741192 13817 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260811 16:06:27.720525 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.742398 13820 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260811 16:06:27.739969 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 70343.2us
I20260811 16:06:27.745612 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:27.748082 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:27.748838 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 150630us
I20260811 16:06:27.756678 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:27.761996 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 158510us
I20260811 16:06:27.763273 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:27.686728 21143 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:27.655333 20747 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.693586 21140 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:27.770586 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:27.773120 14573 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:27.777881 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.739830 20879 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:27.756434 21060 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:27.684075 21147 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260811 16:06:27.791788 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 195429us
I20260811 16:06:27.694306 21121 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.080s
I20260811 16:06:27.750218 21095 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:27.798493 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 97820.8us
I20260811 16:06:27.798532 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:27.772364 21143 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:27.798858 13742 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:06:27.803704 13740 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:27.800856 13871 leader_election.cc:398] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
I20260811 16:06:27.802137 14579 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:06:27.767514 21017 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:27.815483 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:27.856242 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55591us
I20260811 16:06:27.857576 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:27.835122 14575 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:27.791744 21116 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:27.794385 21130 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:27.815378 13741 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:27.793452 21060 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:27.920117 21060 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:27.860101 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.871598 21121 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:27.873075 20747 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.873993 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:27.874653 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104190us
I20260811 16:06:27.958384 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:27.961465 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87570us
I20260811 16:06:27.965029 13707 leader_election.cc:398] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14.
I20260811 16:06:27.777199 20782 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260811 16:06:27.864164 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.863243 21116 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:27.802541 20958 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:27.791093 21126 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260811 16:06:27.883097 21134 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.903769 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:27.911088 21178 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
W20260811 16:06:27.945672 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190095us
I20260811 16:06:27.548799 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:27.886096 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:27.964886 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:27.879639 21095 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:27.967760 21199 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:27.973322 13823 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:27.979364 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 103744us
I20260811 16:06:27.979678 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:27.884745 21182 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260811 16:06:27.969828 21116 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:27.884279 21124 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:27.966212 21058 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:28.010866 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.011966 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.014452 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:28.016846 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:27.980809 21138 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:27.980813 21121 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:27.986450 13739 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
W20260811 16:06:28.023411 21187 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260811 16:06:28.060359 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2649) took 1017 ms. Trace:
I20260811 16:06:28.061411 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.062090 14573 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:28.062152 13741 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:28.023471 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:28.037598 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72759.3us
I20260811 16:06:28.040369 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:28.041316 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:28.063792 13735 raft_consensus.cc:2354] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
W20260811 16:06:28.064016 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 177997us
I20260811 16:06:28.064232 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.042524 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:28.064967 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:28.043686 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1381) took 1190 ms. Trace:
I20260811 16:06:28.044260 21134 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:28.044588 13736 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260811 16:06:28.019759 21017 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:28.047854 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 375178us
I20260811 16:06:28.049167 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:28.068627 14575 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16. Re-sending same reply.
I20260811 16:06:28.008101 20774 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:28.051615 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.053735 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.055955 13818 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260811 16:06:28.074949 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.058326 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.058933 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:28.023864 21173 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.320s	user 0.001s	sys 0.001s
I20260811 16:06:27.982383 20782 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:28.072844 14544 connection.cc:232] RPC call timeout handler was delayed by -2.7076090169139206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260811 16:06:28.060901 13738 rpcz_store.cc:276] 0811 16:06:27.042863 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:27.080020 (+ 37157us) service_pool.cc:227] Handling call
0811 16:06:28.060069 (+980049us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:28.060281 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1329363840}
I20260811 16:06:28.060554 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.075033 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:28.057549 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.067320 14578 rpcz_store.cc:276] 0811 16:06:26.853422 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:26.866199 (+ 12777us) service_pool.cc:227] Handling call
0811 16:06:28.043485 (+1177286us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:28.043599 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1438506752}
I20260811 16:06:28.088577 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.089990 13825 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.103987 14583 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:28.117158 21182 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:28.118086 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:28.120637 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56486.9us
I20260811 16:06:28.121469 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:28.120503 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:28.122148 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:28.122864 14575 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:28.123275 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.124888 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:28.125903 13736 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:28.119355 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44464.5us
I20260811 16:06:28.119714 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.079999 20774 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:28.151341 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:28.093024 20490 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:28.144254 13902 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260811 16:06:28.145244 14577 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:06:28.142732 13738 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:28.155941 14583 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260811 16:06:28.156454 13825 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:28.142606 13909 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260811 16:06:28.142208 21191 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:28.165264 13901 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 6. Preceding OpId from leader: term: 21 index: 8. (index mismatch)
I20260811 16:06:28.124061 21130 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:06:28.169106 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47747.2us
I20260811 16:06:28.171882 13902 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:28.156528 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:28.178404 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 67039.9us
I20260811 16:06:28.178671 21143 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.181766 21058 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:28.182291 21058 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:28.182646 21058 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:28.183468 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92351.8us
W20260811 16:06:28.185333 20789 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.002s
I20260811 16:06:28.185632 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.185995 20789 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:28.186597 20789 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:28.136714 20787 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:28.099328 21126 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.075s
I20260811 16:06:28.187726 20787 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:28.188171 20787 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:28.191529 13824 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260811 16:06:28.198027 13827 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260811 16:06:28.162460 20774 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:28.170364 20490 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:28.216329 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:28.152719 21202 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:28.228117 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.229079 13901 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:28.131108 20782 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:28.233798 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.176091 21130 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:28.195407 21198 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:28.197221 21182 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:28.247326 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.254949 13902 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:28.231582 20490 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:28.232460 21202 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:28.227608 21124 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:28.273114 21124 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.239544 21143 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:28.279734 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.204316 21203 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260811 16:06:28.282850 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.283794 13903 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:28.285038 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.287118 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.288821 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.290406 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.198628 21008 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260811 16:06:28.254949 21198 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:28.273810 21197 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260811 16:06:28.308216 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87496.6us
I20260811 16:06:28.307665 13901 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:28.309615 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.310047 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.311476 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.294472 13906 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.269740 20782 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:28.309321 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.301779 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.316937 13902 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:28.304495 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:28.301507 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 121848us
I20260811 16:06:28.319509 13909 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:28.306551 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.320467 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.321854 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.321162 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.332124 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.336786 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.338871 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.339910 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.292796 21202 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:28.346163 13907 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 12: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.346530 21174 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:28.346655 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.350227 20958 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:28.344120 21143 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:28.242437 21121 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.346544 14575 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:28.360668 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:28.360632 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 164634us
I20260811 16:06:28.363339 13902 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:28.387512 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.383390 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.354580 21130 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:28.371366 21182 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:28.371062 20824 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.004s
I20260811 16:06:28.373653 21124 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:28.306027 21060 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.382560 20832 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
W20260811 16:06:28.375792 21140 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.588s	user 0.016s	sys 0.012s
I20260811 16:06:28.372010 13900 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260811 16:06:28.376730 21116 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:28.405627 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.370463 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.388168 13902 raft_consensus.cc:2362] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17. Re-sending same reply.
I20260811 16:06:28.408067 21182 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:28.408432 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.396129 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:28.398351 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56467us
I20260811 16:06:28.411172 13902 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260811 16:06:28.410369 21124 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:28.417129 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.417905 13826 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.413365 13743 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:28.418247 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.392119 21199 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:28.422076 13901 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.422276 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.402444 21130 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:28.425073 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.399266 20832 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:28.427301 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.428390 13823 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:28.404096 21140 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:28.431814 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:28.434911 13818 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.431102 13902 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:28.437000 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.437410 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.437845 13907 raft_consensus.cc:2362] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15. Re-sending same reply.
I20260811 16:06:28.437000 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.418612 20630 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:28.459440 20630 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.460736 13823 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260811 16:06:28.461637 20630 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:28.448105 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:28.462600 13825 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.449019 13742 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:28.464211 21116 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:28.465054 21116 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:28.466197 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:28.467736 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.435196 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:28.470376 20545 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:28.470791 20545 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:28.470928 21217 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:28.471750 21217 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:28.392807 21200 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260811 16:06:28.477133 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.453907 21060 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:28.455332 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:28.457635 13827 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:28.468472 13825 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:28.467865 13823 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:28.398367 20824 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.473923 13900 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:28.477276 13905 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:28.438587 13902 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:28.488181 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:28.477490 13908 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:28.479475 13818 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:28.490091 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:28.480830 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.469544 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.383673 20789 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.431516 21125 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260811 16:06:28.494112 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.499071 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.433076 21124 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.533119 13902 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:28.581933 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.493733 21019 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:28.588287 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.510583 20630 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:28.592630 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 123161us
I20260811 16:06:28.583671 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.583681 13906 raft_consensus.cc:2354] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
W20260811 16:06:28.583945 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72665.6us
I20260811 16:06:28.629330 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.639683 13907 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:28.642858 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.650341 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:28.590948 20924 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260811 16:06:28.658370 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63480.4us
I20260811 16:06:28.472697 21217 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.657512 13902 raft_consensus.cc:2362] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15. Re-sending same reply.
I20260811 16:06:28.698704 13737 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260811 16:06:28.730098 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.662297 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:28.699368 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:28.661896 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.736285 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.470155 20832 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:28.740280 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:28.583525 21224 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:28.627434 20630 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:28.746357 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84185.2us
I20260811 16:06:28.657011 21198 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:28.590173 21116 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260811 16:06:28.642747 21199 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:28.627686 20782 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:28.498119 20545 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:28.821235 13905 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260811 16:06:28.825464 21191 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:28.748116 20630 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:28.826545 20832 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:28.880825 13902 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:28.883301 13902 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:28.826306 20824 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:28.855659 21198 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:28.884342 13902 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.872527 20545 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:28.898849 13902 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:28.891700 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 154590us
W20260811 16:06:28.899003 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73941.2us
I20260811 16:06:28.906613 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.849152 21199 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:28.892596 20774 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.004s
I20260811 16:06:28.931483 13900 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:28.936136 13902 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260811 16:06:28.869140 20782 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:28.960871 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1393) took 1517 ms (client timeout 1652 ms). Trace:
W20260811 16:06:28.930757 20490 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.000s
W20260811 16:06:28.969425 13903 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.000s
W20260811 16:06:28.961496 14574 rpcz_store.cc:269] 0811 16:06:27.443041 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:27.443269 (+   228us) service_pool.cc:227] Handling call
0811 16:06:28.960590 (+1517321us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b54005401d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:28.960785 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":94118656}
I20260811 16:06:28.918774 21198 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:28.976892 13903 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:28.979956 13902 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:28.944321 21189 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:28.944380 21192 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260811 16:06:28.976902 21227 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260811 16:06:28.962275 21124 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:28.993871 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 332086us
I20260811 16:06:28.991113 13902 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:28.973104 21239 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:28.929908 21143 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.057s
I20260811 16:06:28.994339 13904 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:28.995175 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:28.941747 20774 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:28.985635 20958 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:28.999034 13902 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260811 16:06:28.992708 21240 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:28.992667 20924 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:28.998150 21221 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260811 16:06:28.997897 21236 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:29.015560 21236 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.017930 21236 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:28.981324 20490 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:28.999470 21213 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.463s	user 0.000s	sys 0.001s
I20260811 16:06:29.021332 20490 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:29.002665 21230 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260811 16:06:29.021397 21240 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.024457 20774 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:29.024269 21198 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.004710 21121 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:29.025738 21199 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:29.026104 21240 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:29.027832 21229 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260811 16:06:29.029750 20924 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:29.031212 21183 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.232s	user 0.012s	sys 0.001s
I20260811 16:06:29.032618 20924 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.022909 14582 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260811 16:06:29.014104 21130 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260811 16:06:29.040565 20824 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.041150 20824 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.045179 21044 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.045789 21044 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:29.046777 21058 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.858s	user 0.011s	sys 0.000s
W20260811 16:06:29.048166 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 658194us
I20260811 16:06:29.048794 20824 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:29.050566 21219 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.461s	user 0.000s	sys 0.007s
I20260811 16:06:29.039255 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.061262 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.064670 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:29.067452 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.068572 13825 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:29.081862 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:29.082063 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.092629 21235 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:29.099265 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:29.080464 21058 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.094110 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:28.991597 21189 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.118656 21044 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.119536 21235 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.122201 21223 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260811 16:06:29.122973 21174 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.123660 21130 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:06:29.125157 21235 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.123523 21174 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:29.099782 20826 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.013s
I20260811 16:06:29.010319 20958 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:29.129603 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 90460.4us
I20260811 16:06:29.133812 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.094547 21224 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:29.135710 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1213) took 1080 ms. Trace:
I20260811 16:06:29.142093 13822 rpcz_store.cc:276] 0811 16:06:28.054951 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.056618 (+  1667us) service_pool.cc:227] Handling call
0811 16:06:28.059632 (+  3014us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:28.059893 (+   261us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:28.196306 (+136413us) log.cc:842] Serialized 14 byte log entry
0811 16:06:29.042121 (+845815us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b18003da3e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:06:29.135371 (+ 93250us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:29.135426 (+    55us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:29.135472 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:29.135533 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:29.135653 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12642,"prepare.queue_time_us":239587,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":10546,"raft.queue_time_us":721719,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":7837056,"thread_start_us":310693,"threads_started":3,"wal-append.queue_time_us":204939}
W20260811 16:06:29.132628 20826 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.007s	sys 0.014s
I20260811 16:06:29.085140 21182 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260811 16:06:29.153808 13736 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:06:29.127043 21018 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.150142 13740 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260811 16:06:29.158248 13737 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:29.159868 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.161350 21182 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:29.161729 21189 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.163022 21235 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:29.163408 21174 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:29.164036 20925 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:29.161751 21008 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260811 16:06:29.165337 21202 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.004s
I20260811 16:06:29.149526 20824 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:29.167940 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.147586 20688 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.168879 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.209822 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.182420 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.210458 20925 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:29.211361 20782 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.211774 20958 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.211629 20925 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.177662 21182 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:29.213145 20925 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:29.213337 21058 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.214072 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.215979 21199 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:29.216540 21199 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:29.174597 21018 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:29.210063 13789 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.500s (SENT)
I20260811 16:06:29.217816 21199 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.184574 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.220350 21018 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.219808 21095 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:06:29.177791 20787 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.954s	user 0.013s	sys 0.001s
I20260811 16:06:29.186131 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:29.150718 21239 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:29.174670 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.243557 13740 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:29.233659 13789 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.662s (SENT)
W20260811 16:06:29.245512 13789 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.672s (SENT)
W20260811 16:06:29.246253 13789 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.684s (SENT)
I20260811 16:06:29.252096 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:29.249989 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.203846 21195 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:29.284679 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:29.235292 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 184624us
I20260811 16:06:29.279415 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:29.279737 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65756.3us
W20260811 16:06:29.279979 13789 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.854s (SENT)
I20260811 16:06:29.236744 13737 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:29.281286 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1217) took 1218 ms. Trace:
I20260811 16:06:29.281450 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.285514 14583 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:29.236454 21202 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.290771 21239 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.291692 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.288527 13820 rpcz_store.cc:276] 0811 16:06:28.062749 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.090647 (+ 27898us) service_pool.cc:227] Handling call
0811 16:06:28.130919 (+ 40272us) raft_consensus.cc:1457] Updating replica for 4 ops
0811 16:06:28.145631 (+ 14712us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:28.145687 (+    56us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0811 16:06:28.173810 (+ 28123us) log.cc:842] Serialized 104 byte log entry
0811 16:06:28.333168 (+159358us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:28.333218 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:28.333293 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:29.049803 (+716510us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:29.247952 (+198149us) raft_consensus.cc:1671] finished
0811 16:06:29.247987 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:29.281206 (+ 33219us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9289,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":15224,"spinlock_wait_cycles":4850432,"thread_start_us":91335,"threads_started":1,"wal-append.queue_time_us":244365}
I20260811 16:06:29.292543 14574 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:29.292744 21202 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.293159 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.293437 21121 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:29.291019 13818 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:29.294394 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:29.231935 21095 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:29.296195 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:29.286700 13787 connection.cc:232] RPC call timeout handler was delayed by -1.3876103539951146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260811 16:06:29.304214 14577 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:29.309234 13787 connection.cc:232] RPC call timeout handler was delayed by -1.3336103539913893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260811 16:06:29.332734 13787 connection.cc:232] RPC call timeout handler was delayed by -1.1017697501229122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
I20260811 16:06:29.335548 13740 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260811 16:06:29.284112 21195 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:29.337904 14541 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.340756 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.235129 20688 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.336433 20782 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.339385 20789 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.344411 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:29.302134 21202 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:29.247746 20787 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.346424 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.347090 13735 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260811 16:06:29.306249 21095 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:29.351013 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71076.2us
W20260811 16:06:29.350302 13871 connection.cc:232] RPC call timeout handler was delayed by -1.2313090460374951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
I20260811 16:06:29.335678 21018 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.354707 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.356488 21246 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.363754 21254 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:29.415676 21254 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.415599 21246 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.357638 21235 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:29.383874 14575 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:29.418089 21246 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.386647 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.350870 21202 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.419260 21202 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:29.409827 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.388543 13825 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:29.385154 13789 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.864s (SENT)
I20260811 16:06:29.419973 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:29.416196 21254 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:29.363513 20630 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.416591 20688 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.387885 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:29.421005 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:29.437309 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 82655.7us
I20260811 16:06:29.384351 21191 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:29.409677 21258 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.439131 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:29.435689 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 68238.7us
I20260811 16:06:29.410355 21114 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.355162 20782 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.355297 20789 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.383637 21116 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.057s
I20260811 16:06:29.407044 21018 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.424656 21223 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:29.505146 13744 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:29.483000 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1395) took 1601 ms. Trace:
I20260811 16:06:29.506131 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.444232 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:29.497658 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 759892us
W20260811 16:06:29.462559 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1212) took 1407 ms (client timeout 1825 ms). Trace:
I20260811 16:06:29.536463 13736 raft_consensus.cc:2379] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:29.482966 20630 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.448786 20688 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.076s
I20260811 16:06:29.553462 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2713) took 1274 ms. Trace:
I20260811 16:06:29.463768 21212 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260811 16:06:29.553995 13901 rpcz_store.cc:276] 0811 16:06:28.278625 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.309328 (+ 30703us) service_pool.cc:227] Handling call
0811 16:06:29.553209 (+1243881us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002acbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:29.553390 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":256249600}
I20260811 16:06:29.554917 21212 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:29.555341 21212 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:29.556221 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2715) took 1262 ms. Trace:
W20260811 16:06:29.525744 21119 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260811 16:06:29.559067 21228 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:29.559583 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 17 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.562289 13820 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:06:29.556629 13906 rpcz_store.cc:276] 0811 16:06:28.300046 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.316343 (+ 16297us) service_pool.cc:227] Handling call
0811 16:06:29.556009 (+1239666us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:29.556155 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":280205056}
I20260811 16:06:29.527319 21256 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260811 16:06:29.527590 20789 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.448647 21044 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260811 16:06:29.480509 20787 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.463477 20794 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260811 16:06:29.529101 21114 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.530172 13738 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:29.461705 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.532836 20782 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.422451 20545 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:29.579646 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:29.533511 21232 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:29.580415 13901 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:29.536480 13824 rpcz_store.cc:269] 0811 16:06:28.054640 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.056831 (+  2191us) service_pool.cc:227] Handling call
0811 16:06:29.462284 (+1405453us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:29.462478 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":212283648}
I20260811 16:06:29.537448 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:29.581241 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 119619us
I20260811 16:06:29.580700 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.581684 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:29.540952 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 96853.3us
I20260811 16:06:29.590896 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.580691 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:29.592523 13907 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:29.442840 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.544350 13826 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260811 16:06:29.544974 21070 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:29.546154 21260 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260811 16:06:29.551980 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2417) took 1457 ms. Trace:
I20260811 16:06:29.536862 13739 rpcz_store.cc:276] 0811 16:06:27.881522 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:27.881733 (+   211us) service_pool.cc:227] Handling call
0811 16:06:27.882162 (+   429us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:28.115294 (+233132us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:29.482700 (+1367406us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400002b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:29.482932 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":236803968}
I20260811 16:06:29.565864 13822 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:29.480144 21226 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:29.448489 21017 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:29.441771 20958 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:29.567668 13820 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260811 16:06:29.493240 20879 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
W20260811 16:06:29.528539 21261 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260811 16:06:29.463615 21250 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.569880 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:29.571307 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.576242 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.577121 13736 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260811 16:06:29.613672 13736 pending_rounds.cc:76] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 7
I20260811 16:06:29.614017 13736 pending_rounds.cc:97] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260811 16:06:29.614367 13736 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:29.535574 21258 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.619787 13827 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:06:29.542420 21223 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:29.534286 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 95320.6us
I20260811 16:06:29.581496 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.624464 13905 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:29.624516 14541 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.625433 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.596619 20545 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:29.597095 20782 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:29.627683 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:29.629106 21174 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:29.630107 21174 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:29.630443 21174 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:29.632227 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56109.4us
I20260811 16:06:29.633155 21121 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:29.598237 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60880.4us
I20260811 16:06:29.633134 13871 leader_election.cc:398] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
I20260811 16:06:29.634457 13871 leader_election.cc:401] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260811 16:06:29.634557 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:29.636392 21134 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:29.636806 21134 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:29.637193 21134 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:29.635090 20824 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17.
I20260811 16:06:29.556267 21212 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.640877 21212 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:29.641285 21044 consensus_queue.cc:1159] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 18 status { last_received { term: 16 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:06:29.643757 21174 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.650686 21018 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.652401 21223 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:29.570633 20630 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.582020 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:29.657029 13902 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:29.589699 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.600606 13742 rpcz_store.cc:276] 0811 16:06:28.094275 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.119093 (+ 24818us) service_pool.cc:227] Handling call
0811 16:06:28.151605 (+ 32512us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:28.463679 (+312074us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:29.551696 (+1088017us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54001dc254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:29.551903 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":683488512}
I20260811 16:06:29.556809 21253 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:29.659364 20884 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:29.661523 21018 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.602240 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:29.662369 21234 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.662s	user 0.000s	sys 0.001s
I20260811 16:06:29.603000 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.663594 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.664237 13900 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:29.664445 21044 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:29.603493 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.662099 21018 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.583976 21114 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.449851 21191 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.435880 21195 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.590838 20787 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:29.613173 13818 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:29.621868 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.579023 21095 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.607034 20879 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:29.622252 13740 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:29.627317 21232 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:29.577649 21119 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.711036 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:29.711606 13735 raft_consensus.cc:2396] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260811 16:06:29.711690 14574 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:29.667301 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65127.7us
W20260811 16:06:29.671177 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76963.2us
I20260811 16:06:29.673763 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:29.675772 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86174.7us
I20260811 16:06:29.675953 13739 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:29.681195 13907 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:06:29.715718 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.686951 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.701967 13904 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:29.703670 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:29.700282 13902 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:06:29.707813 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.707814 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.718379 14577 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:29.714915 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.721199 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.722397 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.724618 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.726303 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.730638 14582 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260811 16:06:29.742583 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:29.744243 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1397) took 1720 ms. Trace:
I20260811 16:06:29.744932 13743 rpcz_store.cc:276] 0811 16:06:28.023511 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.023754 (+   243us) service_pool.cc:227] Handling call
0811 16:06:28.024128 (+   374us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:28.421633 (+397505us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:29.744004 (+1322371us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400346cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:29.744184 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":889801472}
I20260811 16:06:29.716711 21114 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:29.748831 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.748725 14574 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:29.687588 20630 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.755636 21070 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:29.759598 20747 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:29.772919 20747 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:29.773406 20747 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:29.766285 21114 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:29.730423 20787 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260811 16:06:29.766024 20879 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.777493 20879 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:29.778491 21018 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:29.779237 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2710) took 1501 ms (client timeout 1864 ms). Trace:
W20260811 16:06:29.779255 21199 consensus_queue.cc:1159] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f46150fac70458986206ec7af67a403" responder_term: 13 status { last_received { term: 12 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260811 16:06:29.779714 13903 rpcz_store.cc:269] 0811 16:06:28.277662 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.286440 (+  8778us) service_pool.cc:227] Handling call
0811 16:06:29.779047 (+1492607us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:29.779169 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46532864}
I20260811 16:06:29.761656 20958 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:29.781422 21191 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.763868 21203 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260811 16:06:29.755120 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.726409 20545 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:29.729916 21126 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:29.731762 20824 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:06:29.714178 20782 consensus_queue.cc:1159] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" responder_term: 17 status { last_received { term: 16 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:06:29.734611 21256 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:29.771739 21134 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.721400 21119 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.747908 21226 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:29.783207 20747 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.804555 21044 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260811 16:06:29.806239 20747 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.796161 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:29.806644 21126 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:29.799672 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:29.803408 13902 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:06:29.624089 21250 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.811173 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:29.811333 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72890.3us
I20260811 16:06:29.812259 21095 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.762878 21138 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.813072 21138 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.813997 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:29.790467 13627 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 10 to 14, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 14 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:29.819761 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 9 to 10, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 10 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:29.821390 20884 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:29.821987 13627 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:29.827306 21134 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.828981 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:29.830853 21119 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:29.831820 13736 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:29.835299 14578 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:29.836247 21250 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.797561 21203 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260811 16:06:29.823274 21199 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:06:29.839840 21199 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:29.840703 13817 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:29.842129 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.844496 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.845609 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.826403 21182 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:29.858824 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62774.7us
I20260811 16:06:29.862306 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:29.865208 13901 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:06:29.866256 13744 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260811 16:06:29.859905 13818 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:29.869488 21283 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.869776 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:29.870129 21283 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.870718 21224 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:29.871541 21224 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:29.857350 20490 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:29.860471 21119 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
W20260811 16:06:29.871040 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 167500us
W20260811 16:06:29.876838 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62915.1us
I20260811 16:06:29.861688 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.879711 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:29.848634 21228 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:29.872527 21224 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.877584 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:29.878026 13741 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:29.840291 21199 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:29.857174 21236 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:29.878773 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.891603 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:29.891847 21060 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:29.893743 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:29.894160 21074 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:29.894460 21226 raft_consensus.cc:2741] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260811 16:06:29.895051 21240 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:29.939599 20490 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:29.941849 21138 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.944000 21095 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:29.946570 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:29.886870 21253 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260811 16:06:29.901140 21182 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:29.895677 21172 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:29.896497 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.947301 13740 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
W20260811 16:06:29.897233 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.825s (SENT)
I20260811 16:06:29.898833 21195 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:29.955683 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.880311 13902 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:29.787119 21258 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:29.960618 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63435.3us
I20260811 16:06:29.962585 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.963587 14575 raft_consensus.cc:2396] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 18 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
W20260811 16:06:29.963951 21278 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:06:29.964269 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:29.966118 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:29.967588 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.963376 20958 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:29.968849 14583 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:29.929279 21192 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.971051 21192 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.952625 21236 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:29.975451 21236 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.910768 21044 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:29.911329 21228 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:29.912762 21202 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.015319 21228 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.015775 21228 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:30.016922 21202 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:29.913390 13908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2705) took 1637 ms (client timeout 1549 ms). Trace:
W20260811 16:06:30.017629 13908 rpcz_store.cc:269] 0811 16:06:28.275935 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.279324 (+  3389us) service_pool.cc:227] Handling call
0811 16:06:29.913178 (+1633854us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:29.913316 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":342828416}
I20260811 16:06:29.914098 13909 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260811 16:06:29.914479 21199 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:29.939805 21240 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:30.019455 21240 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:30.020072 21199 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:30.020363 21240 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.021762 21240 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:29.928349 13738 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
I20260811 16:06:29.928584 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:06:30.024930 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 96521us
I20260811 16:06:29.932413 21250 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:06:30.026365 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:29.929365 20794 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:29.933833 20924 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.027168 20879 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:30.027731 20879 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:30.027390 20924 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.027828 21223 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.028288 21124 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:06:30.028657 20879 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.029661 20924 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:29.935590 21114 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:30.030076 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 152583us
I20260811 16:06:30.030489 13738 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260811 16:06:30.031601 21280 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.935353 21216 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:29.926431 21008 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260811 16:06:30.032127 21280 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.921082 21060 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:29.985330 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92985.2us
I20260811 16:06:30.002764 20787 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.033741 21060 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:30.034066 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.007571 13823 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260811 16:06:30.002751 21058 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:29.921370 21119 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:30.010066 21198 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:29.926083 21203 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260811 16:06:30.013561 21254 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.003s
I20260811 16:06:30.024534 21172 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:29.931543 20545 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260811 16:06:30.004848 21227 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:06:30.036618 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.089654 14573 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:30.037151 13823 pending_rounds.cc:76] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 15
I20260811 16:06:30.088430 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:30.092001 13823 pending_rounds.cc:97] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260811 16:06:30.092481 13823 raft_consensus.cc:2866] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:30.040259 13817 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:30.042130 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:30.043638 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:29.955842 21283 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.045727 13738 pending_rounds.cc:76] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 7
I20260811 16:06:30.097038 13738 pending_rounds.cc:97] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260811 16:06:30.097455 13738 raft_consensus.cc:2866] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:30.045807 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:30.047164 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:30.029704 21124 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:06:30.056947 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 210dcf7aee994bdaa1e75860a25bdd3a, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:30.102191 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 210dcf7aee994bdaa1e75860a25bdd3a, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.063062 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.102931 13901 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:30.063972 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.104485 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.065294 14574 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
W20260811 16:06:30.036970 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 77331.6us
I20260811 16:06:30.091321 13907 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:30.093565 14583 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:30.094832 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:30.106524 14579 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:30.099682 13740 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:30.053345 21246 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:06:30.110123 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:30.115067 13740 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:30.065397 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.116367 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.117727 13904 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:06:30.056962 21202 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.123772 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:30.119472 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.124704 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:30.125563 13901 raft_consensus.cc:2362] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19. Re-sending same reply.
W20260811 16:06:30.119369 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73633.2us
I20260811 16:06:30.121199 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.071375 21239 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:30.130182 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1214) took 2075 ms. Trace:
I20260811 16:06:30.126823 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:30.118858 21226 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:30.124436 13907 raft_consensus.cc:2362] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17. Re-sending same reply.
I20260811 16:06:30.065030 21216 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260811 16:06:30.137101 21074 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:30.137655 21074 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:30.058862 21198 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.129863 21239 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:30.139952 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.140604 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:30.138052 21074 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:30.131539 13821 rpcz_store.cc:276] 0811 16:06:28.061642 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.061802 (+   160us) service_pool.cc:227] Handling call
0811 16:06:28.102126 (+ 40324us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:28.228104 (+125978us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:28.228138 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:28.228659 (+   521us) log.cc:842] Serialized 26 byte log entry
0811 16:06:28.428195 (+199536us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:28.473800 (+ 45605us) log.cc:842] Serialized 14 byte log entry
0811 16:06:29.083011 (+609211us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:29.083116 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:29.926861 (+843745us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b2400138f68. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c8740 00007f5c515bb578 00007f5c515bbcd8 00007f5c515936e8 00007f5c5158eaea 00007f5c5158df36
0811 16:06:30.123266 (+196405us) raft_consensus.cc:1671] finished
0811 16:06:30.129986 (+  6720us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:30.130119 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":611296,"prepare.queue_time_us":46785,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":643846,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":7654,"spinlock_wait_cycles":35996544,"thread_start_us":276061,"threads_started":2,"wal-append.queue_time_us":335628}
I20260811 16:06:30.159582 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.160785 13906 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260811 16:06:30.102057 21124 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.127962 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:30.034042 20787 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.186385 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.123001 21283 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:30.190245 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:30.175729 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.191082 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:30.202919 13824 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:30.204704 13874 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:30.206077 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:30.159024 21198 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:30.093451 21254 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.230180 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.213646 14579 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:30.193252 20545 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:30.130155 21246 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:30.200227 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:30.249504 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:30.250152 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50002.3us
I20260811 16:06:30.185626 21017 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:30.201905 21283 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.250427 14579 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:30.241045 21280 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.242400 20787 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.245256 21243 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:30.279130 21243 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.279646 21243 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:30.245535 21223 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.195222 21134 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.251382 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:30.168542 21130 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:30.281597 21130 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:30.281294 21134 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.282073 21130 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:30.199855 21193 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.196846 21124 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:30.275691 13737 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:30.141909 21202 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.248129 20630 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.196630 21070 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 21.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260811 16:06:30.139014 21239 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.337744 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:30.568943 13744 raft_consensus.cc:595] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:30.277877 21283 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:30.569365 13744 raft_consensus.cc:603] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:30.283480 21193 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.388777 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2719) took 2035 ms. Trace:
I20260811 16:06:30.576988 14582 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260811 16:06:30.399773 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 263089us
W20260811 16:06:30.431334 21286 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.465s	user 0.002s	sys 0.000s
W20260811 16:06:30.431710 21187 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.538s	user 0.008s	sys 0.000s
W20260811 16:06:30.474581 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64716.8us
W20260811 16:06:30.507936 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 303341us
W20260811 16:06:30.472324 13826 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.012s
W20260811 16:06:30.582228 13826 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.014s
I20260811 16:06:30.339318 21291 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:30.340358 21246 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.8, Last appended by leader: 8, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.265244 20545 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:30.576839 13909 rpcz_store.cc:276] 0811 16:06:28.353210 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:28.360359 (+  7149us) service_pool.cc:227] Handling call
0811 16:06:29.913756 (+1553397us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:30.018868 (+105112us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:30.388476 (+369608us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000c8850. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:30.388658 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3505914752}
I20260811 16:06:30.390615 21044 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:30.590390 21174 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:30.603225 13824 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260811 16:06:30.597043 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 453837us
I20260811 16:06:30.511771 21017 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:30.584523 21199 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.564s	user 0.023s	sys 0.000s
I20260811 16:06:30.568003 21200 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:30.588466 21182 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.014s
I20260811 16:06:30.620625 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:30.645843 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 519134us
I20260811 16:06:30.629801 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:30.621080 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.647194 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:30.646914 14580 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:30.656004 13907 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260811 16:06:30.579074 21198 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:30.601961 21044 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:30.665760 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:30.661578 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.665357 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:30.681573 14579 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:30.683240 13744 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:30.687225 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:30.615765 21192 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.652750 21223 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.655278 21058 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:30.679836 21187 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:06:30.703027 13707 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:30.685582 21284 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260811 16:06:30.710693 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1946) took 1041 ms. Trace:
W20260811 16:06:30.710883 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63761.9us
I20260811 16:06:30.679476 21070 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:30.679917 21199 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.711227 14578 rpcz_store.cc:276] 0811 16:06:29.661843 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.663296 (+  1453us) service_pool.cc:227] Handling call
0811 16:06:30.703407 (+1040111us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:30.703527 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":392802688}
I20260811 16:06:30.679757 21126 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:30.706815 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:30.691752 21296 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:30.644364 21119 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260811 16:06:30.718676 13744 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:30.690645 21018 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.662866 21258 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.054s
I20260811 16:06:30.634093 21017 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.727850 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:30.653301 21200 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.689867 20545 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.720412 21254 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.727496 21172 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:30.761130 13824 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:30.712796 21223 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:30.770787 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55228.8us
I20260811 16:06:30.772948 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:30.773496 21195 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.813s	user 0.013s	sys 0.007s
I20260811 16:06:30.773674 13907 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:30.774864 13736 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:06:30.724735 21199 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.775259 20630 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:06:30.772117 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:30.759102 21196 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260811 16:06:30.780975 21290 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260811 16:06:30.714823 21058 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.728638 21018 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.724654 21126 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.788239 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:30.776391 21313 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:30.800271 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 77164.8us
I20260811 16:06:30.799875 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:30.783869 21288 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260811 16:06:30.813855 21318 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:30.814332 21318 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.814687 21318 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:30.814873 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:30.816746 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.817149 21018 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.817492 13909 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:30.819324 21200 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.819787 21058 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.821363 13738 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:30.821774 21298 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260811 16:06:30.819833 13907 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260811 16:06:30.824424 21126 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.788252 21195 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.825261 21195 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.827450 21195 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.828425 21199 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:30.831600 13744 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:30.832288 13904 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:30.833117 13904 raft_consensus.cc:595] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:30.833536 13904 raft_consensus.cc:603] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:06:30.835301 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47171.7us
I20260811 16:06:30.835829 21193 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.836741 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:30.840183 13904 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:30.840101 21300 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:30.841243 21134 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.841804 21300 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:30.843156 21287 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260811 16:06:30.852021 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.852988 14578 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260811 16:06:30.853853 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:30.853951 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2538) took 1004 ms. Trace:
I20260811 16:06:30.854113 21249 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:30.854853 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.855553 21182 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:30.855867 21138 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:30.856168 21182 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:30.856415 21138 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.856871 21138 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:30.857049 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:30.850679 21228 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.834s	user 0.006s	sys 0.017s
I20260811 16:06:30.857196 21182 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.857765 13906 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:30.857970 21228 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.858465 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.858752 21182 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:30.854585 13820 rpcz_store.cc:276] 0811 16:06:29.849477 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.849672 (+   195us) service_pool.cc:227] Handling call
0811 16:06:29.850163 (+   491us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:29.890204 (+ 40041us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:29.890238 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:29.890792 (+   554us) log.cc:842] Serialized 52 byte log entry
0811 16:06:30.049014 (+158222us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:30.049072 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:30.049170 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:30.853717 (+804547us) raft_consensus.cc:1671] finished
0811 16:06:30.853743 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:30.853892 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39546,"raft.queue_time_us":40386,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":147875,"threads_started":1,"wal-append.queue_time_us":308674}
I20260811 16:06:30.855576 13909 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:30.860335 21228 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.859707 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.839562 13627 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 6 to 12, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 12 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:06:30.783108 21130 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260811 16:06:30.799388 21202 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.872011 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.847836 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.849663 14577 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:06:30.843806 14580 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:30.875095 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.875996 14574 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260811 16:06:30.877444 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.869678 21130 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.878993 21250 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:30.879505 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.879918 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.880419 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.872807 14573 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:30.881309 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:30.835368 21074 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.007s
I20260811 16:06:30.830955 21017 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:30.879824 21130 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.882625 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:30.883383 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:30.846256 21199 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
W20260811 16:06:30.850580 21240 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.828s	user 0.014s	sys 0.007s
W20260811 16:06:30.850330 21124 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.007s
W20260811 16:06:30.850054 21060 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.006s
W20260811 16:06:30.886839 21292 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260811 16:06:30.885110 21198 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:30.887223 21308 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260811 16:06:30.887251 21119 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:30.889088 21200 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:30.889118 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.890233 21224 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.890264 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:30.891685 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:30.904983 13901 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:30.893203 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:30.896292 21243 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.004s
I20260811 16:06:30.915859 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:30.916922 13903 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:30.924439 21254 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:30.925019 21254 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.925384 21254 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:30.914651 21017 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:30.927573 21017 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.927944 21017 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:30.931401 13706 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:30.948037 21320 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:30.948778 21320 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.950615 21283 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.951850 21044 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.903411 21200 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:30.906105 20925 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:30.891995 21228 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260811 16:06:30.956344 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:30.892781 21074 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.893585 20879 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260811 16:06:30.849715 21313 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.914808 21130 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.914712 21199 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:30.955695 13903 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:30.932719 21240 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.985155 13901 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:30.899317 21124 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.899507 21060 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.954783 21195 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:30.990562 20824 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:30.987793 21140 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:30.904289 21198 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:30.967947 21200 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:31.036948 14577 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
W20260811 16:06:31.015434 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 132875us
I20260811 16:06:30.979996 21320 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:30.931629 21224 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:30.988577 13817 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:31.032780 13900 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:30.990579 21202 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:30.933205 21243 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.058171 13901 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:31.096964 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.068112 13739 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:31.072243 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:31.114240 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58980.8us
I20260811 16:06:31.127561 21044 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:31.128916 21320 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:31.129712 21320 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:31.132928 21060 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.069602 21138 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.151083 21243 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.151978 21243 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:31.152452 13909 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:31.157480 21301 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.158155 21301 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.160607 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:31.160984 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:31.161285 13901 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:31.161568 13902 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:31.012387 21130 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.187502 21174 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:31.188319 21224 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:31.188138 21174 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.190366 21198 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.130877 21320 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.193320 21130 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.193689 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.181833 13907 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:31.138846 21138 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.067469 21223 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.014719 21240 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.188689 21124 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.194991 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.321923 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.331358 13736 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 12.
I20260811 16:06:31.268438 13901 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:31.195014 21058 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:31.337239 21058 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.339725 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:31.329988 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2426) took 1980 ms (client timeout 1996 ms). Trace:
W20260811 16:06:31.340745 13735 rpcz_store.cc:269] 0811 16:06:29.349292 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.357222 (+  7930us) service_pool.cc:227] Handling call
0811 16:06:31.328765 (+1971543us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:31.329370 (+   605us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":670096640}
I20260811 16:06:31.343714 21283 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:31.343950 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:31.345636 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:31.346144 13735 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:31.346665 14578 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:31.349159 13735 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:31.309929 21321 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:31.354257 21254 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.037914 20824 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.362100 20824 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.344312 21018 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:31.122738 21202 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.053469 21140 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.342201 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.377647 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.381048 13901 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:31.389573 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.394991 13902 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:31.190376 21174 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.397972 13738 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260811 16:06:31.399588 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:31.399591 13742 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:31.370239 21301 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.372553 21074 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.368916 21240 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.403785 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:31.370174 21182 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.001s
I20260811 16:06:31.395354 21018 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:31.410079 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:31.403892 21196 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.362960 21017 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.324226 21318 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.402874 21124 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:31.421253 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 207864us
I20260811 16:06:31.407996 21322 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:31.329854 21199 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.419763 21138 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:31.418854 21235 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.421797 21196 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.424644 21060 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:31.431943 21228 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.430850 21322 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:31.457573 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.434918 21124 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.429598 21018 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.476037 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2534) took 1674 ms. Trace:
I20260811 16:06:31.458470 21322 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:31.442011 21235 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:31.480866 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50162.3us
I20260811 16:06:31.476658 13822 rpcz_store.cc:276] 0811 16:06:29.801422 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.802039 (+   617us) service_pool.cc:227] Handling call
0811 16:06:29.808551 (+  6512us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:29.839897 (+ 31346us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:06:29.889352 (+ 49455us) log.cc:842] Serialized 14 byte log entry
0811 16:06:29.916961 (+ 27609us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:29.917010 (+    49us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:29.917053 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:29.947031 (+ 29978us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b1800461da0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:31.475688 (+1528657us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b540029fc54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:31.475772 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:31.475952 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27300,"prepare.queue_time_us":76689,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":27421,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10045,"spinlock_wait_cycles":84880000,"thread_start_us":49007,"threads_started":1}
I20260811 16:06:31.483584 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:31.482697 21202 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.490047 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2731) took 1452 ms. Trace:
I20260811 16:06:31.490511 13900 rpcz_store.cc:276] 0811 16:06:30.037667 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.037811 (+   144us) service_pool.cc:227] Handling call
0811 16:06:30.063707 (+ 25896us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:31.077868 (+1014161us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:31.489765 (+411897us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:31.489970 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2228113792}
I20260811 16:06:31.492826 21235 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.493109 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2669) took 1569 ms. Trace:
I20260811 16:06:31.471041 21140 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:31.493556 13739 rpcz_store.cc:276] 0811 16:06:29.925696 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.925895 (+   199us) service_pool.cc:227] Handling call
0811 16:06:29.926260 (+   365us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:31.123436 (+1197176us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:31.492870 (+369434us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001045d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:31.493046 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2591590656}
I20260811 16:06:31.494216 21200 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.495100 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.496285 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2432) took 1439 ms. Trace:
I20260811 16:06:31.505215 13741 rpcz_store.cc:276] 0811 16:06:30.058309 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.816002 (+757693us) service_pool.cc:227] Handling call
0811 16:06:30.847259 (+ 31257us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:30.847605 (+   346us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:30.847635 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:30.857063 (+  9428us) log.cc:842] Serialized 26 byte log entry
0811 16:06:30.989225 (+132162us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:30.989267 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:30.989332 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:31.190574 (+201242us) raft_consensus.cc:1671] finished
0811 16:06:31.190595 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:31.495938 (+305343us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b540020a8d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:31.496204 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":528,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":10779,"spinlock_wait_cycles":71099648,"thread_start_us":131752,"threads_started":1,"wal-append.queue_time_us":181566}
I20260811 16:06:31.507869 21124 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.504560 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:31.509202 21134 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:31.509898 21200 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.510042 21058 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:31.507915 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.513226 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:31.515450 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.516734 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.516173 13901 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:31.518517 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.520740 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:31.522759 14578 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260811 16:06:31.523079 14578 pending_rounds.cc:76] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 10
I20260811 16:06:31.523336 14578 pending_rounds.cc:97] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260811 16:06:31.523566 14578 raft_consensus.cc:2866] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:31.523483 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.524629 13904 raft_consensus.cc:595] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:31.524660 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:31.525489 13900 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:31.525876 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:31.458027 21228 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.531780 21318 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.532191 21228 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.532672 21017 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.533581 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:31.533965 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.659s (SENT) [suppressed 41 similar messages]
I20260811 16:06:31.534394 13739 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:31.535440 21217 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:31.535897 21217 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:31.536267 21217 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:31.537123 21134 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:31.539033 21130 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:31.531806 21196 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.540819 21218 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:31.541460 21218 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.549233 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.550436 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.521232 21138 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:31.552845 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.553609 13739 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:31.556428 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:31.557399 13906 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:31.559572 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:31.560493 13902 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:31.527578 21240 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:31.550203 21228 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:31.580276 13902 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:31.581996 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.582851 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.583660 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:31.586849 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.590453 21058 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:31.591296 21058 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:31.592619 21058 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.596064 13900 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:31.598522 21235 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:31.598534 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.599380 21235 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.600063 21343 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:31.600833 21343 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:31.602135 21343 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.603083 21235 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.603856 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.568218 21228 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:31.613834 21274 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:31.614144 21218 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.614380 21274 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:31.584126 21240 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:31.616073 21240 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.608511 21232 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:31.620708 21232 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:31.621282 21232 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:31.610216 21228 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:31.630347 13906 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:31.637115 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.615921 21274 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.649214 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:31.639078 21325 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.479s	user 0.004s	sys 0.000s
I20260811 16:06:31.707788 21195 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:31.707995 21228 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.746155 21228 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.747066 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:31.747821 13739 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:31.751434 21300 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.689663 21191 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:31.752257 21300 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.752609 21191 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.689426 20826 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.758028 20826 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.709293 21218 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:31.760710 21218 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.764875 21240 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.766381 21195 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:31.767783 21195 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.780602 13902 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:31.785367 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.786571 13741 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:31.723623 21342 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:31.790387 21182 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.790135 21342 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.790985 21182 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:31.793262 21342 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.793505 21182 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.831092 13739 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:31.877171 14541 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:31.645830 21138 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.899923 21204 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:31.900870 21228 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:31.901470 21228 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:31.901629 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2437) took 1035 ms. Trace:
I20260811 16:06:31.902068 13738 rpcz_store.cc:276] 0811 16:06:30.866690 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:31.321627 (+454937us) service_pool.cc:227] Handling call
0811 16:06:31.832655 (+511028us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b54002792d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:31.901566 (+ 68911us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":151142784}
I20260811 16:06:31.908998 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.755115 21300 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:31.755075 21191 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.912475 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3063) took 1046 ms. Trace:
I20260811 16:06:31.920466 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2554) took 1019 ms. Trace:
I20260811 16:06:31.928181 13909 rpcz_store.cc:276] 0811 16:06:30.865833 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.865991 (+   158us) service_pool.cc:227] Handling call
0811 16:06:31.912179 (+1046188us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400142b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:31.912391 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":628334336}
I20260811 16:06:31.928817 13817 rpcz_store.cc:276] 0811 16:06:30.900606 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.900817 (+   211us) service_pool.cc:227] Handling call
0811 16:06:30.915203 (+ 14386us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:31.074767 (+159564us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:31.920139 (+845372us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:31.920390 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":168261504}
W20260811 16:06:31.922123 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.010s	sys 0.009s
W20260811 16:06:31.931227 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.011s	sys 0.009s
W20260811 16:06:31.931634 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 815716us
I20260811 16:06:31.914072 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2435) took 1062 ms. Trace:
I20260811 16:06:31.935552 13736 rpcz_store.cc:276] 0811 16:06:30.851827 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:31.392959 (+541132us) service_pool.cc:227] Handling call
0811 16:06:31.401837 (+  8878us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:31.450165 (+ 48328us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:31.450211 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:31.450268 (+    57us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:31.450311 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:31.913739 (+463428us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54000a91d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:31.913815 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:31.913996 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8759,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":4750,"spinlock_wait_cycles":110174592}
I20260811 16:06:31.903349 20826 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:31.698398 21322 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:31.971782 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.977787 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:31.978825 13741 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:31.991554 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:31.945142 21325 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260811 16:06:31.919577 21174 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:31.994392 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:31.997663 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.003818 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:31.912976 21217 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.006206 21232 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.007112 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:31.937352 21218 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.008373 14578 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260811 16:06:32.008545 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1259) took 1118 ms. Trace:
I20260811 16:06:32.029623 13903 rpcz_store.cc:276] 0811 16:06:30.889738 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.889903 (+   165us) service_pool.cc:227] Handling call
0811 16:06:32.008358 (+1118455us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.008483 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27659648}
I20260811 16:06:32.009487 20787 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:06:32.010253 21322 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.011363 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.011581 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1968) took 1137 ms. Trace:
I20260811 16:06:31.972595 21300 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260811 16:06:32.040504 14577 rpcz_store.cc:276] 0811 16:06:30.873736 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.873858 (+   122us) service_pool.cc:227] Handling call
0811 16:06:32.011389 (+1137531us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.011513 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":332163968}
W20260811 16:06:32.013890 21295 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.434s	user 0.014s	sys 0.020s
I20260811 16:06:32.017303 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:32.046583 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.020716 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:32.028576 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.047467 13902 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:32.012439 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2675) took 1381 ms. Trace:
I20260811 16:06:32.044467 13736 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:31.902500 21228 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.048832 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.049733 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.048012 13744 rpcz_store.cc:276] 0811 16:06:30.631270 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.833148 (+201878us) service_pool.cc:227] Handling call
0811 16:06:30.833445 (+   297us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:30.833786 (+   341us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:06:30.834091 (+   305us) log.cc:842] Serialized 14 byte log entry
0811 16:06:30.987033 (+152942us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:30.987583 (+   550us) log.cc:842] Serialized 26 byte log entry
0811 16:06:30.987733 (+   150us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:30.987768 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:30.988062 (+   294us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:31.627214 (+639152us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:32.012061 (+384847us) raft_consensus.cc:1671] finished
0811 16:06:32.012200 (+   139us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.012372 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26063,"prepare.queue_time_us":4730,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":22981,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":23025,"spinlock_wait_cycles":108915456,"thread_start_us":133640,"threads_started":1,"wal-append.queue_time_us":199290}
I20260811 16:06:32.052737 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.026360 14581 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:32.065896 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.066645 13736 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:32.068217 20826 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:32.068795 20826 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:32.069736 20826 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:32.077104 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54743.8us
I20260811 16:06:32.087118 13741 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:32.036224 20787 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:32.081022 21124 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:32.097797 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2537) took 2239 ms. Trace:
W20260811 16:06:32.094950 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50294.3us
I20260811 16:06:32.099606 13823 rpcz_store.cc:276] 0811 16:06:29.841437 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.841567 (+   130us) service_pool.cc:227] Handling call
0811 16:06:29.841875 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:30.101105 (+259230us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.080568 (+1979463us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540014e454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:32.080760 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":332574976}
I20260811 16:06:32.106349 13902 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:32.109033 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1251) took 2079 ms. Trace:
I20260811 16:06:32.027734 21174 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.111627 13908 rpcz_store.cc:276] 0811 16:06:30.029522 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.035423 (+  5901us) service_pool.cc:227] Handling call
0811 16:06:30.035805 (+   382us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:30.036202 (+   397us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:30.036258 (+    56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:30.043430 (+  7172us) log.cc:842] Serialized 26 byte log entry
0811 16:06:30.139525 (+ 96095us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b48000603d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:06:30.197208 (+ 57683us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:30.197275 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:30.197386 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:32.013224 (+1815838us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:32.108762 (+ 95538us) raft_consensus.cc:1671] finished
0811 16:06:32.108793 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.108958 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":690,"raft.run_cpu_time_us":1678,"raft.run_wall_time_us":95829,"spinlock_wait_cycles":42060800,"thread_start_us":153422,"threads_started":1,"wal-append.queue_time_us":291532}
W20260811 16:06:32.140906 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 92155.6us
I20260811 16:06:32.124912 21337 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:32.157296 21337 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.126562 21352 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:32.142563 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.142087 20787 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.8, Last appended by leader: 8, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.146950 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3066) took 1075 ms. Trace:
I20260811 16:06:32.160812 13907 rpcz_store.cc:276] 0811 16:06:31.071756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:31.071877 (+   121us) service_pool.cc:227] Handling call
0811 16:06:32.146778 (+1074901us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.146894 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":190152960}
I20260811 16:06:32.148597 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1434) took 1382 ms. Trace:
I20260811 16:06:32.161835 13627 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:32.149691 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2671) took 2218 ms. Trace:
I20260811 16:06:32.150419 21174 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.150784 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1388) took 2111 ms. Trace:
I20260811 16:06:32.151167 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1246) took 2349 ms. Trace:
I20260811 16:06:32.151539 21217 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.151063 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.153514 21232 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.154250 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:32.170800 13739 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:32.162540 13735 rpcz_store.cc:276] 0811 16:06:30.766604 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:31.358243 (+591639us) service_pool.cc:227] Handling call
0811 16:06:31.358518 (+   275us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:31.391599 (+ 33081us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:31.391645 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:31.391699 (+    54us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:31.391746 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.148346 (+756600us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:32.148392 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.148536 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":75531648}
I20260811 16:06:32.163061 13742 rpcz_store.cc:276] 0811 16:06:29.931073 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.931238 (+   165us) service_pool.cc:227] Handling call
0811 16:06:31.328973 (+1397735us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:31.400355 (+ 71382us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.148803 (+748448us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:32.149510 (+   707us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400311350. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.149609 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3297076992}
I20260811 16:06:32.164788 14582 rpcz_store.cc:276] 0811 16:06:30.039232 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.039371 (+   139us) service_pool.cc:227] Handling call
0811 16:06:30.039812 (+   441us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:30.581736 (+541924us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.150510 (+1568774us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:32.150701 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1229124480}
I20260811 16:06:32.164867 13905 rpcz_store.cc:276] 0811 16:06:29.801901 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.802169 (+   268us) service_pool.cc:227] Handling call
0811 16:06:29.802562 (+   393us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:29.851778 (+ 49216us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:29.851824 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:29.852428 (+   604us) log.cc:842] Serialized 26 byte log entry
0811 16:06:30.147665 (+295237us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:30.199171 (+ 51506us) log.cc:842] Serialized 14 byte log entry
0811 16:06:30.637102 (+437931us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.150703 (+1513601us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54002c10d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:32.150765 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:32.150840 (+    75us) raft_consensus.cc:1671] finished
0811 16:06:32.150936 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.151057 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7296,"prepare.queue_time_us":51305,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":49427,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":22013,"spinlock_wait_cycles":103257472,"thread_start_us":677708,"threads_started":2,"wal-append.queue_time_us":730042,"wal-append.run_cpu_time_us":3590,"wal-append.run_wall_time_us":1216842}
I20260811 16:06:32.169044 13736 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:32.171128 21019 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:32.178311 13871 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.177073 21019 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.181748 21224 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:32.182600 21343 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.183285 21343 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.179133 21243 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:32.186035 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.161494 21352 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.187680 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2431) took 2131 ms. Trace:
I20260811 16:06:32.188831 21352 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:32.188074 13740 rpcz_store.cc:276] 0811 16:06:30.056341 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.205531 (+149190us) service_pool.cc:227] Handling call
0811 16:06:30.206060 (+   529us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:30.215638 (+  9578us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:30.215674 (+    36us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:30.229002 (+ 13328us) log.cc:842] Serialized 52 byte log entry
0811 16:06:31.915980 (+1686978us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b1800478ae0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:32.106865 (+190885us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:32.106899 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.106969 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:32.185046 (+ 78077us) raft_consensus.cc:1671] finished
0811 16:06:32.185069 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.187604 (+  2535us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9078,"raft.queue_time_us":9817,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":13503,"spinlock_wait_cycles":14274816,"thread_start_us":190672,"threads_started":1,"wal-append.queue_time_us":1942845}
I20260811 16:06:32.178071 20787 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:32.193964 21343 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.199529 21019 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.203832 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:32.204839 14582 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:32.211709 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.212100 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.208837 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:32.201256 21344 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.482s	user 0.001s	sys 0.000s
I20260811 16:06:32.219928 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.215513 21116 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:32.219998 13739 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:32.221107 21343 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:32.218878 21337 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.290670 21126 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:32.290918 20879 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:06:32.229619 21116 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:32.312201 21060 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.321180 21343 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:32.328263 21126 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:32.348654 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.333577 21116 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:32.370642 14578 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260811 16:06:32.373208 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:32.377429 13905 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260811 16:06:32.345816 21343 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:32.338709 20879 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:32.377504 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.383723 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.380461 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:32.386626 21224 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:32.387153 21224 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:32.387593 21224 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:32.375109 14577 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:32.395665 21143 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:32.396512 21143 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.398141 21352 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:32.398990 21352 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.401098 21143 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:32.403388 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.404383 13742 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
W20260811 16:06:32.409108 21291 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.272s	user 0.028s	sys 0.042s
I20260811 16:06:32.354549 21126 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:32.428182 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44571.7us
I20260811 16:06:32.424279 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:32.428994 13908 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:32.339032 21060 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.366750 21243 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.426784 13907 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260811 16:06:32.408653 21352 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:32.425469 21291 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.028s	sys 0.042s
I20260811 16:06:32.422876 21019 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:32.437314 13902 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260811 16:06:32.444752 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.445952 13902 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:32.446838 13908 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:32.433270 21217 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:32.452991 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.454761 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:32.455595 13902 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:32.455650 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.457216 13907 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:32.410764 21361 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260811 16:06:32.466361 13902 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:32.471262 20879 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.436043 21243 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.480428 13905 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:32.483119 21060 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.458199 21018 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:32.484949 21018 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.487320 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:32.488052 21313 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.494848 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:32.447817 21019 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:32.450399 21217 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:32.538897 21217 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:32.542845 21349 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.536s	user 0.004s	sys 0.005s
W20260811 16:06:32.546372 21367 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260811 16:06:32.499740 21019 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:32.547571 21289 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.968s	user 0.025s	sys 0.052s
W20260811 16:06:32.548676 21323 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.408s	user 0.006s	sys 0.013s
W20260811 16:06:32.506108 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1416) took 3209 ms (client timeout 2004 ms). Trace:
W20260811 16:06:32.549922 13737 rpcz_store.cc:269] 0811 16:06:29.297111 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.304811 (+  7700us) service_pool.cc:227] Handling call
0811 16:06:32.505837 (+3201026us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54003476d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.506011 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2143632128}
I20260811 16:06:32.506314 13743 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:32.551062 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2540) took 2604 ms. Trace:
I20260811 16:06:32.549757 21243 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.551514 13827 rpcz_store.cc:276] 0811 16:06:29.946582 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.946769 (+   187us) service_pool.cc:227] Handling call
0811 16:06:29.947111 (+   342us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:29.947546 (+   435us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:29.947577 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:29.951694 (+  4117us) log.cc:842] Serialized 26 byte log entry
0811 16:06:30.191166 (+239472us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:30.191214 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:30.191285 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:32.430456 (+2239171us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:32.550768 (+120312us) raft_consensus.cc:1671] finished
0811 16:06:32.550792 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.551000 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":323,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":119,"spinlock_wait_cycles":25395584,"thread_start_us":239019,"threads_started":1,"wal-append.queue_time_us":271775}
I20260811 16:06:32.552796 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36246 (request call id 60) took 1713 ms. Trace:
I20260811 16:06:32.553272 13904 rpcz_store.cc:276] 0811 16:06:30.839858 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.840032 (+   174us) service_pool.cc:227] Handling call
0811 16:06:32.552599 (+1712567us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.552702 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1572290816}
I20260811 16:06:32.555469 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1425) took 1683 ms. Trace:
I20260811 16:06:32.555897 14583 rpcz_store.cc:276] 0811 16:06:30.872292 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.872451 (+   159us) service_pool.cc:227] Handling call
0811 16:06:30.881935 (+  9484us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:30.887555 (+  5620us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:30.887590 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:30.888047 (+   457us) log.cc:842] Serialized 26 byte log entry
0811 16:06:31.926229 (+1038182us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b180033ff40. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:32.050546 (+124317us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:32.050595 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.050672 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:32.148253 (+ 97581us) raft_consensus.cc:1671] finished
0811 16:06:32.148282 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.555276 (+406994us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b54007152d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.555405 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":438,"raft.queue_time_us":3936,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2468,"spinlock_wait_cycles":16392320,"thread_start_us":124130,"threads_started":1,"wal-append.queue_time_us":1254669}
I20260811 16:06:32.515810 21239 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:32.557636 21243 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:32.558248 21243 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.559854 21274 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:32.560377 21243 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.561044 21018 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:32.566279 13623 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 326) took 37114 ms (client timeout 15000 ms). Trace:
I20260811 16:06:32.567739 13627 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:32.569482 13627 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 9 to 13, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:32.521003 21116 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.529364 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:32.536026 21364 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260811 16:06:32.499439 21360 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260811 16:06:32.544359 21327 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.404s	user 0.001s	sys 0.013s
I20260811 16:06:32.513523 21254 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.581064 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:32.583313 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:32.548689 21354 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260811 16:06:32.584724 13627 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:32.590260 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:32.600608 14583 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:32.596596 13739 raft_consensus.cc:595] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:32.602150 13739 raft_consensus.cc:603] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:06:32.617772 13709 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.655s (SENT)
I20260811 16:06:32.618489 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:32.635587 13627 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:06:32.637140 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.92506e+06us
I20260811 16:06:32.630460 20779 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:32.638993 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.639958 21296 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:32.640437 21296 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:32.640817 21296 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:32.644263 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.645733 13789 leader_election.cc:398] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:32.646039 13789 leader_election.cc:401] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:32.647027 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.647696 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2548) took 1906 ms. Trace:
I20260811 16:06:32.648026 21235 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:32.648684 21235 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:32.649780 21258 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:32.649914 21311 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 16
I20260811 16:06:32.630633 21116 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:32.647840 21256 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:32.652051 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:32.655897 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:32.656574 13909 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 21
I20260811 16:06:32.659075 13903 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 6. Preceding OpId from leader: term: 21 index: 8. (index mismatch)
I20260811 16:06:32.648116 13825 rpcz_store.cc:276] 0811 16:06:30.741695 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.743101 (+  1406us) service_pool.cc:227] Handling call
0811 16:06:30.743451 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:32.647362 (+1903911us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:32.647393 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:32.647433 (+    40us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:32.647462 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.647530 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:32.647637 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1895026,"raft.queue_time_us":1898234,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80}
W20260811 16:06:32.654052 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 262157us
I20260811 16:06:32.664721 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:32.670085 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:32.679370 13739 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:32.680744 13739 raft_consensus.cc:595] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:32.681383 13739 raft_consensus.cc:603] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:32.682657 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.683881 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.684369 13904 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260811 16:06:32.689764 21342 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.012s	sys 0.015s
W20260811 16:06:32.690557 21342 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.012s	sys 0.015s
I20260811 16:06:32.695948 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2668) took 2772 ms. Trace:
I20260811 16:06:32.696483 13743 rpcz_store.cc:276] 0811 16:06:29.923692 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:29.923865 (+   173us) service_pool.cc:227] Handling call
0811 16:06:32.506127 (+2582262us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:32.556839 (+ 50712us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.695628 (+138789us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54003476d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:32.695861 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5937653120}
I20260811 16:06:32.704428 13743 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260811 16:06:32.711159 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48618.6us
I20260811 16:06:32.716045 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:32.722700 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.769639 14583 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
W20260811 16:06:32.812248 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 142265us
I20260811 16:06:32.813479 13825 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
W20260811 16:06:32.814177 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91602.4us
I20260811 16:06:32.814965 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:32.815124 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.815758 13823 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:32.811409 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 105052us
I20260811 16:06:32.653630 21226 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:32.662267 21172 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.817482 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.811443 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:32.828774 13627 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 9 to 12, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 12 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:32.677027 21223 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.811751 21044 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:32.841518 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:32.802605 21258 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.842326 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.833701 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:32.719729 20884 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:32.724367 21333 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:32.681510 21114 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.151s
I20260811 16:06:32.681679 21337 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.147s
I20260811 16:06:32.724218 21074 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:32.846647 13739 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:32.831881 20782 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:32.714079 21200 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260811 16:06:32.877838 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.811344 21218 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:32.566788 13623 rpcz_store.cc:269] 0811 16:05:55.451983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:55.508768 (+ 56785us) service_pool.cc:227] Handling call
0811 16:06:32.566015 (+37057247us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:06:16.431508 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:06:16.432136 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:06:16.432189 (+    53us) write_op.cc:435] Acquired schema lock
0811 16:06:16.432222 (+    33us) tablet.cc:660] Decoding operations
0811 16:06:16.434453 (+  2231us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:06:16.434560 (+   107us) write_op.cc:641] Partition lock acquired for write op
0811 16:06:16.434619 (+    59us) tablet.cc:683] Acquiring locks for 27 operations
0811 16:06:16.514584 (+ 79965us) tablet.cc:699] Row locks acquired
0811 16:06:16.514631 (+    47us) write_op.cc:260] PREPARE: finished
0811 16:06:16.514849 (+   218us) write_op.cc:270] Start()
0811 16:06:16.515023 (+   174us) write_op.cc:276] Timestamp: P: 1786464376514765 usec, L: 0
0811 16:06:16.515069 (+    46us) op_driver.cc:331] REPLICATION: starting
0811 16:06:16.581680 (+ 66611us) log.cc:842] Serialized 10739 byte log entry
0811 16:06:18.397516 (+1815836us) op_driver.cc:444] REPLICATION: finished
0811 16:06:18.680383 (+282867us) write_op.cc:301] APPLY: starting
0811 16:06:18.706845 (+ 26462us) tablet.cc:1365] starting BulkCheckPresence
0811 16:06:19.717783 (+1010938us) tablet.cc:1368] finished BulkCheckPresence
0811 16:06:19.717978 (+   195us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:06:21.677935 (+1959957us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:06:21.678569 (+   634us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0811 16:06:21.678662 (+    93us) write_op.cc:312] APPLY: finished
0811 16:06:21.694496 (+ 15834us) log.cc:842] Serialized 236 byte log entry
0811 16:06:22.146892 (+452396us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:22.183709 (+ 36817us) write_op.cc:454] Released schema lock
0811 16:06:22.234359 (+ 50650us) write_op.cc:341] FINISH: Updating metrics
0811 16:06:22.311611 (+ 77252us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:22.316926 (+  5315us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197774,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":223297,"apply.run_cpu_time_us":101847,"apply.run_wall_time_us":3714257,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116771,"num_ops":27,"prepare.queue_time_us":1046864,"prepare.run_cpu_time_us":36277,"prepare.run_wall_time_us":786660,"raft.queue_time_us":360357,"raft.run_cpu_time_us":9587,"raft.run_wall_time_us":143612,"replication_time_us":1879296,"thread_start_us":1913833,"threads_started":5,"wal-append.queue_time_us":1486993,"wal-append.run_cpu_time_us":39583,"wal-append.run_wall_time_us":3323775}]]}
I20260811 16:06:32.832515 21192 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:32.676662 21060 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.167s
I20260811 16:06:32.817318 20787 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:32.872835 13736 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:32.829901 21226 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:32.936108 21226 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:32.939575 20794 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:06:32.836014 20545 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:32.941577 20545 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.943933 20545 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:32.861044 14583 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:32.889955 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:32.677265 21116 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.172s
I20260811 16:06:32.681627 21235 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:32.908116 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 2.2013e+06us
I20260811 16:06:32.910223 13742 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21.
I20260811 16:06:32.722573 21018 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.137s
I20260811 16:06:32.913859 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:32.919045 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:32.919370 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:32.816897 21249 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260811 16:06:32.917742 13823 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
W20260811 16:06:32.918422 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:32.928786 21192 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:32.929510 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:32.930236 20787 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.907660 20782 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:32.931879 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:32.918479 20908 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:32.983665 13822 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260811 16:06:32.855183 21223 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.909198 20490 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:32.933314 21368 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260811 16:06:32.934320 13627 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 10 to 13, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 13 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:32.857465 21044 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.855003 21333 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:32.983741 14578 raft_consensus.cc:2354] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21.
I20260811 16:06:32.915444 21337 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:33.002669 13627 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 11 to 16, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 16 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:33.003221 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:32.992525 21356 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260811 16:06:32.982959 13612 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74214.5us
I20260811 16:06:32.879062 21256 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:32.969012 21246 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.030s	sys 0.056s
I20260811 16:06:32.993518 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.909271 21074 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.998580 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:32.844267 21172 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.999037 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.911793 20884 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:32.979317 21195 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.017s	sys 0.034s
I20260811 16:06:33.035400 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:32.996073 20908 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:32.983517 20782 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:33.024461 21246 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.031s	sys 0.056s
I20260811 16:06:33.021533 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:33.025869 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:32.924458 21218 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:32.995649 20490 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:33.037075 13627 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:06:33.063548 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 218589us
I20260811 16:06:32.864192 21224 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.047643 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3083) took 1138 ms. Trace:
I20260811 16:06:33.014928 13739 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 19. Ops: []
I20260811 16:06:32.861657 21258 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.011240 21333 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:33.050172 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.076771 13827 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:33.076226 13627 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:33.007537 21337 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:33.024407 21300 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:33.092679 13737 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260811 16:06:33.067107 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 250678us
W20260811 16:06:33.046273 21195 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.017s	sys 0.034s
I20260811 16:06:33.063957 14577 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:06:33.071542 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 241366us
I20260811 16:06:33.066032 13906 rpcz_store.cc:276] 0811 16:06:31.909332 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:31.938087 (+ 28755us) service_pool.cc:227] Handling call
0811 16:06:31.971572 (+ 33485us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:31.972000 (+   428us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:31.972030 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:31.995252 (+ 23222us) log.cc:842] Serialized 52 byte log entry
0811 16:06:32.530916 (+535664us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b1800309640. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:32.691210 (+160294us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:33.020014 (+328804us) log.cc:842] Serialized 14 byte log entry
0811 16:06:33.020883 (+   869us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:33.021789 (+   906us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:33.021851 (+    62us) raft_consensus.cc:1671] finished
0811 16:06:33.045067 (+ 23216us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:33.047540 (+  2473us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10985,"prepare.queue_time_us":252499,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"raft.queue_time_us":24281,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12206,"spinlock_wait_cycles":40662400,"thread_start_us":488141,"threads_started":2,"wal-append.queue_time_us":845591}
I20260811 16:06:33.112341 13871 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21.
I20260811 16:06:33.112893 13871 leader_election.cc:401] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:33.061044 21256 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:33.070003 20490 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:33.123802 21337 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:33.126333 21343 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.006s
I20260811 16:06:33.128026 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.128997 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2552) took 2326 ms. Trace:
I20260811 16:06:33.129279 21337 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:33.130544 21373 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260811 16:06:33.131661 13871 leader_election.cc:398] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21.
I20260811 16:06:33.075577 21200 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:33.084508 21070 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:33.129398 13826 rpcz_store.cc:276] 0811 16:06:30.802655 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.802876 (+   221us) service_pool.cc:227] Handling call
0811 16:06:30.803400 (+   524us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:32.648592 (+1845192us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:32.648621 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:32.649160 (+   539us) log.cc:842] Serialized 52 byte log entry
0811 16:06:32.848284 (+199124us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:32.848347 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.848477 (+   130us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:33.128775 (+280298us) raft_consensus.cc:1671] finished
0811 16:06:33.128798 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:33.128938 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1842215,"raft.queue_time_us":1844533,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":198652,"threads_started":1,"wal-append.queue_time_us":425340}
I20260811 16:06:33.128386 20908 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:33.115746 13909 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:33.145174 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:33.146728 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 1981) took 1598 ms. Trace:
I20260811 16:06:33.147198 14574 rpcz_store.cc:276] 0811 16:06:31.547904 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:31.548035 (+   131us) service_pool.cc:227] Handling call
0811 16:06:31.550466 (+  2431us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:31.550854 (+   388us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:06:32.181690 (+630836us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b1800396f40. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:06:32.435935 (+254245us) log.cc:842] Serialized 14 byte log entry
0811 16:06:32.828766 (+392831us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:32.829243 (+   477us) log.cc:842] Serialized 26 byte log entry
0811 16:06:32.829391 (+   148us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:32.829422 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:32.829509 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:33.133647 (+304138us) raft_consensus.cc:1671] finished
0811 16:06:33.146428 (+ 12781us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:33.146648 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":189160,"prepare.queue_time_us":39807,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":156228,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":22336,"spinlock_wait_cycles":6076800,"thread_start_us":493239,"threads_started":2,"wal-append.queue_time_us":395070}
I20260811 16:06:33.117242 20787 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.169909 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.171129 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:33.126883 21343 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.144897 21203 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21.
I20260811 16:06:33.196750 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:33.192479 14579 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260811 16:06:33.085372 21382 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260811 16:06:33.120632 21254 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260811 16:06:33.166694 21200 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:33.172447 21380 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:33.085379 21192 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:33.135283 21359 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.052s
W20260811 16:06:33.203794 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.659s (SENT)
I20260811 16:06:33.217017 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:33.195914 21189 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:33.202373 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 397408us
W20260811 16:06:33.227846 13709 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.596s (SENT)
I20260811 16:06:33.148869 21195 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260811 16:06:33.173827 21070 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:33.211664 13740 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16.
W20260811 16:06:33.204396 13686 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 5088cdd3f79d4c47ba826dc820b3cfaf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:06:33.214223 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 401203us
I20260811 16:06:33.202039 20879 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:33.253266 20879 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:33.192334 21374 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260811 16:06:33.253736 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.255904 20879 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.200369 21228 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:33.139853 21256 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.246198 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.248272 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.250661 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.252921 21070 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.292750 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.225378 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.256399 21258 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:33.256801 21377 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260811 16:06:33.256877 21392 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:33.333070 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.262264 21311 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.004s
I20260811 16:06:33.263253 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2551) took 2476 ms. Trace:
W20260811 16:06:33.265442 21378 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.343s	user 0.004s	sys 0.004s
W20260811 16:06:33.285018 21385 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260811 16:06:33.229519 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:33.277804 13909 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:33.217906 21382 consensus_queue.cc:1225] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260811 16:06:33.279968 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.186769 21226 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.290783 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.180181 20884 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:33.334653 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.338582 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48209.9us
I20260811 16:06:33.343601 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.287127 21223 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:33.345157 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 177735us
I20260811 16:06:33.395586 13827 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:33.342644 13824 rpcz_store.cc:276] 0811 16:06:30.787406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:30.787598 (+   192us) service_pool.cc:227] Handling call
0811 16:06:30.787999 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:32.852440 (+2064441us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:32.852487 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:32.862529 (+ 10042us) log.cc:842] Serialized 26 byte log entry
0811 16:06:33.154834 (+292305us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:33.154867 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:33.154949 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:33.262971 (+108022us) raft_consensus.cc:1671] finished
0811 16:06:33.262997 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:33.263185 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1859057,"raft.queue_time_us":1862358,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":435502,"threads_started":2,"wal-append.queue_time_us":382870}
I20260811 16:06:33.254688 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.402698 13822 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:06:33.406307 13823 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:33.383311 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:33.324342 21044 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:33.279510 20545 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
W20260811 16:06:33.394919 21217 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.005s
I20260811 16:06:33.413488 13818 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:33.414112 13820 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:06:33.414479 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.289960 21074 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:33.434221 21296 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.007s
I20260811 16:06:33.436268 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.342217 21274 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.011s
W20260811 16:06:33.415879 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 70002.5us
W20260811 16:06:33.412009 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 184089us
I20260811 16:06:33.385154 21311 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:33.447023 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.393795 21200 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.413350 21389 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:33.456568 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.440486 21126 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.005s
I20260811 16:06:33.346781 21370 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.097s
I20260811 16:06:33.293658 21228 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.471812 13736 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:33.438444 21224 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.492731 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.347720 21392 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:33.496074 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.502940 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.505568 13871 leader_election.cc:398] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16.
I20260811 16:06:33.494335 21343 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.462965 21218 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:33.541078 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.504886 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85208.2us
I20260811 16:06:33.511272 13820 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
W20260811 16:06:33.514086 21386 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260811 16:06:33.552531 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:33.515666 21397 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260811 16:06:33.584470 13737 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:06:33.518702 13826 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260811 16:06:33.520056 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.586333 13822 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:33.529544 13824 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:33.504004 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 120796us
I20260811 16:06:33.538185 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:33.595975 14573 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:33.502596 21095 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:33.530011 13823 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
W20260811 16:06:33.510643 21379 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260811 16:06:33.439822 21217 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:33.514923 21394 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260811 16:06:33.435004 21296 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.553320 14580 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:33.554093 13709 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.924s (SENT)
I20260811 16:06:33.595023 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:33.601663 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:33.623386 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69318.2us
W20260811 16:06:33.609181 21409 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260811 16:06:33.610066 21396 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260811 16:06:33.611799 21398 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260811 16:06:33.693881 21116 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:33.687825 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 99604.5us
I20260811 16:06:33.688799 21019 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:33.689927 21189 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:33.628718 14574 raft_consensus.cc:2396] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260811 16:06:33.693984 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 99090.6us
I20260811 16:06:33.604280 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.711787 13821 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:33.715816 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.718765 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:33.529278 21126 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:33.736536 13738 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:33.738754 13824 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:33.739413 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:33.747819 13827 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:33.748390 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.624301 21060 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:33.613874 21256 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.756628 14580 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:33.696491 21019 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.767103 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:33.784804 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.787065 21361 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:33.787698 21361 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:33.784951 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.788066 21361 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:33.788081 13817 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
W20260811 16:06:33.771643 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.014s	sys 0.038s
I20260811 16:06:33.791824 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:33.791824 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.015s	sys 0.038s
W20260811 16:06:33.763460 21410 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260811 16:06:33.794032 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 768006us
I20260811 16:06:33.740876 21226 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.798957 13739 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:06:33.750671 21274 raft_consensus.cc:2741] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260811 16:06:33.804343 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.806406 13821 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:33.790354 21370 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:33.821400 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.827263 13824 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:33.740049 21189 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:33.836583 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.837442 13824 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22. Re-sending same reply.
I20260811 16:06:33.820361 21239 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260811 16:06:33.851018 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:33.853986 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.856735 13817 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:33.865761 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.866581 13822 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:33.865777 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:33.868650 13739 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:33.825872 21401 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260811 16:06:33.883747 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:33.888583 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:33.888923 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:33.890925 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:33.897840 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:33.907474 21217 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:33.907716 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:33.908234 21407 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.074s
I20260811 16:06:33.908969 21189 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:33.938870 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:33.941176 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.848954 20884 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260811 16:06:33.933786 21070 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:06:33.911374 21416 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260811 16:06:33.982939 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56883.6us
I20260811 16:06:33.994333 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.985064 13709 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.214s (SENT)
I20260811 16:06:33.986793 13822 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:33.858799 20545 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260811 16:06:33.987862 14573 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:33.956832 21192 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:34.045794 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:33.996369 21426 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260811 16:06:34.082492 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:33.854717 21423 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.138s
I20260811 16:06:34.059284 14583 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 19. Ops: []
I20260811 16:06:34.261637 21413 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:34.299907 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2570) took 1104 ms. Trace:
W20260811 16:06:34.303817 21441 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:06:34.258827 21203 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:34.309429 21333 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.194s	user 0.017s	sys 0.003s
W20260811 16:06:34.350857 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 350126us
I20260811 16:06:34.205019 21435 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:34.227519 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 514438us
I20260811 16:06:33.983239 21392 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:34.059681 20490 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.003s
I20260811 16:06:34.118430 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:34.132103 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:34.366519 13902 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260811 16:06:33.912338 21223 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.149s
I20260811 16:06:34.141605 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:34.283382 13817 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:34.368788 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:34.370200 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:34.285694 20782 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.216s	user 0.014s	sys 0.002s
W20260811 16:06:34.259050 21430 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260811 16:06:34.082899 21070 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260811 16:06:34.132194 21192 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:34.157086 21019 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:34.001080 21373 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260811 16:06:34.204409 21400 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:34.221375 21406 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260811 16:06:33.995748 21296 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:34.233676 21420 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260811 16:06:33.913249 21311 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.135s
I20260811 16:06:34.133477 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.431368 21322 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:34.127358 21126 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:34.223635 21337 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.094s	user 0.012s	sys 0.004s
I20260811 16:06:34.307993 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3097) took 1059 ms. Trace:
W20260811 16:06:34.317618 14577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 1995) took 1831 ms (client timeout 1674 ms). Trace:
I20260811 16:06:34.351827 21413 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:34.177806 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 243819us
I20260811 16:06:34.335999 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.111370 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:34.166615 20787 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:34.113426 20545 consensus_queue.cc:1225] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260811 16:06:34.339927 13821 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.004s
I20260811 16:06:34.342026 13826 rpcz_store.cc:276] 0811 16:06:33.195931 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.202445 (+  6514us) service_pool.cc:227] Handling call
0811 16:06:33.202777 (+   332us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:33.585353 (+382576us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:34.299567 (+714214us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54000983d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:34.299831 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":725820672}
I20260811 16:06:34.358374 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:34.362849 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:34.363054 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:34.364949 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:34.372480 14575 raft_consensus.cc:1203] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Deduplicated request from leader. Original: 12.12->[13.13-13.13]   Dedup: 13.13->[]
I20260811 16:06:34.373864 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.375250 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:34.379993 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 0556c3c022b74f43b43aa6f25d418e58, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:34.408681 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:34.436765 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:34.495332 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 0556c3c022b74f43b43aa6f25d418e58, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:34.495219 13817 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15. Re-sending same reply.
W20260811 16:06:34.436757 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60679.1us
I20260811 16:06:34.375474 21431 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:34.258701 21114 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:34.496080 13821 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:34.446977 21256 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:34.497452 14575 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260811 16:06:34.493350 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:34.516058 14582 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:06:34.451632 13820 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
W20260811 16:06:34.516824 13709 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.532s (SENT)
I20260811 16:06:34.516705 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:34.517293 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.517725 14575 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:34.453836 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:34.498741 14577 rpcz_store.cc:269] 0811 16:06:32.486675 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:32.486913 (+   238us) service_pool.cc:227] Handling call
0811 16:06:34.317360 (+1830447us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54006cbe54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:34.317514 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1324060416}
I20260811 16:06:34.497862 13736 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:34.499614 13825 rpcz_store.cc:276] 0811 16:06:33.248187 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.248822 (+   635us) service_pool.cc:227] Handling call
0811 16:06:33.249213 (+   391us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:33.348234 (+ 99021us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:33.348269 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:33.348312 (+    43us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:33.348338 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:34.307642 (+959304us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b540004e054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:34.307720 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:34.307910 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":227192704}
I20260811 16:06:34.357547 21203 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.534886 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:34.504158 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:34.535622 13821 raft_consensus.cc:2362] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17. Re-sending same reply.
I20260811 16:06:34.409356 20782 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:34.357800 21333 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.508886 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.495585 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:34.510120 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:34.517982 13820 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:34.542680 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.554958 14573 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:34.507452 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.542920 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:34.543787 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.557721 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.556880 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.562906 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:34.379685 20490 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.496938 21223 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:34.495070 20787 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:34.570192 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:34.589262 13904 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:34.571192 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:34.589850 13820 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 17
I20260811 16:06:34.504874 21019 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:34.556867 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:34.575941 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.577764 13825 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:34.580581 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:34.586292 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.571671 13905 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:34.631443 13740 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:34.514032 21256 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:34.632150 13826 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:34.646536 13826 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:34.542605 21126 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:34.604888 13909 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:34.639708 13825 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:34.644500 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1445) took 1502 ms. Trace:
I20260811 16:06:34.492364 21400 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.599639 13907 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:06:34.640183 13821 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260811 16:06:34.550370 20884 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:34.645882 14581 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:34.649888 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 93114.3us
I20260811 16:06:34.648084 13817 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260811 16:06:34.651072 13825 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:34.656487 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3105) took 1416 ms. Trace:
I20260811 16:06:34.659075 13820 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:34.665351 13825 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:34.666052 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:34.669358 13709 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.671s (SENT)
I20260811 16:06:34.664924 13908 rpcz_store.cc:276] 0811 16:06:33.239826 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.239954 (+   128us) service_pool.cc:227] Handling call
0811 16:06:33.240296 (+   342us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:33.240526 (+   230us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:33.240550 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:33.279888 (+ 39338us) log.cc:842] Serialized 26 byte log entry
0811 16:06:33.618228 (+338340us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:33.660031 (+ 41803us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:33.660144 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:34.656274 (+996130us) raft_consensus.cc:1671] finished
0811 16:06:34.656299 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:34.656427 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":207808,"threads_started":1,"wal-append.queue_time_us":515832}
I20260811 16:06:34.655267 14578 rpcz_store.cc:276] 0811 16:06:33.141749 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.141932 (+   183us) service_pool.cc:227] Handling call
0811 16:06:33.170384 (+ 28452us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:33.183598 (+ 13214us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:33.183648 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:33.193457 (+  9809us) log.cc:842] Serialized 26 byte log entry
0811 16:06:33.335069 (+141612us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:33.335107 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:33.335306 (+   199us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:34.644250 (+1308944us) raft_consensus.cc:1671] finished
0811 16:06:34.644273 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:34.644435 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12758,"raft.queue_time_us":16373,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8934,"thread_start_us":122608,"threads_started":1,"wal-append.queue_time_us":630754}
I20260811 16:06:34.672431 13817 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:34.676837 13817 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:34.447861 21435 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.496528 21322 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.677634 13817 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:34.533999 21114 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.514125 21431 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.678424 13826 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:34.598196 21223 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.641722 13822 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:34.596222 21192 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:34.679661 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:34.699867 13709 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.563s (SENT)
W20260811 16:06:34.830703 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 166284us
W20260811 16:06:34.658326 21409 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260811 16:06:35.011628 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 311796us
I20260811 16:06:34.707536 13909 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:34.894024 13825 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:35.013267 13820 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260811 16:06:34.696066 14575 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:35.007285 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:35.014786 13826 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:35.030226 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:35.019188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 339615us
W20260811 16:06:35.015807 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 112654us
I20260811 16:06:34.800789 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.656538 21447 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:06:34.894815 21455 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260811 16:06:34.671108 21417 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.683s	user 0.001s	sys 0.001s
I20260811 16:06:34.672019 21443 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
W20260811 16:06:34.855985 21398 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260811 16:06:34.717178 21439 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:06:35.002489 14582 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:34.872694 21458 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:35.026602 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:35.008334 21203 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:34.988446 20779 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:34.652838 21019 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:35.038051 13709 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.248s (SENT)
I20260811 16:06:35.039676 21447 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:35.052002 14580 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260811 16:06:34.895318 20782 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:34.774879 21333 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.061446 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:35.049396 13825 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260811 16:06:35.033705 21449 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:35.077713 13826 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260811 16:06:35.066253 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:34.904754 21361 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.116s	user 0.009s	sys 0.011s
I20260811 16:06:34.746982 20787 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.080603 20787 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:35.080202 21361 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.067380 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:34.716266 21461 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:35.073303 13709 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.731s (SENT)
I20260811 16:06:35.042091 21228 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:35.043746 21413 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.083438 13822 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260811 16:06:35.065371 21226 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.011s	sys 0.009s
I20260811 16:06:34.676947 20884 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:35.146629 21440 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.889s	user 0.000s	sys 0.009s
I20260811 16:06:34.667339 21126 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.058813 21443 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:34.765868 21256 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.105020 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:35.082271 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:35.133111 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:35.140128 21223 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:35.184330 13743 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.062s
I20260811 16:06:35.054854 21414 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260811 16:06:35.144166 21322 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:35.144546 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2453) took 2303 ms (client timeout 1734 ms). Trace:
W20260811 16:06:35.216488 13738 rpcz_store.cc:269] 0811 16:06:32.841123 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:32.841257 (+   134us) service_pool.cc:227] Handling call
0811 16:06:35.144328 (+2303071us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54003430d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:35.144474 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1983879936}
I20260811 16:06:35.145735 21019 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:35.105794 21226 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.012s	sys 0.009s
I20260811 16:06:35.141541 21431 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:35.079490 21447 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:35.213536 13743 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.007s	sys 0.064s
W20260811 16:06:35.209092 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 152171us
I20260811 16:06:35.081292 21435 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.205997 21449 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:35.075066 20779 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.064512 20545 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260811 16:06:35.220006 13901 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:35.102977 21400 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.178741 21461 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.238124 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:35.241670 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:35.217310 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160420us
W20260811 16:06:35.213676 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 174672us
I20260811 16:06:35.073364 21458 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:35.243647 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 205143us
I20260811 16:06:35.520255 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:35.521572 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:35.522482 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 449233us
I20260811 16:06:35.332224 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:35.523558 21126 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.468272 21114 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:35.368957 21465 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
W20260811 16:06:35.257014 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 195353us
I20260811 16:06:35.524338 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:35.530864 13825 raft_consensus.cc:2362] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14. Re-sending same reply.
I20260811 16:06:35.529924 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:35.411969 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.042s	sys 0.079s
W20260811 16:06:35.533001 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.047s	sys 0.084s
I20260811 16:06:35.532853 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:35.535097 13709 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.976s (SENT)
W20260811 16:06:35.536487 13709 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.745s (SENT)
W20260811 16:06:35.537640 13709 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.449s (SENT)
I20260811 16:06:35.538151 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:35.222307 20490 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:35.579182 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:35.580354 13825 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15. Re-sending same reply.
W20260811 16:06:35.582473 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52594.2us
I20260811 16:06:35.233896 21256 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:06:35.584751 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:35.586871 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49268us
I20260811 16:06:35.409880 21223 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:35.591946 13822 raft_consensus.cc:2362] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14. Re-sending same reply.
I20260811 16:06:35.509755 21172 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:35.630295 13743 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260811 16:06:35.314067 21482 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:35.235203 21431 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:35.297760 20884 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.592947 21226 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:35.629086 21217 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.063s	sys 0.087s
I20260811 16:06:35.593634 21414 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:35.292740 21443 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:35.656632 21217 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.063s	sys 0.087s
I20260811 16:06:35.667681 21361 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:35.667963 21490 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260811 16:06:35.668398 14543 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.036s	sys 0.039s
W20260811 16:06:35.668783 14543 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.036s	sys 0.039s
W20260811 16:06:35.670485 21463 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.774s	user 0.000s	sys 0.003s
I20260811 16:06:35.655411 21431 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.673185 21431 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:35.314989 21492 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:35.542826 21192 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:35.629918 20545 consensus_queue.cc:1225] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:06:35.676451 21493 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.033s
I20260811 16:06:35.683813 21492 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:35.701325 21044 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260811 16:06:35.702251 21475 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260811 16:06:35.709161 21447 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.710860 20779 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.673935 21321 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:35.711917 21447 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.699959 21492 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.712349 21321 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.714274 21458 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.714550 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1394) took 2544 ms. Trace:
I20260811 16:06:35.715086 14583 rpcz_store.cc:276] 0811 16:06:33.169731 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.169959 (+   228us) service_pool.cc:227] Handling call
0811 16:06:33.191623 (+ 21664us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:34.348009 (+1156386us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:35.714211 (+1366202us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54007e13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:35.714462 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1994893696}
W20260811 16:06:35.720515 20787 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260811 16:06:35.721961 21461 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.723937 21448 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:35.724433 21448 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:35.725283 21448 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.726658 21448 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:35.714829 21321 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:35.653321 21223 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:35.782934 21428 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.786s	user 0.003s	sys 0.012s
I20260811 16:06:35.796675 21443 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:35.802819 21380 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:35.803728 21380 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:35.811942 21479 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.493s	user 0.005s	sys 0.000s
W20260811 16:06:35.855374 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.008s
W20260811 16:06:35.856523 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.001s	sys 0.010s
W20260811 16:06:35.868160 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 273076us
W20260811 16:06:35.873344 13709 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.820s (SENT)
W20260811 16:06:35.876106 13709 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.836s (SENT)
W20260811 16:06:35.878507 13709 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.733s (SENT)
I20260811 16:06:35.879101 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:35.889932 13737 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 19. Ops: [17.11-17.11]
I20260811 16:06:35.896919 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:35.898586 13743 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:35.894843 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2689) took 1936 ms. Trace:
I20260811 16:06:35.899294 13740 rpcz_store.cc:276] 0811 16:06:33.958510 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.986494 (+ 27984us) service_pool.cc:227] Handling call
0811 16:06:33.986870 (+   376us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:34.643527 (+656657us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:35.893969 (+1250442us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54000a96d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:35.894555 (+   586us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1397688064}
W20260811 16:06:35.903939 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2573) took 2626 ms (client timeout 1684 ms). Trace:
W20260811 16:06:35.904605 13818 rpcz_store.cc:269] 0811 16:06:33.277558 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.279638 (+  2080us) service_pool.cc:227] Handling call
0811 16:06:35.903260 (+2623622us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:35.903615 (+   355us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":43614592}
I20260811 16:06:35.910423 13817 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:35.916627 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 94d079a9604d4ed3832dbb48ba12cd16, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:35.917232 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 94d079a9604d4ed3832dbb48ba12cd16, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:35.919672 13826 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:35.920424 13826 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:35.922545 13826 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:35.926419 13826 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:35.930024 13709 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:35.941304 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3116) took 1437 ms. Trace:
I20260811 16:06:35.941877 13901 rpcz_store.cc:276] 0811 16:06:34.503844 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.504839 (+   995us) service_pool.cc:227] Handling call
0811 16:06:35.940766 (+1435927us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:35.940985 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1509033216}
I20260811 16:06:35.943583 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:35.945591 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 2.0754e+06us
I20260811 16:06:35.932494 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2574) took 2654 ms. Trace:
I20260811 16:06:35.946681 13827 rpcz_store.cc:276] 0811 16:06:33.277874 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.396386 (+118512us) service_pool.cc:227] Handling call
0811 16:06:33.396799 (+   413us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:33.748480 (+351681us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:35.931831 (+2183351us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002dd2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:35.932266 (+   435us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":806616832}
I20260811 16:06:35.951020 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:35.952416 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3109) took 1585 ms. Trace:
I20260811 16:06:35.952883 13909 rpcz_store.cc:276] 0811 16:06:34.366384 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.374920 (+  8536us) service_pool.cc:227] Handling call
0811 16:06:35.951954 (+1577034us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000339d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:35.952212 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":252135296}
I20260811 16:06:35.954828 13818 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: [14.10-15.11]
I20260811 16:06:35.958650 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:35.959719 13820 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:35.952260 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:35.983052 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1439) took 3110 ms (client timeout 2236 ms). Trace:
W20260811 16:06:35.983652 14581 rpcz_store.cc:269] 0811 16:06:32.872484 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:32.872638 (+   154us) service_pool.cc:227] Handling call
0811 16:06:35.982401 (+3109763us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54007e04d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:35.982757 (+   356us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3859682688}
I20260811 16:06:35.985747 21224 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:35.986487 21224 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:35.987573 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:35.988150 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:35.988742 13820 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:35.972925 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 367510us
I20260811 16:06:35.995555 21195 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:35.996513 21195 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:35.993077 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:35.999658 21200 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:35.985843 21019 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:36.005532 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.012521 13818 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.014319 21321 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:36.014999 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.016467 13827 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:36.017382 21448 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:36.022229 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.026942 21223 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.014658 21074 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:36.027251 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:36.027774 21074 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:36.028195 13736 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:36.031524 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.032807 13820 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
W20260811 16:06:36.033257 14544 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.551s (SENT)
I20260811 16:06:36.033880 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:36.035075 21249 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:36.022665 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:36.037582 14581 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:36.027289 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2022) took 1587 ms. Trace:
I20260811 16:06:36.018345 21448 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.049181 21224 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.051542 21019 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.058967 21322 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.059669 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.059820 21322 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.044359 14580 rpcz_store.cc:276] 0811 16:06:34.376905 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.509135 (+132230us) service_pool.cc:227] Handling call
0811 16:06:34.561573 (+ 52438us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:35.075836 (+514263us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:35.962756 (+886920us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400741154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:35.964057 (+  1301us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1096496000}
I20260811 16:06:36.075656 21224 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:36.058192 21195 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.080927 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.063274 21019 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.086478 20879 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:36.092074 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58885.9us
I20260811 16:06:36.093299 20879 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.096750 20879 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.099606 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.100090 21126 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:36.101171 21126 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:06:36.103475 13820 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:36.104133 20794 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260811 16:06:36.091100 21438 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.106753 21438 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.110239 21438 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:36.112869 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.652s (SENT)
I20260811 16:06:36.113444 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:36.115850 21249 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:36.116047 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 192973us
I20260811 16:06:36.116709 21249 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.119524 21228 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:36.119256 21254 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:36.123538 21449 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.124325 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2578) took 2338 ms. Trace:
I20260811 16:06:36.124286 21449 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.125330 21195 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260811 16:06:36.127158 21249 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:36.128175 21471 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:36.124830 13823 rpcz_store.cc:276] 0811 16:06:33.786081 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:33.786653 (+   572us) service_pool.cc:227] Handling call
0811 16:06:33.786997 (+   344us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:33.787272 (+   275us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:33.787298 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:35.904703 (+2117405us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:35.905747 (+  1044us) log.cc:842] Serialized 26 byte log entry
0811 16:06:35.963645 (+ 57898us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:36.020539 (+ 56894us) log.cc:842] Serialized 14 byte log entry
0811 16:06:36.123545 (+103006us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:36.123684 (+   139us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:36.123740 (+    56us) raft_consensus.cc:1671] finished
0811 16:06:36.123886 (+   146us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:36.124122 (+   236us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":105580,"prepare.queue_time_us":100229,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2407,"raft.queue_time_us":100614,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":8050048,"thread_start_us":57282,"threads_started":1,"wal-append.queue_time_us":145509}
W20260811 16:06:36.132074 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.690s (SENT)
I20260811 16:06:36.132992 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:36.136842 13742 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:36.130820 21504 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.138319 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3142) took 1828 ms. Trace:
I20260811 16:06:36.138119 21504 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.138774 13817 rpcz_store.cc:276] 0811 16:06:34.310336 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.667208 (+356872us) service_pool.cc:227] Handling call
0811 16:06:34.667588 (+   380us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:35.909454 (+1241866us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5800a157b0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51887f63 00007f5c518ebaba 00007f5c519033af 00007f5c51904b4e 00007f5c5190ec89 00007f5c5190f556 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684
0811 16:06:36.137832 (+228378us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:06:36.137860 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:36.137898 (+    38us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:36.137954 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:36.138062 (+   108us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:36.138235 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":171,"spinlock_wait_cycles":2040924928}
I20260811 16:06:36.140731 21504 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.146595 13826 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:06:36.132995 21448 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.148468 21322 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.148875 21138 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:36.093319 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.169116 13736 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.177843 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:36.178938 13817 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:36.186028 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.189198 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.188817 21074 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.190024 13739 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.190217 21074 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:36.198524 21437 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:06:36.227236 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55800.3us
I20260811 16:06:36.233578 14581 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
W20260811 16:06:36.243384 21517 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260811 16:06:36.249120 13740 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:36.249830 13735 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:36.253194 13736 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
W20260811 16:06:36.249264 21467 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260811 16:06:36.256304 21449 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.259439 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:36.263504 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.264212 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.286058 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.291654 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.283890 21322 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:36.312961 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:36.314092 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 182085us
I20260811 16:06:36.316577 13736 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:36.319185 13826 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
W20260811 16:06:36.323422 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 693091us
W20260811 16:06:36.333410 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.09515e+06us
I20260811 16:06:36.339807 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:36.351187 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168275us
I20260811 16:06:36.361300 21467 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:36.355353 20779 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260811 16:06:36.365419 13826 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.366444 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.367604 13822 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:36.368774 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:36.375900 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:36.380399 14581 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16.
I20260811 16:06:36.375707 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.378926 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.377202 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:36.386521 13740 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20.
I20260811 16:06:36.386658 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.391322 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.393448 21322 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260811 16:06:36.396726 21524 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:36.397030 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.397575 21524 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:36.408260 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63266.8us
I20260811 16:06:36.392271 21467 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.409436 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:36.410710 13826 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:36.413401 21521 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.414124 21521 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.415266 21524 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.416424 21521 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.413275 13822 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:36.417534 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 89824.4us
I20260811 16:06:36.417563 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:36.422138 14544 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.061s (SENT)
I20260811 16:06:36.422389 21529 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:36.422889 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:36.423468 21529 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.425500 21449 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.426486 21529 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.427067 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2584) took 1471 ms. Trace:
I20260811 16:06:36.427179 21489 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:36.421450 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3108) took 1974 ms. Trace:
I20260811 16:06:36.426153 21449 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.412046 21322 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:36.439628 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.440013 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:36.439874 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.441257 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.441296 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.442979 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.437790 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:36.444100 14582 raft_consensus.cc:2354] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20.
I20260811 16:06:36.444494 13741 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:36.443622 13739 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:36.446967 21522 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260811 16:06:36.447359 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.448246 14573 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:36.449098 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.449627 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:36.432111 21380 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.009s
I20260811 16:06:36.452914 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.452598 21467 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.447073 21224 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:36.453831 21449 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:36.454306 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.453770 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:36.442119 21443 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.573s	user 0.016s	sys 0.005s
I20260811 16:06:36.427635 13821 rpcz_store.cc:276] 0811 16:06:34.927444 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:35.038724 (+111280us) service_pool.cc:227] Handling call
0811 16:06:35.039103 (+   379us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:35.051072 (+ 11969us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:06:35.525002 (+473930us) log.cc:842] Serialized 14 byte log entry
0811 16:06:36.275372 (+750370us) log.cc:842] Serialized 14 byte log entry
0811 16:06:36.316223 (+ 40851us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:36.320231 (+  4008us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:36.330754 (+ 10523us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:36.382171 (+ 51417us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54002db4d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:36.382208 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:36.399017 (+ 16809us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59659,"prepare.queue_time_us":746961,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":36048,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":18190,"spinlock_wait_cycles":26838656,"thread_start_us":1124562,"threads_started":4,"wal-append.queue_time_us":167908}
I20260811 16:06:36.469049 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:36.469554 13822 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:36.472069 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.461166 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.473088 21521 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:36.473866 21521 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.463179 21523 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:36.479372 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.479663 21523 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.465906 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.467197 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.445498 21322 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:06:36.454697 21518 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260811 16:06:36.463899 21224 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.466452 21467 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:36.485363 21523 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.473305 14583 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260811 16:06:36.486956 21322 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.488195 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:36.489159 14583 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:36.491358 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3110) took 2088 ms. Trace:
I20260811 16:06:36.491739 13902 rpcz_store.cc:276] 0811 16:06:34.402755 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.448749 (+ 45994us) service_pool.cc:227] Handling call
0811 16:06:34.449126 (+   377us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:34.449526 (+   400us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:34.449572 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:34.460835 (+ 11263us) log.cc:842] Serialized 26 byte log entry
0811 16:06:35.960064 (+1499229us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b18002d3340. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:36.092980 (+132916us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:36.115256 (+ 22276us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:36.115396 (+   140us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:36.490920 (+375524us) raft_consensus.cc:1671] finished
0811 16:06:36.490941 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:36.491171 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56569,"raft.queue_time_us":111788,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7764,"spinlock_wait_cycles":51254656,"thread_start_us":53161,"threads_started":1,"wal-append.queue_time_us":1718919}
I20260811 16:06:36.474481 21521 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.496958 21521 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.474956 21524 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:36.497840 21524 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.498446 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.475883 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.499505 14574 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:36.499943 13823 raft_consensus.cc:2354] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15.
I20260811 16:06:36.500744 14574 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:36.460937 21380 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.503857 21380 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.476112 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.506104 13820 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:36.476473 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.507445 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:36.477315 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.477312 13818 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260811 16:06:36.480201 14579 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
W20260811 16:06:36.468276 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66223.4us
I20260811 16:06:36.468151 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.457789 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.485427 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:36.507349 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 117405us
I20260811 16:06:36.472167 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.515125 13818 pending_rounds.cc:76] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 12
W20260811 16:06:36.509001 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 56965.1us
I20260811 16:06:36.479544 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.518522 13821 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:36.509697 21380 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:06:36.485242 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.510798 21224 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.432273 13900 rpcz_store.cc:276] 0811 16:06:34.366075 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.366207 (+   132us) service_pool.cc:227] Handling call
0811 16:06:34.366540 (+   333us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:06:34.590660 (+224120us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:34.590695 (+    35us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:06:34.654967 (+ 64272us) log.cc:842] Serialized 78 byte log entry
0811 16:06:35.019753 (+364786us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:35.057989 (+ 38236us) log.cc:842] Serialized 14 byte log entry
0811 16:06:35.939014 (+881025us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18001c41a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:06:36.229944 (+290930us) log.cc:842] Serialized 14 byte log entry
0811 16:06:36.289335 (+ 59391us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:36.313050 (+ 23715us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:36.330841 (+ 17791us) raft_consensus.cc:1671] finished
0811 16:06:36.330867 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:36.340257 (+  9390us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26358,"prepare.queue_time_us":204518,"prepare.run_cpu_time_us":208,"prepare.run_wall_time_us":8342,"raft.queue_time_us":1187096,"raft.run_cpu_time_us":658,"raft.run_wall_time_us":30994,"spinlock_wait_cycles":6079232,"thread_start_us":632269,"threads_started":4,"wal-append.queue_time_us":772712}
I20260811 16:06:36.486876 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.494822 14583 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260811 16:06:36.445906 13871 connection.cc:232] RPC call timeout handler was delayed by -1.4859751199837774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260811 16:06:36.480969 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:36.523800 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0544931349577382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260811 16:06:36.517902 13818 pending_rounds.cc:97] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260811 16:06:36.508556 21524 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.524441 13818 raft_consensus.cc:2866] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:36.520699 13824 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:36.529026 13817 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:36.535319 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.537849 13825 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260811 16:06:36.539111 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:36.540481 14544 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.777s (SENT)
I20260811 16:06:36.541461 13902 raft_consensus.cc:2396] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260811 16:06:36.542543 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.551513 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.552670 13909 raft_consensus.cc:2354] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:36.566478 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.567194 13817 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.577283 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:36.581243 21453 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260811 16:06:36.580271 13902 raft_consensus.cc:2362] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17. Re-sending same reply.
I20260811 16:06:36.592312 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:36.588567 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:36.595775 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60952us
I20260811 16:06:36.597509 13900 raft_consensus.cc:2354] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:36.600980 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.604259 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:36.609359 13825 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.612196 21322 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:36.613080 21435 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:36.616747 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.617682 13817 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:36.619819 21456 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.620600 21456 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.627301 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.628868 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:36.629633 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.630357 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.631322 13909 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260811 16:06:36.632196 13905 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 19. Ops: []
I20260811 16:06:36.632648 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.633450 13909 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:36.627367 13906 raft_consensus.cc:1203] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Deduplicated request from leader. Original: 12.12->[13.13-13.13]   Dedup: 13.13->[]
I20260811 16:06:36.634287 13906 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260811 16:06:36.634565 13901 raft_consensus.cc:1203] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Deduplicated request from leader. Original: 17.9->[18.10-20.11]   Dedup: 20.11->[]
I20260811 16:06:36.635085 13901 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260811 16:06:36.636796 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:36.637231 13907 raft_consensus.cc:1203] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Deduplicated request from leader. Original: 17.6->[19.7-21.8]   Dedup: 21.8->[]
I20260811 16:06:36.637784 13907 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: [19.7-21.8]
I20260811 16:06:36.638211 21523 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:36.638833 21523 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:36.630484 13900 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:36.629940 13903 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260811 16:06:36.643337 21531 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260811 16:06:36.647029 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1292) took 2001 ms. Trace:
I20260811 16:06:36.647473 21525 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.639092 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:36.648252 21525 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.653170 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:36.653865 13817 raft_consensus.cc:2362] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18. Re-sending same reply.
I20260811 16:06:36.646063 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:36.639480 21523 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:36.665099 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:36.666739 21525 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.669462 20879 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:36.640512 21456 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:36.651418 21467 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:36.673411 13902 raft_consensus.cc:1203] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[17.10-17.10]   Dedup: 17.10->[]
I20260811 16:06:36.673616 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:36.675230 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 139992us
I20260811 16:06:36.677053 13902 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260811 16:06:36.647794 13904 rpcz_store.cc:276] 0811 16:06:34.593513 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:34.632827 (+ 39314us) service_pool.cc:227] Handling call
0811 16:06:35.943318 (+1310491us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:36.222795 (+279477us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:36.222843 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:36.311657 (+ 88814us) log.cc:842] Serialized 26 byte log entry
0811 16:06:36.432386 (+120729us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:36.432434 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:36.436533 (+  4099us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:36.519556 (+ 83023us) raft_consensus.cc:1671] finished
0811 16:06:36.519587 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:36.579933 (+ 60346us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000875d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:36.594320 (+ 14387us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":132223,"raft.queue_time_us":158774,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":2986966400,"thread_start_us":192873,"threads_started":2,"wal-append.queue_time_us":157028}
I20260811 16:06:36.688031 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.688966 13817 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:36.686568 21380 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260811 16:06:36.675002 21467 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:36.687018 21453 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:06:36.702080 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.832s (SENT)
I20260811 16:06:36.703809 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.704501 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:36.705037 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:36.705713 13817 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:36.708489 21074 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.008s
W20260811 16:06:36.716223 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77351.5us
I20260811 16:06:36.718827 21529 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:36.715772 21489 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:36.723850 13902 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:36.706681 21380 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:36.728844 13904 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:36.730337 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.731855 13817 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:36.739742 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.741333 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.742741 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.743600 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:36.744020 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:36.745625 13909 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260811 16:06:36.745162 21467 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.746730 21467 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:06:36.749497 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54666.6us
I20260811 16:06:36.747612 13909 pending_rounds.cc:76] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 9
I20260811 16:06:36.754467 13909 pending_rounds.cc:97] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260811 16:06:36.754776 13909 raft_consensus.cc:2866] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:36.762409 13901 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260811 16:06:36.754215 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.770902 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:36.726817 21380 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:36.760665 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.772915 13903 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:36.742493 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:06:36.752920 21534 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.192s	user 0.001s	sys 0.002s
I20260811 16:06:36.776580 13825 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:36.784037 13906 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:36.786075 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:36.754146 21074 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election won for term 16
W20260811 16:06:36.798887 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 155845us
W20260811 16:06:36.801177 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 101791us
I20260811 16:06:36.802994 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.806852 13825 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:36.796741 21529 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:36.800735 21443 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:36.826352 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.811601 21074 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:36.830349 13825 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
W20260811 16:06:36.833029 14544 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.088s (SENT)
I20260811 16:06:36.830760 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:36.832311 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 89971.8us
I20260811 16:06:36.825892 21435 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:36.826205 21529 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:36.843636 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:36.844874 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:36.847396 13818 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:36.848822 13817 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:36.845283 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.828936 21443 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:36.851249 20779 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:36.855266 21443 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.856853 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:36.863718 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.867460 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.868244 13822 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:36.871057 13871 leader_election.cc:398] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16.
I20260811 16:06:36.871479 13871 leader_election.cc:401] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260811 16:06:36.873173 21126 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16.
I20260811 16:06:36.877723 21523 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:36.879189 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54915.6us
W20260811 16:06:36.879966 14544 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.108s (SENT)
I20260811 16:06:36.880332 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:36.881371 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.907s (SENT) [suppressed 54 similar messages]
I20260811 16:06:36.882503 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.858958 21322 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:36.886255 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.883387 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.883260 13821 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:36.886350 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.887367 13826 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:36.896596 13902 raft_consensus.cc:2354] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:06:36.894605 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.900679 13822 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:36.895071 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:36.911476 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:36.911675 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.912901 13827 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:36.914044 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:36.919032 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57999.4us
I20260811 16:06:36.888533 21489 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:36.887243 20879 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:36.856447 21435 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.836700 21380 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.886420 21322 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:36.923882 13824 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:36.926565 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.935472 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.935738 13821 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:06:36.927366 13826 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:06:36.936064 13871 leader_election.cc:398] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20.
I20260811 16:06:36.935330 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.936595 13871 leader_election.cc:401] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:36.932489 13818 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:36.927980 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 111724us
W20260811 16:06:36.940243 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:36.941787 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:36.942512 13744 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:36.948388 21456 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:36.948926 21456 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:36.948807 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.950356 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:36.950002 21456 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.957957 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:36.938295 21322 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:36.927618 21449 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:36.967646 13818 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260811 16:06:36.963599 21521 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:06:36.966599 21529 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:36.965101 21523 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.987238 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:36.988587 21435 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:36.988970 21467 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:36.989614 21467 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:36.991681 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.997030 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:36.997073 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:37.008490 13900 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:36.967410 21456 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:37.014822 21224 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:36.966539 21449 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:37.018158 21489 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:36.938005 21074 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.006166 21380 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:37.037158 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.043922 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.037398 21449 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:37.069794 13744 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:37.072082 13740 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:37.077327 13871 leader_election.cc:398] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20.
I20260811 16:06:37.082679 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:37.087536 21224 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:37.089412 14574 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.017s	sys 0.075s
W20260811 16:06:37.098199 14574 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.017s	sys 0.076s
I20260811 16:06:37.099520 21224 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:37.083984 21467 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:37.106510 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.111387 21523 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:37.110100 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.104214 21138 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:37.127128 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.157315 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:37.160746 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 95970.2us
I20260811 16:06:37.164436 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.215270 21521 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20.
I20260811 16:06:37.218647 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.220369 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:37.247690 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 120679us
I20260811 16:06:37.248946 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.254457 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.255664 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.206162 21523 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:37.271977 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.212574 21467 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:37.277318 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:37.277850 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49618.7us
I20260811 16:06:37.283605 21521 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:37.295646 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.297346 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.304028 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:37.304021 21521 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:06:37.313086 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 431726us
I20260811 16:06:37.313674 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.298213 21529 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:37.316421 21437 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.013s	sys 0.018s
I20260811 16:06:37.313009 21453 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:37.313989 21523 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:37.306967 21467 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.340253 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:37.329356 21437 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.013s	sys 0.018s
W20260811 16:06:37.329641 13907 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.025s
I20260811 16:06:37.330785 21443 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:37.327237 21529 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:37.347415 13907 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.025s
I20260811 16:06:37.328397 21524 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:37.354643 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50695us
W20260811 16:06:37.360520 21407 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.011s
W20260811 16:06:37.361351 21407 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.008s	sys 0.012s
W20260811 16:06:37.361626 21540 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260811 16:06:37.389948 21224 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.360612 21523 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:37.399575 13874 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.034s
W20260811 16:06:37.399893 13874 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.010s	sys 0.034s
W20260811 16:06:37.399302 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.031s
I20260811 16:06:37.350063 21529 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:37.397771 14583 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.032s	sys 0.028s
W20260811 16:06:37.401342 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61217.8us
W20260811 16:06:37.403199 14583 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.033s	sys 0.028s
W20260811 16:06:37.397655 21471 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.018s
W20260811 16:06:37.401996 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.003s	sys 0.031s
I20260811 16:06:37.402585 21521 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:37.402400 21524 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:37.418632 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.012s	sys 0.032s
W20260811 16:06:37.419224 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.013s	sys 0.032s
W20260811 16:06:37.427031 14544 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.817s (SENT)
I20260811 16:06:37.427691 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:37.430821 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.431600 13903 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:37.431396 21521 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.432654 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.433569 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.433707 21524 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.434432 13904 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:37.435444 21239 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:37.435670 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.420734 20879 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:37.436324 13908 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:06:37.436044 21239 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.436744 20879 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:37.431497 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:37.412708 21471 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.015s	sys 0.018s
I20260811 16:06:37.439121 13900 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:06:37.441598 13904 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260811 16:06:37.442483 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:37.444517 14574 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260811 16:06:37.447980 13902 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:37.465402 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:37.467597 20879 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:37.476886 13627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 329) took 39811 ms (client timeout 15000 ms). Trace:
I20260811 16:06:37.480727 21239 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:37.482039 21524 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:37.483574 21467 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:37.484957 21467 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:37.485544 21467 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:37.355790 21443 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:37.488380 21019 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:06:37.488766 21443 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:37.489341 21443 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:37.489787 21443 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:37.445277 21322 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.491405 21224 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:37.493440 21322 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:37.495219 21435 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:37.496658 21435 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:37.496934 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:37.477355 13627 rpcz_store.cc:269] 0811 16:05:57.664945 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:57.674332 (+  9387us) service_pool.cc:227] Handling call
0811 16:06:37.476649 (+39802317us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:06:34.154749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:06:34.295637 (+140888us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:06:34.295694 (+    57us) write_op.cc:435] Acquired schema lock
0811 16:06:34.295712 (+    18us) tablet.cc:660] Decoding operations
0811 16:06:34.297135 (+  1423us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:06:34.297243 (+   108us) write_op.cc:641] Partition lock acquired for write op
0811 16:06:34.297288 (+    45us) tablet.cc:683] Acquiring locks for 16 operations
0811 16:06:34.298490 (+  1202us) tablet.cc:699] Row locks acquired
0811 16:06:34.298527 (+    37us) write_op.cc:260] PREPARE: finished
0811 16:06:34.298706 (+   179us) write_op.cc:270] Start()
0811 16:06:34.298860 (+   154us) write_op.cc:276] Timestamp: P: 1786464394298631 usec, L: 0
0811 16:06:34.298900 (+    40us) op_driver.cc:331] REPLICATION: starting
0811 16:06:34.440794 (+141894us) log.cc:842] Serialized 6424 byte log entry
0811 16:06:35.784586 (+1343792us) op_driver.cc:444] REPLICATION: finished
0811 16:06:35.820932 (+ 36346us) write_op.cc:301] APPLY: starting
0811 16:06:35.821098 (+   166us) tablet.cc:1365] starting BulkCheckPresence
0811 16:06:36.382716 (+561618us) tablet.cc:1368] finished BulkCheckPresence
0811 16:06:36.406859 (+ 24143us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:06:36.623824 (+216965us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:06:36.624271 (+   447us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0811 16:06:36.624338 (+    67us) write_op.cc:312] APPLY: finished
0811 16:06:36.624995 (+   657us) log.cc:842] Serialized 148 byte log entry
0811 16:06:36.659844 (+ 34849us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:36.751191 (+ 91347us) write_op.cc:454] Released schema lock
0811 16:06:36.770916 (+ 19725us) write_op.cc:341] FINISH: Updating metrics
0811 16:06:36.785076 (+ 14160us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:36.785109 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7787919,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":34353,"apply.run_cpu_time_us":34821,"apply.run_wall_time_us":964868,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70879,"num_ops":16,"prepare.queue_time_us":442089,"prepare.run_cpu_time_us":47995,"prepare.run_wall_time_us":593041,"raft.queue_time_us":112281,"raft.run_cpu_time_us":9425,"raft.run_wall_time_us":35259,"replication_time_us":1485566,"thread_start_us":530271,"threads_started":4,"wal-append.queue_time_us":306932}]]}
I20260811 16:06:37.498399 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.500388 21557 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:37.486897 13621 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 18, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 18 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:37.508195 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.511955 13743 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
W20260811 16:06:37.511415 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 110193us
I20260811 16:06:37.553296 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.580169 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.542923 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.497079 21435 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:37.643049 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:37.702499 21543 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260811 16:06:37.502769 13621 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:06:37.701010 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 189195us
I20260811 16:06:37.703684 13621 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 15, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:37.706036 13621 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 13, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 13 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:37.704998 21435 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.709885 21435 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:37.715036 21443 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:37.523607 13905 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.000s
I20260811 16:06:37.718031 21529 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:37.677317 21380 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:37.718573 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 291587us
I20260811 16:06:37.719820 13904 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260811 16:06:37.719558 21380 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:37.720510 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2057) took 1124 ms. Trace:
I20260811 16:06:37.720942 14583 rpcz_store.cc:276] 0811 16:06:36.595874 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:36.596068 (+   194us) service_pool.cc:227] Handling call
0811 16:06:36.605058 (+  8990us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:36.640286 (+ 35228us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:36.640324 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:36.642227 (+  1903us) log.cc:842] Serialized 26 byte log entry
0811 16:06:37.417069 (+774842us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:37.417133 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:37.417212 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:37.720261 (+303049us) raft_consensus.cc:1671] finished
0811 16:06:37.720283 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:37.720451 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5979,"thread_start_us":717860,"threads_started":1,"wal-append.queue_time_us":834086}
I20260811 16:06:37.499101 13909 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:37.718612 13905 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
W20260811 16:06:37.719853 14544 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.035s (SENT)
W20260811 16:06:37.652980 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 166720us
W20260811 16:06:37.674602 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 208749us
I20260811 16:06:37.714855 13907 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:37.691980 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:37.737075 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45013.9us
I20260811 16:06:37.746328 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.754642 13903 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:37.754860 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:37.761847 13739 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:37.774194 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:37.750334 21449 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.008s
I20260811 16:06:37.732931 21521 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:37.783531 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.784513 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.789800 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.787869 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.750119 21443 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:37.821636 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:37.821636 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.822956 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:37.823313 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:37.823640 14578 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:06:37.827591 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.821868 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:37.775132 21524 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:37.833945 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49890us
W20260811 16:06:37.815690 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52304.5us
W20260811 16:06:37.838587 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 118785us
I20260811 16:06:37.789197 21380 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:37.862402 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 170332us
W20260811 16:06:37.864053 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 80604.2us
I20260811 16:06:37.865123 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:37.895587 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:37.895900 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:37.896344 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:37.896638 13818 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:37.897333 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2594) took 1016 ms. Trace:
W20260811 16:06:37.898557 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 152025us
I20260811 16:06:37.898406 13621 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:37.897725 13817 rpcz_store.cc:276] 0811 16:06:36.881033 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:36.881196 (+   163us) service_pool.cc:227] Handling call
0811 16:06:36.881590 (+   394us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:36.881986 (+   396us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:36.882015 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:36.882517 (+   502us) log.cc:842] Serialized 26 byte log entry
0811 16:06:37.320417 (+437900us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:37.320460 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:37.320526 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:37.897138 (+576612us) raft_consensus.cc:1671] finished
0811 16:06:37.897158 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:37.897281 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1219,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":437509,"threads_started":1,"wal-append.queue_time_us":906186}
I20260811 16:06:37.904959 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.904947 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.839232 21467 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:37.837656 21566 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:37.815950 21449 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:37.908449 14544 leader_election.cc:334] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.039s (SENT)
I20260811 16:06:37.937095 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:37.938859 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:37.903349 21380 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:37.895587 21575 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:37.932504 13823 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:37.951591 13817 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260811 16:06:37.930742 21456 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.906s	user 0.017s	sys 0.001s
I20260811 16:06:37.967664 13820 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:37.969034 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:37.969974 13826 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:37.978672 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.980271 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:37.880892 21524 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:37.982679 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:37.926510 20879 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:37.998185 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:37.997295 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.005034 13817 raft_consensus.cc:2362] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17. Re-sending same reply.
I20260811 16:06:38.016386 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:38.017738 13906 raft_consensus.cc:2362] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16. Re-sending same reply.
I20260811 16:06:38.019176 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:38.020155 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:38.022159 13906 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260811 16:06:38.030632 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:38.007393 21534 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260811 16:06:38.032600 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:37.996932 21566 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:37.944948 21443 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260811 16:06:37.985298 21437 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:37.972783 21561 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:38.037355 13817 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:38.037837 13826 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 13: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:38.009258 21467 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:37.996649 21568 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:38.055998 21562 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260811 16:06:38.056808 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:38.057751 13821 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260811 16:06:38.044780 21551 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260811 16:06:38.045532 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 137150us
I20260811 16:06:37.961061 21380 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.059918 13818 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:06:38.060470 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 161129us
W20260811 16:06:38.074337 14544 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.071s (SENT)
I20260811 16:06:38.074911 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:38.079267 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 252043us
I20260811 16:06:38.055307 21568 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.096510 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:38.098713 13903 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:38.107662 21449 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.108146 21524 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.108331 21449 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:38.109119 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:38.110011 13821 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260811 16:06:38.110368 14544 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.173s (SENT)
I20260811 16:06:38.110788 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.112673 13827 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:38.053040 21566 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.133801 13821 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:38.119274 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1276) took 1192 ms. Trace:
I20260811 16:06:38.120707 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:38.122399 21380 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.122337 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:38.062906 21467 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.106434 21529 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.149103 13901 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260811 16:06:38.125924 13902 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:38.128264 21568 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.134382 13820 rpcz_store.cc:276] 0811 16:06:36.908958 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:36.922235 (+ 13277us) service_pool.cc:227] Handling call
0811 16:06:38.101556 (+1179321us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002db4d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:38.101706 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2360700160}
I20260811 16:06:38.127944 13621 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 12 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:38.129225 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:38.135440 13825 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:38.108868 21449 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.129570 21435 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:38.145857 21566 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:38.148841 21544 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.434s	user 0.012s	sys 0.000s
I20260811 16:06:38.148960 21467 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.106056 21561 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:38.161846 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 231038us
I20260811 16:06:38.178663 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2762) took 1438 ms. Trace:
I20260811 16:06:38.183625 13822 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:38.186640 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.189635 14578 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:38.198383 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:38.194666 21570 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:38.190990 21435 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.199621 21572 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.011s
I20260811 16:06:38.200431 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:38.190325 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 98968.4us
I20260811 16:06:38.190909 21019 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:38.201859 21524 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:38.202426 21524 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:38.202859 21524 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:38.202934 21453 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260811 16:06:38.203697 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 78a0d32ee74448a6931819ee7d5e0f59, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:38.204059 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 78a0d32ee74448a6931819ee7d5e0f59, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.201354 21529 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:38.201937 21019 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.190480 13903 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:38.205463 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.197322 13905 rpcz_store.cc:276] 0811 16:06:36.740518 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:36.743331 (+  2813us) service_pool.cc:227] Handling call
0811 16:06:38.166409 (+1423078us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54002ac6d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:38.178579 (+ 12170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":444615552}
I20260811 16:06:38.193159 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:38.207732 13825 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:38.204581 21489 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:38.208561 21529 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:38.194919 21566 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:38.210412 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:38.210680 21566 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.211820 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:38.212031 21019 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.212843 21566 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.213064 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:38.213761 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 103433us
I20260811 16:06:38.185717 21074 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:38.213970 13823 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260811 16:06:38.210456 21529 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:38.215621 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.217432 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.208698 20879 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:38.201551 21435 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.217370 21074 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:38.218232 21321 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:38.222474 21521 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:38.250944 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:38.253933 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 349339us
W20260811 16:06:38.255271 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53911.1us
I20260811 16:06:38.221764 21581 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:38.268594 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:38.273479 21321 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.274382 21074 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.276476 21321 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.276901 21074 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:38.279234 21521 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:38.322459 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 52289.7us
W20260811 16:06:38.319621 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53528.4us
I20260811 16:06:38.335950 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:38.264634 21578 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:38.215705 21556 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.113s
I20260811 16:06:38.337180 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:38.319964 21521 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:38.267475 21019 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:38.344180 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111540us
I20260811 16:06:38.319043 21126 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:06:38.365962 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1975660250755027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260811 16:06:38.366672 13789 connection.cc:232] RPC call timeout handler was delayed by -1.1219660250935704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260811 16:06:38.367028 13789 connection.cc:232] RPC call timeout handler was delayed by -1.108466025092639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260811 16:06:38.367420 13789 connection.cc:232] RPC call timeout handler was delayed by -1.100366024998948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260811 16:06:38.280390 21581 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:38.351598 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.353071 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.354437 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.354893 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:38.360111 21565 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260811 16:06:38.360328 21019 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.361605 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:38.330895 21321 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:38.367753 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0697660250589252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260811 16:06:38.328557 21471 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260811 16:06:38.416234 13739 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:38.431106 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.399044 21581 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:06:38.434145 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72753.7us
I20260811 16:06:38.429682 21321 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.435708 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:38.438102 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:38.446457 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.402290 21224 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:38.404800 21552 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:38.403355 21449 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:38.450230 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 114348us
I20260811 16:06:38.403550 21594 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:38.448988 21572 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:38.504120 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:38.468446 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:38.469439 21561 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.453552 20779 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:38.471822 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:38.472401 21585 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.325s	user 0.000s	sys 0.002s
I20260811 16:06:38.475310 13907 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
W20260811 16:06:38.475884 21569 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260811 16:06:38.476276 21601 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260811 16:06:38.476982 21579 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260811 16:06:38.481660 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77013.9us
I20260811 16:06:38.489439 13825 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:38.500219 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:38.318925 13621 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 12 to 17, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:38.507849 13739 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
W20260811 16:06:38.510305 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53118.4us
I20260811 16:06:38.512869 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:38.513628 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 45270.8us
I20260811 16:06:38.538076 14579 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260811 16:06:38.513180 21584 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
I20260811 16:06:38.485464 21224 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:38.471810 21602 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:38.531082 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:38.545204 14577 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:38.541018 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:38.539705 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.547003 13743 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:38.403393 21578 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.509114 21570 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:38.453895 21453 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260811 16:06:38.518471 21561 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:38.508924 20779 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:38.561021 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:38.563194 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:38.562937 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:38.532851 21525 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:38.564256 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:38.566111 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.533339 21321 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.573853 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:38.572593 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.567546 21592 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:38.576722 21592 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:38.577092 21592 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:06:38.569444 13613 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c390fd23cec5435d81b38a50b2988a60 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5088cdd3f79d4c47ba826dc820b3cfaf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:38.580572 21578 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.581750 21019 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.583880 21224 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.559885 21600 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:38.573764 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:38.588270 21074 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:38.588828 21074 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:38.589212 21074 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:38.569867 21561 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:38.597012 21561 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:38.598949 13903 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:38.599545 21074 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.600181 13903 raft_consensus.cc:595] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.570111 20779 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:38.607405 13903 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:38.608796 13903 raft_consensus.cc:595] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.610193 13903 raft_consensus.cc:603] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:38.610795 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:38.611246 21074 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.611593 13744 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:38.619096 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58841.7us
I20260811 16:06:38.619815 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:38.573233 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:38.631135 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 199611us
I20260811 16:06:38.549274 21602 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:38.642381 13822 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:38.647605 13827 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260811 16:06:38.588263 21599 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260811 16:06:38.632347 21543 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260811 16:06:38.510175 21594 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.676342 13903 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:38.633683 21552 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:38.619022 21525 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.682294 21545 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:38.682721 21545 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:38.683189 21525 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.683725 21545 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.684249 21548 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:38.685179 21545 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:38.568243 21570 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.694696 21521 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.696978 21521 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.680923 21611 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:38.680986 21552 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:38.700183 21552 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.702368 21552 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.703377 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:38.704027 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0148660250706598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260811 16:06:38.704926 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:38.705761 21556 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:38.706185 21556 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:38.706578 21556 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:38.707501 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:38.707516 13789 leader_election.cc:398] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:38.713063 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.714128 21407 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:38.714550 21407 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:38.714906 21407 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:38.715663 21437 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:38.720649 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3123) took 1243 ms. Trace:
I20260811 16:06:38.721103 13900 rpcz_store.cc:276] 0811 16:06:37.476875 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:37.513613 (+ 36738us) service_pool.cc:227] Handling call
0811 16:06:37.730760 (+217147us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:06:37.750547 (+ 19787us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:37.750590 (+    43us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:06:37.773982 (+ 23392us) log.cc:842] Serialized 78 byte log entry
0811 16:06:37.919781 (+145799us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:37.953485 (+ 33704us) log.cc:842] Serialized 14 byte log entry
0811 16:06:37.953840 (+   355us) log.cc:842] Serialized 14 byte log entry
0811 16:06:37.962716 (+  8876us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:37.962808 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:38.228337 (+265529us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b180036dfc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4799 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:38.717241 (+488904us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c8740 00007f5c515bb578 00007f5c515bbcd8 00007f5c515936e8 00007f5c5158eaea 00007f5c5158df36
0811 16:06:38.720430 (+  3189us) raft_consensus.cc:1671] finished
0811 16:06:38.720450 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:38.720592 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20980,"prepare.queue_time_us":184928,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":4695,"raft.queue_time_us":104182,"raft.run_cpu_time_us":543,"raft.run_wall_time_us":33632,"spinlock_wait_cycles":95399424,"thread_start_us":62853,"threads_started":1,"wal-append.queue_time_us":267996}
I20260811 16:06:38.723759 13621 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:38.725630 21570 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.645469 21602 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:38.730394 21529 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.002s
I20260811 16:06:38.731062 21529 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.732040 21592 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.734076 21529 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.643406 21572 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
W20260811 16:06:38.740460 21524 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.005s
I20260811 16:06:38.737452 21592 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:38.731860 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:38.678843 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 243245us
I20260811 16:06:38.752781 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:38.725728 13621 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 16 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:38.757898 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.760207 13736 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:38.760880 13744 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:38.757830 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:38.763383 13739 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 21
I20260811 16:06:38.762501 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:38.767554 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 223230us
I20260811 16:06:38.741357 21524 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.769701 13787 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:38.759261 21594 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:38.773278 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 427342us
I20260811 16:06:38.774163 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.782804 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.790604 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:38.791781 14575 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:38.768505 21592 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:38.738956 20779 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.772392 21074 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:38.802398 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 132388us
I20260811 16:06:38.785818 21566 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:38.795619 21453 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:38.786835 21575 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:38.903571 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:38.906879 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 191984us
I20260811 16:06:38.907703 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.909410 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:38.913264 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.915053 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:38.915371 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.900408 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:38.895552 21074 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:38.918807 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 147720us
I20260811 16:06:38.914325 13736 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:06:38.920066 21615 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260811 16:06:38.938524 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:38.920161 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:38.928905 20779 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.930553 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:38.797348 21581 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.898731 21566 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:38.946918 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 216572us
I20260811 16:06:38.950186 14578 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:38.951943 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54144us
I20260811 16:06:38.926319 21622 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260811 16:06:38.893980 21523 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260811 16:06:38.957577 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:38.913848 21572 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:38.958710 13903 raft_consensus.cc:595] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:38.893479 21407 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.945055 21074 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:38.931758 21611 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:38.963286 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:38.956034 21126 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:38.964968 21602 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.965975 14575 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:38.965317 21581 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:38.959306 21525 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:38.993239 21525 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:38.971607 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:38.972739 21524 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:38.973030 13789 leader_election.cc:398] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:38.996701 13789 leader_election.cc:401] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260811 16:06:38.932127 21548 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.035s
I20260811 16:06:38.978351 13739 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:06:38.979604 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:38.979843 13743 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:06:38.977900 14578 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:38.979982 21407 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:39.004380 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c3ac106c3df9431c9323c322b9f8118b, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.980760 14577 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260811 16:06:39.004729 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c3ac106c3df9431c9323c322b9f8118b, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:38.981215 21523 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:39.007367 21523 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.008329 21523 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.009934 21523 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:39.011494 21548 consensus_queue.cc:1225] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:06:39.016850 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.019541 21594 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 13. Current term is 14.
I20260811 16:06:38.982818 21622 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:38.984352 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:38.986018 14581 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:38.953898 21521 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:38.958554 20779 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:38.989456 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:38.990093 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:38.991408 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:39.026249 14573 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:38.992412 21126 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.029922 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:38.967432 21574 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:39.002660 21605 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260811 16:06:39.032816 13909 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:39.002473 21603 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:39.033970 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:38.998692 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:39.035341 21594 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:39.035612 21602 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:39.035916 21594 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:39.036753 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.036896 21594 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.037968 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.038759 13904 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:39.039291 14579 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:39.028323 13907 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:39.039566 21524 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:39.039932 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.032191 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.037308 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.026904 20779 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:39.041513 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:39.040717 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.032104 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.042171 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.041718 20779 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:39.042485 13905 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:06:39.042785 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:39.042191 13736 raft_consensus.cc:595] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:39.043428 14581 raft_consensus.cc:2362] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15. Re-sending same reply.
I20260811 16:06:39.041524 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:39.044581 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.036940 21126 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.003434 21525 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.047736 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.042311 14579 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
W20260811 16:06:39.050601 14544 connection.cc:232] RPC call timeout handler was delayed by -1.5815374570665881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260811 16:06:39.048465 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.027491 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.047272 21524 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.056847 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:39.057533 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:39.060226 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.064500 13736 raft_consensus.cc:595] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:06:39.064230 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65574.4us
I20260811 16:06:39.064920 13736 raft_consensus.cc:603] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:39.066327 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.071089 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:39.071696 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.072238 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:39.073495 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.027565 21622 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:39.077054 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.062147 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:39.070107 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:39.084470 13903 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: []
I20260811 16:06:39.088673 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:39.078588 13743 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:38.949609 13621 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:39.088544 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:39.100493 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.084195 21622 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:39.085532 21602 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:39.075421 21592 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:39.029994 21556 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.137070 14577 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260811 16:06:39.142407 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.162345 14573 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
W20260811 16:06:39.166757 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104732us
I20260811 16:06:39.145396 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:39.146592 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.147679 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.169085 13903 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:39.030685 21566 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.030923 21548 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260811 16:06:39.082638 21616 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:39.151940 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:39.082633 21575 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:39.157927 21581 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:39.108081 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:39.152846 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.155905 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:39.156314 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.181232 13821 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:39.181473 13826 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:39.069860 21545 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:39.104485 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:39.183264 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:39.188381 21625 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:39.180014 21581 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:39.070168 21600 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260811 16:06:39.190227 21581 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:39.170514 21561 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.001s
I20260811 16:06:39.171169 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.191491 21561 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.180346 20879 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260811 16:06:39.193677 21561 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:39.074528 21611 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260811 16:06:39.168767 21602 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:39.151573 21489 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:39.173559 13824 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
W20260811 16:06:39.176597 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104983us
I20260811 16:06:39.114070 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:39.211819 13817 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:39.087916 21467 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260811 16:06:39.158535 21594 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:39.189244 21625 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.191994 13900 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:39.063382 21574 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.212576 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:39.161336 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.221411 13903 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:39.170035 21239 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:39.223699 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 150250us
I20260811 16:06:39.211472 13824 pending_rounds.cc:76] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 13
I20260811 16:06:39.241484 13824 pending_rounds.cc:97] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260811 16:06:39.241758 13824 raft_consensus.cc:2866] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:06:39.230412 21605 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260811 16:06:39.241039 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:39.174280 21524 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.105770 21624 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.160s
W20260811 16:06:39.265314 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104060us
I20260811 16:06:39.277964 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.294232 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:39.294353 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 266813us
I20260811 16:06:39.301973 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.277390 21595 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:39.222461 21545 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.284121 21561 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:39.315234 13817 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:39.242885 21239 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.261742 21594 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260811 16:06:39.180662 21616 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.250967 21592 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
W20260811 16:06:39.366189 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160070us
W20260811 16:06:39.366708 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65322.8us
W20260811 16:06:39.370216 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71335.4us
I20260811 16:06:39.299252 21449 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:06:39.372457 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 194777us
W20260811 16:06:39.374887 14544 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.806s (SENT)
I20260811 16:06:39.387172 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:39.373721 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65577.8us
I20260811 16:06:39.376912 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.389107 13743 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:39.389748 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.387876 13826 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:39.393647 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.365451 21435 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:06:39.411532 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 117383us
I20260811 16:06:39.412350 13787 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:39.373422 21467 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:39.414376 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:39.375018 21600 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:39.430068 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.404400 21595 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:39.389602 21561 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:39.375524 21602 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.433449 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:39.438804 13737 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:39.421429 21633 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260811 16:06:39.449836 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56227.8us
I20260811 16:06:39.417614 21525 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:39.433380 21449 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:39.428620 21600 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:06:39.469090 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58674.3us
I20260811 16:06:39.405020 21074 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.473197 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.474414 14579 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:39.473297 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:39.468607 21637 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260811 16:06:39.456248 21548 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:39.480365 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 105514us
I20260811 16:06:39.413641 21622 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.467108 21556 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:39.483228 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.470989 21574 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:39.488099 21407 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:39.516633 21407 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:39.517078 21407 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:39.518074 21622 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:39.519250 13904 raft_consensus.cc:2354] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:39.446866 21575 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260811 16:06:39.520702 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:39.526480 13744 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 19
W20260811 16:06:39.528056 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54824.7us
I20260811 16:06:39.529127 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.477017 21449 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:39.544018 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.553175 21449 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.554158 14577 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:39.532656 21586 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260811 16:06:39.542021 21556 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:39.556567 21556 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:39.556667 21591 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:39.557060 21556 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:39.561111 21437 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:06:39.561559 21437 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:39.563060 21467 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:39.563925 21467 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.566286 21467 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.567243 21644 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:39.569142 21074 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.569389 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.570288 21435 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:39.570698 21435 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.571624 21435 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.572877 21435 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:39.563189 21561 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.557106 21591 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.576347 21591 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:39.580008 21640 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260811 16:06:39.581228 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.581683 21636 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:39.582118 21636 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:39.533403 21625 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:39.580104 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:39.594663 21616 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:39.596365 21545 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:39.597280 21239 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:39.598029 20779 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260811 16:06:39.599498 21126 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:06:39.600255 21523 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.590s	user 0.015s	sys 0.000s
I20260811 16:06:39.601147 13906 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:39.601531 21594 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:39.602188 21594 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.606086 21591 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:39.612502 21074 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:39.614492 13744 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:39.615660 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:39.594820 21586 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:06:39.615242 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:39.620850 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.622570 13744 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:39.627950 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:39.630883 14581 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 17
I20260811 16:06:39.631729 13737 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:39.562433 21437 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.638613 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:39.598491 20779 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.635591 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:39.647974 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 112797us
W20260811 16:06:39.651502 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 128074us
I20260811 16:06:39.668467 13737 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260811 16:06:39.649153 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 231480us
I20260811 16:06:39.621389 21586 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:39.682899 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:39.684589 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:39.686721 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.691411 21646 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:39.692788 21594 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.588624 21600 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.695587 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.698207 13739 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:39.670785 21239 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:39.707074 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.673975 20879 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:39.480252 13621 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:39.676853 21592 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:39.718889 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.630600 21074 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.741050 13874 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.747359 21658 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:06:39.747393 21529 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:39.749184 21529 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.736222 20879 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.753329 20879 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.754269 21407 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.582960 21636 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.716950 21239 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:39.750329 21529 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:39.758487 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.763278 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:39.717044 21622 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:39.697139 21616 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260811 16:06:39.769853 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:39.772435 13827 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:39.780287 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:39.784744 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:39.739851 21592 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:39.683697 21586 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.765519 21239 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:39.760150 21126 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:39.839558 21126 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:39.840543 21126 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.821514 21658 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:39.842710 21658 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.843863 21548 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:39.844331 21548 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:39.845183 21658 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.823320 21642 raft_consensus.cc:2741] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260811 16:06:39.778442 21591 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:39.845327 21548 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.846493 21591 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.802552 21561 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260811 16:06:39.849334 21591 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.850358 13621 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:39.735334 21521 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260811 16:06:39.826020 21586 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:39.826344 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.826970 21456 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:39.786473 21471 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:39.831297 13827 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:39.832331 21592 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:39.833431 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 75031.3us
I20260811 16:06:39.785881 21622 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:39.835444 21581 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.014s
I20260811 16:06:39.771191 21611 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:39.836220 20779 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.847088 21548 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:39.857538 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 67071.1us
I20260811 16:06:39.844406 21407 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:39.882220 14581 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:39.884562 21456 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.824932 21074 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:39.892627 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:39.895300 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 169184us
I20260811 16:06:39.895759 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:39.881521 21437 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:39.882468 21561 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:39.908702 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.910621 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:39.907493 13743 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:39.913738 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:39.914618 14581 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:39.911401 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:39.911867 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:39.920132 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 179613us
I20260811 16:06:39.920644 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.921609 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:39.896730 21636 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:39.924872 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:39.944931 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:39.945775 13826 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:39.947441 13904 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:39.950933 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:39.892411 21581 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.967723 14573 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:06:39.986166 13900 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:39.940534 21635 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:40.028108 13821 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260811 16:06:39.918222 21524 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:39.989979 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:39.992717 13908 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
W20260811 16:06:40.003960 21663 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:06:40.015722 21622 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.016512 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.045879 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:40.018327 21456 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.019749 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:40.021348 21659 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260811 16:06:40.022186 21665 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260811 16:06:39.894686 21611 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:39.951444 21646 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:39.962267 21603 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:40.045621 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 52085.6us
I20260811 16:06:40.059670 13903 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:40.072293 14573 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:06:40.104701 13874 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:40.109843 13736 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260811 16:06:40.081741 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:40.072719 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 155514us
I20260811 16:06:40.118229 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:40.082633 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 92740.4us
I20260811 16:06:40.119002 14573 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:40.044312 21321 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.099s
I20260811 16:06:40.160014 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:40.108651 21138 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.154652 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:40.156770 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.072655 21407 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:40.177623 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72999.4us
I20260811 16:06:40.044888 21524 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.187817 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:40.048988 21556 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.122710 21456 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:40.200930 14579 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:40.143894 21594 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:40.202407 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:40.204552 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.122067 21074 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
I20260811 16:06:40.207780 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.143406 21239 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.211733 21456 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:40.189111 21407 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.216670 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1492) took 1014 ms. Trace:
I20260811 16:06:40.190078 21435 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.223387 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:40.229812 13737 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:40.186561 21521 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:40.230636 21521 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:40.189956 21669 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260811 16:06:40.231129 21521 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:39.906679 13621 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 13, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 13 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:40.236860 13621 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:40.252609 21524 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.254027 21556 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:40.254829 21646 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.218192 21671 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260811 16:06:40.254269 21126 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:40.259686 21611 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.259541 21126 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:40.263676 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61369.3us
I20260811 16:06:40.220793 21239 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:40.267657 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:40.285018 14577 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:06:40.221722 14582 rpcz_store.cc:276] 0811 16:06:39.202501 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:39.202753 (+   252us) service_pool.cc:227] Handling call
0811 16:06:39.241062 (+ 38309us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:39.241390 (+   328us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:39.241415 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:39.251527 (+ 10112us) log.cc:842] Serialized 26 byte log entry
0811 16:06:39.711188 (+459661us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:39.711232 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:39.711302 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:40.216432 (+505130us) raft_consensus.cc:1671] finished
0811 16:06:40.216455 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:40.216598 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":55700,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12819,"thread_start_us":414117,"threads_started":1,"wal-append.queue_time_us":613197}
I20260811 16:06:40.220854 21456 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:40.299777 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 218155us
I20260811 16:06:40.214577 21616 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.221560 21644 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:06:40.303066 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.254102 21600 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:40.227943 21581 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.314870 13737 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:40.334152 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:40.281754 21591 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:40.367046 14579 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:06:40.370209 13789 leader_election.cc:398] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:06:40.370733 13789 leader_election.cc:401] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:40.370496 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:40.377182 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 167309us
I20260811 16:06:40.385769 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.387815 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.390731 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:40.360468 21591 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:40.410403 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:40.411608 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:40.448263 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:40.308233 20779 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
I20260811 16:06:40.381060 21453 raft_consensus.cc:2741] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260811 16:06:40.394521 21570 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:40.456374 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.405460 13621 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 9 to 15, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:40.457270 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.458391 20779 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:40.459362 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:40.448562 21126 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.460553 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:40.408941 21407 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:40.461032 13739 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260811 16:06:40.468750 21566 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:40.472366 13743 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260811 16:06:40.480443 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 135615us
I20260811 16:06:40.532606 13901 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:06:40.483112 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 323164us
W20260811 16:06:40.500164 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 43895.6us
I20260811 16:06:40.537117 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.447496 21591 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:40.407773 21449 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:06:40.514393 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260811 16:06:40.506433 21677 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260811 16:06:40.522953 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:40.502731 21617 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:40.503875 21611 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.574314 21521 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.535173 21566 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:40.522656 21581 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:06:40.542296 21680 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260811 16:06:40.542487 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:40.596091 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53717us
I20260811 16:06:40.548220 13826 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:40.555012 13707 leader_election.cc:398] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:40.597385 13707 leader_election.cc:401] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:06:40.539309 21636 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.006s
I20260811 16:06:40.567849 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:40.604501 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:40.569828 13621 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:40.572860 21685 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:40.607921 14577 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260811 16:06:40.573774 21678 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260811 16:06:40.534435 20779 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:40.577080 21321 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:40.609659 21625 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.453061 21642 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260811 16:06:40.610949 21642 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:40.611347 21642 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:40.612215 21642 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.613219 21521 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.516749 21570 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:40.546219 21407 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:40.615576 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:40.615679 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60825.1us
I20260811 16:06:40.619246 21407 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:40.618590 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:40.620855 13739 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:40.621408 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:40.619772 21407 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:40.613788 21642 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:40.626159 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:40.632679 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:40.633095 14583 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:40.633996 13709 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.556s (SENT)
I20260811 16:06:40.634542 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:40.623689 21321 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:40.641142 21594 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:40.632175 21688 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:40.619060 21552 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260811 16:06:40.669996 13826 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260811 16:06:40.686453 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53793.6us
I20260811 16:06:40.689620 13826 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:40.693071 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.700966 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:40.702069 13821 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:40.662181 21658 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:40.657596 21594 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:40.706440 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:40.665016 21686 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:40.723786 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 156112us
I20260811 16:06:40.674598 21322 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:40.725991 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:40.720178 13739 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:40.659004 21126 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260811 16:06:40.683416 21671 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:40.661458 21453 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260811 16:06:40.753835 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:40.768761 13905 raft_consensus.cc:595] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:40.769313 13905 raft_consensus.cc:603] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:40.657382 21621 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.072s
I20260811 16:06:40.719172 20879 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.680649 21602 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260811 16:06:40.715754 21625 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:40.723191 21685 raft_consensus.cc:2741] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260811 16:06:40.722914 21594 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:40.737367 21611 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:40.657869 20779 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.753427 21523 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:40.620414 13621 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 14 to 16, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 16 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:40.783263 21525 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:40.738543 21322 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:40.675774 21688 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.731912 21658 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.826447 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:40.801376 21621 consensus_queue.cc:1225] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:06:40.765298 21595 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
W20260811 16:06:40.816275 21548 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.920s	user 0.012s	sys 0.003s
I20260811 16:06:40.820936 21321 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
W20260811 16:06:40.827903 21695 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260811 16:06:40.840883 14580 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:40.842162 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:40.772403 21671 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.755467 21570 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.848810 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.807504 21625 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.838052 21467 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:40.820433 21525 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:40.837553 21435 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:40.843983 21321 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:40.889279 21658 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:40.883839 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 157979us
I20260811 16:06:40.888923 21321 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:40.860239 21646 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:40.865749 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.891435 13621 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 14 to 18, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 18 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:06:40.868294 21586 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.981s	user 0.015s	sys 0.000s
I20260811 16:06:40.898384 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:40.869552 21592 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:40.894580 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.902422 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.914067 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:40.914754 13905 raft_consensus.cc:595] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:40.883301 21138 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:06:40.915234 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.915401 21138 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:40.915706 21321 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:40.916543 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.916622 21138 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.918265 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.918711 21138 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:40.938572 21074 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:40.907779 21624 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:40.919884 14582 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:40.915087 13905 raft_consensus.cc:603] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:40.935510 21646 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:40.930696 21704 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260811 16:06:40.936709 21688 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.938184 21322 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:40.940114 21625 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:40.932464 21525 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:40.922173 21467 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:40.949219 13744 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:40.950253 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.955241 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:40.961880 14583 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:06:40.990324 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83281us
I20260811 16:06:40.962626 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.959430 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:40.966346 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 205897us
I20260811 16:06:40.990365 14577 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:40.969851 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:40.892715 21435 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.001425 13621 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:40.978117 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:40.953028 21592 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:40.953599 21407 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:40.962280 21594 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.012869 13821 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:40.957412 21624 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:41.010102 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:41.010718 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60579.3us
W20260811 16:06:41.010457 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 315486us
I20260811 16:06:41.012199 13820 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260811 16:06:40.997164 21706 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:06:41.021759 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:41.023404 21708 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:41.025707 21575 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:41.029011 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a48002159c1643c489d152b863d3d839"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:41.032047 21594 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.033623 21624 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.035190 21624 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:41.037775 21708 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:41.039860 14579 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260811 16:06:41.040283 21407 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:41.041811 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:41.042285 21671 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.046880 13738 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:41.048267 21689 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:41.048753 21689 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:41.049633 21689 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.022931 21591 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.056285 13740 raft_consensus.cc:595] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:41.056763 13740 raft_consensus.cc:603] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:41.058529 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:41.062981 13903 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:41.065099 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:41.068348 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:41.009207 21525 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:41.070056 14577 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260811 16:06:41.051044 21689 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:41.072836 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.074676 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.075047 21717 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.091s
I20260811 16:06:41.077368 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:41.096837 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.097939 13903 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:06:41.082026 21435 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:41.098937 13905 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:41.099725 13738 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:41.084600 21718 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260811 16:06:40.997416 21622 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260811 16:06:41.106925 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.107569 13741 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:41.107936 13824 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:41.087608 13621 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:41.090333 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.062131 21671 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:41.114208 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:41.114845 13906 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:41.115882 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.118072 13904 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260811 16:06:41.101361 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.111948 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.112320 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.124933 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.125864 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:41.106958 21646 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260811 16:06:41.111439 21661 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:41.129016 21437 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:41.129631 21437 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:41.131659 21591 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.132099 21672 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260811 16:06:41.116621 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.133242 13908 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:41.137434 13738 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260811 16:06:41.135530 13901 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:41.104460 21525 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.142184 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.144886 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:41.147320 21708 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.147724 21525 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.150177 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.157191 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.158160 13818 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:06:41.150290 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55313.1us
W20260811 16:06:41.152844 14544 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.592s (SENT)
I20260811 16:06:41.153499 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.155081 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:41.160080 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:41.160724 13902 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:41.155515 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.161640 13900 raft_consensus.cc:2354] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:41.138502 21594 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:41.162524 21467 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.162426 21594 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.153199 21592 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.163051 21467 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.163666 21592 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.164556 21594 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.165163 21467 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.152908 21661 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:41.165688 21592 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.166262 13825 pending_rounds.cc:76] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 8
I20260811 16:06:41.166599 13825 pending_rounds.cc:97] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260811 16:06:41.152781 21566 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.166827 13825 raft_consensus.cc:2866] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:41.167563 21566 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:41.130568 21437 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.168735 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.159770 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.138690 21671 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:41.165791 21575 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:41.174779 20779 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:41.160972 21708 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.174526 21525 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.140733 21721 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260811 16:06:41.166007 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:41.196329 13908 raft_consensus.cc:2354] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17.
I20260811 16:06:41.178026 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.171447 13621 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 15, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:06:41.211733 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51824.6us
I20260811 16:06:41.182474 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.183073 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.184319 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:41.212760 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59336.7us
I20260811 16:06:41.182564 13902 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:41.195245 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:41.213932 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.214912 13818 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:06:41.221558 13906 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260811 16:06:41.213032 13824 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:41.213424 13900 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:41.231278 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.234187 13818 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:41.235622 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.237149 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.237526 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.231484 13900 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260811 16:06:41.241565 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.245091 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.195333 21435 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.165719 21661 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.251370 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:41.257982 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45333.5us
I20260811 16:06:41.252771 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.262234 13900 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:06:41.264906 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.196416 21708 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.300396 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.302170 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.303685 13908 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:41.228964 21525 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.232705 21706 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:41.319578 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51875.6us
W20260811 16:06:41.319633 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 124262us
I20260811 16:06:41.332887 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.337266 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:41.338464 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.292s (SENT)
I20260811 16:06:41.339100 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.341773 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.344730 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.348093 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.349303 13739 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:06:41.306265 21661 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:41.262846 21592 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.356518 21710 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:41.356849 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:41.317699 21680 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260811 16:06:41.320254 21467 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:41.364892 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:41.365445 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:41.316365 21437 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.369047 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.369104 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.325778 21693 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260811 16:06:41.381912 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:41.373468 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.256268 21449 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260811 16:06:41.306893 21435 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.391180 13903 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:41.391883 13903 raft_consensus.cc:595] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:41.392223 13903 raft_consensus.cc:603] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:41.323853 21525 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.378249 21636 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:41.401813 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.406127 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.432669 21524 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:41.416693 13820 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:41.399369 21575 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:41.455308 13735 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:41.404467 21574 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.398509 21693 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.375013 21592 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.385392 21453 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
W20260811 16:06:41.402577 21701 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260811 16:06:41.470359 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 131945us
I20260811 16:06:41.464951 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:41.453437 21678 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260811 16:06:41.400125 21642 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:41.476294 13820 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:41.367060 13621 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 15, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:41.471375 21570 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:41.477855 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.495018 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.489365 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.489606 13823 raft_consensus.cc:1203] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 15.9->[17.10-17.10]   Dedup: 17.10->[]
I20260811 16:06:41.455044 21552 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.500248 13823 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260811 16:06:41.387799 21437 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.505182 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.506263 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:41.506867 13735 raft_consensus.cc:595] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:41.507223 13735 raft_consensus.cc:603] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:06:41.479209 21733 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260811 16:06:41.507328 13820 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:41.509187 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:41.479974 21728 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260811 16:06:41.514335 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.518191 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.508261 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.483155 21690 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:41.489053 21435 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:41.524421 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:41.519992 13741 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:41.484659 21592 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.483733 21525 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:41.388131 21671 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.595781 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.596760 13821 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:41.475580 20879 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260811 16:06:41.472208 21574 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.531424 21690 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:41.489609 21570 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.624874 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:41.627856 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:41.628897 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:41.630430 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:41.632597 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.576349 21575 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.508764 21552 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.640192 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1515) took 1022 ms. Trace:
I20260811 16:06:41.642238 14580 rpcz_store.cc:276] 0811 16:06:40.617822 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:40.618270 (+   448us) service_pool.cc:227] Handling call
0811 16:06:40.632658 (+ 14388us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:40.846528 (+213870us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:41.635692 (+789164us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:41.640112 (+  4420us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":477708032}
I20260811 16:06:41.617813 21740 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:41.666307 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2741) took 1956 ms (client timeout 2235 ms). Trace:
I20260811 16:06:41.666776 13737 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260811 16:06:41.666744 13744 rpcz_store.cc:269] 0811 16:06:39.695114 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:39.695326 (+   212us) service_pool.cc:227] Handling call
0811 16:06:41.651790 (+1956464us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:41.651899 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2881537792}
I20260811 16:06:41.664911 21224 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:41.668534 21224 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:41.668921 21224 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:41.669608 21437 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:41.670198 21574 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:41.673431 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.481890 13621 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:41.651934 21708 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:41.722271 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.477252 21693 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.728955 13905 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
W20260811 16:06:41.734107 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50394.2us
I20260811 16:06:41.735252 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.676759 21322 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:41.751708 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 136604us
I20260811 16:06:41.752277 13737 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:06:41.752985 13905 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:41.766855 13903 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260811 16:06:41.744469 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68683.3us
W20260811 16:06:41.744391 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 81442.7us
I20260811 16:06:41.644318 21575 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.756500 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.772274 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:41.770359 13821 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:41.776810 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:41.783833 21735 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260811 16:06:41.786087 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.787619 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.788228 13908 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260811 16:06:41.676056 21690 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.788596 21575 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:41.789072 21690 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:41.680477 21740 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.791903 21685 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:41.792727 21685 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:41.773413 21322 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.685367 21591 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260811 16:06:41.795471 21322 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:41.793411 21740 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:41.757063 21456 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:41.798292 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:41.788272 13822 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:41.803475 21456 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.805905 21456 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.807042 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.807806 13737 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:06:41.807925 21684 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.348s	user 0.007s	sys 0.004s
I20260811 16:06:41.809381 21693 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.811444 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2644) took 1866 ms. Trace:
I20260811 16:06:41.811846 13817 rpcz_store.cc:276] 0811 16:06:39.944944 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:39.945119 (+   175us) service_pool.cc:227] Handling call
0811 16:06:39.990624 (+ 45505us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:40.033173 (+ 42549us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:40.033227 (+    54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:40.035292 (+  2065us) log.cc:842] Serialized 26 byte log entry
0811 16:06:40.269157 (+233865us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:40.307906 (+ 38749us) log.cc:842] Serialized 14 byte log entry
0811 16:06:40.308164 (+   258us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:40.308263 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:41.172688 (+864425us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b18001a92c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:41.807358 (+634670us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:41.811227 (+  3869us) raft_consensus.cc:1671] finished
0811 16:06:41.811249 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:41.811381 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":63232,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5844,"raft.queue_time_us":24767,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":226,"spinlock_wait_cycles":123076608,"thread_start_us":197373,"threads_started":1,"wal-append.queue_time_us":333804}
I20260811 16:06:41.814085 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.814488 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:41.815263 21734 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260811 16:06:41.815346 13908 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:41.798792 20779 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.005s
I20260811 16:06:41.817090 21715 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:41.821861 21715 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:41.823652 21570 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:41.824855 21715 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:41.817934 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.827524 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.828148 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:41.727391 21617 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260811 16:06:41.829596 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.830849 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.831977 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:41.819005 13736 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:41.833081 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.819396 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:41.835851 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63674.4us
I20260811 16:06:41.820520 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:41.834873 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:41.835665 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.837358 13817 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 11.
I20260811 16:06:41.803519 21552 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:41.849916 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49988.1us
I20260811 16:06:41.855569 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.863719 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.865959 13826 raft_consensus.cc:1203] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.12->[14.13-14.13]   Dedup: 14.13->[]
I20260811 16:06:41.866473 13826 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260811 16:06:41.884280 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49480.5us
I20260811 16:06:41.884552 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.885169 13789 leader_election.cc:398] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:41.885447 13789 leader_election.cc:401] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:41.886059 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.886478 13826 raft_consensus.cc:1203] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 13.9->[14.10-19.12]   Dedup: 14.10->[15.11-19.12]
I20260811 16:06:41.886677 13821 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:41.887045 13826 pending_rounds.cc:76] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 10
I20260811 16:06:41.863257 21658 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:06:41.887476 13826 pending_rounds.cc:97] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260811 16:06:41.887610 21658 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:41.887804 13826 raft_consensus.cc:2866] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:41.887988 21658 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:41.888247 21074 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:41.888751 13821 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:06:41.889621 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:41.891779 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:41.893363 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:41.895509 21749 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.002s
I20260811 16:06:41.896287 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:41.897071 13908 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:41.897780 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:41.902207 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:41.903390 13820 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:41.929790 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:41.937959 13789 leader_election.cc:398] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17.
W20260811 16:06:41.900906 13738 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.020s	sys 0.032s
I20260811 16:06:41.846719 21708 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:41.882616 21693 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:41.903733 21661 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.007s
I20260811 16:06:41.906105 21449 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:41.939596 13738 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.020s	sys 0.032s
I20260811 16:06:41.952003 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.953935 13904 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:06:41.867267 21566 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.002s
I20260811 16:06:41.952771 13820 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:41.899377 21074 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:41.986624 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.970427 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:41.993392 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 221623us
I20260811 16:06:41.995790 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.955998 21646 raft_consensus.cc:2741] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260811 16:06:41.998535 13686 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:06:41.965711 21689 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.865s	user 0.011s	sys 0.002s
I20260811 16:06:41.939972 21693 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:41.940928 21661 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:41.968879 21751 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:42.002948 13824 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:06:42.022194 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:41.949210 21636 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
W20260811 16:06:42.028304 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 90558.1us
I20260811 16:06:42.020313 13739 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:42.043876 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b2c264c500bb4a599103d9117a31012d, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.019654 21693 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:42.028264 21689 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:42.044454 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet b2c264c500bb4a599103d9117a31012d, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:42.036504 21706 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.701s	user 0.002s	sys 0.010s
I20260811 16:06:42.075982 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:42.077692 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 122716us
I20260811 16:06:42.044396 21467 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260811 16:06:42.071648 21706 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:42.093537 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:42.076637 21760 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.099701 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:42.096254 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.086745 21437 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.102698 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2532) took 1133 ms. Trace:
I20260811 16:06:42.101038 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:42.078259 21449 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260811 16:06:42.102734 13820 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:42.077752 21646 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260811 16:06:42.070676 21689 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.106299 13736 rpcz_store.cc:276] 0811 16:06:40.969121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:40.969502 (+   381us) service_pool.cc:227] Handling call
0811 16:06:42.102464 (+1132962us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400344ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:42.102617 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1895795072}
W20260811 16:06:42.108958 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 112173us
I20260811 16:06:42.086380 21688 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260811 16:06:42.111876 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:42.113772 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.136648 13820 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:42.137668 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.137785 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:42.098917 21755 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:42.115913 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.099311 21690 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:42.146993 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:42.203559 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:42.204083 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.205390 13823 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:06:42.207403 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.140969 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:42.174392 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85707.6us
W20260811 16:06:42.226318 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 88611.8us
I20260811 16:06:42.227443 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:42.140607 21753 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:06:42.248268 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:42.172359 21617 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.247959 21453 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:42.265895 21453 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:42.266353 21453 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:06:42.266991 21756 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260811 16:06:42.269167 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2755) took 1128 ms. Trace:
I20260811 16:06:42.179224 21636 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:42.272183 21765 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260811 16:06:42.272449 21636 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.274695 21636 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:42.170595 21755 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:42.275425 21755 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:42.278375 21707 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:42.101789 21760 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:42.280123 21757 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260811 16:06:42.281167 21760 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:42.110266 21437 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.282686 21529 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.283236 21529 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.285167 21529 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.269723 13738 rpcz_store.cc:276] 0811 16:06:41.140395 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.142488 (+  2093us) service_pool.cc:227] Handling call
0811 16:06:41.157249 (+ 14761us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.158573 (+  1324us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:41.158604 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:41.215638 (+ 57034us) log.cc:842] Serialized 26 byte log entry
0811 16:06:41.947127 (+731489us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:41.947191 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:41.947258 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:42.268845 (+321587us) raft_consensus.cc:1671] finished
0811 16:06:42.268880 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.269074 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":945,"raft.queue_time_us":12063,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":639065,"threads_started":1,"wal-append.queue_time_us":757042}
I20260811 16:06:42.134923 21224 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:42.307183 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 78226.2us
W20260811 16:06:42.304296 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160012us
I20260811 16:06:42.249543 21661 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.360937 13904 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260811 16:06:42.279096 21707 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:42.364542 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1524) took 1286 ms. Trace:
W20260811 16:06:42.364936 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 161511us
I20260811 16:06:42.342252 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:42.367784 21763 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260811 16:06:42.294562 21529 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:42.383699 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.366804 14574 rpcz_store.cc:276] 0811 16:06:41.078444 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.082264 (+  3820us) service_pool.cc:227] Handling call
0811 16:06:42.358057 (+1275793us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:06:42.358461 (+   404us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:42.358756 (+   295us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:42.358797 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:42.358857 (+    60us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:42.363902 (+  5045us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:42.364179 (+   277us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.364445 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20848384}
I20260811 16:06:42.393571 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:42.412559 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:42.416443 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 241631us
I20260811 16:06:42.423481 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2671) took 1281 ms. Trace:
I20260811 16:06:42.424029 13827 rpcz_store.cc:276] 0811 16:06:41.142426 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.142542 (+   116us) service_pool.cc:227] Handling call
0811 16:06:41.142868 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.161642 (+ 18774us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:06:41.161967 (+   325us) log.cc:842] Serialized 14 byte log entry
0811 16:06:41.327748 (+165781us) log.cc:842] Serialized 14 byte log entry
0811 16:06:41.327932 (+   184us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:41.328442 (+   510us) log.cc:842] Serialized 26 byte log entry
0811 16:06:41.328556 (+   114us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:41.328601 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:41.328689 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:41.487493 (+158804us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b18003b3620. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:42.363669 (+876176us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b2400138ed8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c8740 00007f5c515bb578 00007f5c515bbcd8 00007f5c515936e8 00007f5c5158eaea 00007f5c5158df36
0811 16:06:42.423237 (+ 59568us) raft_consensus.cc:1671] finished
0811 16:06:42.423262 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.423409 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12021,"prepare.queue_time_us":11310,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":21920,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":18179,"spinlock_wait_cycles":145072000,"thread_start_us":162972,"threads_started":1,"wal-append.queue_time_us":246165}
W20260811 16:06:42.434180 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 11dc75ffca384b91994ceec6d295e6e8, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:42.434662 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 11dc75ffca384b91994ceec6d295e6e8, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.436733 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.437927 13824 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260811 16:06:42.385767 21437 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.384665 21529 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.449034 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:42.455771 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:42.452379 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.459084 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:42.460868 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.461310 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:42.462169 13738 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:06:42.463953 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:42.464234 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 104106us
I20260811 16:06:42.297570 21617 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.465787 13736 raft_consensus.cc:2396] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260811 16:06:42.480868 21707 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:42.494234 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:42.443199 21782 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:42.455735 21529 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:42.500151 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.515161 13737 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:06:42.549750 21657 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260811 16:06:42.558221 21784 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:42.560824 21657 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.558650 21806 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:42.561349 21657 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:42.561702 21806 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.559818 21789 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:06:42.562736 21789 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:42.562222 21806 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.563095 21789 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:42.564978 21806 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.475829 21437 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:42.574210 21789 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.576584 21789 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:42.584652 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 88568.8us
I20260811 16:06:42.500344 21689 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:42.583573 21736 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260811 16:06:42.583158 21762 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.469s	user 0.001s	sys 0.001s
I20260811 16:06:42.610303 21777 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.616909 21777 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:42.625808 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 161931us
I20260811 16:06:42.673164 21777 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:42.675061 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:42.682224 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:42.685441 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 196776us
I20260811 16:06:42.690610 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.691767 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.694029 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:42.485939 21707 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.697844 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:42.700613 13741 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:06:42.697011 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 480609us
W20260811 16:06:42.693907 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 214756us
I20260811 16:06:42.684803 21437 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:06:42.703025 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.704959 21437 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:42.703390 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 209278us
W20260811 16:06:42.706431 13709 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.551s (SENT)
I20260811 16:06:42.706913 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:42.682502 21224 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.695657 21689 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.709570 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:42.718261 21770 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.718377 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.726197 13740 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:42.733757 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2544) took 1002 ms. Trace:
I20260811 16:06:42.701774 21575 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.742266 21794 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:42.742765 21575 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.742905 21794 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.703783 21753 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:42.745352 21753 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:42.745076 21575 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.746686 21617 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:42.746966 21801 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260811 16:06:42.746438 21575 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:42.747620 21575 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:42.748657 21766 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.387s	user 0.000s	sys 0.002s
I20260811 16:06:42.741051 21781 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:42.750177 21764 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
I20260811 16:06:42.750106 21781 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.752460 21781 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:42.753296 21793 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260811 16:06:42.746973 21074 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.754s	user 0.005s	sys 0.005s
I20260811 16:06:42.739656 21772 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.758548 21772 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.761014 21772 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:42.745869 21753 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:42.706459 21437 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:42.766255 21453 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:42.767313 21730 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.300s	user 0.005s	sys 0.000s
I20260811 16:06:42.769419 21453 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:42.769893 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2534) took 1680 ms. Trace:
I20260811 16:06:42.737984 21790 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:42.770330 13743 rpcz_store.cc:276] 0811 16:06:41.089531 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.089690 (+   159us) service_pool.cc:227] Handling call
0811 16:06:41.090074 (+   384us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.090491 (+   417us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:41.090525 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:41.091013 (+   488us) log.cc:842] Serialized 26 byte log entry
0811 16:06:41.334646 (+243633us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:41.334706 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:41.334795 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:42.766530 (+1431735us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:42.769577 (+  3047us) raft_consensus.cc:1671] finished
0811 16:06:42.769600 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.769827 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23833,"raft.queue_time_us":5778,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9238,"spinlock_wait_cycles":4177280,"thread_start_us":243231,"threads_started":1,"wal-append.queue_time_us":308571}
I20260811 16:06:42.734345 13742 rpcz_store.cc:276] 0811 16:06:41.731766 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.731915 (+   149us) service_pool.cc:227] Handling call
0811 16:06:41.763224 (+ 31309us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.769671 (+  6447us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:41.769703 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:41.779166 (+  9463us) log.cc:842] Serialized 26 byte log entry
0811 16:06:42.057776 (+278610us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:42.057839 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:42.059737 (+  1898us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:42.733544 (+673807us) raft_consensus.cc:1671] finished
0811 16:06:42.733567 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.733697 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29841,"raft.queue_time_us":8462,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":106,"thread_start_us":278234,"threads_started":1,"wal-append.queue_time_us":314770}
W20260811 16:06:42.740160 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43625.5us
I20260811 16:06:42.741711 21805 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.754926 21074 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:06:42.779762 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:42.745190 21794 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:42.781987 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:42.788079 13817 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:42.796214 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86713.8us
I20260811 16:06:42.796051 13741 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:06:42.756245 21575 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:42.752511 21741 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:42.795760 21617 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.826869 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:42.828644 13905 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260811 16:06:42.787539 21138 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:42.737795 21689 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:42.840476 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134062us
I20260811 16:06:42.775939 21657 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.738997 21770 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.834947 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.835453 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.857026 13905 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:42.826679 21751 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.791s	user 0.014s	sys 0.000s
I20260811 16:06:42.844718 21785 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:42.869643 13871 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.766s (SENT) [suppressed 30 similar messages]
I20260811 16:06:42.870293 21777 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:42.831696 21658 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.943s	user 0.015s	sys 0.000s
I20260811 16:06:42.800463 21805 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.861438 21826 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:42.873788 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2124) took 2241 ms. Trace:
I20260811 16:06:42.881945 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1284) took 1427 ms. Trace:
I20260811 16:06:42.889626 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.890096 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.829766 21453 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:42.900609 14579 rpcz_store.cc:276] 0811 16:06:40.632281 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:40.632474 (+   193us) service_pool.cc:227] Handling call
0811 16:06:40.637341 (+  4867us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.040334 (+402993us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:42.873489 (+1833155us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54004bffd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:42.873700 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":925075712}
I20260811 16:06:42.894322 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.879413 21672 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:42.875746 21574 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:42.896016 21775 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.876719 21770 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.882136 21529 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.896646 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.939790 13908 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:06:42.940502 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:42.877981 21437 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.830629 21741 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.945545 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.946295 13740 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:06:42.898206 21657 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:42.948143 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:42.948784 13824 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:42.898762 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.949698 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:42.899088 21815 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260811 16:06:42.901961 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.907401 13827 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:42.869711 21138 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.828058 21617 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.914767 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3202) took 1662 ms. Trace:
I20260811 16:06:42.915944 13821 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:42.916771 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:42.870972 21751 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:06:42.930569 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c3ac106c3df9431c9323c322b9f8118b, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:42.958009 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 131223us
W20260811 16:06:42.959914 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c3ac106c3df9431c9323c322b9f8118b, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.960067 14583 raft_consensus.cc:2354] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:06:42.960923 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:42.931517 13909 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:42.896211 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:42.935720 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:42.876458 21785 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.902973 21658 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.943818 21126 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:42.901326 13822 rpcz_store.cc:276] 0811 16:06:41.454407 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.864786 (+410379us) service_pool.cc:227] Handling call
0811 16:06:41.893889 (+ 29103us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:41.894259 (+   370us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:41.894289 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:41.894883 (+   594us) log.cc:842] Serialized 52 byte log entry
0811 16:06:42.078238 (+183355us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:06:42.088988 (+ 10750us) log.cc:842] Serialized 14 byte log entry
0811 16:06:42.289145 (+200157us) log.cc:842] Serialized 14 byte log entry
0811 16:06:42.881308 (+592163us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18002cefc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:06:42.881496 (+   188us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:42.881567 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:42.881701 (+   134us) raft_consensus.cc:1671] finished
0811 16:06:42.881721 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.881879 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":57901,"prepare.queue_time_us":11014,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":645847,"raft.run_cpu_time_us":2956,"raft.run_wall_time_us":71493,"spinlock_wait_cycles":35254016,"thread_start_us":382550,"threads_started":2,"wal-append.queue_time_us":215172}
I20260811 16:06:42.945238 21685 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:42.957077 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:42.959095 13818 rpcz_store.cc:276] 0811 16:06:41.252229 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.252443 (+   214us) service_pool.cc:227] Handling call
0811 16:06:42.914576 (+1662133us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54002dc8d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:42.914699 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1913757568}
I20260811 16:06:42.962188 13741 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
W20260811 16:06:42.963714 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 94096.8us
W20260811 16:06:42.965557 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1441) took 1892 ms (client timeout 1585 ms). Trace:
W20260811 16:06:42.989575 14583 rpcz_store.cc:269] 0811 16:06:41.068611 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.068733 (+   122us) service_pool.cc:227] Handling call
0811 16:06:42.916598 (+1847865us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:42.960634 (+ 44036us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24670976}
I20260811 16:06:42.930503 21574 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:42.941969 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:42.968333 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 186436us
I20260811 16:06:42.955569 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:42.955700 21777 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:06:42.975871 21755 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.007s
I20260811 16:06:42.997720 21755 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.998291 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:42.921025 21453 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.000830 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.001875 13743 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:43.003238 21453 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:42.977533 21617 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:42.977754 21138 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.000697 21755 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.008450 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.010007 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.011056 13743 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:42.931293 21672 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:42.964649 21785 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:42.975899 21693 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.912s	user 0.004s	sys 0.010s
I20260811 16:06:42.979099 21646 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:42.979900 21824 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:42.980333 21437 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.028631 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.028762 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:42.985055 21592 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:42.941706 21775 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:42.947991 21636 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:42.977982 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1288) took 1466 ms. Trace:
I20260811 16:06:43.039209 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.016507 21529 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:43.017668 21830 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260811 16:06:42.964311 21657 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:43.021266 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79394.7us
I20260811 16:06:43.046689 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:43.022439 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.022650 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:43.022902 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122396us
I20260811 16:06:42.983031 21811 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:43.006824 21574 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:43.025686 21770 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:42.982707 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:43.019327 21521 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.014s	sys 0.018s
I20260811 16:06:43.026183 21126 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:06:42.958841 21760 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
I20260811 16:06:43.032156 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.032335 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.042311 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:42.915273 21826 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.037734 13826 rpcz_store.cc:276] 0811 16:06:41.512000 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.885860 (+373860us) service_pool.cc:227] Handling call
0811 16:06:41.886260 (+   400us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:06:41.904181 (+ 17921us) raft_consensus.cc:1520] Early marking committed up to index 9
0811 16:06:41.904207 (+    26us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:41.904744 (+   537us) log.cc:842] Serialized 52 byte log entry
0811 16:06:42.843411 (+938667us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18004ba540. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:42.977531 (+134120us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:42.977568 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:42.977641 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:42.977705 (+    64us) raft_consensus.cc:1671] finished
0811 16:06:42.977717 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:42.977912 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15679,"raft.queue_time_us":25148,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2940,"spinlock_wait_cycles":36435328,"thread_start_us":133903,"threads_started":1,"wal-append.queue_time_us":1031505}
I20260811 16:06:43.071408 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.072463 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.072930 14580 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:43.051923 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1442) took 1982 ms. Trace:
I20260811 16:06:43.052001 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.052816 21796 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:43.053277 21745 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:42.982749 21753 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.058930 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.059823 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.057098 21529 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:43.062062 21752 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:43.064973 13906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:43.048862 21074 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:43.079303 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.067803 21836 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:43.074723 14582 rpcz_store.cc:276] 0811 16:06:41.069011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.069125 (+   114us) service_pool.cc:227] Handling call
0811 16:06:41.069428 (+   303us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.069783 (+   355us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:41.069824 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:41.080684 (+ 10860us) log.cc:842] Serialized 26 byte log entry
0811 16:06:43.034218 (+1953534us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18003be000. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:43.050589 (+ 16371us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:43.050644 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:43.050742 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:43.051613 (+   871us) raft_consensus.cc:1671] finished
0811 16:06:43.051632 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:43.051862 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2592,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":25688960,"thread_start_us":16134,"threads_started":1,"wal-append.queue_time_us":1969291}
W20260811 16:06:43.059520 21521 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.015s	sys 0.018s
I20260811 16:06:43.029901 21693 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.033613 21646 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.084285 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.070303 21126 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:42.993340 21685 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.088742 13903 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260811 16:06:43.088919 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.070990 21689 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.043661 21636 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.099545 13824 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:43.140192 13826 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:43.080541 21529 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:43.144757 14577 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:43.092074 21126 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:43.086549 21745 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:43.032671 21824 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.097150 21752 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:43.166575 21837 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:06:43.155489 21529 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:43.168421 21646 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.149340 21437 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:43.142798 21453 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:43.213992 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129616us
I20260811 16:06:43.171072 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2541) took 1677 ms. Trace:
I20260811 16:06:43.172691 21693 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.173425 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.173723 21753 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.174496 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:43.175935 21826 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.176050 21841 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:43.224131 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:43.224562 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 156705us
I20260811 16:06:43.176918 14573 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:43.177556 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.177902 21636 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.178646 21741 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.179399 21805 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.179778 21775 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.176234 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.164937 21723 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260811 16:06:43.092888 21796 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.197528 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.207934 21824 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:43.182667 21762 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260811 16:06:43.215029 13739 rpcz_store.cc:276] 0811 16:06:41.494050 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.494754 (+   704us) service_pool.cc:227] Handling call
0811 16:06:43.170881 (+1676127us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:43.171002 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1205587712}
I20260811 16:06:43.219080 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.246963 13742 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:43.187827 21745 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:43.162320 21836 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:43.227885 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.204115 21752 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:43.227290 14575 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:43.224902 13736 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:06:43.230221 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 962f3dc40b494dc48647abd894784e8d, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.231981 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:43.255496 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 962f3dc40b494dc48647abd894784e8d, TS 5f46150fac70458986206ec7af67a403 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.256037 13738 raft_consensus.cc:2396] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260811 16:06:43.193312 21658 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:43.209497 21437 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:43.236030 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.238158 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.238245 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.239614 21672 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:43.239255 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.221472 21453 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.229550 21837 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:43.239012 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 169301us
I20260811 16:06:43.286937 21837 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.290756 21574 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.292027 21453 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.292337 21824 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:43.260776 21836 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.265564 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.234028 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:43.294610 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 62333.6us
I20260811 16:06:43.295269 21836 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.295626 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.233315 21693 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260811 16:06:43.298429 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.251041 13824 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:43.264974 21437 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:43.281157 21685 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.237591 21841 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:43.285022 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 301058us
I20260811 16:06:43.285578 21796 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.260070 21832 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:43.292088 14579 raft_consensus.cc:2354] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:43.293310 21824 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:43.273566 21732 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.793s	user 0.004s	sys 0.000s
I20260811 16:06:43.299770 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.300061 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.299109 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:43.305825 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.306270 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.310370 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.312451 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.315476 21574 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.317863 21794 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:43.318697 21624 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:43.320744 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.304185 13740 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:43.325341 13742 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:06:43.328835 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.366526 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.359911 21321 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:43.368363 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.369027 13742 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:06:43.369681 21824 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:43.372807 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44067.8us
I20260811 16:06:43.375353 21574 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:43.382556 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.383337 13824 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:06:43.384357 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.385788 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.386444 13817 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:43.388960 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.389639 13827 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:43.334923 13743 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:06:43.329598 21635 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:43.318656 21126 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.348268 21832 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.354792 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:43.353036 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47324.1us
I20260811 16:06:43.395335 13906 raft_consensus.cc:595] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:43.353396 21841 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:43.397938 13906 raft_consensus.cc:603] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:43.396095 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.397753 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:43.399924 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.392802 21321 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:43.398917 21685 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:43.405082 21685 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.405455 21321 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.407322 21138 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:43.407680 21624 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:43.408156 21624 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.410192 21624 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.400570 13824 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:43.412079 21126 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.414397 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3194) took 2266 ms. Trace:
I20260811 16:06:43.393146 21635 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:43.418520 21635 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:43.422530 21685 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.410073 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.430197 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.431458 13827 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:43.433451 13742 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:43.433619 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.414775 13825 rpcz_store.cc:276] 0811 16:06:41.148317 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.150795 (+  2478us) service_pool.cc:227] Handling call
0811 16:06:41.166064 (+ 15269us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:41.167518 (+  1454us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:41.167552 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:41.167941 (+   389us) log.cc:842] Serialized 26 byte log entry
0811 16:06:41.328073 (+160132us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:41.607217 (+279144us) log.cc:842] Serialized 14 byte log entry
0811 16:06:41.615275 (+  8058us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:41.615383 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:43.273054 (+1657671us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b2400138ed8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:06:43.414088 (+141034us) raft_consensus.cc:1671] finished
0811 16:06:43.414195 (+   107us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:43.414338 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14342,"prepare.queue_time_us":159532,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":7878,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":18353,"spinlock_wait_cycles":55780224,"thread_start_us":396673,"threads_started":2,"wal-append.queue_time_us":258410}
I20260811 16:06:43.438900 13817 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:06:43.442463 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.446411 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.455881 13817 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:43.389087 21785 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.462383 21574 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:43.468466 21657 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:06:43.483261 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:43.484184 14581 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:43.485177 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.487061 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.488299 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.485011 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:43.490624 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.491804 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.492396 14581 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:43.494225 21832 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.451124 21841 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:43.495482 21841 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.495580 21745 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.497601 21745 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.486701 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.503065 14574 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:43.503839 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:43.504068 14583 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:43.497601 21841 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.478394 21796 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260811 16:06:43.511998 21745 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:43.538530 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 96155.7us
I20260811 16:06:43.486635 21574 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.550580 21869 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:43.550952 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.552824 21841 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:43.553525 21841 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:43.561376 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.571185 13706 leader_election.cc:398] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:43.573239 13706 leader_election.cc:401] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:43.575747 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.576640 13817 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:43.575054 21841 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.550767 21574 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:43.592993 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 361684us
I20260811 16:06:43.593207 21785 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:43.593604 21870 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:43.594002 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.594201 21870 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.574102 21745 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.596236 21826 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:43.574527 21752 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.597529 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.598167 21745 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.598831 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.524879 21437 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.600020 14582 raft_consensus.cc:2354] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:43.599735 21529 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.600627 21852 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:43.601611 21852 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:43.601926 21529 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:43.602197 21852 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:43.598984 21752 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.579409 21657 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:43.605764 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46230.4us
W20260811 16:06:43.607661 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 369552us
W20260811 16:06:43.628748 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 140492us
I20260811 16:06:43.630529 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:43.632663 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:43.605150 21671 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.808s	user 0.010s	sys 0.010s
I20260811 16:06:43.631032 21753 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:43.634666 21713 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:43.635282 21876 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:43.636170 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.689882 13739 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:43.636250 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.637387 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:43.637842 21761 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.558s	user 0.011s	sys 0.030s
I20260811 16:06:43.646415 21752 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:43.646893 21798 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:43.647518 21863 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:43.651153 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44307.5us
I20260811 16:06:43.652932 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.653366 21874 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:43.654379 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.606802 21693 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:43.710093 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.710239 21693 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.626817 21437 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.626524 21708 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:43.684937 21870 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:43.687167 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.663704 21852 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.688213 21713 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:43.693563 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 56289.3us
I20260811 16:06:43.695611 21876 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:43.696451 21872 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:43.696816 21752 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.722898 21239 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader election won for term 12
I20260811 16:06:43.748569 21752 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.748818 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:43.749740 13903 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 23: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:43.710848 13817 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:06:43.683331 21657 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:43.712812 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58555.8us
I20260811 16:06:43.754417 13744 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 13. Current term is 14. Ops: []
W20260811 16:06:43.714753 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61890.2us
I20260811 16:06:43.725468 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:43.725466 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:06:43.670771 21671 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.847s	user 0.011s	sys 0.010s
I20260811 16:06:43.729584 13739 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:43.743214 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.761703 13907 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:43.743494 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.762598 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.743650 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:43.747906 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.711457 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.764292 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:43.723481 21658 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:43.758733 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.757071 21239 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:43.748554 21624 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:43.767342 21239 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.770946 21713 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.757148 21872 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:43.726460 21863 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.739375 21876 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:43.753767 21824 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:43.763211 13907 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:43.723079 21708 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.778450 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.758479 21600 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:43.776849 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.811558 13824 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:43.782480 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.812024 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.787772 14541 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:43.812572 13871 leader_election.cc:398] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:43.812907 13871 leader_election.cc:401] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260811 16:06:43.795465 13817 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:06:43.779798 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2794) took 2619 ms. Trace:
I20260811 16:06:43.813866 13904 rpcz_store.cc:276] 0811 16:06:41.160009 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.160861 (+   852us) service_pool.cc:227] Handling call
0811 16:06:41.953804 (+792943us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:42.361538 (+407734us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:43.779523 (+1417985us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400301950. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:43.779712 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1823028992}
I20260811 16:06:43.797097 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.798846 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.796469 21775 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:43.818125 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.809379 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:43.759305 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:43.818814 13739 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:43.816109 13827 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:43.817035 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.817610 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.819584 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.820571 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.788623 21624 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:43.820740 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:43.822039 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.821154 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:43.821561 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.801970 21693 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:43.805388 21872 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:43.832943 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:43.822813 13744 raft_consensus.cc:595] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:43.834311 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:43.841234 13741 raft_consensus.cc:2379] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:43.835381 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.841698 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:43.842166 13903 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:43.835872 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:43.836045 21467 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:06:43.838073 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.802690 21806 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260811 16:06:43.824378 21456 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:43.854279 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:43.855213 13825 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:43.857391 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.858144 13908 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:43.839671 21710 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:43.839530 21449 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:43.868412 21467 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:43.826440 21592 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:06:43.902060 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3185) took 1012 ms. Trace:
I20260811 16:06:43.902635 13909 rpcz_store.cc:276] 0811 16:06:42.889732 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:42.889863 (+   131us) service_pool.cc:227] Handling call
0811 16:06:43.901757 (+1011894us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:43.901959 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":66949888}
I20260811 16:06:43.834821 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:43.881620 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.884447 21624 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:43.842813 13900 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:06:43.891911 14577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1523) took 2813 ms (client timeout 1766 ms). Trace:
I20260811 16:06:43.893518 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:06:43.906579 14577 rpcz_store.cc:269] 0811 16:06:41.078034 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.082905 (+  4871us) service_pool.cc:227] Handling call
0811 16:06:43.032193 (+1949288us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:06:43.891654 (+859461us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b540057fdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:43.891818 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":194310912}
W20260811 16:06:43.911289 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63142.3us
I20260811 16:06:43.912422 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:43.826174 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:43.922542 13739 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:43.815002 21824 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.970605 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:43.934327 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 113650us
I20260811 16:06:43.973189 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:43.974879 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:43.984251 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:06:43.999410 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 177730us
W20260811 16:06:43.927548 21635 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.001s
W20260811 16:06:44.010666 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 98376.3us
I20260811 16:06:43.856773 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:43.840117 21775 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:43.908583 21467 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:44.014662 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.026139 21635 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.026921 21824 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.027981 13736 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17.
I20260811 16:06:44.013098 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2696) took 1032 ms. Trace:
W20260811 16:06:44.021392 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 293961us
I20260811 16:06:44.032635 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:44.031159 13818 rpcz_store.cc:276] 0811 16:06:42.980447 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:42.993137 (+ 12690us) service_pool.cc:227] Handling call
0811 16:06:42.993443 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:43.208589 (+215146us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:43.208625 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:43.208666 (+    41us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:43.208699 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:44.012870 (+804171us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:44.012919 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:44.013041 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":494315392}
W20260811 16:06:44.035014 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:44.033615 13908 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:44.030053 13825 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:44.004145 21710 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:44.051990 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51511us
I20260811 16:06:44.003826 21592 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:44.002727 21767 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:44.064184 13900 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:06:44.016183 21661 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:44.068646 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.069739 13823 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:06:44.060736 13905 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 14. Current term is 15. Ops: []
W20260811 16:06:44.058099 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48173.7us
I20260811 16:06:44.030498 21467 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.058089 21824 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:44.098961 13825 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
W20260811 16:06:44.066980 21879 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260811 16:06:44.146835 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46614us
I20260811 16:06:44.116331 13817 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:44.054037 21713 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:44.097792 21798 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:44.155010 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86467.3us
W20260811 16:06:44.119185 21883 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260811 16:06:44.119540 21715 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:44.071097 21658 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:06:44.125479 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.126216 21778 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:44.127264 21824 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:44.079758 21767 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.069017 21661 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:44.126920 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:44.156962 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.152835 21592 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:44.180574 21658 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:44.189661 21661 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.199257 21658 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:44.181711 21778 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:44.203091 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76254.5us
I20260811 16:06:44.205128 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:44.161832 21708 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.181411 21824 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:44.152357 21449 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260811 16:06:44.202503 21715 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:44.219318 21786 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:44.242290 21786 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:44.243613 21786 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:44.219264 21224 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:44.163069 21798 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:44.220294 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 154717us
I20260811 16:06:44.267620 21768 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:44.268217 21768 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:44.269104 21768 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.269659 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:44.270776 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113876us
I20260811 16:06:44.216318 21592 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:44.271840 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 146454us
I20260811 16:06:44.272961 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:44.276664 13905 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260811 16:06:44.282254 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:44.283298 13901 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:44.287410 21798 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.289019 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:44.301961 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:44.285111 21715 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260811 16:06:44.307705 21894 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:44.310520 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2144) took 1139 ms. Trace:
I20260811 16:06:44.310873 21592 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:44.310945 14580 rpcz_store.cc:276] 0811 16:06:43.170624 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:43.173798 (+  3174us) service_pool.cc:227] Handling call
0811 16:06:43.892557 (+718759us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:43.892804 (+   247us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:43.892841 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:43.892898 (+    57us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:43.892943 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:43.893017 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:44.310341 (+417324us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540057fdd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:44.310450 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1652256128}
I20260811 16:06:44.317817 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.304718 13901 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:44.285605 21863 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.320951 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.320096 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.322032 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:44.315171 21624 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.323098 21775 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.325299 21710 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:44.325841 21710 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:44.325006 21791 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:44.326193 21710 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.326758 21791 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:44.327124 21791 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:44.328018 21791 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.331002 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2775) took 1033 ms. Trace:
I20260811 16:06:44.296164 21635 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.331470 13736 rpcz_store.cc:276] 0811 16:06:43.297809 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:43.299513 (+  1704us) service_pool.cc:227] Handling call
0811 16:06:44.330748 (+1031235us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001054d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:44.330914 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1557145856}
I20260811 16:06:44.334600 21710 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.336114 21456 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:06:44.336227 21872 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.337422 13744 raft_consensus.cc:595] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.337790 13744 raft_consensus.cc:603] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:44.338004 21710 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.342555 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1301) took 2671 ms. Trace:
I20260811 16:06:44.344354 13821 rpcz_store.cc:276] 0811 16:06:41.671108 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:41.889497 (+218389us) service_pool.cc:227] Handling call
0811 16:06:42.915589 (+1026092us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:42.959338 (+ 43749us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:44.342258 (+1382920us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002dc8d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:44.342467 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2359075584}
I20260811 16:06:44.338285 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:44.347105 13907 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:44.299738 21778 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.325217 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.355587 13817 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:44.352479 21635 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:44.321219 21878 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:44.357535 21878 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:44.357992 21878 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.358785 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:44.359725 13905 raft_consensus.cc:595] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.363935 13905 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:06:44.364589 13905 raft_consensus.cc:595] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.364933 13905 raft_consensus.cc:603] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:44.350441 21603 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:44.366333 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:44.372107 13787 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17.
I20260811 16:06:44.372545 13787 leader_election.cc:401] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260811 16:06:44.372840 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:44.379482 13901 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:44.380853 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:44.381784 13736 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260811 16:06:44.383438 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:44.383814 13742 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260811 16:06:44.384073 13906 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.385326 13739 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260811 16:06:44.385706 13739 pending_rounds.cc:76] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 8
I20260811 16:06:44.386935 13739 pending_rounds.cc:97] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260811 16:06:44.387262 13739 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:44.388967 13744 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:44.390359 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:44.390211 21467 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.391108 21635 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 16:06:44.392148 21819 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:06:44.392525 21819 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:44.392589 21467 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.393468 21819 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:44.393591 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:44.394707 13739 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:44.398486 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:44.397163 21872 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.367491 21767 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.400754 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:44.368451 21603 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:44.402179 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:44.407491 13906 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:44.378865 21894 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:44.412334 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 624615us
I20260811 16:06:44.417598 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:44.421097 13737 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260811 16:06:44.421452 13737 pending_rounds.cc:76] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 14
I20260811 16:06:44.421589 13737 pending_rounds.cc:97] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260811 16:06:44.421742 13737 raft_consensus.cc:2866] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:44.424734 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:44.427335 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:44.374213 21715 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.042s
I20260811 16:06:44.419705 21825 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:44.429729 21636 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:44.367568 21892 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260811 16:06:44.434552 21710 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
W20260811 16:06:44.438633 21876 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.007s
I20260811 16:06:44.455636 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:44.456957 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:44.454769 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:44.456388 14577 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:44.459671 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:44.459846 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:44.460467 14579 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.460863 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:44.457736 14578 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:44.461505 14583 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:44.424392 21672 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260811 16:06:44.428083 21603 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.437216 21798 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260811 16:06:44.437708 21778 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.024s
I20260811 16:06:44.502153 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:44.449935 21636 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:44.464118 21710 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:44.453337 21825 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:44.514776 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 96508.3us
I20260811 16:06:44.518296 14577 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:44.514262 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:44.520696 14578 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:44.521415 14575 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:44.520104 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.497793 21592 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:44.527177 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67399.8us
I20260811 16:06:44.532403 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:44.533483 14578 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:44.535722 21825 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.539847 21710 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.540869 21603 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.547302 14578 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:44.547439 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.548775 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:06:44.517529 21636 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:44.461144 21876 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.556694 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.565267 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:44.565903 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.568930 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.555644 14583 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:44.549887 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:44.532788 21778 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:44.578727 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:44.588923 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 54911.9us
I20260811 16:06:44.590150 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.558285 21437 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:44.596433 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:44.602809 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:44.592823 21891 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:06:44.605052 21891 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:44.605551 21891 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:44.605607 21872 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:44.547338 21592 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:44.614262 21592 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:44.533489 21661 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.617420 21661 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.585343 21785 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:44.618604 21785 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:44.586921 21873 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:44.619172 21785 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:44.599625 21437 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:44.620409 21437 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:44.581403 21869 raft_consensus.cc:2741] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260811 16:06:44.634013 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:44.635349 13739 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:44.597959 21784 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:44.636350 21784 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:44.637830 21784 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.597574 21642 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260811 16:06:44.642627 21893 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260811 16:06:44.644555 21893 consensus_queue.cc:1225] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260811 16:06:44.649713 21791 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:44.598384 14542 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:44.656342 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 58042.6us
I20260811 16:06:44.657593 21873 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:44.658948 21889 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:44.659637 21889 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:44.660811 21889 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.670770 21747 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:44.671631 13818 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:06:44.671485 21747 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.601385 21841 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:44.673326 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2554) took 1810 ms. Trace:
I20260811 16:06:44.674065 21747 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:44.673704 13735 rpcz_store.cc:276] 0811 16:06:42.862925 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:42.890544 (+ 27619us) service_pool.cc:227] Handling call
0811 16:06:42.922092 (+ 31548us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:42.976959 (+ 54867us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:42.976997 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:42.977038 (+    41us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:42.977072 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:44.671126 (+1694054us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54000a91d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:44.673144 (+  2018us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:44.673269 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":125666048}
W20260811 16:06:44.675901 21898 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260811 16:06:44.677373 21548 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:44.677772 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.678056 21548 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.680197 21561 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:44.682933 21548 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:44.686031 21876 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:44.693846 21824 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.583721 21778 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:44.696089 21778 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:44.705991 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 103299us
I20260811 16:06:44.710093 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:44.707405 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:44.715459 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:44.684000 14579 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:44.728277 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:44.732192 13817 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:44.735473 14582 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:44.736053 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.750499 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.752777 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:44.753964 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 43956.1us
I20260811 16:06:44.760638 14582 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:44.702406 21878 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.738703 21693 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:44.737686 21792 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:44.736282 21449 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:44.740759 21642 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260811 16:06:44.749704 21824 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.771688 13744 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:44.773562 21878 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:44.776919 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:44.781617 21873 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:44.749529 21894 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17.
I20260811 16:06:44.756559 21767 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:44.799929 21437 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.820160 21616 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:44.786146 21785 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.801992 21792 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:44.803442 21876 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:44.881475 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55497.6us
I20260811 16:06:44.813580 21693 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:44.897716 21693 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.900154 21789 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:44.900724 21789 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:44.901986 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1369) took 1093 ms. Trace:
I20260811 16:06:44.901918 21789 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.902643 13907 rpcz_store.cc:276] 0811 16:06:43.808836 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:43.809005 (+   169us) service_pool.cc:227] Handling call
0811 16:06:44.901699 (+1092694us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000339d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:44.901891 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1195858816}
I20260811 16:06:44.905965 21789 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:44.906282 21768 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:44.923189 13825 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260811 16:06:44.931195 21689 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Stepping down as leader of term 11
I20260811 16:06:44.931738 21689 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:44.932698 21689 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.933898 21689 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 11 FOLLOWER]: Advancing to term 12
I20260811 16:06:44.940826 21636 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:44.822450 21873 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:44.963429 14582 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:44.883772 21616 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:44.942099 21896 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
W20260811 16:06:44.987015 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 82080.2us
W20260811 16:06:44.992125 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 119386us
I20260811 16:06:44.980068 21755 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:44.981009 21822 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:44.943076 21876 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.017488 21876 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:45.030897 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:44.981227 21873 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.034475 21688 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:45.009543 21822 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.038717 21688 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.040199 21822 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.041399 21636 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.042150 21688 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.007424 21755 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.043303 21586 raft_consensus.cc:979] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:06:45.043861 21586 raft_consensus.cc:1067] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Signalling peer 5088cdd3f79d4c47ba826dc820b3cfaf to start an election
I20260811 16:06:45.045149 21755 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.047183 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:45.049510 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:45.049960 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:45.050562 14579 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:45.052567 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.053737 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.055540 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.056759 21785 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.057502 21873 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.060354 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:45.056824 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:45.061540 13735 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:45.068953 21616 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.024680 21792 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.070611 14577 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:06:45.055263 21437 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.072365 21693 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:45.073593 21693 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:06:45.075228 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 519396us
W20260811 16:06:45.076263 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 491027us
I20260811 16:06:45.078755 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:45.079557 13737 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:45.087121 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:45.088789 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:45.092367 14579 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:45.101615 13823 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:45.104266 13735 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
W20260811 16:06:45.105813 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50130.1us
I20260811 16:06:45.106101 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:45.105715 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58198.9us
I20260811 16:06:45.107554 21721 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:45.108090 21721 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:45.133054 13907 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:45.134845 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:45.135257 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:45.135512 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.136636 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.136533 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.139464 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:45.109390 21891 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.140748 21688 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.125619 21810 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:45.142428 21891 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.142552 21810 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.141462 21688 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.150283 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:45.152552 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.153136 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.153357 13907 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:06:45.194038 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:45.267616 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 111581us
I20260811 16:06:45.271934 13906 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:60522
I20260811 16:06:45.272719 13906 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:06:45.273130 13906 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:45.275188 21789 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:45.276192 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.276541 21760 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:45.276903 13902 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:06:45.277004 21760 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:45.278112 21760 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.278745 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:45.279522 21760 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:45.280059 21789 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:45.282491 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:45.284065 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:45.277760 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:45.285821 13906 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.286721 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:45.139240 21721 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.295250 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:45.317303 13818 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:45.301245 13822 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:45.283354 21837 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:45.320345 13906 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.287503 21789 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:45.325590 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:45.326701 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:45.294516 21784 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:45.333647 13821 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260811 16:06:45.336294 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:45.340682 21624 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:45.341377 21624 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.343339 21600 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:45.296344 21636 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:45.344707 21785 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:45.344223 21636 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.347724 21785 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:45.348169 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:45.348260 21785 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.316876 21822 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:45.349570 21822 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.350914 21819 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:45.351620 21822 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.355276 21636 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.361564 13741 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:45.330271 21873 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260811 16:06:45.373732 14575 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 11. Current term is 12. Ops: []
I20260811 16:06:45.336773 21437 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:45.376194 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2711) took 1057 ms. Trace:
I20260811 16:06:45.376591 13825 rpcz_store.cc:276] 0811 16:06:44.318756 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:44.319670 (+   914us) service_pool.cc:227] Handling call
0811 16:06:45.375959 (+1056289us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:45.376102 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1382429952}
I20260811 16:06:45.376948 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:06:45.379786 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53606.4us
I20260811 16:06:45.390403 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.383462 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:45.392138 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:45.392998 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.379309 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.393435 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.394176 14574 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:45.391186 14579 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:45.350798 21785 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.328217 21824 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:45.399396 13826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3228) took 2329 ms (client timeout 1836 ms). Trace:
W20260811 16:06:45.399849 13826 rpcz_store.cc:269] 0811 16:06:43.070174 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:43.071009 (+   835us) service_pool.cc:227] Handling call
0811 16:06:45.399256 (+2328247us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b5400240c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:45.399344 (+    88us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":156573056}
I20260811 16:06:45.402280 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:45.378933 21791 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:45.433308 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:45.434968 14574 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:45.435592 13735 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:45.397673 21878 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.441932 21878 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.422375 21824 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.444298 21878 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.445585 21824 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.375372 21810 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.478070 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.505301 14574 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:45.507907 21892 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.511727 14578 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:45.452687 21796 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:06:45.498989 21624 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.509778 21688 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.534273 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.461097 21791 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.552166 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:45.555444 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:45.697172 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:45.700628 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 145300us
I20260811 16:06:45.691272 21819 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.680446 21771 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:45.694176 21600 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:45.697432 21796 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:45.703397 21891 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.704820 21792 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:45.761941 14583 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:45.685864 21892 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:45.726305 21658 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.396s	user 0.014s	sys 0.020s
W20260811 16:06:45.750557 21918 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260811 16:06:45.784409 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:45.771878 21921 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260811 16:06:45.774384 21792 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:45.785861 21658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.015s	sys 0.021s
I20260811 16:06:45.773919 21891 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.800977 21891 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.801271 21760 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:45.801395 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:45.803387 13738 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:45.806295 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:45.806923 13737 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260811 16:06:45.807925 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:45.752074 21771 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.757213 21600 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.735258 21819 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.814179 13737 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260811 16:06:45.753835 21453 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260811 16:06:45.793081 21878 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.795998 21792 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:45.828145 13735 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:06:45.871465 13739 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:45.882001 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:45.886119 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:45.892405 21453 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:45.889643 21407 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260811 16:06:45.893134 21453 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.896389 21789 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:06:45.890388 21873 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:45.843176 21878 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.901520 21322 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:45.902192 21322 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.914296 13742 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:45.920953 14577 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:45.921721 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1598) took 1501 ms. Trace:
I20260811 16:06:45.922150 13744 rpcz_store.cc:276] 0811 16:06:44.419971 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:44.420084 (+   113us) service_pool.cc:227] Handling call
0811 16:06:44.420382 (+   298us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:44.801244 (+380862us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:45.921462 (+1120218us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400104fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:45.921650 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":807435648}
I20260811 16:06:45.893955 21760 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:45.928649 21453 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.912092 21890 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:45.909528 21832 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:45.835843 21796 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.935055 21715 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:45.934948 21844 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.041s	sys 0.034s
I20260811 16:06:45.955799 21892 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.945001 21791 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:45.975677 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80236.3us
I20260811 16:06:45.948060 21832 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.976915 21760 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:06:45.978654 21832 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.955826 21322 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.942807 21890 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:45.981452 21890 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.967031 21715 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.969651 21600 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:45.986234 21715 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.970559 21819 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:45.971323 21771 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:45.972049 21924 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260811 16:06:45.965499 21844 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.041s	sys 0.035s
I20260811 16:06:45.949188 21453 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:45.988788 21453 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:45.979117 21760 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:45.992403 21760 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:45.997509 21760 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:45.998657 21760 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:46.188081 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 77882.6us
I20260811 16:06:46.193361 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.194748 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.196122 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.209173 14579 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:46.212673 21819 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.213376 21602 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.213589 21407 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.004870 21616 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.214318 21407 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.206815 21795 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.232868 21795 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.235499 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.080884 21545 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.254870 13907 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:06:46.254586 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.267233 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:46.267917 13900 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:46.270473 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 943775us
I20260811 16:06:46.273509 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.274392 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:46.246871 21407 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.207610 21811 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260811 16:06:46.244067 21616 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.289080 21773 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:46.289991 21616 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.291509 21773 consensus_queue.cc:1225] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260811 16:06:46.269774 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:46.213406 21819 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.293273 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1376) took 1159 ms. Trace:
I20260811 16:06:46.247746 21545 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.214066 21602 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.299337 21842 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.299631 21853 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.300637 21770 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:46.302522 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:46.303478 21525 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:06:46.340106 21786 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:46.245159 21795 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.306341 21713 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.303977 21831 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:06:46.315265 13909 rpcz_store.cc:276] 0811 16:06:45.133936 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:45.137792 (+  3856us) service_pool.cc:227] Handling call
0811 16:06:45.138131 (+   339us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:45.138375 (+   244us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:06:45.325757 (+187382us) log.cc:842] Serialized 14 byte log entry
0811 16:06:46.292903 (+967146us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:46.292962 (+    59us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:46.293005 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:46.293077 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:46.293207 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":498776,"prepare.queue_time_us":377126,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":498917,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":650283,"threads_started":2,"wal-append.queue_time_us":549152}
I20260811 16:06:46.317938 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.337121 21842 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.335917 21869 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.341300 21616 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.419305 21453 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.436724 21602 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.438737 21545 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:46.443202 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:46.446782 14577 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:46.372582 21713 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.343746 21770 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.341387 21853 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.463261 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.464514 14577 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:46.467849 21819 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.471983 21853 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.475994 21770 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.478041 21842 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:46.431851 21869 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:46.485538 21792 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260811 16:06:46.486111 21792 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.481979 21713 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:46.486819 21869 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.489073 21792 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.433324 21616 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.494639 21616 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:46.569814 21602 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
W20260811 16:06:46.553012 13735 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.017s	sys 0.077s
I20260811 16:06:46.395121 13900 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:46.575037 13744 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
W20260811 16:06:46.577888 13735 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.018s	sys 0.078s
W20260811 16:06:46.588891 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0982461139792576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260811 16:06:46.589178 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:46.589749 13871 connection.cc:232] RPC call timeout handler was delayed by -1.0370461139827967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260811 16:06:46.591646 21713 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.593089 21713 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.596127 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:46.597083 21713 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:46.605512 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.605892 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:46.606863 14580 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:46.609839 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:46.610654 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:46.614471 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:46.611231 14578 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:46.616135 21770 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:46.616762 21453 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:46.612417 21771 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:46.619381 21771 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:46.627064 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:46.627969 13741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2792) took 2230 ms (client timeout 1600 ms). Trace:
W20260811 16:06:46.628474 13741 rpcz_store.cc:269] 0811 16:06:44.396912 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:44.398229 (+  1317us) service_pool.cc:227] Handling call
0811 16:06:46.627490 (+2229261us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54001dc254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:46.627742 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2213284224}
I20260811 16:06:46.627339 21138 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:46.641091 21138 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:46.629881 21771 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.651057 21713 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:06:46.655603 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.655651 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3212) took 2127 ms. Trace:
I20260811 16:06:46.661777 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.650426 13900 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:46.643088 21778 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:46.666888 21836 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.655011 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.668665 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.668583 21836 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.655099 21781 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.670854 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:46.670603 21781 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.672561 21836 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.645347 21771 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:46.674706 14582 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:06:46.678128 21602 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:06:46.678777 14582 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:46.682410 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:46.684242 14582 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.691359 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2174) took 1935 ms. Trace:
I20260811 16:06:46.691732 21781 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:46.691596 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64892.4us
I20260811 16:06:46.692565 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3257) took 1698 ms. Trace:
I20260811 16:06:46.643553 21138 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.704366 13736 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260811 16:06:46.712172 14578 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:46.717125 13822 rpcz_store.cc:276] 0811 16:06:44.993950 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:44.994096 (+   146us) service_pool.cc:227] Handling call
0811 16:06:45.300963 (+306867us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:45.322319 (+ 21356us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:46.692051 (+1369732us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400124650. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:46.692277 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":695009536}
I20260811 16:06:46.728816 21693 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.730114 21775 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.731631 21775 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.728931 21710 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.697772 14575 rpcz_store.cc:276] 0811 16:06:44.756020 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:44.756462 (+   442us) service_pool.cc:227] Handling call
0811 16:06:44.775746 (+ 19284us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:45.373547 (+597801us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b540056fa20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190e300 00007f5c5190f371 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc
0811 16:06:45.374210 (+   663us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:46.690720 (+1316510us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540056fa20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190fb42 00007f5c5190bf26 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:46.691128 (+   408us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":111829760}
I20260811 16:06:46.741793 14582 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:46.730206 21693 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.755035 13741 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 23. Current term is 24. Ops: []
I20260811 16:06:46.762837 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:46.768957 21693 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.765568 21854 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.770696 21854 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.772660 21775 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.776350 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:46.663705 13908 rpcz_store.cc:276] 0811 16:06:44.527712 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:44.527848 (+   136us) service_pool.cc:227] Handling call
0811 16:06:44.550313 (+ 22465us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:44.550705 (+   392us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:06:44.804760 (+254055us) log.cc:842] Serialized 14 byte log entry
0811 16:06:45.130733 (+325973us) log.cc:842] Serialized 14 byte log entry
0811 16:06:46.250212 (+1119479us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b18002ba920. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c557b4bcf 00007f5c4e9e47b6 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d
0811 16:06:46.259987 (+  9775us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:46.290734 (+ 30747us) log.cc:842] Serialized 52 byte log entry
0811 16:06:46.433800 (+143066us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18002ba920. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:46.604769 (+170969us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:46.605497 (+   728us) log.cc:842] Serialized 14 byte log entry
0811 16:06:46.635231 (+ 29734us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:46.655129 (+ 19898us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:46.655229 (+   100us) raft_consensus.cc:1671] finished
0811 16:06:46.655247 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:46.655451 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1792089,"prepare.queue_time_us":38562,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":97,"raft.queue_time_us":1247127,"raft.run_cpu_time_us":697,"raft.run_wall_time_us":32234,"spinlock_wait_cycles":29921664,"thread_start_us":686129,"threads_started":3,"wal-append.queue_time_us":429509,"wal-append.run_cpu_time_us":2061,"wal-append.run_wall_time_us":1151795}
I20260811 16:06:46.782025 21671 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:46.765596 21710 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.790275 21710 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.791723 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.792248 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2720) took 1714 ms. Trace:
I20260811 16:06:46.792683 13824 rpcz_store.cc:276] 0811 16:06:45.077467 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:45.077623 (+   156us) service_pool.cc:227] Handling call
0811 16:06:45.077904 (+   281us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:45.078115 (+   211us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:45.096222 (+ 18107us) log.cc:842] Serialized 14 byte log entry
0811 16:06:45.293791 (+197569us) log.cc:842] Serialized 14 byte log entry
0811 16:06:46.709787 (+1415996us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800439840. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c557b4bcf 00007f5c4e9e47b6 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d
0811 16:06:46.761394 (+ 51607us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:46.766321 (+  4927us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:46.780244 (+ 13923us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:46.785753 (+  5509us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:46.792069 (+  6316us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1428742,"prepare.queue_time_us":22439,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":98,"raft.queue_time_us":1562494,"raft.run_cpu_time_us":576,"raft.run_wall_time_us":6382,"spinlock_wait_cycles":5383424,"thread_start_us":118897,"threads_started":2,"wal-append.queue_time_us":231005,"wal-append.run_cpu_time_us":1818,"wal-append.run_wall_time_us":1064613}
W20260811 16:06:46.796416 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47431.6us
I20260811 16:06:46.797158 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:46.798045 21524 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.798671 21524 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:46.799073 14583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1555) took 1451 ms (client timeout 1573 ms). Trace:
I20260811 16:06:46.813614 21617 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:46.807961 14583 rpcz_store.cc:269] 0811 16:06:45.347635 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:45.347767 (+   132us) service_pool.cc:227] Handling call
0811 16:06:46.798611 (+1450844us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54004c0c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:46.798844 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":887897216}
I20260811 16:06:46.813984 21683 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:06:46.814812 21617 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.818881 21688 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.825152 21688 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.828264 21889 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:46.829115 21860 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:46.829706 21860 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:46.783558 21854 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.818991 13706 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:46.851267 21906 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.852332 21906 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.855484 21776 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.856213 21636 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.854905 21945 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.861855 21888 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:46.862428 21945 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.865335 21945 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.865566 21775 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:46.867606 21602 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:46.868170 21602 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:46.868613 21721 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:46.856460 21776 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.871017 21824 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.871699 21776 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.871865 21824 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.857005 21636 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.869670 21721 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.862602 21888 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.876986 21636 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.878760 21888 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.835110 21617 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:46.859098 21693 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.882658 21824 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:46.883041 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64358.5us
I20260811 16:06:46.883985 21689 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:46.859401 21906 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.885578 21786 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:46.904223 14582 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260811 16:06:46.879035 21721 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.880764 21854 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.904698 14582 pending_rounds.cc:76] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 15
I20260811 16:06:46.907908 13735 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:06:46.909627 14582 pending_rounds.cc:97] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260811 16:06:46.912549 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:46.890494 21693 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.903802 21786 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:46.919721 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:46.905514 21689 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:46.916159 14582 raft_consensus.cc:2866] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:46.929459 21885 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:46.930583 21885 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.933805 21885 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.936125 21860 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.938045 21860 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:46.909278 21617 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.955325 21688 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:46.941260 21683 consensus_queue.cc:1159] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 19 status { last_received { term: 18 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:06:46.959673 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:46.966374 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56816.3us
I20260811 16:06:46.967276 21672 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:46.977521 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:46.978124 21878 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:46.981629 21710 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.974583 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:46.986711 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 67192.1us
I20260811 16:06:46.986513 21753 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:46.986970 21786 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.987890 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:46.987841 21753 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.990733 21752 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:46.991915 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:46.993664 21752 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:46.988652 21786 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:46.982440 21710 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:46.970541 21854 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:46.995472 21688 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:47.005421 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.024191 13905 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260811 16:06:47.022547 21685 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:46.997660 21906 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:46.999729 21753 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.030527 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1610) took 1206 ms. Trace:
I20260811 16:06:47.032781 21890 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:47.031042 21824 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:47.033488 21890 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.034144 21824 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.025010 21947 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.035456 21819 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:47.035876 21947 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.036546 21824 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.036334 21819 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.006639 21885 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:47.006224 21878 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:47.040493 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.031914 13742 rpcz_store.cc:276] 0811 16:06:45.815072 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:45.815488 (+   416us) service_pool.cc:227] Handling call
0811 16:06:45.816328 (+   840us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:45.914926 (+ 98598us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:47.021121 (+1106195us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:47.021500 (+   379us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":223810304}
I20260811 16:06:47.000249 21617 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.054487 20779 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:47.054682 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.055554 13904 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:47.055335 20779 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.058887 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.059482 21740 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:06:47.055953 21819 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.061035 21740 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:47.061493 21740 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:47.062354 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.062963 20779 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.063916 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.063488 13904 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:47.066249 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.058627 21906 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.043256 21689 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:47.063452 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104077us
I20260811 16:06:47.080744 21776 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.081550 21776 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.083904 21768 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.084740 21768 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.086040 13818 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 23. Current term is 24. Ops: []
I20260811 16:06:47.087358 21636 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:47.088106 21636 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.089599 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.090417 13818 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:47.090699 21636 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.075764 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.072104 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.072264 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.073360 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.075469 21906 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.075728 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.075871 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.077622 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.079891 21467 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:47.109596 21467 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.110664 13903 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:47.112352 21467 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:47.093102 21949 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260811 16:06:47.116938 21948 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.163s	user 0.000s	sys 0.005s
I20260811 16:06:47.117375 21768 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.093379 21939 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:47.118873 21453 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:47.119815 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:47.080008 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.096352 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.121340 13908 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:47.123560 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.124387 21760 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:47.102721 21688 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.128688 21688 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.132241 13907 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:47.132437 21671 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:47.134101 13902 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:47.135061 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:47.135456 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:47.135725 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:47.136812 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:47.142140 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.143913 21939 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:47.046448 21685 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.145006 21878 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.097770 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.146739 13822 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:47.095743 21693 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.043074 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:47.147694 21685 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.019919 21721 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:47.064589 21947 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.112221 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.096927 21617 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:47.148947 21721 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.150539 21770 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:47.151190 21770 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:47.152271 21770 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.152879 21617 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.153328 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.153622 21617 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.046181 21138 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:47.155982 21617 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.136751 21890 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.051911 21888 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:47.157042 21888 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.148869 21685 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:47.047705 21524 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:47.095283 21776 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.136960 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:47.145241 21710 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:47.148175 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 118595us
I20260811 16:06:47.158874 21854 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.188320 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.191361 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.164203 21685 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.192730 21685 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:47.194316 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.195438 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.196110 13736 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:47.191424 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.192239 13735 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:06:47.062680 21740 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.198139 13825 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:47.207870 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.208114 13824 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260811 16:06:47.202565 21617 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:47.213392 21617 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.216756 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.197847 21688 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.223834 21740 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:47.224073 21617 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.232496 21888 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.239296 21836 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:47.242568 21602 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:47.250136 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113301us
I20260811 16:06:47.255878 13736 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:47.240141 13626 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 13, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:47.263597 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:47.266350 21671 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:06:47.271498 21888 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:47.272606 21888 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:47.273875 21888 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:47.276244 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101533us
I20260811 16:06:47.277091 21775 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:47.277684 21775 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.280216 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.282682 13817 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:47.283370 21854 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:47.286639 21939 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:06:47.288604 21939 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:06:47.289179 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:47.289386 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 66911.6us
I20260811 16:06:47.286209 21775 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.291579 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.293615 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.295174 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.296001 13824 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:47.302062 13736 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 23. Current term is 24. Ops: []
I20260811 16:06:47.305760 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.306668 14575 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 12.
I20260811 16:06:47.318905 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.318078 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.320238 13824 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 12.
I20260811 16:06:47.306020 21721 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.326627 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.327435 14575 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:47.332361 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.340194 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.344398 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.346176 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.350662 14575 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:47.356503 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.301748 21885 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.357975 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.357318 13739 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:47.363286 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.361537 13817 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:47.364828 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.368384 13824 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:06:47.366791 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.369132 13736 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:47.336967 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 12, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 12 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:06:47.373139 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141429us
I20260811 16:06:47.375430 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.377933 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.378561 14575 raft_consensus.cc:2354] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:47.378841 13908 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:47.374841 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.383090 13739 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:47.386654 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.390430 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.394196 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.392453 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.397461 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.395089 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.399375 13818 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:47.343801 21524 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260811 16:06:47.403954 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.401973 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.405500 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.406622 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.410213 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.410295 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.414583 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:47.420861 13871 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:47.424782 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.434916 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.436825 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:47.450623 21959 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:06:47.452205 21885 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.453130 21574 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.453872 21574 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.424590 21854 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:47.419538 21775 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:47.455427 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.455833 21785 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:06:47.456086 21775 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.456866 21785 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:06:47.457266 21785 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:47.458498 21775 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.458302 21785 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.470693 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.474143 21785 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:06:47.467950 21962 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260811 16:06:47.474663 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48259.8us
I20260811 16:06:47.464793 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.475523 21842 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:47.475666 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:47.476042 21842 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:47.476508 21842 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:47.476567 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.477837 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.479605 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.479809 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.479090 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.480366 13826 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:47.455430 21854 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:47.482087 21854 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:47.482677 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.483402 13826 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
W20260811 16:06:47.484948 21957 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:06:47.470781 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.488315 13817 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:47.464754 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.491654 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.493045 13825 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:47.408830 21752 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:47.494345 21752 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.499321 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.500653 21786 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:47.501080 21786 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:47.501492 21786 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:47.474046 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.504288 14579 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:47.523874 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:47.524956 21574 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:47.529572 21860 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.000s
I20260811 16:06:47.529935 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.530113 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.531796 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.532389 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:47.532706 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.533330 13909 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:47.534237 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:47.536587 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:47.538642 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:47.480491 21773 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:47.539556 21773 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:47.524956 21689 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:47.540521 21689 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:47.540704 21602 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.540935 21689 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:47.541435 21602 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:47.544461 21685 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.548841 21524 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:47.533372 13822 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:06:47.539939 21773 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:47.555022 21878 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.556190 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.555811 13626 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 11 to 12, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 12 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:47.563516 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.567193 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.567615 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.569335 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.572456 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.573239 13744 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:47.574461 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.575238 13735 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:06:47.576881 13738 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:47.577636 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.578869 13824 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:47.579571 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.580590 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.586133 13735 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:47.588464 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:47.590370 21873 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:47.590552 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.590865 21873 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:47.591264 21873 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:47.592582 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.592953 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:47.506564 21760 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:47.521440 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:47.581481 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.601200 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.581705 13626 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 13, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 13 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:47.592582 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:47.625473 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:47.642894 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:47.638062 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 116757us
I20260811 16:06:47.644375 13822 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:47.645283 14583 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:47.532385 21752 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.665081 13822 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:47.658402 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.680330 13626 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 10 to 11, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 11 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:47.623634 21760 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.623716 21888 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.644440 21688 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260811 16:06:47.869983 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 98530.5us
I20260811 16:06:47.873661 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.877473 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:47.875866 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:47.890605 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.871945 21688 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:47.900063 21688 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
W20260811 16:06:47.904345 13621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 327) took 20299 ms (client timeout 15000 ms). Trace:
I20260811 16:06:47.907646 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:47.908674 14579 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:47.909963 13626 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:47.913079 13626 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 11 to 13, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 13 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:47.924793 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.925691 21888 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:47.927806 21852 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:47.867381 21882 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:47.931586 21760 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:47.934067 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.741s (SENT) [suppressed 9 similar messages]
W20260811 16:06:47.934980 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50345.2us
I20260811 16:06:47.936632 14581 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:06:47.976120 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:47.993516 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:47.994735 13826 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:48.001756 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.007591 21760 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.008425 21760 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:47.937906 13821 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:48.031102 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:47.892661 21945 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:06:48.019863 13901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.019s	sys 0.029s
I20260811 16:06:48.032189 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:47.882691 21453 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:47.986246 21685 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:47.938882 21852 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:48.060791 13904 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.033s	sys 0.098s
W20260811 16:06:48.084465 13904 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.033s	sys 0.098s
W20260811 16:06:48.058040 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 394632us
I20260811 16:06:47.936305 21775 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.115s
I20260811 16:06:47.934063 21773 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:47.974882 21770 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260811 16:06:48.095259 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.106015 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:48.117174 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:48.154500 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 178488us
I20260811 16:06:48.105623 21671 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260811 16:06:48.124403 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.052s	sys 0.100s
W20260811 16:06:48.199440 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.054s	sys 0.102s
I20260811 16:06:48.196659 14581 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:48.083338 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:48.058969 21945 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:48.093751 21683 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.020s	sys 0.048s
W20260811 16:06:48.124831 21755 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.027s	sys 0.029s
I20260811 16:06:48.066529 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:06:48.206732 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 89671.7us
I20260811 16:06:48.222613 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:48.230659 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 2211) took 1078 ms. Trace:
I20260811 16:06:48.231244 14583 rpcz_store.cc:276] 0811 16:06:47.152707 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.152935 (+   228us) service_pool.cc:227] Handling call
0811 16:06:48.230474 (+1077539us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540067eb54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:48.230596 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1129448320}
I20260811 16:06:48.219060 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.240784 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:48.208451 21854 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.721s	user 0.016s	sys 0.003s
W20260811 16:06:48.213537 21755 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.027s	sys 0.033s
I20260811 16:06:48.309702 13626 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:06:48.203595 21786 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.702s	user 0.013s	sys 0.008s
W20260811 16:06:48.213990 21683 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.021s	sys 0.051s
I20260811 16:06:48.316102 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:48.199113 21671 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:48.210289 21945 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:48.213079 21888 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:06:48.226917 21760 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:48.331245 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:48.216898 21689 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.675s	user 0.016s	sys 0.006s
W20260811 16:06:48.321427 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.010s	sys 0.026s
W20260811 16:06:48.379050 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.010s	sys 0.027s
I20260811 16:06:48.413233 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.327018 21671 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:48.414367 13826 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
W20260811 16:06:48.434257 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.026s	sys 0.037s
W20260811 16:06:48.434733 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.026s	sys 0.037s
I20260811 16:06:48.340494 21888 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:48.442548 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 13, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:48.445946 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:48.446842 13826 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 15
W20260811 16:06:48.453282 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.032s	sys 0.092s
W20260811 16:06:48.455266 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.033s	sys 0.092s
I20260811 16:06:48.320065 21854 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:48.438493 21524 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.041s
W20260811 16:06:48.444461 21873 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.853s	user 0.015s	sys 0.000s
I20260811 16:06:48.328375 21786 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:48.468010 14580 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:48.440085 21888 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:06:48.444762 21602 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.903s	user 0.013s	sys 0.000s
I20260811 16:06:48.441655 21710 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:48.476426 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.379558 21689 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.479244 13706 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:48.460104 21524 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.018s	sys 0.042s
W20260811 16:06:48.485006 13735 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.023s	sys 0.051s
W20260811 16:06:48.485500 13735 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.023s	sys 0.051s
W20260811 16:06:48.478266 21842 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.001s	user 0.014s	sys 0.004s
W20260811 16:06:48.491025 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 952465us
I20260811 16:06:48.451855 21775 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:06:48.484951 21688 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.009s
I20260811 16:06:48.479203 21602 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:48.506013 13737 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:06:48.490108 21785 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.492300 21740 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.515199 13824 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260811 16:06:48.515432 13626 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 11 to 14, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 14 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:48.481810 21770 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260811 16:06:48.497644 21775 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:48.477892 21873 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.438876 21852 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:48.522483 21968 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.637s	user 0.006s	sys 0.009s
I20260811 16:06:48.512171 21574 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:48.497314 21842 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:48.547178 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.528012 21775 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:48.503911 21688 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.533780 21854 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:48.538411 21773 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.597100 21710 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:48.597870 21710 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:48.603747 21970 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260811 16:06:48.605294 21978 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260811 16:06:48.606169 21972 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260811 16:06:48.607461 21789 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.607700 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1629) took 1309 ms. Trace:
I20260811 16:06:48.608232 21789 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.608295 13742 rpcz_store.cc:276] 0811 16:06:47.297955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.303315 (+  5360us) service_pool.cc:227] Handling call
0811 16:06:47.325669 (+ 22354us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:47.368061 (+ 42392us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:47.368111 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:47.389292 (+ 21181us) log.cc:842] Serialized 26 byte log entry
0811 16:06:47.663755 (+274463us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:47.663794 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:47.664108 (+   314us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:48.607380 (+943272us) raft_consensus.cc:1671] finished
0811 16:06:48.607416 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:48.607617 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8233,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":16359,"thread_start_us":251885,"threads_started":1,"wal-append.queue_time_us":705761}
W20260811 16:06:48.628417 21982 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:06:48.632009 21688 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:48.560460 21740 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.635684 21786 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.551642 14578 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:48.559487 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.544239 13626 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 14, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 14 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:48.552464 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:48.570232 21138 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:06:48.572358 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1498) took 1047 ms. Trace:
I20260811 16:06:48.576319 13826 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:48.537093 21785 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.580195 21873 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:48.583315 21882 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:48.645308 13825 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:48.643463 14580 rpcz_store.cc:276] 0811 16:06:47.525206 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.619113 (+ 93907us) service_pool.cc:227] Handling call
0811 16:06:47.644076 (+ 24963us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:48.476558 (+832482us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:48.572056 (+ 95498us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54004ce354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:48.572258 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1894429952}
I20260811 16:06:48.642760 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2600) took 1028 ms. Trace:
I20260811 16:06:48.546100 21574 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:48.659859 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 107537us
I20260811 16:06:48.653504 13738 rpcz_store.cc:276] 0811 16:06:47.614466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.615162 (+   696us) service_pool.cc:227] Handling call
0811 16:06:47.615592 (+   430us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:47.636274 (+ 20682us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:47.636315 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:47.655747 (+ 19432us) log.cc:842] Serialized 26 byte log entry
0811 16:06:48.327872 (+672125us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:48.327921 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:48.328004 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:48.642495 (+314491us) raft_consensus.cc:1671] finished
0811 16:06:48.642516 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:48.642694 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":210682,"raft.queue_time_us":21620,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7843,"thread_start_us":437526,"threads_started":1,"wal-append.queue_time_us":822425}
W20260811 16:06:48.676111 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 469858us
I20260811 16:06:48.682361 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.657308 21882 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:48.691368 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 375360us
I20260811 16:06:48.691967 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2739) took 1215 ms. Trace:
W20260811 16:06:48.666890 21975 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.175s	user 0.003s	sys 0.000s
I20260811 16:06:48.692503 13626 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 6 to 12, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 12 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:48.661598 21138 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:48.694236 13821 rpcz_store.cc:276] 0811 16:06:47.462021 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.478700 (+ 16679us) service_pool.cc:227] Handling call
0811 16:06:48.677696 (+1198996us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540021a054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:48.677865 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1050137856}
I20260811 16:06:48.674650 21713 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:48.675837 21789 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.693276 21740 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:48.717159 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:48.714483 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cec0688f86d54789b9b9ecc924ddecf3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:06:48.721796 13612 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55701.1us
I20260811 16:06:48.723457 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.719935 21842 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.725634 21986 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.726179 21986 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.728472 21986 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:48.729018 21986 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:48.729539 21986 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:48.731809 21984 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:48.732510 21984 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:48.735507 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2736) took 1274 ms. Trace:
I20260811 16:06:48.724143 13821 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:48.710824 21688 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.736140 21752 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:48.735922 13817 rpcz_store.cc:276] 0811 16:06:47.460973 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.490403 (+ 29430us) service_pool.cc:227] Handling call
0811 16:06:47.514552 (+ 24149us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:47.649818 (+135266us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:47.649869 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:47.742623 (+ 92754us) log.cc:842] Serialized 26 byte log entry
0811 16:06:48.435190 (+692567us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:48.435263 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:48.435354 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:48.735248 (+299894us) raft_consensus.cc:1671] finished
0811 16:06:48.735272 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:48.735439 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":92589,"raft.queue_time_us":98432,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":10222,"thread_start_us":535653,"threads_started":1,"wal-append.queue_time_us":665236}
I20260811 16:06:48.742513 21986 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.744768 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:48.735085 21984 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.739516 21524 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:48.736792 21773 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:48.751297 21710 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:48.710752 21689 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:48.766865 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:48.772940 21786 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:48.767493 21842 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:48.767351 21752 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:47.905076 13621 rpcz_store.cc:269] 0811 16:06:27.604892 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:27.606201 (+  1309us) service_pool.cc:227] Handling call
0811 16:06:47.903964 (+20297763us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:06:42.570424 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:06:42.571324 (+   900us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:06:42.571393 (+    69us) write_op.cc:435] Acquired schema lock
0811 16:06:42.571420 (+    27us) tablet.cc:660] Decoding operations
0811 16:06:42.574265 (+  2845us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:06:42.574414 (+   149us) write_op.cc:641] Partition lock acquired for write op
0811 16:06:42.574489 (+    75us) tablet.cc:683] Acquiring locks for 23 operations
0811 16:06:42.577123 (+  2634us) tablet.cc:699] Row locks acquired
0811 16:06:42.577184 (+    61us) write_op.cc:260] PREPARE: finished
0811 16:06:42.577434 (+   250us) write_op.cc:270] Start()
0811 16:06:42.577626 (+   192us) write_op.cc:276] Timestamp: P: 1786464402577348 usec, L: 0
0811 16:06:42.577651 (+    25us) op_driver.cc:331] REPLICATION: starting
0811 16:06:42.578984 (+  1333us) log.cc:842] Serialized 8999 byte log entry
0811 16:06:43.160129 (+581145us) op_driver.cc:444] REPLICATION: finished
0811 16:06:43.332365 (+172236us) write_op.cc:301] APPLY: starting
0811 16:06:43.332513 (+   148us) tablet.cc:1365] starting BulkCheckPresence
0811 16:06:43.501356 (+168843us) tablet.cc:1368] finished BulkCheckPresence
0811 16:06:43.520395 (+ 19039us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:06:43.837482 (+317087us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:06:43.838140 (+   658us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0811 16:06:43.838216 (+    76us) write_op.cc:312] APPLY: finished
0811 16:06:43.838701 (+   485us) log.cc:842] Serialized 204 byte log entry
0811 16:06:43.838916 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:43.843666 (+  4750us) write_op.cc:454] Released schema lock
0811 16:06:43.857239 (+ 13573us) write_op.cc:341] FINISH: Updating metrics
0811 16:06:43.862699 (+  5460us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:43.862743 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1249942,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":143113,"apply.run_cpu_time_us":40003,"apply.run_wall_time_us":531120,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100083,"num_ops":23,"prepare.queue_time_us":1482,"prepare.run_cpu_time_us":33735,"prepare.run_wall_time_us":107210,"raft.queue_time_us":137622,"raft.run_cpu_time_us":10728,"raft.run_wall_time_us":239992,"replication_time_us":574684,"thread_start_us":277446,"threads_started":4,"wal-append.queue_time_us":129274,"wal-append.run_cpu_time_us":37601,"wal-append.run_wall_time_us":2161997}]]}
I20260811 16:06:48.730921 21860 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:48.777434 13626 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:48.787864 13626 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:48.794852 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.805570 21752 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:48.796172 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 317033us
I20260811 16:06:48.820035 21773 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.820042 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:48.824659 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 319268us
I20260811 16:06:48.752566 21775 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.834178 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.770470 21688 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.839563 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:48.840281 14575 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:48.841615 14580 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260811 16:06:48.851028 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77770.3us
I20260811 16:06:48.789021 21860 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:48.858788 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 71794.7us
I20260811 16:06:48.834944 21873 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:48.794981 21524 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:48.863454 14573 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:06:48.865038 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.865231 21979 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:48.866008 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:48.866161 21688 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:48.901273 14575 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:48.866843 21574 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:48.868225 21671 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.871475 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:48.872304 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:48.794872 21138 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.841459 21785 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:48.874797 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:48.875248 21995 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:48.875521 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.937561 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:48.876226 21773 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:48.848503 21689 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:48.877095 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.878825 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.841243 21987 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:48.879645 21873 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.881987 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.883976 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.885311 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2602) took 1268 ms. Trace:
I20260811 16:06:48.885471 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.886546 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.887514 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.888271 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.889047 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.889763 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.946916 13822 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:48.897183 13825 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:48.896708 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:48.903060 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:48.927235 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60689.2us
I20260811 16:06:48.934038 13744 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:48.936529 14579 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:48.936890 13741 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:48.938162 13738 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:06:48.935909 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76308.7us
I20260811 16:06:48.952044 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:48.946190 13827 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:06:48.952548 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.952894 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:48.946822 13818 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:06:48.957767 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61156.5us
W20260811 16:06:48.950294 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45973.5us
I20260811 16:06:48.963454 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:48.964401 13739 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:48.940490 21994 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:48.953516 13742 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:48.967129 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:48.971233 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.971949 13738 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:48.973850 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.974233 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:48.975841 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.977190 22003 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:48.977614 22003 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:48.945255 21987 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:48.976133 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.975777 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:48.945719 13735 rpcz_store.cc:276] 0811 16:06:47.617090 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.617297 (+   207us) service_pool.cc:227] Handling call
0811 16:06:47.637140 (+ 19843us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:48.486029 (+848889us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:48.486079 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:48.493421 (+  7342us) log.cc:842] Serialized 26 byte log entry
0811 16:06:48.843479 (+350058us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:48.843516 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:48.843580 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:48.885070 (+ 41490us) raft_consensus.cc:1671] finished
0811 16:06:48.885091 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:48.885253 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":114991,"raft.queue_time_us":230403,"raft.run_cpu_time_us":1675,"raft.run_wall_time_us":55181,"thread_start_us":941751,"threads_started":2,"wal-append.queue_time_us":385411}
I20260811 16:06:48.981757 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:48.978983 13743 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:48.950174 21854 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:48.979452 13823 raft_consensus.cc:2362] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15. Re-sending same reply.
I20260811 16:06:48.986271 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:48.990149 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:48.977989 22003 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:48.954123 21689 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.982332 21994 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:49.000995 21689 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.001333 21994 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:48.988582 21710 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.015573 13744 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:06:48.982084 21987 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.028915 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:49.042785 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:48.996425 21888 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.009s
I20260811 16:06:48.996234 21752 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:06:49.056747 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61871.5us
I20260811 16:06:49.019853 21740 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260811 16:06:49.067090 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 114271us
W20260811 16:06:49.068425 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45428.7us
I20260811 16:06:49.021700 21775 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:48.953938 21995 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.069492 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:48.995663 21854 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.070240 21740 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:49.058156 22007 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:49.060729 21671 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.106772 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.060946 21524 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.103688 13787 leader_election.cc:398] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
W20260811 16:06:49.079046 21945 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.003s
W20260811 16:06:49.074323 21977 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.586s	user 0.003s	sys 0.000s
I20260811 16:06:49.112495 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2608) took 1026 ms. Trace:
I20260811 16:06:49.051802 21989 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.054s
I20260811 16:06:49.117545 14574 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.116307 13787 leader_election.cc:401] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:06:49.113395 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 150111us
I20260811 16:06:49.119695 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.120476 13821 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:49.119725 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.117767 13737 rpcz_store.cc:276] 0811 16:06:48.086486 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:48.087106 (+   620us) service_pool.cc:227] Handling call
0811 16:06:48.110812 (+ 23706us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:48.506406 (+395594us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:49.112182 (+605776us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400277ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:49.112421 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":908168064}
I20260811 16:06:49.122165 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.065970 21888 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.089179 21860 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.105297 21775 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:49.108381 22007 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:49.124492 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.132139 13741 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:49.071090 21819 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260811 16:06:49.142264 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.143018 13827 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:49.144645 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.145534 13822 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:49.134950 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.109743 21740 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.139979 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.140767 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.095471 21785 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260811 16:06:49.140023 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.149444 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.153076 13824 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.108528 22008 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:49.153986 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47368.6us
I20260811 16:06:49.161443 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.162544 13827 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:49.133241 21789 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:49.167259 13817 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 24: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:49.168800 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.168933 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.172551 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.142838 21989 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:49.156387 21775 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.147301 22007 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.142302 21998 raft_consensus.cc:2741] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260811 16:06:49.181859 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 106286us
I20260811 16:06:49.169878 22013 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:49.127519 21945 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.171536 21873 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.175947 21688 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:49.226431 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:49.229142 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 81355.4us
I20260811 16:06:49.193274 22005 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:49.234344 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:06:49.235663 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63176.9us
W20260811 16:06:49.235939 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5550369980046526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
I20260811 16:06:49.203836 21852 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:49.241964 13820 raft_consensus.cc:2354] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17.
I20260811 16:06:49.240626 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.232262 21993 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:49.239431 21574 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.246850 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.233487 21906 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:49.208056 22004 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:06:49.258447 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1402) took 1878 ms. Trace:
I20260811 16:06:49.295358 21985 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.167057 22008 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.300639 21995 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.284384 22016 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:49.258962 21574 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.249357 21852 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.285377 22001 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:49.300686 14574 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:49.245312 22005 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.203042 21989 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.247160 21785 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:49.285061 22014 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:49.296810 21888 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.296022 22028 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.299278 22027 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:49.333062 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 90152.6us
I20260811 16:06:49.333176 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:49.336930 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:49.338791 21882 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.007s
I20260811 16:06:49.340193 13909 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:06:49.345760 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 99006.2us
I20260811 16:06:49.346349 13825 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:49.398933 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65849.9us
I20260811 16:06:49.399931 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.347112 13901 rpcz_store.cc:276] 0811 16:06:47.377812 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.377944 (+   132us) service_pool.cc:227] Handling call
0811 16:06:47.397568 (+ 19624us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:47.407757 (+ 10189us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:47.407791 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:47.491252 (+ 83461us) log.cc:842] Serialized 26 byte log entry
0811 16:06:48.059251 (+567999us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:48.059302 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:48.059413 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:49.073988 (+1014575us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:06:49.247732 (+173744us) raft_consensus.cc:1671] finished
0811 16:06:49.247756 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:49.255751 (+  7995us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11921,"raft.queue_time_us":6388,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":109796096,"thread_start_us":567503,"threads_started":1,"wal-append.queue_time_us":927213}
I20260811 16:06:49.364499 22016 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.349769 21789 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:49.355994 21993 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.377450 13821 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:49.378304 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 144045us
I20260811 16:06:49.378594 13739 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:06:49.359045 21574 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.408998 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.409880 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.394812 22014 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.397225 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.392428 22028 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:49.400182 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:49.355293 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:49.410809 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.354621 21985 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.398224 22005 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.416034 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.420608 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.418183 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:49.421139 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.419003 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.419286 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.423391 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:49.424278 14579 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:49.426334 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.403695 21888 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:49.432617 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.432534 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:49.408169 22001 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:49.408419 21979 raft_consensus.cc:2741] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260811 16:06:49.433782 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:49.435622 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.381162 22003 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.420619 21906 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:49.422206 21984 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:49.412515 22013 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260811 16:06:49.398537 22027 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.441984 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.443430 13743 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
I20260811 16:06:49.425793 21685 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:49.432054 21617 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:06:49.416325 22028 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.455592 21854 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.455402 22008 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.454839 22036 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.464869 22036 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.458770 21945 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.467352 13826 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:49.467943 22003 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.463801 21617 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:49.468362 14575 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:06:49.468842 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.478614 13824 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:49.463181 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:49.469633 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.470374 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.480654 13822 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:49.404498 21882 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.471662 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.486492 13821 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:49.483943 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.472213 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.471635 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.472201 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.432034 21760 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.433405 21888 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:49.482712 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.495553 13822 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:49.452446 21852 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.482987 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.436281 21789 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:49.487778 13818 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:06:49.477835 21984 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.445442 22031 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:49.445600 22026 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.068s
I20260811 16:06:49.487546 13737 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:49.485147 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.475472 21710 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:49.450743 22016 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.499716 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.455123 22014 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.502508 13738 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:49.507109 13908 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:49.496996 21888 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:49.507619 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.508239 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.508893 13908 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:49.508925 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.509632 13902 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.504094 22006 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.504271 22026 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:49.510497 22028 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.511343 22026 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:49.511305 22006 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:49.512622 21974 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.080s	user 0.003s	sys 0.007s
I20260811 16:06:49.512436 22026 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:49.506044 22033 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.078s	user 0.000s	sys 0.002s
I20260811 16:06:49.513991 22006 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.514933 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1497) took 1990 ms. Trace:
I20260811 16:06:49.446908 21993 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.512957 22028 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.514040 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1403) took 2135 ms. Trace:
I20260811 16:06:49.506901 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.515347 14578 rpcz_store.cc:276] 0811 16:06:47.524814 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.618672 (+ 93858us) service_pool.cc:227] Handling call
0811 16:06:47.656546 (+ 37874us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:48.647668 (+991122us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:49.514696 (+867028us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:49.514874 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2046248192}
I20260811 16:06:49.516953 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:49.506393 22032 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260811 16:06:49.518549 13903 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:49.515841 13904 rpcz_store.cc:276] 0811 16:06:47.378106 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.378241 (+   135us) service_pool.cc:227] Handling call
0811 16:06:47.390687 (+ 12446us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:47.406784 (+ 16097us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:47.406825 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:47.472845 (+ 66020us) log.cc:842] Serialized 26 byte log entry
0811 16:06:48.084953 (+612108us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:06:48.553253 (+468300us) log.cc:842] Serialized 14 byte log entry
0811 16:06:48.553517 (+   264us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:48.553615 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:49.492615 (+939000us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b2400244808. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:06:49.513716 (+ 21101us) raft_consensus.cc:1671] finished
0811 16:06:49.513841 (+   125us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:49.513976 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11623,"prepare.queue_time_us":625910,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":25314,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":223,"spinlock_wait_cycles":10255104,"thread_start_us":1051901,"threads_started":2,"wal-append.queue_time_us":958769}
I20260811 16:06:49.494920 21760 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:49.505007 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.482271 21617 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:49.517028 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:49.524315 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48215.4us
I20260811 16:06:49.525810 13905 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:49.533136 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.533921 13900 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.537230 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.538211 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.538632 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.538913 13743 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 17
I20260811 16:06:49.504536 21785 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:49.539640 21785 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.538676 21834 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260811 16:06:49.540148 21785 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:49.542428 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.543431 13906 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:49.544525 22026 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.494735 21740 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.552369 21740 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.520779 22003 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260811 16:06:49.555385 21906 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:06:49.553472 21671 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:49.555830 21906 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:49.556011 21671 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.556872 21906 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.560542 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:49.526364 21760 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.569876 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.570573 13741 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.538208 21882 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.565277 21984 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.576924 21775 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:49.506515 21987 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.579644 21987 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.580148 21993 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:06:49.569927 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.581154 21993 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:49.581521 21993 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:49.565044 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3291) took 1283 ms. Trace:
I20260811 16:06:49.567602 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.582172 13820 rpcz_store.cc:276] 0811 16:06:48.282095 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:48.302199 (+ 20104us) service_pool.cc:227] Handling call
0811 16:06:49.564795 (+1262596us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:49.564972 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1990792064}
I20260811 16:06:49.585615 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.586891 13905 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.592825 13818 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:49.585290 13743 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:49.591763 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:49.598174 13741 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:49.599337 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:49.600041 13821 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:49.600937 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.500723 21854 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:49.605269 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.605564 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.606438 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.605343 13826 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:49.607115 13821 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:49.607721 13823 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260811 16:06:49.605783 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:49.609282 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.610176 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.610584 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.611385 13822 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:49.610101 13904 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:49.611678 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.557015 21671 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.611600 21990 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260811 16:06:49.616670 21671 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.616856 21990 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:49.617367 21990 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:49.619457 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:49.620142 13824 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.621145 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.616086 21991 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.622008 21991 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:49.622485 21991 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.619457 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.623870 13817 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260811 16:06:49.620023 14573 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:06:49.619853 22014 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:49.635751 22014 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:49.612918 13821 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:49.636819 22014 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.614439 21882 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.640079 21882 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:49.640515 21882 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.642185 22036 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.643559 21989 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.652683 21602 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:06:49.653628 21574 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.654311 21789 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:49.654772 21789 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:49.655349 21993 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.656661 21993 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.631124 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:49.635001 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1632) took 1991 ms. Trace:
I20260811 16:06:49.618301 21990 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:49.658633 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.014s
W20260811 16:06:49.673055 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.004s	sys 0.014s
W20260811 16:06:49.673367 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 531897us
I20260811 16:06:49.614454 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:49.673897 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:49.659165 13824 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
W20260811 16:06:49.674332 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59970us
I20260811 16:06:49.669097 13900 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:49.671345 14574 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:49.688000 13905 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:49.690339 13902 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:49.691351 13903 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:06:49.692404 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.627965 21906 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:06:49.657022 21740 consensus_queue.cc:1159] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" responder_term: 19 status { last_received { term: 19 index: 14 } last_committed_idx: 13 last_received_current_leader { term: 19 index: 14 } }
I20260811 16:06:49.671872 13740 rpcz_store.cc:276] 0811 16:06:47.636952 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:47.677072 (+ 40120us) service_pool.cc:227] Handling call
0811 16:06:48.640825 (+963753us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:06:48.641114 (+   289us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:48.641548 (+   434us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:48.641590 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:49.352129 (+710539us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b2c0004cec8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:49.380586 (+ 28457us) log.cc:842] Serialized 26 byte log entry
0811 16:06:49.473942 (+ 93356us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:49.473994 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:49.474064 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:49.627797 (+153733us) raft_consensus.cc:1671] finished
0811 16:06:49.627822 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:49.627980 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9371,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":8897,"spinlock_wait_cycles":15848448,"thread_start_us":48803,"threads_started":1,"wal-append.queue_time_us":191694}
I20260811 16:06:49.717554 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:49.723403 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:49.692022 21602 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:49.692188 21986 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:49.694011 22041 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:49.629635 21854 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.710741 21773 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:49.730963 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:49.718443 21998 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:49.756163 21984 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:49.756289 21574 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.757082 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:49.755383 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.760591 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.761880 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.741148 21986 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.765362 14579 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.764425 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.745565 22036 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:49.755563 21987 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:49.723960 21617 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.728060 21992 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260811 16:06:49.757612 21773 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.729655 22007 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.778254 21987 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:49.780345 22008 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260811 16:06:49.796695 22027 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.802162 21991 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.768362 22004 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260811 16:06:49.803277 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 87247.7us
I20260811 16:06:49.847858 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.782949 22042 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:49.803602 22036 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.807961 21854 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.768383 21984 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.765983 22006 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:49.768787 22028 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.817243 22007 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.819474 21785 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.861191 14577 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:49.861394 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.862100 21785 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.809337 21773 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.863741 21984 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.821919 21617 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:49.824329 21985 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:49.869524 21991 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:49.869397 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.870474 13735 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:49.827435 14579 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:49.825513 21987 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.829005 13871 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.830875 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:49.831642 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.832669 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:49.879444 13743 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.848644 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:49.849918 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:49.880594 13738 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:49.851022 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 171595us
I20260811 16:06:49.855329 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.881525 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:49.882076 14582 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:49.777817 21986 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.885896 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:49.887993 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.889212 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:49.892824 13743 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:49.840564 21138 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260811 16:06:49.896775 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67885.9us
I20260811 16:06:49.896931 13874 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:49.898669 21713 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 16:06:49.899360 22051 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:06:49.900079 21713 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:49.900246 22051 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.900558 21713 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.901307 21752 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:49.901875 21752 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.901657 22051 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.901927 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.902649 13903 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:06:49.903015 21752 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:49.903957 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55453.8us
I20260811 16:06:49.904970 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.906159 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:49.909835 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.911453 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.911550 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.913573 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.913995 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:49.914453 13909 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:49.852195 22004 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:49.851948 22016 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260811 16:06:49.916304 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.917215 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:49.916517 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.858297 22028 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:49.923787 14582 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:49.923575 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.925283 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:49.925129 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.926254 13903 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:49.841213 22030 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260811 16:06:49.930320 21854 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:49.930787 21854 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:49.931119 21854 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.933921 21760 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:49.936890 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47754.7us
I20260811 16:06:49.940536 21994 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:06:49.941216 21990 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:49.894556 21985 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260811 16:06:49.938028 21138 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:49.945724 21138 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:49.947108 21138 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.938315 21453 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:49.949633 21453 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:49.926066 13820 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:06:49.938746 21991 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:49.928102 22028 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.950819 21453 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.917735 21602 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260811 16:06:49.854090 21888 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.954041 21453 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:49.940193 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:49.956055 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47733.9us
I20260811 16:06:49.877166 22006 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:49.957038 14542 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:49.957777 22006 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.905192 22036 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:49.927867 21785 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:49.958665 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.963647 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.952800 13905 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
W20260811 16:06:49.966008 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46932.9us
I20260811 16:06:49.908468 21890 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:49.916831 21617 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:49.976171 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.980065 21602 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:49.918816 22004 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:49.988579 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48504.5us
I20260811 16:06:49.990011 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:49.990382 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74825.5us
I20260811 16:06:49.991840 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:49.993857 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66158.1us
W20260811 16:06:49.993880 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 105964us
I20260811 16:06:49.995548 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:49.961798 21785 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:49.997085 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:49.946789 21882 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:49.971877 21740 raft_consensus.cc:2741] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260811 16:06:50.008987 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.004208 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.010767 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:49.980561 21602 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:49.982496 21617 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:50.012910 13907 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:49.988992 22014 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:49.996194 21991 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:50.001221 21574 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:50.025025 13741 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:49.999336 21785 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:50.028431 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:50.009385 21873 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:50.003311 21999 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:50.036204 13903 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260811 16:06:49.999225 21994 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260811 16:06:50.017030 21617 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:50.014920 21878 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:50.024057 21983 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:50.003512 22054 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.071s
I20260811 16:06:50.068918 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.071691 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:49.993883 21713 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.073333 21713 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:50.073498 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.025523 21888 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:50.077382 22027 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:50.077971 22027 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:50.036767 21873 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:50.055653 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.079408 21873 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:06:50.079820 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 52415.3us
I20260811 16:06:50.080221 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.080683 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:50.081379 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.082525 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:50.083550 22008 consensus_queue.cc:1159] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cec0688f86d54789b9b9ecc924ddecf3" responder_term: 17 status { last_received { term: 17 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 17 index: 9 } }
I20260811 16:06:50.084551 22018 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:50.085000 22037 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:50.085109 22018 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:50.085773 22018 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:50.088001 22054 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:50.088433 22054 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:50.089318 22054 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.058878 21760 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:50.091342 22056 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:50.092001 21882 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:50.055430 21602 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.093222 21602 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:50.059532 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.060367 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.061098 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.061853 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.062333 22049 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:50.098829 22049 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:50.099303 22049 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:50.091969 22056 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:50.081984 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:50.108551 13903 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260811 16:06:50.058151 22058 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260811 16:06:50.075060 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.031189 22014 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:50.117823 13909 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:50.008862 21789 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.123908 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.048166 22048 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:50.132663 21789 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:50.132637 22054 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:50.140534 22065 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260811 16:06:50.106662 21906 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260811 16:06:50.155812 13902 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
W20260811 16:06:50.157943 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76016.4us
I20260811 16:06:50.090741 21987 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.167569 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:50.120456 20779 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:50.134407 21989 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Stepping down as leader of term 12
I20260811 16:06:50.175683 22014 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.121697 21986 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.182302 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:50.191197 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:50.169986 21984 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Stepping down as leader of term 23
W20260811 16:06:50.182255 22060 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.129s	user 0.004s	sys 0.000s
I20260811 16:06:50.117293 21854 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.200625 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.213698 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.214313 13906 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:50.214627 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.220597 21986 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.206471 21852 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:06:50.222884 21852 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:50.223327 21852 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:50.196398 21873 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.228637 22004 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.229347 21873 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.230741 21617 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.232254 21987 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:50.233033 21617 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:50.234418 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.235538 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.236518 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.237149 13909 raft_consensus.cc:2362] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18. Re-sending same reply.
I20260811 16:06:50.173290 21878 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:50.243016 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.196364 21984 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:50.182693 21989 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:50.254465 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.254487 13905 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:50.255856 13905 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:50.161525 22027 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.239615 13900 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:50.143075 22028 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.205600 13741 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:50.121372 21773 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.245771 13909 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:50.203403 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:50.249909 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.250295 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.253043 13740 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:50.270483 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.259668 13739 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:50.230798 22004 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.266443 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.285545 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.256703 13905 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.267865 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.268620 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:50.238057 13820 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260811 16:06:50.211320 21819 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:50.280320 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:06:50.275808 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.277264 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.295254 13903 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:50.297802 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:50.298370 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:50.256328 22056 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.299587 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.300110 21773 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.300702 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.300830 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:50.301538 14583 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:50.290401 21990 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:50.278177 14575 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:50.279274 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.310791 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.279844 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:50.280647 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:50.287882 13905 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:50.290576 14581 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 12. Current term is 13. Ops: []
I20260811 16:06:50.292598 21888 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:50.295580 21819 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:50.319657 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.277870 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:50.320247 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 116931us
I20260811 16:06:50.295002 21987 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:50.315810 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.326160 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:50.316058 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:50.357066 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:50.312943 22027 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:50.361315 14579 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:50.361581 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:50.362272 13817 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:50.361366 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:50.363279 13820 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:50.364384 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53726.3us
I20260811 16:06:50.375459 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:50.375761 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:50.377229 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.379927 22028 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.380527 21888 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:50.428682 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:50.428699 13744 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:50.380800 22018 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.316891 21989 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.383541 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.387207 22026 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:50.395852 21854 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:50.358060 21987 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:50.399315 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:50.400197 21785 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.372036 21775 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:50.403739 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:50.301440 22049 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.416584 13904 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:50.419617 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:50.420984 13905 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260811 16:06:50.517705 13905 pending_rounds.cc:76] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 13
I20260811 16:06:50.518004 13905 pending_rounds.cc:97] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260811 16:06:50.518306 13905 raft_consensus.cc:2866] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:50.421370 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:50.422300 14573 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:50.367944 21984 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.422031 22001 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:06:50.430343 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69522us
I20260811 16:06:50.431401 13909 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:50.364466 21819 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:50.527760 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:50.432873 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:50.450351 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:50.454633 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 443993us
I20260811 16:06:50.530328 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.532274 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:50.320155 21574 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:50.473753 13742 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:50.444248 22026 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:50.454797 21987 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:50.486570 14582 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
W20260811 16:06:50.521052 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 101509us
W20260811 16:06:50.520527 22061 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
I20260811 16:06:50.450774 21888 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260811 16:06:50.553439 14578 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
I20260811 16:06:50.554425 13824 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:06:50.525185 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:50.526311 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.543505 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.523954 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:50.545821 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 267999us
W20260811 16:06:50.548094 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 191383us
I20260811 16:06:50.574131 13827 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260811 16:06:50.553490 13825 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260811 16:06:50.520147 21775 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:50.571960 13826 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:06:50.543015 22014 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:50.654711 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111291us
I20260811 16:06:50.537633 21983 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:50.549232 21773 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:50.681203 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 149045us
I20260811 16:06:50.556713 21992 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:50.665882 13709 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:50.689231 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:50.665896 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.690816 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.693928 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:50.664896 22057 log.cc:924] Time spent T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260811 16:06:50.527817 22051 consensus_queue.cc:1159] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f46150fac70458986206ec7af67a403" responder_term: 24 status { last_received { term: 21 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 23. Current term is 24. Ops: [23.13-23.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260811 16:06:50.702275 14574 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:50.652783 21990 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:50.653499 21854 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:50.653921 21842 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:50.720762 14579 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:50.703027 21775 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:06:50.760876 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:50.761140 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:50.703099 21602 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.000s
I20260811 16:06:50.670614 21852 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.727087 21138 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:50.772104 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:50.723203 21992 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:50.775161 13817 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:50.776747 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:50.751063 21713 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.000s
I20260811 16:06:50.741686 21991 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:50.752434 21990 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260811 16:06:50.785462 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 212370us
I20260811 16:06:50.755129 22049 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.794327 13907 raft_consensus.cc:2396] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260811 16:06:50.768245 22018 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:50.764333 21890 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:50.796653 14574 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:06:50.802475 21992 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.773061 21574 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:50.814465 21878 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.573s	user 0.002s	sys 0.007s
W20260811 16:06:50.815893 22080 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:06:50.817325 14574 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:50.819618 21984 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:06:50.828421 22073 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260811 16:06:50.783669 21785 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.835364 21878 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:50.798213 22071 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
W20260811 16:06:50.836352 22088 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260811 16:06:50.824489 21890 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:06:50.741317 21842 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.845846 14574 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
W20260811 16:06:50.798473 22068 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
W20260811 16:06:50.848229 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 144115us
W20260811 16:06:50.798368 22074 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260811 16:06:50.860996 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.873930 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.878787 13736 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:06:50.882917 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:50.885802 21906 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:06:50.886462 22082 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260811 16:06:50.886801 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:50.876468 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:50.784655 21752 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260811 16:06:50.893491 13820 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.520s	user 0.014s	sys 0.000s
I20260811 16:06:50.898022 14579 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
W20260811 16:06:50.899607 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 151362us
I20260811 16:06:50.893934 13820 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:50.888159 21990 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:50.894691 21906 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:50.916741 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:50.851874 22072 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.209s
I20260811 16:06:50.930184 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:50.900046 22049 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260811 16:06:50.895117 21878 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260811 16:06:50.895324 22018 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260811 16:06:50.922288 21986 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:50.943624 13817 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:50.907558 21854 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260811 16:06:50.950906 13825 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260811 16:06:50.952919 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:50.954465 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:50.955315 13817 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:50.959447 21986 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:50.960744 21986 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.967161 21453 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:50.967691 21453 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:50.968509 21453 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:50.944474 21770 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:50.912122 21984 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260811 16:06:50.971095 13817 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:06:50.970450 21819 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:50.921962 22034 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260811 16:06:50.971678 22081 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260811 16:06:50.949443 21852 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:50.977139 21842 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:50.972164 21770 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:51.008920 13741 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: []
W20260811 16:06:51.011965 22086 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260811 16:06:51.012773 22036 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260811 16:06:51.031116 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 340397us
I20260811 16:06:50.993019 21713 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260811 16:06:50.983554 21785 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260811 16:06:51.032299 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:51.047950 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 317785us
I20260811 16:06:51.051884 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:51.053695 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.056417 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.059818 22091 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.060389 22091 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.062541 22091 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.033116 22094 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.076208 22103 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:06:51.078447 22075 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.592s	user 0.000s	sys 0.010s
I20260811 16:06:51.089286 22093 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:51.072079 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.079403 21770 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.090368 21984 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:51.089939 22093 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.067349 22008 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:51.091569 22008 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:51.092335 22093 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.092458 21984 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:06:51.083881 21990 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:51.086750 22103 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:51.096791 13744 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:06:51.070664 22034 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:51.105269 13739 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260811 16:06:51.092469 22008 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:51.102581 21987 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.004s
I20260811 16:06:51.094283 22094 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.107270 22026 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.108269 22093 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:51.109503 22094 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.109436 21987 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.110175 22094 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:51.105063 21574 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:06:51.082798 22101 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260811 16:06:51.108939 22093 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.099597 21842 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:51.106868 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.106379 22008 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:51.110874 13742 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:51.116218 13738 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:51.108381 22026 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:51.108289 13735 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:51.119349 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:51.118191 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:51.118534 13743 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:06:51.126950 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:51.127102 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.128104 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.129809 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.130352 13744 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260811 16:06:51.132040 13900 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:51.133460 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.134704 13741 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:51.136411 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:51.137413 14579 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:51.111666 22103 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.111528 21989 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:06:51.117916 21987 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.112844 21842 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:51.116956 22093 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.113171 21819 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:51.139155 22027 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.770s	user 0.014s	sys 0.000s
W20260811 16:06:51.141794 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 143847us
I20260811 16:06:51.153863 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:51.154129 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:51.136551 22034 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:51.161419 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.139389 21990 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:51.164103 13909 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:06:51.110674 22094 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.157714 21986 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:06:51.236315 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 77532.4us
W20260811 16:06:51.238230 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68613.7us
W20260811 16:06:51.238894 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 185305us
I20260811 16:06:51.248162 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.234899 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:51.160216 22092 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.250934 14579 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:51.152524 21906 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:51.234462 22093 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:51.170013 21990 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:51.261556 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.269188 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:51.247550 21986 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:51.151538 22103 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.273986 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:51.254774 22037 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.277370 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.279780 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:51.281184 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:51.282008 13905 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:06:51.278412 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.283694 13902 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:51.271428 21990 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:51.290688 21984 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:51.280784 21842 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.292387 21842 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:51.295575 21906 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:51.306360 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54994.9us
I20260811 16:06:51.310510 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:51.254846 22092 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.279173 21986 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:51.300630 22095 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:51.314764 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.303068 22102 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:51.333141 13905 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:06:51.338258 14579 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:06:51.307657 22004 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:06:51.283387 22104 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:51.309492 22101 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:51.279953 22072 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.044s
I20260811 16:06:51.354210 13904 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:06:51.340024 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.316170 13741 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:51.316747 21819 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 22.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260811 16:06:51.369275 22092 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.369922 22092 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:06:51.370296 22092 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:51.301186 22037 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.330900 21984 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260811 16:06:51.373548 22037 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.374477 21984 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:51.374979 21984 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:51.375550 22094 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.351004 22110 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:06:51.376129 21984 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.351219 22102 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.346649 21852 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:51.380899 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.382469 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:51.388749 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87986.7us
I20260811 16:06:51.391896 13737 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:51.388155 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20ad41e4f434442792e36eb47449b101. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:06:51.394676 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:51.399248 22108 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260811 16:06:51.383436 22049 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:51.402381 22049 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.363933 22004 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:51.366654 22042 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.366979 22104 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:51.388458 22092 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.9, Last appended by leader: 9, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:51.414181 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 126965us
I20260811 16:06:51.418593 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.414402 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.418038 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:51.420014 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:51.392921 21983 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.367367 21854 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260811 16:06:51.412056 21852 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:51.427829 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.381397 21878 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
W20260811 16:06:51.431877 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55423.3us
I20260811 16:06:51.434497 21713 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:51.434938 21713 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:51.435349 21713 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:51.435923 22098 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.410s	user 0.003s	sys 0.001s
I20260811 16:06:51.436791 22099 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:51.428766 22101 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:51.439818 22114 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:06:51.441167 21991 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:51.441561 21991 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:51.443815 22103 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.445650 21984 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:51.447536 22004 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:51.428766 22051 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260811 16:06:51.442404 21991 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.452787 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.462781 13737 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:06:51.466033 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:51.428853 22092 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:51.461488 22093 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:51.559027 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49546.5us
I20260811 16:06:51.476434 21991 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:51.416733 22042 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:51.567003 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2862) took 1503 ms (client timeout 1530 ms). Trace:
I20260811 16:06:51.467872 22125 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:06:51.568573 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 154857us
I20260811 16:06:51.429155 21983 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:51.574431 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 150238us
W20260811 16:06:51.572782 13907 rpcz_store.cc:269] 0811 16:06:50.057676 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:50.068538 (+ 10862us) service_pool.cc:227] Handling call
0811 16:06:51.555420 (+1486882us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54002c0bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:51.561037 (+  5617us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1658826496}
I20260811 16:06:51.577792 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:51.527225 22112 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260811 16:06:51.587463 22119 log.cc:924] Time spent T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260811 16:06:51.591307 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 171402us
I20260811 16:06:51.593312 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.599399 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:51.611835 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2253) took 1502 ms. Trace:
I20260811 16:06:51.612305 14582 rpcz_store.cc:276] 0811 16:06:50.109090 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:50.109376 (+   286us) service_pool.cc:227] Handling call
0811 16:06:50.109675 (+   299us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:50.548020 (+438345us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:51.611572 (+1063552us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400643cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:51.611764 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":866188672}
I20260811 16:06:51.620613 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.621037 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.584815 22112 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:51.567539 21854 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260811 16:06:51.594765 21906 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:51.607544 22093 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260811 16:06:51.650815 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 232840us
I20260811 16:06:51.600672 22049 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.655678 13825 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:06:51.665380 22135 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:51.666764 13907 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260811 16:06:51.666764 13825 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:06:51.668458 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:51.667264 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:51.629390 22112 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:06:51.692757 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46644.5us
I20260811 16:06:51.697662 13823 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:51.622694 22094 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260811 16:06:51.707894 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.702991 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.708707 13818 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:51.712500 13823 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260811 16:06:51.721956 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 118276us
I20260811 16:06:51.648355 21994 consensus_queue.cc:1046] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260811 16:06:51.676412 22133 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:51.743546 22138 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:51.639236 22099 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260811 16:06:51.744191 22101 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:51.724568 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.747448 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.689123 21986 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.691303 22102 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.749344 21983 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.752458 13824 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:51.767753 13825 raft_consensus.cc:2362] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15. Re-sending same reply.
I20260811 16:06:51.708328 22093 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.769662 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.768014 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:51.789464 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.790577 13825 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 13: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:51.785552 14579 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:51.693127 21890 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260811 16:06:51.800501 13740 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:51.805271 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.806283 13825 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:51.799517 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.814229 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:51.823908 22124 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260811 16:06:51.722131 21990 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.835167 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.836568 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.840378 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.840513 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.841747 13824 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:51.848330 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:51.842993 22148 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:51.851214 13822 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:51.860499 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.861441 13825 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:51.862433 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:51.874812 21819 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.875659 21819 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.798619 22093 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.881464 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:51.887652 22026 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.001s
I20260811 16:06:51.886019 13824 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:51.889402 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.890064 13824 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:51.848526 22042 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:51.776448 22138 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.892552 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:51.893275 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.893553 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:51.898017 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.898578 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:51.867962 21994 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:51.907091 22118 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:51.908249 21819 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.909556 22131 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260811 16:06:51.850660 22148 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.912370 21890 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:51.914036 22148 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.798696 22135 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:06:51.915693 22138 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.907912 22118 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.940362 13818 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:51.921798 13825 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:51.956022 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.867736 20779 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260811 16:06:51.878999 21602 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260811 16:06:51.974547 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 112206us
W20260811 16:06:51.919579 22008 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.794s	user 0.008s	sys 0.005s
I20260811 16:06:51.958386 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:51.907199 22105 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.962771 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.970875 13817 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:51.974462 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.976065 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:51.903789 21994 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:51.989490 22140 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:51.989850 21994 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:51.990187 22140 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.992650 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.993564 13822 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:51.994443 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:51.994953 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2857) took 1089 ms. Trace:
I20260811 16:06:51.995368 13736 rpcz_store.cc:276] 0811 16:06:50.905549 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:50.905738 (+   189us) service_pool.cc:227] Handling call
0811 16:06:50.906194 (+   456us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:51.255470 (+349276us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:51.255508 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:51.255567 (+    59us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:51.255612 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:51.994708 (+739096us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54003430d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:51.994763 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:51.994891 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":802815232}
I20260811 16:06:51.996402 22152 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:51.996958 20779 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:51.995826 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:51.984714 13818 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:51.998304 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:52.000029 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1424) took 1800 ms (client timeout 1810 ms). Trace:
W20260811 16:06:52.000458 13902 rpcz_store.cc:269] 0811 16:06:50.199788 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:50.199919 (+   131us) service_pool.cc:227] Handling call
0811 16:06:51.999868 (+1799949us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:51.999970 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2196045056}
I20260811 16:06:52.002635 21138 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:52.003366 21138 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:52.003867 21138 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:52.004835 21138 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.007670 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3275) took 1058 ms. Trace:
I20260811 16:06:52.008080 13900 rpcz_store.cc:276] 0811 16:06:50.949562 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:50.959379 (+  9817us) service_pool.cc:227] Handling call
0811 16:06:50.959910 (+   531us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:51.140103 (+180193us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:52.007407 (+867304us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400143a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:52.007599 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":395378048}
I20260811 16:06:52.012856 13825 raft_consensus.cc:1261] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:06:52.014041 13825 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:06:51.986038 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.016889 22093 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:51.996352 22127 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260811 16:06:52.022301 22037 raft_consensus.cc:3032] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:52.022773 22037 raft_consensus.cc:729] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:51.940913 22092 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:52.023603 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.023561 22092 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.024684 21785 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:52.024993 22109 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:52.025388 22109 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:52.026055 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.026479 22092 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.026237 22109 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.029023 22118 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:51.907857 22034 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:52.029838 22034 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:52.030237 13906 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:52.033610 13818 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:52.034090 21990 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:51.960839 22133 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:52.036454 22133 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.038039 13825 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:52.030272 22034 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:51.903401 22134 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260811 16:06:52.029342 22109 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:52.027541 22095 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:51.997514 20779 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:52.047003 13818 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:52.076191 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:52.076344 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 255807us
I20260811 16:06:52.077399 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.049782 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:52.077935 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.940073 21890 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:51.988651 22105 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:51.975328 22148 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:52.088287 13742 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:52.063988 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.073908 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:52.064929 21989 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.914s	user 0.012s	sys 0.001s
W20260811 16:06:52.065135 21713 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.629s	user 0.004s	sys 0.008s
I20260811 16:06:52.077988 13818 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:52.084849 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:51.954913 22137 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.120s
I20260811 16:06:52.065801 21785 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:06:52.068014 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.090215 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:52.081324 21991 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.004s
I20260811 16:06:52.096050 14544 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.097924 13818 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:52.098043 14580 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:52.102993 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.103768 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:52.104116 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 233464us
I20260811 16:06:52.104436 14580 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:52.105254 13818 raft_consensus.cc:1261] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260811 16:06:52.100996 22001 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.019s	sys 0.010s
I20260811 16:06:52.121528 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.122254 13902 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:52.123379 13823 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:52.083403 22095 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.097657 21713 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.101838 22138 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:52.125711 21713 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.126040 22095 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.095856 22151 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:06:52.125962 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.128901 13905 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:52.130983 13818 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260811 16:06:52.097308 22027 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:52.134639 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.112550 22148 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:52.142566 22138 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:52.146209 22105 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.149237 22112 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.133004 22028 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260811 16:06:52.133188 22042 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260811 16:06:52.087927 21890 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.152380 22008 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:06:52.136024 22131 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.154676 21890 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.154448 22131 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:52.158810 21984 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.000s
I20260811 16:06:52.151647 21989 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260811 16:06:52.128535 20779 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.155846 22027 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.127252 21785 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:52.163633 21785 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.164359 13824 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 23: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:52.165074 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.165782 21785 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:52.166023 22167 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:52.166381 21785 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:52.088742 22092 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260811 16:06:52.175367 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.119773 21986 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.177667 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.167382 22014 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:52.180044 22103 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:52.183219 22138 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:52.166947 22148 raft_consensus.cc:686] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:52.185837 22102 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:52.185946 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:52.187327 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:52.189014 22131 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:52.170325 21453 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:52.191679 13735 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260811 16:06:52.192375 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:52.196413 13736 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:52.196827 13740 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:52.204074 13820 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260811 16:06:52.210085 13820 pending_rounds.cc:76] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 14
I20260811 16:06:52.210513 13820 pending_rounds.cc:97] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260811 16:06:52.198112 13744 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:06:52.210389 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.210808 13820 raft_consensus.cc:2866] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:52.202154 13743 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:52.211194 13907 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
W20260811 16:06:52.121483 22001 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.020s	sys 0.010s
I20260811 16:06:52.217159 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.198068 13901 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:06:52.220084 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.244933 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.245913 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:52.246546 13903 raft_consensus.cc:2362] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18. Re-sending same reply.
W20260811 16:06:52.249419 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 111930us
I20260811 16:06:52.250133 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.252555 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.198691 22168 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:52.194883 22103 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:52.220221 21785 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260811 16:06:52.194754 22014 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:52.196084 22102 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:52.261430 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.262444 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:52.264881 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.220458 21842 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.263783 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:52.263125 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.274287 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.247835 22112 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.290587 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.203565 22111 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
W20260811 16:06:52.277628 22077 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.004s	sys 0.008s
I20260811 16:06:52.259656 22110 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:52.278007 22130 consensus_queue.cc:1035] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
I20260811 16:06:52.335597 13817 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260811 16:06:52.336331 22121 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.776s	user 0.002s	sys 0.000s
I20260811 16:06:52.337750 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2810) took 1085 ms. Trace:
I20260811 16:06:52.337994 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.288556 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:52.277009 14582 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:52.301730 13906 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:52.194519 22034 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.348727 14575 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:52.302158 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.302646 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:52.303678 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.304224 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.306851 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:52.351691 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47575.5us
I20260811 16:06:52.195847 22148 consensus_queue.cc:237] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.197400 22138 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.311448 22102 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.338244 13827 rpcz_store.cc:276] 0811 16:06:51.252414 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.252801 (+   387us) service_pool.cc:227] Handling call
0811 16:06:51.264192 (+ 11391us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:51.265947 (+  1755us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:51.265978 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:51.278291 (+ 12313us) log.cc:842] Serialized 26 byte log entry
0811 16:06:51.348032 (+ 69741us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:51.348082 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:51.348180 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:52.335582 (+987402us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:52.337372 (+  1790us) raft_consensus.cc:1671] finished
0811 16:06:52.337424 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:52.337688 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14376,"raft.queue_time_us":12367,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":8339,"spinlock_wait_cycles":14504192,"thread_start_us":57530,"threads_started":1,"wal-append.queue_time_us":132853}
I20260811 16:06:52.311806 21994 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.313042 22056 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.313434 22167 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:06:52.314742 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:52.305894 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.279803 21842 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.321979 22103 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.381723 22103 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:52.316331 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:52.386756 22177 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260811 16:06:52.325681 22123 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.813s	user 0.001s	sys 0.001s
I20260811 16:06:52.301709 21785 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:52.393498 22159 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:52.394465 13901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2871) took 2170 ms (client timeout 2153 ms). Trace:
I20260811 16:06:52.395982 21994 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.327935 22079 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
W20260811 16:06:52.305100 22077 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.005s	sys 0.009s
I20260811 16:06:52.297338 22151 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260811 16:06:52.329576 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1436) took 1020 ms. Trace:
I20260811 16:06:52.413694 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2807) took 1162 ms. Trace:
I20260811 16:06:52.334216 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.280995 13789 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.327939 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.415845 13820 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
W20260811 16:06:52.415490 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 134573us
I20260811 16:06:52.413875 13904 rpcz_store.cc:276] 0811 16:06:51.308645 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.308788 (+   143us) service_pool.cc:227] Handling call
0811 16:06:51.324570 (+ 15782us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:51.354730 (+ 30160us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:52.329251 (+974521us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5400321254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:52.329485 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":60791552}
W20260811 16:06:52.358803 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55229.3us
I20260811 16:06:52.360839 22001 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:52.366310 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:52.367120 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61263.7us
W20260811 16:06:52.371508 22174 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260811 16:06:52.373392 22056 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.374781 13902 raft_consensus.cc:2354] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:06:52.378209 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.380312 22130 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
W20260811 16:06:52.394982 13901 rpcz_store.cc:269] 0811 16:06:50.223747 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:50.302715 (+ 78968us) service_pool.cc:227] Handling call
0811 16:06:52.394210 (+2091495us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002ad0d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:52.394362 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4014970112}
W20260811 16:06:52.407747 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93088.1us
I20260811 16:06:52.423235 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:52.414191 13826 rpcz_store.cc:276] 0811 16:06:51.251440 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.252569 (+  1129us) service_pool.cc:227] Handling call
0811 16:06:51.258850 (+  6281us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:51.259195 (+   345us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:51.259228 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:51.271387 (+ 12159us) log.cc:842] Serialized 26 byte log entry
0811 16:06:51.377612 (+106225us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:51.377652 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:51.377724 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:52.325056 (+947332us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:52.406435 (+ 81379us) raft_consensus.cc:1671] finished
0811 16:06:52.406465 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:52.413621 (+  7156us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6517,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":13129,"spinlock_wait_cycles":7102720,"thread_start_us":56751,"threads_started":1,"wal-append.queue_time_us":127085}
I20260811 16:06:52.432344 14578 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:52.433825 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:52.435885 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.437319 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.414673 21785 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:52.437999 13817 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:52.410533 22079 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:52.439522 14583 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:52.440871 13826 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260811 16:06:52.444574 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.449404 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.450469 14573 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:52.450986 13827 raft_consensus.cc:1226] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260811 16:06:52.451813 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:52.425336 22110 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260811 16:06:52.446821 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.438047 22027 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.479588 22179 ts_tablet_manager.cc:927] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.481037 22161 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:06:52.481550 22161 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:52.482004 22161 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:06:52.481459 22028 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260811 16:06:52.489156 22034 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:52.441610 22167 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260811 16:06:52.492357 13825 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:52.463469 22144 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:52.494067 22144 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:52.495123 22144 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.496500 22167 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:52.496737 22056 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.497190 22079 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.497124 22167 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.498377 22079 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:52.500528 22167 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.461789 22001 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:52.462517 21989 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:52.503765 21989 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:52.504189 21989 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:52.453780 22130 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:52.446010 21906 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260811 16:06:52.507001 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.507068 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.508891 21713 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.509079 13901 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:52.509429 21713 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.508226 22130 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:52.512322 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63013.6us
I20260811 16:06:52.513392 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.471621 13820 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:06:52.446368 22095 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:52.559770 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.560905 14577 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:52.520141 21713 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.521040 22109 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:52.524142 22056 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:52.576597 22135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43350 (request call id 2) took 3308 ms. Trace:
I20260811 16:06:52.577185 22135 rpcz_store.cc:276] 0811 16:06:49.259006 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:49.259171 (+   165us) service_pool.cc:227] Handling call
0811 16:06:49.524054 (+264883us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502feada 00007f5c502fe763 00007f5c502fe701 00007f5c51947601 00007f5c518993ee 00007f5c51907ab9 00007f5c51908ada 00007f5c51907c8b 00007f5c51913084 00007f5c51912743
0811 16:06:49.650295 (+126241us) log.cc:842] Serialized 506 byte log entry
0811 16:06:49.805063 (+154768us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b1800243040. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:06:50.120555 (+315492us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b1800175740. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51948f11 00007f5c5189df91 00007f5c51886545 00007f5c5188b771 00007f5c5188b6f9 00007f5c5188b689 00007f5c5188b651 00007f5c5188a81d 00007f5c57c48204 00007f5c57c48039
0811 16:06:50.127687 (+  7132us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502feada 00007f5c502fe763 00007f5c502fe701 00007f5c51948d62 00007f5c51948f05 00007f5c5189df91 00007f5c51886545 00007f5c5188b771 00007f5c5188b6f9 00007f5c5188b689
0811 16:06:50.377974 (+250287us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5400208620. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a5416 00007f5c5189edaa 00007f5c5189e014 00007f5c51886545 00007f5c5188b771 00007f5c5188b6f9 00007f5c5188b689 00007f5c5188b651 00007f5c5188a81d 00007f5c57c48204
0811 16:06:52.566901 (+2188927us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":77950,"raft.queue_time_us":6689,"raft.run_cpu_time_us":10836,"raft.run_wall_time_us":993683,"spinlock_wait_cycles":79104000,"thread_start_us":76615,"threads_started":1,"wal-append.queue_time_us":131426,"wal-append.run_cpu_time_us":2214,"wal-append.run_wall_time_us":1091652}
I20260811 16:06:52.551824 22095 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:52.590517 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:52.591333 13825 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:52.601079 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.610245 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:52.635588 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44911.1us
I20260811 16:06:52.637614 13825 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:52.655369 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.668004 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:52.649678 22030 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.676245 13901 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:52.658354 21906 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:52.667739 22042 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:52.678159 22149 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:52.694975 22159 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:06:52.699393 22159 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:52.708828 22140 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:52.716270 22184 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260811 16:06:52.719368 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1438) took 1127 ms. Trace:
I20260811 16:06:52.724427 13902 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:52.727492 22149 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:52.719950 13909 rpcz_store.cc:276] 0811 16:06:51.592451 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.592821 (+   370us) service_pool.cc:227] Handling call
0811 16:06:51.593178 (+   357us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:06:51.593529 (+   351us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:51.593556 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:06:52.337839 (+744283us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:52.338423 (+   584us) log.cc:842] Serialized 52 byte log entry
0811 16:06:52.518592 (+180169us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:52.518646 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:52.518747 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:52.718849 (+200102us) raft_consensus.cc:1671] finished
0811 16:06:52.718880 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:52.719238 (+   358us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":44996,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11544,"spinlock_wait_cycles":3511168,"thread_start_us":154874,"threads_started":1,"wal-append.queue_time_us":208002}
W20260811 16:06:52.730546 22172 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.423s	user 0.001s	sys 0.000s
W20260811 16:06:52.732470 22175 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260811 16:06:52.689908 22042 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:52.739445 13789 leader_election.cc:398] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:06:52.692790 21906 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.686080 22093 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260811 16:06:52.756156 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3338) took 1009 ms. Trace:
I20260811 16:06:52.756848 21906 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:52.756587 13824 rpcz_store.cc:276] 0811 16:06:51.747190 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.896740 (+149550us) service_pool.cc:227] Handling call
0811 16:06:52.755941 (+859201us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540014dcd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:52.756092 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":610208000}
I20260811 16:06:52.779757 13818 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260811 16:06:52.675484 22095 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.743809 22042 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:52.786677 13909 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:52.788455 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.789139 13904 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:52.789494 22110 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:52.793684 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:52.799783 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3326) took 1096 ms. Trace:
I20260811 16:06:52.790032 22110 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.686398 22030 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.807734 22037 consensus_queue.cc:260] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.808917 22037 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:52.809516 22030 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:52.810135 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 222700us
I20260811 16:06:52.750880 22103 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260811 16:06:52.812294 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.814778 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:52.815449 13824 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:52.728581 22149 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:52.818948 22173 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.489s	user 0.002s	sys 0.000s
I20260811 16:06:52.813699 14579 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:52.820592 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:52.821382 22203 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:52.822036 22203 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.798558 22154 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:52.831120 13821 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260811 16:06:52.832372 22051 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:52.832831 22051 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:52.833205 22051 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:52.837566 22014 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.800267 13822 rpcz_store.cc:276] 0811 16:06:51.703324 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.999462 (+296138us) service_pool.cc:227] Handling call
0811 16:06:51.999780 (+   318us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:52.063876 (+ 64096us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:52.063908 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:52.065661 (+  1753us) log.cc:842] Serialized 26 byte log entry
0811 16:06:52.209877 (+144216us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:06:52.427920 (+218043us) log.cc:842] Serialized 14 byte log entry
0811 16:06:52.436350 (+  8430us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:52.436420 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:52.729952 (+293532us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:52.795278 (+ 65326us) raft_consensus.cc:1671] finished
0811 16:06:52.798350 (+  3072us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:52.799705 (+  1355us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71331,"prepare.queue_time_us":139399,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":73012,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":12678,"spinlock_wait_cycles":27698944,"thread_start_us":287547,"threads_started":2,"wal-append.queue_time_us":193001}
I20260811 16:06:52.845500 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.700363 22159 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:06:52.846228 22203 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.853927 22110 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.839130 22014 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:52.859354 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.831349 22154 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:52.860436 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.862715 14578 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:52.863693 22093 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.887892 22093 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.890249 22093 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.874396 22159 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:52.844960 21989 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.901821 13902 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:52.902943 21989 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:52.904184 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.906015 13909 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:52.905189 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:52.907835 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:52.908706 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:52.865388 22154 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:52.920686 22026 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:52.928114 22026 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:52.928488 22026 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:52.923674 22161 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:52.932446 22161 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:52.934245 22185 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.356s	user 0.001s	sys 0.001s
W20260811 16:06:52.936050 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 854374us
I20260811 16:06:52.937902 22102 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:52.938696 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:52.940089 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:52.940726 13822 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:06:52.940776 20779 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:52.923691 22151 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:52.941707 22151 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:52.952643 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:52.950448 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.976696 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:52.979286 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:52.980191 13744 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:52.995518 13824 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:06:52.974416 21989 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260811 16:06:53.000953 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 933000us
I20260811 16:06:53.002190 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:52.996395 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.003710 13743 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:53.006474 13743 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:52.982064 22030 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:52.986205 22092 consensus_queue.cc:1225] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5088cdd3f79d4c47ba826dc820b3cfaf log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260811 16:06:52.957449 22148 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260811 16:06:52.986951 22103 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:06:53.016124 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.017906 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.024654 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.026369 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:53.035856 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.036285 21992 consensus_queue.cc:1035] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:06:53.036779 13740 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:53.038542 21992 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:52.993480 22129 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260811 16:06:53.012974 21834 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:53.042467 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.042479 13822 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:06:53.016284 22151 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.059641 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.066555 13735 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:06:53.063215 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:53.027915 21882 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.064424 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:53.065069 22209 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260811 16:06:53.111099 13743 raft_consensus.cc:1261] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260811 16:06:53.069087 22212 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260811 16:06:53.021991 22103 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:53.114660 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3290) took 1231 ms. Trace:
I20260811 16:06:53.114961 22154 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.117437 14583 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:53.115166 13905 rpcz_store.cc:276] 0811 16:06:51.883374 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.883522 (+   148us) service_pool.cc:227] Handling call
0811 16:06:53.114493 (+1230971us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:53.114602 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":527758720}
I20260811 16:06:53.119176 22110 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:53.122026 22051 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.010856 22130 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260811 16:06:53.081795 14578 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:53.084524 13737 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Stepping down as leader of term 19
W20260811 16:06:53.085889 22213 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260811 16:06:53.085763 22090 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:53.087471 21882 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.039866 22091 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260811 16:06:53.091981 22210 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:06:53.017496 22030 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.114208 22103 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.123611 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2823) took 1220 ms. Trace:
I20260811 16:06:53.124306 22154 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.188732 13818 rpcz_store.cc:276] 0811 16:06:51.903368 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:52.137811 (+234443us) service_pool.cc:227] Handling call
0811 16:06:52.766681 (+628870us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:52.780481 (+ 13800us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:53.123416 (+342935us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540014dcd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:53.123552 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1445220608}
I20260811 16:06:53.039021 21992 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:53.128203 21785 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:53.127828 22042 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.134560 13742 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:06:53.063100 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:53.139762 13737 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:53.180024 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:53.183369 14573 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:06:53.213680 14578 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:53.229796 13735 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260811 16:06:53.231400 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168281us
I20260811 16:06:53.236898 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:53.233217 13737 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.240134 22134 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:53.241052 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:53.243474 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 180467us
I20260811 16:06:53.243975 21989 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:06:53.244576 21989 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:53.245739 22208 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260811 16:06:53.245514 21989 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.248821 22026 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.240303 21834 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.178663 22148 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.251084 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:53.257187 13738 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:06:53.249152 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:53.216544 21992 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:53.210865 22219 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.218798 22092 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.257912 13904 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:53.259716 20779 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:53.216998 21785 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:53.256621 13706 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:53.214537 21453 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:53.271881 13907 raft_consensus.cc:2354] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:53.272925 13906 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260811 16:06:53.278239 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:53.277626 20779 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.259863 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.279299 13822 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:53.235206 22126 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.292439 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:53.245551 22159 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.293159 13735 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:06:53.256060 21878 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:53.252808 22099 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.309052 20779 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.309790 20779 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.314087 20779 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.287326 22219 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.278517 22102 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.323398 13738 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:06:53.301697 22008 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.005s	sys 0.010s
I20260811 16:06:53.299635 22110 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:53.335625 13741 raft_consensus.cc:595] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:53.337182 13741 raft_consensus.cc:603] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:53.308518 21878 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:53.330112 22203 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.339174 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:53.339354 20779 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.341885 13824 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:53.283034 22207 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260811 16:06:53.285497 21683 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260811 16:06:53.262272 21834 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.277344 22148 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.287878 22092 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.320160 21994 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:53.340270 22125 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.332966 21991 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:53.336207 22008 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.006s	sys 0.010s
I20260811 16:06:53.295987 21453 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.346449 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.308163 22159 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.338071 21983 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:53.348223 22110 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:53.363322 14541 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:53.364406 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:53.323289 22151 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260811 16:06:53.368132 13824 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:53.334118 22102 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.391829 21882 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.395605 22014 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:53.395262 21983 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.396071 22014 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:53.396481 22014 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:53.307878 22126 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.391635 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:53.399128 22126 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.319523 22099 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.401088 22099 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.401633 22026 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.402330 14541 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:53.402508 22030 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:53.360628 22034 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:06:53.403779 22102 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.404229 22034 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:53.405282 22034 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.406814 22034 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:06:53.372723 22092 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.373824 21453 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.344108 21878 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:53.418610 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.381361 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:53.385541 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:53.421177 13817 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 15
I20260811 16:06:53.406984 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:53.421360 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:53.407881 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.408063 22151 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:53.376744 22125 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.408653 22130 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:06:53.408762 22219 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.371059 21834 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.409022 22129 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:53.409792 14541 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:53.410745 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.360005 21994 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.414158 13824 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:06:53.346804 22203 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.400934 22148 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.381037 22051 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.451071 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.343894 21785 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.489387 21994 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.450910 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:53.453469 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.501475 13744 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
W20260811 16:06:53.501664 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50895.4us
I20260811 16:06:53.502503 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:53.503315 13744 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:53.504272 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.505381 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.408763 22042 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.507887 22106 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:06:53.458737 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49043.6us
I20260811 16:06:53.428025 22094 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:06:53.461182 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.514034 22093 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.514467 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:53.514703 22214 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.448s	user 0.001s	sys 0.002s
I20260811 16:06:53.515115 14578 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:53.520645 22148 consensus_queue.cc:1035] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:53.527299 22110 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.528622 13744 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:53.529466 13737 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:53.531252 13686 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:53.514709 22093 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.534569 22093 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.535307 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48244 (request call id 70) took 2219 ms. Trace:
I20260811 16:06:53.531033 22094 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.473336 13822 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:53.469705 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:53.475771 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.479979 22203 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:53.462776 22129 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:53.491780 22227 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260811 16:06:53.412876 13735 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
W20260811 16:06:53.492484 22234 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260811 16:06:53.497673 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1684) took 2139 ms. Trace:
I20260811 16:06:53.424760 22151 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:53.507337 13787 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:06:53.571264 13787 leader_election.cc:401] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:53.461179 22130 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:53.511514 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:53.574959 14573 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:53.529742 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.467097 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:53.535796 13741 rpcz_store.cc:276] 0811 16:06:51.315865 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.316013 (+   148us) service_pool.cc:227] Handling call
0811 16:06:53.535052 (+2219039us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:53.535204 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4542129536}
I20260811 16:06:53.541400 13737 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:06:53.577772 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2657) took 1392 ms. Trace:
I20260811 16:06:53.559849 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:53.544687 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75125.8us
I20260811 16:06:53.562745 13743 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:53.531256 14578 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:53.566536 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.511557 22159 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:53.580709 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:53.593921 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86752.9us
I20260811 16:06:53.649825 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.650146 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:53.650560 13741 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:53.658752 13735 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:53.645053 13737 rpcz_store.cc:276] 0811 16:06:52.184932 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:52.186487 (+  1555us) service_pool.cc:227] Handling call
0811 16:06:52.186797 (+   310us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:53.084399 (+897602us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003aee20. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5189c730 00007f5c5190e300 00007f5c5190f371 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc
0811 16:06:53.529068 (+444669us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b580090a4b0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51887f63 00007f5c518ebaba 00007f5c519033af 00007f5c51904b4e 00007f5c5190ec89 00007f5c5190f556 00007f5c5190bedf 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684
0811 16:06:53.577494 (+ 48426us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:53.577689 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2563135232}
I20260811 16:06:53.632375 13817 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
W20260811 16:06:53.577459 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 320920us
I20260811 16:06:53.570611 13739 rpcz_store.cc:276] 0811 16:06:51.358294 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:51.358973 (+   679us) service_pool.cc:227] Handling call
0811 16:06:51.359356 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:51.359696 (+   340us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:51.359735 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:52.387667 (+1027932us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b18003f4ea0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a
0811 16:06:53.131043 (+743376us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b2c0004cec8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:53.131721 (+   678us) log.cc:842] Serialized 26 byte log entry
0811 16:06:53.335253 (+203532us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:53.335334 (+    81us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:53.336037 (+   703us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:53.497390 (+161353us) raft_consensus.cc:1671] finished
0811 16:06:53.497422 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:53.497591 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3571,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":11341,"spinlock_wait_cycles":19038336,"thread_start_us":203018,"threads_started":1,"wal-append.queue_time_us":317419}
I20260811 16:06:53.662664 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:53.566819 22179 thread.cc:636] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.019s	sys 0.005s
I20260811 16:06:53.653069 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:53.565459 22129 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:53.565965 21713 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.660362 14573 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:06:53.679172 13743 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260811 16:06:53.565843 21986 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:53.680779 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:53.686017 13743 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:06:53.681243 13739 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
W20260811 16:06:53.619982 21987 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260811 16:06:53.690658 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:53.693606 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:53.693805 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.577296 22151 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:53.700569 13743 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:06:53.536525 22094 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.794164 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.710508 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.801312 22072 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.872617 13826 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:53.875501 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.874080 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:53.680446 22179 thread.cc:602] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.020s	sys 0.005s
I20260811 16:06:53.876137 13826 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:53.671862 22202 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:06:53.878780 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.804661 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.681020 22001 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:53.671058 21983 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.670841 22137 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.810333 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.810679 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.688687 21138 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:53.789970 22051 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260811 16:06:53.792358 22093 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.823017 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2655) took 1638 ms. Trace:
I20260811 16:06:53.905690 13742 rpcz_store.cc:276] 0811 16:06:52.184273 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:52.187828 (+  3555us) service_pool.cc:227] Handling call
0811 16:06:52.188099 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:53.225139 (+1037040us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:53.822695 (+597556us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54000a8cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:53.822937 (+   242us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2175603456}
I20260811 16:06:53.699553 22159 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.115s
I20260811 16:06:53.706192 21713 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.698905 22219 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.826381 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.827662 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.689213 22105 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:54.015192 14578 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:53.834858 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.839802 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.840519 14574 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:06:53.841861 13735 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:53.881560 22138 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.811641 22042 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260811 16:06:53.845687 22014 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:53.813567 22134 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.001s
W20260811 16:06:53.857481 21992 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.003s
I20260811 16:06:53.707794 22238 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:53.858233 21842 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:53.865155 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.066951 22238 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.067883 13817 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:53.617560 22112 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:53.885753 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:53.886008 13743 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:54.071878 13743 raft_consensus.cc:595] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:54.072257 13743 raft_consensus.cc:603] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:54.072219 22138 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:53.886212 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:53.880290 13826 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:54.074368 21713 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.074591 22138 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:53.894739 14579 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:53.903997 13822 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:06:54.076566 21785 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:53.701097 22165 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:54.038651 22161 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260811 16:06:54.077646 22165 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.078104 22165 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:54.026144 21989 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.053s	sys 0.101s
I20260811 16:06:53.871630 22071 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:54.032923 22219 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.015172 13820 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:54.011437 22154 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:53.800047 21453 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.009692 13706 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:54.091370 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 81810.1us
I20260811 16:06:53.887615 22001 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:54.043723 21992 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:53.907972 22137 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.025375 22049 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.057605 22094 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.018764 22179 tablet_copy_client.cc:316] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:06:54.061929 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.063714 22245 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.071468 22112 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.017832 21138 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:53.897598 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:53.902638 13821 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:54.076836 22126 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.082547 21906 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.084836 22014 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:53.871701 22106 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:54.088354 22071 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:53.880333 22099 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:53.884446 22072 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:54.085798 21989 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.053s	sys 0.101s
I20260811 16:06:54.079375 22134 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:06:54.103984 13735 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260811 16:06:54.101594 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d00255c500904da78a120b3431f1e31d, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.082934 22238 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.119912 13741 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:06:54.097992 22001 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:54.030884 22105 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:54.123193 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 331828us
I20260811 16:06:54.097600 21834 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:54.019824 22093 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.138900 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2897) took 1279 ms. Trace:
I20260811 16:06:54.185132 13907 rpcz_store.cc:276] 0811 16:06:52.859394 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:52.860121 (+   727us) service_pool.cc:227] Handling call
0811 16:06:54.138718 (+1278597us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:54.138844 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":912529280}
W20260811 16:06:54.142369 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 244888us
I20260811 16:06:54.146862 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:54.168973 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 465151us
W20260811 16:06:54.168820 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d00255c500904da78a120b3431f1e31d, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.093710 21453 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.150635 22218 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:54.193238 14573 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:54.099727 22154 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:06:54.194139 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.190339 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.195291 13818 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:54.195331 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:54.195665 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.114298 22049 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.161029 22071 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:54.181226 13735 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:54.165506 22106 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:54.199168 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.200858 13742 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:06:54.196746 22218 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.200991 22106 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.201555 22105 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.201833 22218 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:54.202497 22105 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:54.203004 22105 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.205727 22105 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.206398 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2664) took 1165 ms. Trace:
I20260811 16:06:54.143725 22126 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.206817 13740 rpcz_store.cc:276] 0811 16:06:53.040720 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.040901 (+   181us) service_pool.cc:227] Handling call
0811 16:06:53.041287 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:53.060810 (+ 19523us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:53.060855 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:53.061294 (+   439us) log.cc:842] Serialized 26 byte log entry
0811 16:06:53.541778 (+480484us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b1800370600. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:06:53.948773 (+406995us) raft_consensus.cc:1631] Marking committed up to 7
0811 16:06:53.948836 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:53.948947 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:54.206099 (+257152us) raft_consensus.cc:1671] finished
0811 16:06:54.206121 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:54.206337 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5387,"raft.queue_time_us":25481,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":18144,"spinlock_wait_cycles":21613440,"thread_start_us":406617,"threads_started":1,"wal-append.queue_time_us":1077947}
I20260811 16:06:54.208400 22137 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:54.208925 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.211226 14577 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:54.211282 21990 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:54.213217 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:54.213922 13738 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:54.198108 22102 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:54.197942 22103 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260811 16:06:54.217813 22219 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.210173 22154 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.226462 22154 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.227169 22154 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.228447 22238 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:54.228922 22238 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:54.229303 22238 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:54.229914 22154 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.230520 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.231295 21138 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.232275 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.234512 22244 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:54.234947 22151 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.236809 21992 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.237167 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.239467 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.238808 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.247521 13740 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:54.249913 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.250279 22165 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.255420 22151 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.239868 22112 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.167954 22099 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.242622 22125 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.256196 22079 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:54.145747 21906 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.241190 22072 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:54.274065 13709 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:54.191169 22014 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:54.280570 13823 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:54.249979 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2663) took 1214 ms. Trace:
I20260811 16:06:54.254143 22218 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.252214 22202 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:06:54.327044 22072 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:54.327682 22072 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.329903 22072 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:54.136093 22245 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.314360 13736 rpcz_store.cc:276] 0811 16:06:53.035421 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.038505 (+  3084us) service_pool.cc:227] Handling call
0811 16:06:53.038880 (+   375us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:53.061121 (+ 22241us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:06:53.227983 (+166862us) log.cc:842] Serialized 14 byte log entry
0811 16:06:53.606990 (+379007us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:53.649805 (+ 42815us) log.cc:842] Serialized 26 byte log entry
0811 16:06:53.649969 (+   164us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:53.650002 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:54.249569 (+599567us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b54000302d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:54.249620 (+    51us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:54.249671 (+    51us) raft_consensus.cc:1671] finished
0811 16:06:54.249762 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:54.249914 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":101373,"prepare.queue_time_us":42875,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":30023,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":37498,"spinlock_wait_cycles":50054912,"thread_start_us":462055,"threads_started":2,"wal-append.queue_time_us":798775}
I20260811 16:06:54.337088 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.339210 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.340116 13736 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:54.297525 22079 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.346640 13735 raft_consensus.cc:595] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:54.347116 13735 raft_consensus.cc:603] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:54.199066 22138 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.132s
I20260811 16:06:54.324494 22112 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:54.326396 22129 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
W20260811 16:06:54.303340 22110 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.062s	sys 0.096s
W20260811 16:06:54.322185 22034 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.896s	user 0.013s	sys 0.000s
I20260811 16:06:54.346004 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.321363 22125 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:06:54.323668 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.319550 13738 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:54.368431 13742 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260811 16:06:54.369097 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:54.359803 22110 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.063s	sys 0.097s
I20260811 16:06:54.355825 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:54.355005 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.349144 22079 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:54.376888 13737 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:54.379609 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.385560 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.387826 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.389938 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.361438 22129 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.375301 21602 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:54.395462 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:54.401808 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.376036 22130 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:54.370904 22260 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:54.360507 22112 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.377465 22245 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.386322 22134 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:54.381683 22165 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:54.372942 21890 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260811 16:06:54.387096 22256 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.416714 13706 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.418005 22238 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.389477 22110 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:54.419713 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.420923 13904 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:54.434165 13908 raft_consensus.cc:2354] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20.
W20260811 16:06:54.411826 21878 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.963s	user 0.007s	sys 0.007s
I20260811 16:06:54.411041 21986 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:54.426174 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.397279 22104 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:54.436192 14579 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:06:54.428170 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.402503 21602 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.432246 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.409224 22260 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:54.437270 14544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.021s	sys 0.050s
I20260811 16:06:54.475100 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.475409 14577 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
W20260811 16:06:54.475471 14544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.021s	sys 0.050s
I20260811 16:06:54.466464 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:54.468551 13789 leader_election.cc:398] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:54.411608 22090 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:54.438741 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.422415 22134 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:54.475874 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:54.495980 13789 leader_election.cc:401] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:06:54.494323 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:54.505236 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:54.505375 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.506328 14582 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:06:54.511356 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:06:54.514987 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73568.5us
I20260811 16:06:54.516024 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:06:54.519986 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 51655.3us
I20260811 16:06:54.524415 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:54.526571 13873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.039s
W20260811 16:06:54.526958 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.000s	sys 0.040s
I20260811 16:06:54.434060 21994 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:06:54.537919 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:54.538859 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.540448 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.493391 21602 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:54.421097 22130 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.545687 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.582280 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:54.589375 13825 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:54.506897 22090 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.504244 21453 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.612444 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.591792 14582 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:54.434415 22219 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260811 16:06:54.519171 22134 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:54.546711 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:54.545913 14577 raft_consensus.cc:2379] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:54.596197 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:54.597820 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.598786 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.600225 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.604238 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:54.606370 13821 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:06:54.535368 21990 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:54.606834 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.625648 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.626592 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.627070 13825 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:06:54.609534 13739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.013s	sys 0.056s
I20260811 16:06:54.609685 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:54.493741 22260 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:54.535336 22218 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.528204 22255 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:54.534767 22027 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:54.534536 21994 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.706017 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:54.620008 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.621193 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.467665 22110 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.622469 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.714710 13742 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:54.630142 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.630604 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:54.715759 13822 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:54.470439 21878 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.632879 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.634601 13787 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:06:54.717799 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2675) took 1418 ms. Trace:
I20260811 16:06:54.716871 13825 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:06:54.436424 22256 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.631765 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:54.632784 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.592200 22141 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:54.588109 22245 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:54.537431 22257 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.172s
I20260811 16:06:54.587644 22238 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.628841 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:54.715742 13824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.033s
W20260811 16:06:54.746150 13824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.033s
W20260811 16:06:54.633198 22251 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.339s	user 0.002s	sys 0.000s
W20260811 16:06:54.716957 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 88158.7us
W20260811 16:06:54.677749 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 131155us
I20260811 16:06:54.731204 13818 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:54.612334 22090 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:54.679360 22037 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:54.633610 22103 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:54.748893 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:54.682608 22261 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260811 16:06:54.677994 22051 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:54.501798 22104 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.718297 13741 rpcz_store.cc:276] 0811 16:06:53.299093 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.674145 (+375052us) service_pool.cc:227] Handling call
0811 16:06:53.674441 (+   296us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:54.184025 (+509584us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:54.717536 (+533511us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:54.717714 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1022638848}
I20260811 16:06:54.636823 21834 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:54.542402 22154 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:54.762179 13744 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:54.762872 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.863956 13820 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:54.864181 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.676334 22093 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:54.744891 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 114368us
I20260811 16:06:54.867941 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:54.714071 22027 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.869107 22027 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:54.677644 22130 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:54.766327 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 137597us
I20260811 16:06:54.875949 22129 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.756446 22141 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.877046 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:54.878429 22141 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.635582 22148 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:54.880088 22255 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:06:54.880848 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:54.767405 13823 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 13.
I20260811 16:06:54.716714 21994 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:06:54.883428 22001 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.687s	user 0.003s	sys 0.008s
I20260811 16:06:54.883898 22001 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.884986 13827 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
I20260811 16:06:54.762006 22245 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.886368 21878 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.856070 22257 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:54.675856 22112 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.750520 22218 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:54.887284 22257 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.887814 22218 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:54.889371 22257 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:54.889004 22218 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.637215 22056 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.131s
I20260811 16:06:54.892055 22104 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.856431 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.893427 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.894626 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.631028 21986 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.895803 22154 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.896909 22256 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.897913 22154 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.892778 13908 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:54.892778 13907 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:54.859090 21834 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:54.899775 21834 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:06:54.899889 22071 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260811 16:06:54.900331 22071 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.676115 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 20ad41e4f434442792e36eb47449b101 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:06:54.902444 22071 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:54.902519 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 20ad41e4f434442792e36eb47449b101 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-20ad41e4f434442792e36eb47449b101
I20260811 16:06:54.903388 13909 raft_consensus.cc:2354] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19.
I20260811 16:06:54.904424 22268 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:06:54.775552 22263 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:54.907328 22134 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:54.878751 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.909613 22134 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.680734 22258 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:54.910096 22263 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:54.910422 22258 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.912864 22258 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.855415 22051 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:54.914877 22051 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:54.906772 21602 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:54.916054 13737 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260811 16:06:54.917917 21602 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.923696 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.924830 22263 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:54.926982 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65812.2us
I20260811 16:06:54.894631 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.702569 21906 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.880107 22110 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:54.937235 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.938344 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:54.948272 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.948721 13818 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:06:54.950886 13743 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.037s	sys 0.058s
W20260811 16:06:54.951294 13743 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.037s	sys 0.058s
I20260811 16:06:54.959666 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.936369 13820 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:54.960273 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:54.963692 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:06:54.874269 21785 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.003s
I20260811 16:06:54.926829 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:54.933676 22245 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:54.939911 22104 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260811 16:06:54.993974 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67250.7us
I20260811 16:06:55.002445 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:54.928023 21138 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.033s	sys 0.058s
W20260811 16:06:55.005065 21138 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.033s	sys 0.058s
I20260811 16:06:54.995972 22130 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:55.003458 22110 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.006803 22110 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.009419 22110 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:55.010942 22273 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260811 16:06:54.995111 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62567us
I20260811 16:06:54.962199 22056 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:06:55.021787 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.009671 13742 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:54.961817 22267 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
I20260811 16:06:55.025429 22125 raft_consensus.cc:2741] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260811 16:06:54.940286 22129 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260811 16:06:54.961536 22106 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.046s	sys 0.072s
I20260811 16:06:54.965646 22266 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.004354 22104 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:55.029925 22106 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.047s	sys 0.072s
I20260811 16:06:55.017364 22207 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:55.018273 21785 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:55.043170 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.062142 13820 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:55.045787 13825 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:55.049484 13818 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:55.057353 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.058471 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:55.063033 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.064169 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:55.064095 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.065161 14582 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:55.066362 13818 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:55.066846 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:55.068636 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:55.071583 14583 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:55.072553 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:55.085243 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.041s
W20260811 16:06:55.088088 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.005s	sys 0.041s
I20260811 16:06:55.088538 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:55.087405 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51419.8us
I20260811 16:06:55.102720 13825 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260811 16:06:55.053328 22104 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:55.042128 22056 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.061203 22255 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.116405 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.116796 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:55.039577 22266 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.128844 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:55.158356 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:55.133419 22102 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.015s	sys 0.004s
I20260811 16:06:55.159314 22256 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:55.159554 22102 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.016s	sys 0.004s
I20260811 16:06:55.160022 22154 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:06:55.160590 22154 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.161038 22154 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:55.038389 22071 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260811 16:06:55.051993 22027 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:55.117689 13736 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.018s	sys 0.034s
I20260811 16:06:55.086180 21602 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
W20260811 16:06:55.176353 13736 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.018s	sys 0.034s
I20260811 16:06:55.149387 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:55.116075 13818 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:55.150310 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.082808 22265 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:55.085980 22134 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:55.112501 21878 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.177168 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:55.096733 22207 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:55.122108 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:55.112785 21138 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.112243 22245 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.176077 22219 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.116989 21785 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
W20260811 16:06:55.194439 22072 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.024s	sys 0.052s
W20260811 16:06:55.201525 22072 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.024s	sys 0.053s
I20260811 16:06:55.188006 22001 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.187292 21602 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:55.152555 22056 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.169870 22260 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:55.185492 13740 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.020s	sys 0.014s
W20260811 16:06:55.221297 13740 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.020s	sys 0.014s
I20260811 16:06:55.189347 22134 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:55.197322 22159 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:55.240988 21602 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.169304 22255 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.212253 22157 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:55.242410 22207 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.189213 21878 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.258451 21994 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.259423 22263 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:55.259956 21878 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.260524 21878 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:55.260828 21994 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.248657 13822 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260811 16:06:55.251618 14574 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:06:55.258030 22274 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260811 16:06:55.261024 21878 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.271538 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.203114 22219 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.274739 22219 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.269697 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:55.270272 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2890) took 1012 ms. Trace:
I20260811 16:06:55.276631 13736 rpcz_store.cc:276] 0811 16:06:54.258244 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.386570 (+128326us) service_pool.cc:227] Handling call
0811 16:06:54.386961 (+   391us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:54.387217 (+   256us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:54.387240 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:54.411591 (+ 24351us) log.cc:842] Serialized 26 byte log entry
0811 16:06:55.178446 (+766855us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:55.178490 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:55.178555 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:55.270048 (+ 91493us) raft_consensus.cc:1671] finished
0811 16:06:55.270072 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:55.270209 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":682094,"threads_started":1,"wal-append.queue_time_us":845563}
I20260811 16:06:55.270926 13923 tablet_copy_source_session.cc:205] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:06:55.276146 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3351) took 1565 ms. Trace:
I20260811 16:06:55.282254 13827 rpcz_store.cc:276] 0811 16:06:53.710382 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.839288 (+128906us) service_pool.cc:227] Handling call
0811 16:06:55.275979 (+1436691us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540004e054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:55.276087 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1992169216}
I20260811 16:06:55.276253 13821 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:55.286453 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2910) took 1600 ms. Trace:
I20260811 16:06:55.287022 13904 rpcz_store.cc:276] 0811 16:06:53.685821 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.685974 (+   153us) service_pool.cc:227] Handling call
0811 16:06:53.686253 (+   279us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:54.434251 (+747998us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:55.286138 (+851887us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400142654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:55.286378 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1689165696}
I20260811 16:06:55.297695 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:55.197847 21138 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.241052 22266 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:55.304075 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:55.305676 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.203362 22245 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:55.302525 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.006s	sys 0.020s
W20260811 16:06:55.309975 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.007s	sys 0.021s
W20260811 16:06:55.310355 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 552706us
I20260811 16:06:55.255199 22157 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:55.318095 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:55.199435 22028 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.015s
I20260811 16:06:55.282253 22154 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:06:55.313664 13821 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:55.350986 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1711) took 1156 ms. Trace:
I20260811 16:06:55.356283 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:55.330935 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.004s	sys 0.017s
I20260811 16:06:55.355501 13743 rpcz_store.cc:276] 0811 16:06:54.194558 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.196413 (+  1855us) service_pool.cc:227] Handling call
0811 16:06:54.196678 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:54.196881 (+   203us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:06:54.953839 (+756958us) log.cc:842] Serialized 14 byte log entry
0811 16:06:55.315885 (+362046us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:55.315964 (+    79us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:55.316037 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:55.316136 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:55.350883 (+ 34747us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1012589,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":73,"raft.queue_time_us":33831,"thread_start_us":1115224,"threads_started":2}
W20260811 16:06:55.360297 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.017s
I20260811 16:06:55.354656 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:55.253783 22159 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.360066 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:55.443205 13827 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260811 16:06:55.397109 13817 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260811 16:06:55.441390 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:55.358767 22028 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.018s	sys 0.015s
I20260811 16:06:55.446532 22159 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.427081 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.446484 13907 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:55.390293 22130 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.359433 22134 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.307449 22133 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.425563 22157 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.426545 22027 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.396744 22001 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.448557 22133 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.316139 22126 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:55.361244 22219 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:06:55.449610 22001 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.352730 22037 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:55.382175 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:55.430953 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.452641 22133 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:55.425616 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 262673us
I20260811 16:06:55.452970 22001 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:55.316915 22153 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.014s
I20260811 16:06:55.453312 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:55.453768 22153 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.021s	sys 0.015s
I20260811 16:06:55.454051 14580 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:06:55.450600 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.456238 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.456892 13827 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:06:55.448093 22130 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.461161 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.427289 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:06:55.575973 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 221413us
I20260811 16:06:55.361241 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:55.601773 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:55.354988 22112 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.251s
I20260811 16:06:55.601382 22102 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:55.606544 22102 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.607718 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:55.608024 22056 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.609362 22219 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:55.610365 22219 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.611284 22071 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:55.611898 22071 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:55.612855 22071 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.616145 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:55.616613 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:55.617301 14582 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:55.617442 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:55.622066 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46656.8us
I20260811 16:06:55.414673 21878 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:55.622457 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45327.9us
I20260811 16:06:55.607894 22130 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.635543 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.664050 13821 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:55.664680 14582 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:55.641151 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.632382 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:55.632429 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:55.632718 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.631880 14580 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:06:55.627416 22001 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:06:55.639997 13706 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.637s (SENT) [suppressed 17 similar messages]
W20260811 16:06:55.673151 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 551163us
W20260811 16:06:55.706655 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74360.3us
I20260811 16:06:55.711241 13707 leader_election.cc:398] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20.
I20260811 16:06:55.623601 22148 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260811 16:06:55.651029 21906 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:55.712677 22271 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.525s	user 0.001s	sys 0.001s
W20260811 16:06:55.724964 22090 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.961s	user 0.013s	sys 0.000s
I20260811 16:06:55.660274 22133 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.082s
W20260811 16:06:55.762720 14573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 2287) took 2059 ms (client timeout 1637 ms). Trace:
I20260811 16:06:55.717657 22260 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:55.760382 22051 consensus_meta.cc:287] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.002s
I20260811 16:06:55.757638 22112 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.795644 22051 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:55.770031 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 323084us
W20260811 16:06:55.769767 14573 rpcz_store.cc:269] 0811 16:06:53.703156 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.703302 (+   146us) service_pool.cc:227] Handling call
0811 16:06:55.762427 (+2059125us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540063e2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:55.762619 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":685014400}
W20260811 16:06:55.757019 22079 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.371s	user 0.009s	sys 0.005s
I20260811 16:06:55.742918 22130 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:55.798482 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2676) took 2497 ms. Trace:
I20260811 16:06:55.827934 13744 rpcz_store.cc:276] 0811 16:06:53.301515 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.674238 (+372723us) service_pool.cc:227] Handling call
0811 16:06:53.674500 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:54.881925 (+1207425us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:55.798143 (+916218us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400310e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:55.798405 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2500883072}
I20260811 16:06:55.747473 22282 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:55.804199 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 164245us
I20260811 16:06:55.751065 22001 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:55.821434 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.823318 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.835013 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.761322 22026 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:55.839202 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:55.839983 13744 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:06:55.841008 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:55.841296 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122679us
I20260811 16:06:55.841692 13744 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:06:55.802340 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 169977us
I20260811 16:06:55.831013 22130 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.761543 22293 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:55.833791 13821 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:55.850328 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.757546 21906 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:55.845511 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 137943us
I20260811 16:06:55.791085 22266 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260811 16:06:55.866339 22283 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260811 16:06:55.868719 22130 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.772998 22290 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:06:55.870801 22290 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:55.873657 22290 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:06:55.865521 22280 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260811 16:06:55.840232 21138 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.877691 22051 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.848827 22245 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.880187 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.880388 22179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ad41e4f434442792e36eb47449b101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:06:55.880496 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:55.882011 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:55.846890 13818 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:06:55.770399 22255 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.886808 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:55.851665 13821 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:55.773535 22094 consensus_queue.cc:1046] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260811 16:06:55.889122 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.863428 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:55.865521 22286 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260811 16:06:55.870586 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.903482 13908 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:06:55.871526 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.872977 22309 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:55.796113 22112 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:55.889634 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:55.909857 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:55.890448 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:55.854359 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.887300 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.913414 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:55.913830 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:55.900341 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.901415 14582 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:55.906297 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:55.772647 22090 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.916167 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.861876 22154 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.927163 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.911329 13744 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:55.935753 13908 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260811 16:06:55.933552 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:55.927603 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.912163 14580 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:55.827907 22079 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.892401 22302 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:55.940748 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.941763 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3348) took 2224 ms. Trace:
I20260811 16:06:55.883590 21983 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:06:55.939524 14581 raft_consensus.cc:1226] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
W20260811 16:06:55.914548 21834 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.009s	user 0.014s	sys 0.000s
I20260811 16:06:55.934026 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:55.917584 22245 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:06:55.850137 22026 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.945015 22028 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:55.946076 22049 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:55.946769 22090 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.938236 22255 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:55.947989 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2885) took 1691 ms. Trace:
I20260811 16:06:55.948767 13741 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: [18.17-18.17]
I20260811 16:06:55.967090 13740 rpcz_store.cc:276] 0811 16:06:54.256291 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.258628 (+  2337us) service_pool.cc:227] Handling call
0811 16:06:54.258998 (+   370us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:54.259634 (+   636us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:54.259670 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:54.260109 (+   439us) log.cc:842] Serialized 26 byte log entry
0811 16:06:55.223468 (+963359us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:55.223531 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:55.223640 (+   109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:55.947765 (+724125us) raft_consensus.cc:1671] finished
0811 16:06:55.947788 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:55.947924 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":962756,"threads_started":1,"wal-append.queue_time_us":1101197}
I20260811 16:06:55.969739 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:55.970093 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:55.900063 22091 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:55.950649 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:55.950428 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.932524 22266 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:55.849560 22001 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.984762 22290 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.001852 22266 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.003391 22001 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.003930 22290 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:55.913326 21138 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:55.950955 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.943038 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:55.942231 13824 rpcz_store.cc:276] 0811 16:06:53.709365 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.709489 (+   124us) service_pool.cc:227] Handling call
0811 16:06:53.816128 (+106639us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:54.122142 (+306014us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:54.122192 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:54.139800 (+ 17608us) log.cc:842] Serialized 26 byte log entry
0811 16:06:54.746621 (+606821us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:06:54.752373 (+  5752us) log.cc:842] Serialized 14 byte log entry
0811 16:06:54.752683 (+   310us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:54.752806 (+   123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:55.933170 (+1180364us) raft_consensus.cc:1671] finished
0811 16:06:55.933191 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:55.933339 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":2069,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":27381,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7840,"thread_start_us":868985,"threads_started":2,"wal-append.queue_time_us":924810}
I20260811 16:06:56.029486 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.029163 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:06:55.953203 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 201376us
I20260811 16:06:56.041473 13825 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:06:55.959529 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91083.2us
I20260811 16:06:55.938802 22265 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:55.956297 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 101470us
I20260811 16:06:55.956843 14575 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:55.962523 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.042954 13818 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:55.845695 22282 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:55.973269 22278 raft_consensus.cc:3032] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
W20260811 16:06:56.024699 22288 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260811 16:06:56.050153 22278 raft_consensus.cc:729] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:56.052191 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2892) took 1449 ms. Trace:
I20260811 16:06:56.052554 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48244 (request call id 72) took 1864 ms. Trace:
I20260811 16:06:55.979354 22277 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260811 16:06:55.974982 13827 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:55.980041 22304 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:56.059759 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:55.980406 22292 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:55.961468 21834 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.012879 22112 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:55.981118 22297 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:55.981560 22026 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:55.992967 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.990912 13736 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
W20260811 16:06:55.966259 22301 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260811 16:06:55.995169 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:55.990900 22028 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:56.000615 22027 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:55.923447 14583 raft_consensus.cc:2354] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:56.007125 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:56.009217 22268 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
W20260811 16:06:56.010351 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3314) took 1577 ms (client timeout 1976 ms). Trace:
I20260811 16:06:56.044435 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:06:56.137341 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 92989.6us
I20260811 16:06:55.967025 22255 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:56.139436 22255 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:56.140972 22318 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:56.141191 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.052580 13742 rpcz_store.cc:276] 0811 16:06:54.602663 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.026072 (+423409us) service_pool.cc:227] Handling call
0811 16:06:55.026556 (+   484us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:55.026835 (+   279us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:55.026871 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:55.028075 (+  1204us) log.cc:842] Serialized 26 byte log entry
0811 16:06:55.453615 (+425540us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:55.453653 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:55.453723 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:56.051972 (+598249us) raft_consensus.cc:1671] finished
0811 16:06:56.051999 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:56.052132 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":420553,"threads_started":1,"wal-append.queue_time_us":636022}
I20260811 16:06:56.142624 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.142746 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:56.052484 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:55.974639 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.052484 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.086982 22297 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.147734 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.148110 22297 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:56.049183 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:56.143764 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:56.148918 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 99924.5us
W20260811 16:06:56.136885 13909 rpcz_store.cc:269] 0811 16:06:54.433302 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.435328 (+  2026us) service_pool.cc:227] Handling call
0811 16:06:56.010094 (+1574766us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400320d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.010264 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":937020800}
W20260811 16:06:56.030182 22312 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260811 16:06:56.065452 13825 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:06:56.070966 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:55.980742 22284 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.061915 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:56.073405 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.180263 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:56.044862 22151 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:56.077646 21906 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.078887 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1652) took 1033 ms. Trace:
I20260811 16:06:56.078991 22079 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:56.060458 22071 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:56.081013 22293 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:56.081123 22034 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:56.073611 22304 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.085219 22311 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:56.085908 13818 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260811 16:06:56.024387 22266 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:56.096666 22285 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:56.238950 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:56.099429 13738 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:56.088515 22290 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.011s
I20260811 16:06:56.050513 22265 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.101002 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.051208 22278 consensus_queue.cc:260] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.104417 21987 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:56.113067 13903 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:06:55.918553 22309 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.141594 22318 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:56.053296 13735 rpcz_store.cc:276] 0811 16:06:54.179520 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.181030 (+  1510us) service_pool.cc:227] Handling call
0811 16:06:56.014608 (+1833578us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001dbd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.044019 (+ 29411us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":339770240}
I20260811 16:06:56.149421 13742 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:06:56.055413 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 121126us
I20260811 16:06:56.149832 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:56.051671 21878 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:56.260210 21878 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.181972 13902 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:56.153070 22027 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:56.248781 22104 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.006s
I20260811 16:06:56.230077 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:56.231050 14583 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:06:56.179098 22026 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:06:56.149513 22268 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:56.098696 21834 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.183346 14577 rpcz_store.cc:276] 0811 16:06:55.045882 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.046076 (+   194us) service_pool.cc:227] Handling call
0811 16:06:55.085745 (+ 39669us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:55.295308 (+209563us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:06:55.673689 (+378381us) log.cc:842] Serialized 14 byte log entry
0811 16:06:55.774443 (+100754us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:55.774501 (+    58us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:55.774554 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.077854 (+303300us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18003f4060. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:06:56.078662 (+   808us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400571f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:56.078697 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:56.078821 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13927,"prepare.queue_time_us":131397,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":14086,"raft.queue_time_us":98,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":19814,"spinlock_wait_cycles":523970176,"thread_start_us":470467,"threads_started":2,"wal-append.queue_time_us":190686}
I20260811 16:06:56.243984 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.188665 22112 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:56.153422 22282 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.252056 13825 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:06:56.240675 22079 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:06:56.257794 14573 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:06:56.262988 13742 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260811 16:06:56.186553 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:56.238698 21138 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:56.242103 22219 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.236910 22071 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.228437 22151 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.290966 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.188822 22284 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.238976 22034 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.344283 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:56.363003 14577 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:56.285692 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:56.364182 13826 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:56.256702 22318 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:56.371512 22001 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:06:56.374456 22157 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:56.378192 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3321) took 1261 ms. Trace:
I20260811 16:06:56.378715 13901 rpcz_store.cc:276] 0811 16:06:55.116376 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.116563 (+   187us) service_pool.cc:227] Handling call
0811 16:06:56.377948 (+1261385us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.378116 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2177964928}
W20260811 16:06:56.384509 22317 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260811 16:06:56.385025 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52448 (request call id 4) took 1332 ms. Trace:
I20260811 16:06:56.385546 13820 rpcz_store.cc:276] 0811 16:06:55.052983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.071549 (+ 18566us) service_pool.cc:227] Handling call
0811 16:06:56.384622 (+1313073us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b5400200b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519127c5 00007f5c5190ac1a 00007f5c5684e6d9 00007f5c4ff38184 00007f5c4ff38112 00007f5c4ff38041 00007f5c4ff37fbc 00007f5c4ff37272 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:56.384892 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":213846784}
I20260811 16:06:56.389447 14580 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:56.390491 22268 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.247680 22285 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.357407 22219 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.395740 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3376) took 1119 ms. Trace:
I20260811 16:06:56.396142 13817 rpcz_store.cc:276] 0811 16:06:55.276393 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.276558 (+   165us) service_pool.cc:227] Handling call
0811 16:06:56.395526 (+1118968us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b540014d7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.395661 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":207534336}
W20260811 16:06:56.353559 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 291701us
W20260811 16:06:56.356799 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 170304us
I20260811 16:06:56.402388 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:56.336854 13824 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260811 16:06:56.283250 22290 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:06:56.365371 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.245343 22311 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.368096 21878 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.253553 21987 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.334100 22079 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:56.348842 21138 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.262104 22028 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.414852 22314 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:56.422464 22265 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.369930 22151 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.370576 22260 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:56.424546 22260 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.272907 22104 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.296586 22090 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:56.444785 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.449666 14577 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:56.355923 22263 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260811 16:06:56.416023 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.417425 13787 leader_election.cc:398] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
I20260811 16:06:56.422806 22309 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.466958 13787 leader_election.cc:401] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260811 16:06:56.382895 22093 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Stepping down as leader of term 18
W20260811 16:06:56.406198 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 329831us
I20260811 16:06:56.429006 13817 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:56.423825 22027 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:56.432364 22311 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.480192 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:56.432281 21834 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:06:56.419559 22079 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:06:56.434672 22331 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260811 16:06:56.435694 22014 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:56.435988 21987 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.439587 22071 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.440593 22034 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.426100 22290 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:56.415337 13826 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:56.446370 22219 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.467022 13820 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:06:56.431540 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:56.468037 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50843.1us
I20260811 16:06:56.506251 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.446192 22090 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.509018 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.510766 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.511713 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.512033 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:56.492708 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 5f46150fac70458986206ec7af67a403 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 18 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:56.479769 22103 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15.
W20260811 16:06:56.501008 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 263328us
I20260811 16:06:56.476436 22093 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:56.490264 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.491393 22282 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election won for term 14
I20260811 16:06:56.512369 13820 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:56.516968 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:56.482323 22092 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260811 16:06:56.526995 22104 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:56.527650 22310 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:06:56.529716 22090 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.529882 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.494041 22014 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:56.533048 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.538066 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.533381 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.538753 13824 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:06:56.548183 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:56.548664 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.544866 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:56.507732 22285 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.550635 13706 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:56.537531 22219 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:06:56.533782 21138 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.525385 22284 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.562907 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:56.565666 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:56.539443 22103 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:56.534374 22304 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.536947 22282 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:56.545243 22265 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:56.529488 22093 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:56.595788 13823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2876) took 1963 ms (client timeout 1802 ms). Trace:
I20260811 16:06:56.582229 21992 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:56.558470 22314 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:56.600805 22099 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.588604 22290 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.601121 22314 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.589905 22336 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:56.602936 22336 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.603130 22093 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:56.603370 22336 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:56.586951 22343 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.594285 22103 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.604099 22334 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:56.582974 22112 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:56.598086 22265 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.566903 22260 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.596225 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.586939 22326 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260811 16:06:56.596263 13823 rpcz_store.cc:269] 0811 16:06:54.632408 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.632552 (+   144us) service_pool.cc:227] Handling call
0811 16:06:56.595615 (+1963063us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b5400125f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.595721 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":116999936}
I20260811 16:06:56.568276 22026 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:56.594322 14541 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:56.580487 22219 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.594595 22028 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260811 16:06:56.615559 22112 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:56.609336 22270 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.572s	user 0.004s	sys 0.000s
W20260811 16:06:56.621289 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55777.2us
I20260811 16:06:56.664238 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:56.657178 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 62947.2us
I20260811 16:06:56.592998 22134 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:06:56.614037 22292 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.002s
I20260811 16:06:56.680253 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.655160 22219 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:56.590900 22284 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:56.614749 22334 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.607211 21992 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:56.614060 22289 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:56.610102 21987 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:56.606748 22282 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:06:56.673542 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 127766us
I20260811 16:06:56.647449 22258 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:06:56.676565 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.664316 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:56.653326 22260 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:56.714386 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50164.4us
I20260811 16:06:56.681070 14577 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:56.662388 22263 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:06:56.692457 22292 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:56.720974 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:56.726768 22347 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:56.665815 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:56.610639 22297 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.741338 13901 raft_consensus.cc:2396] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260811 16:06:56.743033 22297 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.590612 22014 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.706319 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1708) took 3178 ms. Trace:
I20260811 16:06:56.692696 22284 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.730177 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.744647 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:56.745000 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 79274.1us
I20260811 16:06:56.732327 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2879) took 2014 ms. Trace:
I20260811 16:06:56.745684 13822 rpcz_store.cc:276] 0811 16:06:54.717830 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.718008 (+   178us) service_pool.cc:227] Handling call
0811 16:06:54.752834 (+ 34826us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:55.262597 (+509763us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.732036 (+1469439us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54002dbed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:56.732261 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1139529600}
I20260811 16:06:56.733361 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1722) took 2333 ms. Trace:
I20260811 16:06:56.747274 13737 rpcz_store.cc:276] 0811 16:06:54.400473 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.400661 (+   188us) service_pool.cc:227] Handling call
0811 16:06:54.401027 (+   366us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:54.916421 (+515394us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.733101 (+1816680us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540020add4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:56.733301 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1183921920}
I20260811 16:06:56.749050 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:56.733995 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1554) took 2196 ms. Trace:
W20260811 16:06:56.730751 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2891) took 2254 ms (client timeout 1773 ms). Trace:
I20260811 16:06:56.700380 22028 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:56.719043 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.719910 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:56.743462 13744 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:56.732928 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1728) took 1485 ms. Trace:
I20260811 16:06:56.756443 13743 rpcz_store.cc:276] 0811 16:06:55.248025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.359743 (+111718us) service_pool.cc:227] Handling call
0811 16:06:56.732707 (+1372964us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400278dd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.732866 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1693298560}
I20260811 16:06:56.757520 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.749967 14575 rpcz_store.cc:276] 0811 16:06:54.537991 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.539032 (+  1041us) service_pool.cc:227] Handling call
0811 16:06:54.539340 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:56.042685 (+1503345us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.733733 (+691048us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003d13d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:56.733905 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3259412864}
I20260811 16:06:56.759635 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.760485 14575 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:56.730851 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:56.750713 13738 rpcz_store.cc:269] 0811 16:06:54.476427 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.748548 (+272121us) service_pool.cc:227] Handling call
0811 16:06:56.730525 (+1981977us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400281ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:56.730654 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3056486144}
I20260811 16:06:56.743851 13739 rpcz_store.cc:276] 0811 16:06:53.528149 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:53.699901 (+171752us) service_pool.cc:227] Handling call
0811 16:06:53.700195 (+   294us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:54.104288 (+404093us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:54.104368 (+    80us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:54.104997 (+   629us) log.cc:842] Serialized 26 byte log entry
0811 16:06:54.658197 (+553200us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:54.658256 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.372240 (+1713984us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:56.372298 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:56.593139 (+220841us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:56.706107 (+112968us) raft_consensus.cc:1671] finished
0811 16:06:56.706130 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:56.706261 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13825,"raft.queue_time_us":8372,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7188,"spinlock_wait_cycles":938638720,"thread_start_us":552732,"threads_started":1,"wal-append.queue_time_us":897384}
I20260811 16:06:56.764807 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.755524 22297 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:56.765270 22092 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:06:56.766162 22092 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:56.766685 22092 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:56.703305 22289 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.772773 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:56.729709 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:56.765232 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:56.716995 13787 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:56.805495 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:56.825364 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:57.658016 13824 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:57.592406 13821 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:57.594985 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:57.598655 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:57.598810 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 819632us
W20260811 16:06:57.603075 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 855967us
I20260811 16:06:57.601015 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:57.576635 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:57.663436 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:57.664057 13738 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:57.664917 14580 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:56.705699 21987 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:06:57.689379 22355 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.780s	user 0.003s	sys 0.010s
I20260811 16:06:57.693084 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2316) took 1635 ms. Trace:
W20260811 16:06:57.695981 22345 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.135s	user 0.005s	sys 0.041s
I20260811 16:06:56.743474 21992 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:56.726691 22026 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.735946 22102 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.691251 22134 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:57.808063 13739 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:57.808862 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2708) took 1278 ms. Trace:
I20260811 16:06:57.809243 13739 rpcz_store.cc:276] 0811 16:06:56.530846 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.597927 (+1067081us) service_pool.cc:227] Handling call
0811 16:06:57.808710 (+210783us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:57.810735 22134 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:56.728688 22260 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:56.773165 22263 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:56.736999 22265 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:56.761258 22284 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:56.804688 22289 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:56.720829 22311 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.137s
I20260811 16:06:56.737511 22314 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:57.887887 22260 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:57.888481 22314 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:57.818939 22049 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:56.612632 22343 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:56.726442 22344 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260811 16:06:57.679544 22028 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:57.893267 22306 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:57.894045 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2699) took 2250 ms. Trace:
I20260811 16:06:57.894721 13742 rpcz_store.cc:276] 0811 16:06:55.643432 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.344855 (+701423us) service_pool.cc:227] Handling call
0811 16:06:56.345227 (+   372us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:56.345474 (+   247us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:56.345510 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:56.346069 (+   559us) log.cc:842] Serialized 26 byte log entry
0811 16:06:56.499709 (+153640us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:56.499765 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.501853 (+  2088us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:57.893079 (+1391226us) raft_consensus.cc:1671] finished
0811 16:06:57.893124 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:57.893718 (+   594us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":153000,"threads_started":1,"wal-append.queue_time_us":235398}
I20260811 16:06:57.895857 22264 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260811 16:06:57.682926 14577 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
W20260811 16:06:57.695844 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 931809us
I20260811 16:06:56.740162 22079 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:57.924074 22151 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:57.924595 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:57.925153 22151 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:57.926079 13907 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:06:57.897688 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:57.693679 14579 rpcz_store.cc:276] 0811 16:06:56.057061 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.182034 (+124973us) service_pool.cc:227] Handling call
0811 16:06:56.182391 (+   357us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:56.182619 (+   228us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:56.182643 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:56.193398 (+ 10755us) log.cc:842] Serialized 26 byte log entry
0811 16:06:56.591010 (+397612us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:56.591049 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.591118 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:57.692320 (+1101202us) raft_consensus.cc:1671] finished
0811 16:06:57.692362 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:57.692715 (+   353us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":357932,"threads_started":1,"wal-append.queue_time_us":461660}
I20260811 16:06:57.712204 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1668) took 1087 ms. Trace:
I20260811 16:06:57.698853 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2322) took 1127 ms. Trace:
I20260811 16:06:57.763154 13743 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:57.678720 22103 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:57.795742 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.07859e+06us
I20260811 16:06:57.811362 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2925) took 2341 ms. Trace:
W20260811 16:06:56.734162 22255 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
I20260811 16:06:57.871624 22334 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:57.817039 22072 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:57.818387 22300 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:57.804782 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:57.690881 21987 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:57.844013 22292 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:57.867322 22338 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:57.796938 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:57.889067 22314 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:57.866226 22099 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:57.898452 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1670) took 1319 ms. Trace:
W20260811 16:06:57.922876 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 258302us
I20260811 16:06:57.927979 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2715) took 1330 ms. Trace:
I20260811 16:06:57.930333 14580 rpcz_store.cc:276] 0811 16:06:56.578003 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.745146 (+167143us) service_pool.cc:227] Handling call
0811 16:06:57.665694 (+920548us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:57.930457 14575 rpcz_store.cc:276] 0811 16:06:56.570777 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.777979 (+207202us) service_pool.cc:227] Handling call
0811 16:06:57.686656 (+908677us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:57.697801 (+ 11145us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:57.697849 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:57.697952 (+   103us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:57.698065 (+   113us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:57.698209 (+   144us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:57.698509 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:57.822976 22333 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:57.946707 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2712) took 1350 ms. Trace:
I20260811 16:06:58.041287 13742 rpcz_store.cc:276] 0811 16:06:56.597341 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.897073 (+1299732us) service_pool.cc:227] Handling call
0811 16:06:57.927879 (+ 30806us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:06:57.927906 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2898) took 2207 ms (client timeout 1698 ms). Trace:
I20260811 16:06:57.980945 22343 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:57.927083 22079 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.052408 22094 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.047973 22297 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:58.053755 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:58.053937 22297 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.054898 13742 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:58.055114 22125 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:58.055411 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2900) took 1552 ms (client timeout 2031 ms). Trace:
W20260811 16:06:58.042454 13744 rpcz_store.cc:269] 0811 16:06:55.720808 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.942733 (+221925us) service_pool.cc:227] Handling call
0811 16:06:57.927428 (+1984695us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54000302d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:57.927650 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1616463744}
I20260811 16:06:58.056044 22125 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.057502 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:58.058413 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2711) took 1490 ms (client timeout 1968 ms). Trace:
W20260811 16:06:58.058790 13744 rpcz_store.cc:269] 0811 16:06:56.567656 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.057176 (+1489520us) service_pool.cc:227] Handling call
0811 16:06:58.058331 (+  1155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.059975 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:58.060791 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2706) took 1538 ms (client timeout 2034 ms). Trace:
W20260811 16:06:58.061141 13744 rpcz_store.cc:269] 0811 16:06:56.522145 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.059583 (+1537438us) service_pool.cc:227] Handling call
0811 16:06:58.060741 (+  1158us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.062196 22112 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.062259 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.000908 22134 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:57.810781 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:57.996069 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2324) took 1389 ms. Trace:
I20260811 16:06:58.073922 14579 rpcz_store.cc:276] 0811 16:06:56.584223 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.929144 (+1344921us) service_pool.cc:227] Handling call
0811 16:06:57.929791 (+   647us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:57.958434 (+ 28643us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:57.958479 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:57.958553 (+    74us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:57.973270 (+ 14717us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:57.973377 (+   107us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:57.973546 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:57.894502 22306 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:57.930989 13904 rpcz_store.cc:276] 0811 16:06:55.463174 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.464662 (+  1488us) service_pool.cc:227] Handling call
0811 16:06:55.465114 (+   452us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:55.465409 (+   295us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:55.465446 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:56.369794 (+904348us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:56.370159 (+   365us) log.cc:842] Serialized 26 byte log entry
0811 16:06:56.500263 (+130104us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:06:56.500300 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:56.500374 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:57.712303 (+1211929us) raft_consensus.cc:1671] finished
0811 16:06:57.727026 (+ 14723us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:57.804371 (+ 77345us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":317250944,"thread_start_us":129788,"threads_started":1,"wal-append.queue_time_us":151269}
I20260811 16:06:58.045995 22282 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:58.045794 22338 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.046662 22285 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:58.095674 22072 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.038676 22314 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:58.097501 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:58.098799 22338 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.101039 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.026919 22103 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.050830 22056 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.103904 22103 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.104430 22056 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.048059 22037 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:58.049871 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:58.049671 22333 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.108980 22037 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.047430 22102 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.051754 22343 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:58.064677 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2709) took 1518 ms (client timeout 2023 ms). Trace:
W20260811 16:06:58.121845 13744 rpcz_store.cc:269] 0811 16:06:56.546740 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.061811 (+1515071us) service_pool.cc:227] Handling call
0811 16:06:58.064594 (+  2783us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:06:58.055846 13742 rpcz_store.cc:269] 0811 16:06:56.503444 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.051059 (+1547615us) service_pool.cc:227] Handling call
0811 16:06:58.055314 (+  4255us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.041337 13743 rpcz_store.cc:276] 0811 16:06:56.580652 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.594099 (+1013447us) service_pool.cc:227] Handling call
0811 16:06:57.930634 (+336535us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.040463 14577 rpcz_store.cc:276] 0811 16:06:56.578645 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.729413 (+150768us) service_pool.cc:227] Handling call
0811 16:06:57.898306 (+1168893us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:06:58.088940 22219 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.377s	user 0.014s	sys 0.014s
I20260811 16:06:58.126782 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:58.127655 22219 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:58.130573 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 80976.4us
I20260811 16:06:58.047434 22099 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.096175 22282 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.053323 22094 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:58.115839 13739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2902) took 1610 ms (client timeout 1957 ms). Trace:
I20260811 16:06:57.972123 22049 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.095857 22285 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.063858 22361 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.132401 22102 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.197755 22102 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.064543 22134 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.079715 22112 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:58.198961 22112 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.200153 21602 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.201491 22112 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.201159 21602 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:58.204118 22179 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.770s	user 0.012s	sys 0.023s
W20260811 16:06:58.204316 14574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1654) took 3147 ms (client timeout 1528 ms). Trace:
W20260811 16:06:58.204839 14574 rpcz_store.cc:269] 0811 16:06:55.056748 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.056983 (+   235us) service_pool.cc:227] Handling call
0811 16:06:58.203801 (+3146818us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540065ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:58.204033 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":432646016}
I20260811 16:06:58.106839 22103 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.129771 22141 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:06:58.146770 13739 rpcz_store.cc:269] 0811 16:06:56.505551 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.810356 (+1304805us) service_pool.cc:227] Handling call
0811 16:06:58.115732 (+305376us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.131510 22153 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:58.150152 22092 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.383s	user 0.014s	sys 0.046s
I20260811 16:06:58.158893 22126 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:58.160049 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:58.160427 22361 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:06:58.162427 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.163120 13743 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:58.163503 22037 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.153615 22125 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.165495 22306 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.166388 22056 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.151604 22028 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.168282 21987 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:58.168462 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.169775 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.170919 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.119478 22072 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.171311 22292 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.130452 22300 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.172596 22255 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.174682 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:58.175709 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:58.176705 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 380301us
I20260811 16:06:58.178820 22049 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.179222 22343 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.183101 22333 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:58.149981 22148 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:58.186297 22099 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.187968 22297 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.189244 22219 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.191452 22376 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.192658 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2915) took 1433 ms. Trace:
W20260811 16:06:58.226154 13821 consensus_meta.cc:287] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.535s	user 0.017s	sys 0.005s
I20260811 16:06:58.332754 22376 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:58.240175 13738 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.006s
I20260811 16:06:58.334648 13738 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:06:58.290323 22103 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:06:58.335280 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2705) took 1813 ms (client timeout 1848 ms). Trace:
W20260811 16:06:58.335716 13738 rpcz_store.cc:269] 0811 16:06:56.521829 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.773416 (+251587us) service_pool.cc:227] Handling call
0811 16:06:58.335199 (+1561783us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.336884 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.338481 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.174700 22265 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:06:58.339802 22157 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.900s	user 0.020s	sys 0.016s
I20260811 16:06:58.339551 22265 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.341128 14578 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260811 16:06:58.342206 22265 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.226744 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.200258 22134 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.276679 13742 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:06:58.234843 22285 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.289983 22102 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:58.255117 22126 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.295456 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:58.296200 22093 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.671s	user 0.021s	sys 0.013s
W20260811 16:06:58.296599 22001 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.924s	user 0.025s	sys 0.013s
I20260811 16:06:58.297009 13907 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:58.300416 22289 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.309645 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43028 (request call id 1616) took 6051 ms. Trace:
I20260811 16:06:58.311728 22300 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:06:58.312628 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 152851us
I20260811 16:06:58.315909 14582 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:06:58.316074 22336 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.676s	user 0.016s	sys 0.016s
I20260811 16:06:58.316782 22255 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.316936 22263 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:58.317831 13739 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:58.319451 22094 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.242090 22092 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.321664 22361 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:58.296622 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.322552 14577 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:06:58.325091 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1496) took 1607 ms. Trace:
I20260811 16:06:58.331728 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2331) took 1682 ms. Trace:
I20260811 16:06:58.280226 22141 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.332582 22151 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:58.315908 22318 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.944s	user 0.009s	sys 0.024s
I20260811 16:06:58.333552 13821 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:06:58.165001 22282 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:58.342489 14578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 2307) took 2916 ms (client timeout 2205 ms). Trace:
W20260811 16:06:58.343680 13742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2901) took 1840 ms (client timeout 2097 ms). Trace:
W20260811 16:06:58.346228 13824 consensus_meta.cc:287] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.006s
I20260811 16:06:58.333364 13820 rpcz_store.cc:276] 0811 16:06:56.759092 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.759321 (+   229us) service_pool.cc:227] Handling call
0811 16:06:56.759728 (+   407us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:57.846222 (+1086494us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:57.846321 (+    99us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:57.846415 (+    94us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:57.846494 (+    79us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.192149 (+345655us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400219154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.192200 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.192423 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2496994048}
I20260811 16:06:58.346611 13738 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:06:58.388741 13742 rpcz_store.cc:269] 0811 16:06:56.505246 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.140737 (+1635491us) service_pool.cc:227] Handling call
0811 16:06:58.343606 (+202869us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.288733 21602 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:58.372331 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 340648us
I20260811 16:06:58.376686 14579 rpcz_store.cc:276] 0811 16:06:56.649189 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.094661 (+1445472us) service_pool.cc:227] Handling call
0811 16:06:58.242426 (+147765us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.331197 (+ 88771us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.331255 (+    58us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.331316 (+    61us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:06:58.331393 (+    77us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.331496 (+   103us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.331638 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.331569 22072 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:58.376483 13903 rpcz_store.cc:276] 0811 16:06:56.717890 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.719030 (+  1140us) service_pool.cc:227] Handling call
0811 16:06:56.719342 (+   312us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:57.892450 (+1173108us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:57.892526 (+    76us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:57.892600 (+    74us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:06:57.892633 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.324584 (+431951us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000c7454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.324649 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.324876 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2696913280}
I20260811 16:06:58.386025 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2700) took 2736 ms. Trace:
I20260811 16:06:58.388891 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:58.397634 13739 rpcz_store.cc:276] 0811 16:06:55.643926 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.242108 (+2598182us) service_pool.cc:227] Handling call
0811 16:06:58.317594 (+ 75486us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.379997 (+ 62403us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.380217 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.402189 22376 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.403611 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.375998 22014 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:58.388166 14578 rpcz_store.cc:269] 0811 16:06:55.426387 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.427025 (+   638us) service_pool.cc:227] Handling call
0811 16:06:58.342233 (+2915208us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54006d38d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:58.342419 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6366755200}
I20260811 16:06:58.374044 22336 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:58.409214 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 2912) took 1655 ms (client timeout 1883 ms). Trace:
W20260811 16:06:58.409809 13821 rpcz_store.cc:269] 0811 16:06:56.753811 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.764968 (+ 11157us) service_pool.cc:227] Handling call
0811 16:06:58.409073 (+1644105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.410555 22336 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.411338 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.412117 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2325) took 1823 ms. Trace:
I20260811 16:06:58.412947 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.415182 22151 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.415277 22318 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.416215 22151 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.417042 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.418035 13905 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:58.418073 22318 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:58.418664 22151 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:58.419533 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.420289 13900 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:58.420902 22072 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.421923 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.423312 13822 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:58.424467 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:58.358652 22179 rpcz_store.cc:276] 0811 16:06:52.258543 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:52.258678 (+   135us) service_pool.cc:227] Handling call
0811 16:06:52.480129 (+221451us) ts_tablet_manager.cc:928] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
0811 16:06:53.317475 (+837346us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e062a 00007f5c4e9e0552 00007f5c567fd691
0811 16:06:55.633877 (+2316402us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:06:56.386549 (+752672us) tablet_metadata.cc:641] Metadata flushed
0811 16:06:56.414433 (+ 27884us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:06:58.205064 (+1790631us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:06:58.308826 (+103762us) tablet_replica.cc:205] Creating consensus instance
0811 16:06:58.309281 (+   455us) ts_tablet_manager.cc:983] Replica registered.
0811 16:06:58.309512 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":82115,"spinlock_wait_cycles":80034048,"tablet-copy.queue_time_us":203088,"thread_start_us":1409522,"threads_started":2}
I20260811 16:06:58.425434 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.425732 22179 tablet_copy_client.cc:791] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:06:58.426767 22179 tablet_copy_client.cc:655] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:06:58.427459 13817 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:58.428812 22289 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.429996 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:58.453954 13907 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:58.432610 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:58.438159 22292 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.361654 22001 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:06:58.438813 22130 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:06:58.439194 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1418) took 2610 ms (client timeout 1817 ms). Trace:
I20260811 16:06:58.390727 22263 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:58.441799 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:58.443372 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3396) took 1697 ms (client timeout 2007 ms). Trace:
I20260811 16:06:58.444401 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2686) took 4016 ms. Trace:
I20260811 16:06:58.385488 22102 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.466320 13743 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:06:58.466795 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1734) took 1953 ms. Trace:
I20260811 16:06:58.467103 13743 rpcz_store.cc:276] 0811 16:06:56.514303 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.126301 (+1611998us) service_pool.cc:227] Handling call
0811 16:06:58.466728 (+340427us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.446030 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1727) took 3270 ms. Trace:
I20260811 16:06:58.468616 13744 raft_consensus.cc:595] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:58.469141 13744 raft_consensus.cc:603] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260811 16:06:58.445565 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 74414.9us
I20260811 16:06:58.425872 14583 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:58.484304 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.485208 13742 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:58.412515 14580 rpcz_store.cc:276] 0811 16:06:56.589023 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.047536 (+1458513us) service_pool.cc:227] Handling call
0811 16:06:58.048088 (+   552us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.120717 (+ 72629us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.120756 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.125865 (+  5109us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:06:58.126017 (+   152us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.411844 (+285827us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b540067eb54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.411894 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.412038 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":142935936}
I20260811 16:06:58.420544 14579 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:58.466112 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.451496 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:58.465159 13824 rpcz_store.cc:269] 0811 16:06:56.746387 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.746948 (+   561us) service_pool.cc:227] Handling call
0811 16:06:58.443260 (+1696312us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.471673 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.457290 22151 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.479617 22263 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:58.463029 13827 rpcz_store.cc:269] 0811 16:06:55.829089 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.834690 (+  5601us) service_pool.cc:227] Handling call
0811 16:06:58.438775 (+2604085us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:58.438969 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":319976704}
I20260811 16:06:58.465307 13741 rpcz_store.cc:276] 0811 16:06:54.427932 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:54.862586 (+434654us) service_pool.cc:227] Handling call
0811 16:06:54.894033 (+ 31447us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:55.967256 (+1073223us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.443820 (+2476564us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003471d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.444203 (+   383us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2424968064}
I20260811 16:06:58.471184 13820 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:06:58.472421 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.482079 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.492861 13743 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:06:58.468359 13740 rpcz_store.cc:276] 0811 16:06:55.175784 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.180596 (+1004812us) service_pool.cc:227] Handling call
0811 16:06:56.180916 (+   320us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:56.262084 (+ 81168us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:56.262132 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:56.262192 (+    60us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:56.262245 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.445479 (+2183234us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.445566 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.445805 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":186065152}
I20260811 16:06:58.495062 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1730) took 2620 ms. Trace:
I20260811 16:06:58.498241 13742 rpcz_store.cc:276] 0811 16:06:55.866938 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.486057 (+2619119us) service_pool.cc:227] Handling call
0811 16:06:58.486553 (+   496us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.486785 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.486819 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.486865 (+    46us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:06:58.486928 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.486988 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.487115 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.519170 22151 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.520064 22314 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.520591 13827 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:06:58.521672 22151 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.522217 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2702) took 2558 ms. Trace:
I20260811 16:06:58.522379 22314 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.522614 13740 rpcz_store.cc:276] 0811 16:06:55.963328 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.516312 (+2552984us) service_pool.cc:227] Handling call
0811 16:06:58.521585 (+  5273us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.521867 (+   282us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.521896 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.521939 (+    43us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:58.521968 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.522026 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.522138 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.524235 13824 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:58.524416 22141 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.524689 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2713) took 1933 ms. Trace:
I20260811 16:06:58.498340 22134 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.525514 13741 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:58.525658 22134 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.527369 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2332) took 1865 ms. Trace:
I20260811 16:06:58.528349 22134 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.529584 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1732) took 2623 ms. Trace:
I20260811 16:06:58.530184 22102 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.530911 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:58.525126 13740 rpcz_store.cc:276] 0811 16:06:56.591364 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.523647 (+1932283us) service_pool.cc:227] Handling call
0811 16:06:58.524078 (+   431us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.524345 (+   267us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.524378 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.524440 (+    62us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:58.524479 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.524542 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.524637 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.526211 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2703) took 2562 ms. Trace:
I20260811 16:06:58.527424 22343 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.540158 14574 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:58.517841 13821 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:06:58.527923 14577 rpcz_store.cc:276] 0811 16:06:56.661719 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.152956 (+1491237us) service_pool.cc:227] Handling call
0811 16:06:58.174094 (+ 21138us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.376413 (+202319us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.527124 (+150711us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540052c954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.527309 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":271892352}
I20260811 16:06:58.537308 13741 rpcz_store.cc:276] 0811 16:06:55.963792 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.516347 (+2552555us) service_pool.cc:227] Handling call
0811 16:06:58.525312 (+  8965us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.526003 (+   691us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.526161 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.529975 13739 rpcz_store.cc:276] 0811 16:06:55.906115 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.502622 (+2596507us) service_pool.cc:227] Handling call
0811 16:06:58.528918 (+ 26296us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.529138 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.529175 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.529238 (+    63us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:58.529312 (+    74us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.529370 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.529462 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.539872 22092 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.560742 13907 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:58.561558 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.540959 22126 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:58.564666 14580 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:58.571451 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:58.568236 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50218.3us
I20260811 16:06:58.575999 13742 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:58.576889 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2904) took 2070 ms. Trace:
I20260811 16:06:58.577224 13742 rpcz_store.cc:276] 0811 16:06:56.506130 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.537415 (+2031285us) service_pool.cc:227] Handling call
0811 16:06:58.575764 (+ 38349us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.576549 (+   785us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.576809 (+   260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.568786 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.480829 22130 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.572757 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.557914 22102 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:06:58.582787 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2701) took 2614 ms. Trace:
I20260811 16:06:58.589869 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:58.601572 13740 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
W20260811 16:06:58.602398 13707 connection.cc:232] RPC call timeout handler was delayed by -1.5121507670264691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260811 16:06:58.603619 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:58.605393 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:58.605888 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2697) took 2972 ms. Trace:
I20260811 16:06:58.568786 22103 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:58.606381 13736 rpcz_store.cc:276] 0811 16:06:55.633013 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.259483 (+626470us) service_pool.cc:227] Handling call
0811 16:06:56.259807 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:56.262987 (+  3180us) raft_consensus.cc:1520] Early marking committed up to index 8
0811 16:06:56.291821 (+ 28834us) log.cc:842] Serialized 14 byte log entry
0811 16:06:58.306736 (+2014915us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b1800470920. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:06:58.560525 (+253789us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.566560 (+  6035us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:06:58.572641 (+  6081us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.583551 (+ 10910us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.605688 (+ 22137us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":28637,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":46210,"spinlock_wait_cycles":87291264,"thread_start_us":189872,"threads_started":1}
I20260811 16:06:58.607913 22126 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:06:58.608498 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.602427 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2905) took 2003 ms. Trace:
I20260811 16:06:58.585628 13743 rpcz_store.cc:276] 0811 16:06:55.959813 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.501981 (+2542168us) service_pool.cc:227] Handling call
0811 16:06:58.565109 (+ 63128us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.573970 (+  8861us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.574011 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.574087 (+    76us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:06:58.574127 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.574204 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.574338 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.609182 13740 rpcz_store.cc:276] 0811 16:06:56.599356 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.557688 (+1958332us) service_pool.cc:227] Handling call
0811 16:06:58.589423 (+ 31735us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.602127 (+ 12704us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.602367 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.616500 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1736) took 1947 ms. Trace:
I20260811 16:06:58.617093 13742 rpcz_store.cc:276] 0811 16:06:56.669125 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.578111 (+1908986us) service_pool.cc:227] Handling call
0811 16:06:58.578580 (+   469us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.616058 (+ 37478us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.616100 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.616158 (+    58us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:58.616201 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.616279 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.616426 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.614877 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:58.597193 22314 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260811 16:06:58.637285 22314 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:58.609238 22141 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:58.637995 22314 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:06:58.638375 22141 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:58.639971 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73654.9us
I20260811 16:06:58.640926 22141 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.637471 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1735) took 1981 ms. Trace:
I20260811 16:06:58.586050 22102 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.642216 13739 rpcz_store.cc:276] 0811 16:06:56.656151 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.564995 (+1908844us) service_pool.cc:227] Handling call
0811 16:06:58.620407 (+ 55412us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.637121 (+ 16714us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.637148 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.637194 (+    46us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:06:58.637222 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.637283 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.637402 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.648712 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.649782 14577 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
W20260811 16:06:58.646987 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60358us
I20260811 16:06:58.651961 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:06:58.657305 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 139774us
I20260811 16:06:58.657121 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2716) took 1966 ms. Trace:
I20260811 16:06:58.659350 13743 rpcz_store.cc:276] 0811 16:06:56.690805 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.609675 (+1918870us) service_pool.cc:227] Handling call
0811 16:06:58.647040 (+ 37365us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.650754 (+  3714us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.650796 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.650870 (+    74us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:58.656829 (+  5959us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.656912 (+    83us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.657047 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.664422 13740 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:06:58.645452 22102 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:58.668180 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2717) took 1966 ms. Trace:
I20260811 16:06:58.668684 13740 rpcz_store.cc:276] 0811 16:06:56.701360 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.610003 (+1908643us) service_pool.cc:227] Handling call
0811 16:06:58.651436 (+ 41433us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.664932 (+ 13496us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.668106 (+  3174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.674201 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:58.653828 22125 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:58.680034 13742 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260811 16:06:58.676437 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.028s	sys 0.064s
I20260811 16:06:58.676633 14574 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260811 16:06:58.680878 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.028s	sys 0.064s
I20260811 16:06:58.679657 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:58.656653 22071 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:58.656804 22376 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.688624 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:58.656733 22387 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:58.690431 14577 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:58.694878 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:58.685245 22071 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.695997 22316 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:58.687597 22072 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:58.704276 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2334) took 1941 ms. Trace:
I20260811 16:06:58.684995 22297 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260811 16:06:58.707158 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:58.711994 14579 rpcz_store.cc:276] 0811 16:06:56.755555 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.653261 (+1897706us) service_pool.cc:227] Handling call
0811 16:06:58.686161 (+ 32900us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.692837 (+  6676us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.692872 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.692913 (+    41us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:06:58.697023 (+  4110us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.697085 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.697190 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.673081 22314 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.692342 22014 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.691202 22387 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.709349 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1737) took 1957 ms. Trace:
I20260811 16:06:58.736121 13736 rpcz_store.cc:276] 0811 16:06:56.751833 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.615901 (+1864068us) service_pool.cc:227] Handling call
0811 16:06:58.679246 (+ 63345us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.704424 (+ 25178us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.704465 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.704538 (+    73us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:58.709090 (+  4552us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.709166 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.709294 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.719942 14580 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
W20260811 16:06:58.723316 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 119900us
I20260811 16:06:58.724845 22071 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:58.725476 22106 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:58.730012 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2329) took 2086 ms. Trace:
I20260811 16:06:58.709534 21602 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:58.722594 22378 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260811 16:06:58.692086 22263 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:58.730242 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:58.716708 22361 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:58.751546 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.917788 14577 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:58.845116 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2321) took 2599 ms. Trace:
I20260811 16:06:58.825039 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:58.841214 13737 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:58.740744 14575 rpcz_store.cc:276] 0811 16:06:56.643248 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.048440 (+1405192us) service_pool.cc:227] Handling call
0811 16:06:58.049079 (+   639us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:58.320316 (+271237us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.320358 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:58.320977 (+   619us) log.cc:842] Serialized 26 byte log entry
0811 16:06:58.591222 (+270245us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:58.591284 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.607796 (+ 16512us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540063e2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.607863 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:58.729672 (+121809us) raft_consensus.cc:1671] finished
0811 16:06:58.729691 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:58.729940 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4160,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":622608128,"thread_start_us":263011,"threads_started":1,"wal-append.queue_time_us":371470}
W20260811 16:06:58.793483 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50319.6us
I20260811 16:06:58.848093 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48244 (request call id 73) took 2200 ms. Trace:
I20260811 16:06:58.756292 13824 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:06:58.863579 13787 connection.cc:232] RPC call timeout handler was delayed by -1.3707725930726156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260811 16:06:58.869887 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2917) took 2077 ms. Trace:
W20260811 16:06:58.756963 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66507.1us
I20260811 16:06:58.938432 13744 rpcz_store.cc:276] 0811 16:06:56.648007 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.150455 (+1502448us) service_pool.cc:227] Handling call
0811 16:06:58.847810 (+697355us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400311d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:58.847971 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":442494336}
I20260811 16:06:58.812260 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.779814 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.819469 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:58.941375 13821 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:58.850526 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 2330) took 2207 ms. Trace:
W20260811 16:06:58.937088 13737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1738) took 2153 ms (client timeout 1677 ms). Trace:
W20260811 16:06:58.779276 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87518us
I20260811 16:06:58.936470 14583 rpcz_store.cc:276] 0811 16:06:56.246164 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.416467 (+170303us) service_pool.cc:227] Handling call
0811 16:06:56.444825 (+ 28358us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.484000 (+2039175us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.844687 (+360687us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.845011 (+   324us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4555162880}
I20260811 16:06:58.943933 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.818758 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:37762 (request call id 929) took 3641 ms. Trace:
W20260811 16:06:58.811049 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 237165us
I20260811 16:06:58.850198 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:06:58.867960 14582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1563) took 2966 ms (client timeout 2557 ms). Trace:
I20260811 16:06:58.945222 13740 rpcz_store.cc:276] 0811 16:06:55.177725 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.686228 (+3508503us) service_pool.cc:227] Handling call
0811 16:06:58.818632 (+132404us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:06:58.849695 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:58.738118 22387 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:58.939633 13817 rpcz_store.cc:276] 0811 16:06:56.792207 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.595183 (+802976us) service_pool.cc:227] Handling call
0811 16:06:57.596282 (+  1099us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.457000 (+860718us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:58.869600 (+412600us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400219b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.869819 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1910740736}
I20260811 16:06:58.941998 14573 rpcz_store.cc:276] 0811 16:06:56.643533 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.792060 (+148527us) service_pool.cc:227] Handling call
0811 16:06:58.850299 (+2058239us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b5400437bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:58.850452 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":181906688}
W20260811 16:06:58.749671 22284 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.802s	user 0.015s	sys 0.003s
I20260811 16:06:58.941839 14580 raft_consensus.cc:2396] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260811 16:06:58.795074 22386 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260811 16:06:58.922943 22390 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260811 16:06:58.946132 14582 rpcz_store.cc:269] 0811 16:06:55.901408 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.915806 (+ 14398us) service_pool.cc:227] Handling call
0811 16:06:58.867654 (+2951848us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:58.867870 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5463020800}
W20260811 16:06:58.942193 13737 rpcz_store.cc:269] 0811 16:06:56.784000 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.600472 (+816472us) service_pool.cc:227] Handling call
0811 16:06:58.840911 (+1240439us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b540020a728. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57885434 00007f5c5684e437 00007f5c5684dbc8 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:58.936996 (+ 96085us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15109888}
I20260811 16:06:58.797770 22341 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.737169 22376 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:58.947346 21987 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.669s	user 0.013s	sys 0.001s
I20260811 16:06:58.864879 22266 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:58.798712 22373 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:06:58.859484 22133 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:58.964931 22342 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:06:58.798506 22393 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.737377 22014 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.861016 22380 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:58.944198 22314 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:58.988257 13738 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260811 16:06:58.796255 21602 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:58.955365 22284 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.973632 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:58.967376 13820 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:58.982326 22129 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260811 16:06:58.982409 22393 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:58.983861 22376 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:58.984182 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ff741363b70845aeab13c5999c9843e4, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.984853 14580 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260811 16:06:58.985648 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:58.986158 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 161326us
I20260811 16:06:58.968974 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:58.748605 22106 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:59.006630 22403 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:06:59.008330 22106 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:59.011050 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47001.2us
I20260811 16:06:58.988703 13738 pending_rounds.cc:76] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Aborting all ops after (but not including) 11
I20260811 16:06:58.996271 21994 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.010s
I20260811 16:06:58.990402 22380 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:06:59.017313 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:59.017797 22393 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.008471 22014 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.008498 14575 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260811 16:06:59.003191 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ff741363b70845aeab13c5999c9843e4, TS 5088cdd3f79d4c47ba826dc820b3cfaf -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:58.979714 22266 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.003793 14580 pending_rounds.cc:76] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 12
I20260811 16:06:59.000447 22133 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.026716 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:59.027944 14581 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:58.997473 22130 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:59.016733 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.015010 21987 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:06:59.024727 14580 pending_rounds.cc:97] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260811 16:06:59.035454 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:59.029371 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.029810 13821 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:59.030766 13827 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:06:59.028522 22133 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:59.011785 13738 pending_rounds.cc:97] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260811 16:06:59.039305 14580 raft_consensus.cc:2866] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:59.034327 22292 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260811 16:06:59.039983 22256 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:59.040613 22292 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:59.041157 22292 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.042937 13738 raft_consensus.cc:2866] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:06:59.043465 21987 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:59.044915 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2707) took 2522 ms. Trace:
I20260811 16:06:59.044647 21987 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.045275 13738 rpcz_store.cc:276] 0811 16:06:56.522405 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.532103 (+2009698us) service_pool.cc:227] Handling call
0811 16:06:58.532595 (+   492us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:59.043633 (+511038us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.044585 (+   952us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400310954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:59.044826 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1042911488}
W20260811 16:06:59.047123 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 197042us
I20260811 16:06:59.051803 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2333) took 2296 ms. Trace:
I20260811 16:06:59.052268 14578 rpcz_store.cc:276] 0811 16:06:56.755272 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.456687 (+1701415us) service_pool.cc:227] Handling call
0811 16:06:58.477148 (+ 20461us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.567935 (+ 90787us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:58.567971 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.568019 (+    48us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:58.568064 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.051545 (+483481us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b54006dfbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:59.051611 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:59.051741 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":86244224}
I20260811 16:06:59.023216 22384 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:59.051992 22380 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.056659 22256 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:06:59.057755 22369 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.064s	user 0.005s	sys 0.000s
I20260811 16:06:59.059938 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.061358 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3395) took 2470 ms. Trace:
I20260811 16:06:59.061789 13826 rpcz_store.cc:276] 0811 16:06:56.590967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.591694 (+   727us) service_pool.cc:227] Handling call
0811 16:06:56.592056 (+   362us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:57.592938 (+1000882us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:57.593066 (+   128us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:57.594478 (+  1412us) log.cc:842] Serialized 26 byte log entry
0811 16:06:57.639396 (+ 44918us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:57.639493 (+    97us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:57.669430 (+ 29937us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:59.056818 (+1387388us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:06:59.060824 (+  4006us) raft_consensus.cc:1671] finished
0811 16:06:59.060851 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:59.061143 (+   292us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10659,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":6647040,"thread_start_us":223487,"threads_started":2,"wal-append.queue_time_us":398824}
I20260811 16:06:58.990743 22341 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.050685 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2919) took 1122 ms. Trace:
I20260811 16:06:59.035161 22335 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:06:59.058316 22266 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:59.072849 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 46627.1us
I20260811 16:06:59.077096 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:06:59.081183 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48384.2us
I20260811 16:06:59.082572 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:58.999328 22373 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.089233 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.042541 22292 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.107968 13738 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:59.086874 22327 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:59.111414 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.124998 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.124078 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.127430 13820 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:59.115852 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.115724 22327 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:59.136134 22327 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.140193 22278 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:59.067126 13823 rpcz_store.cc:276] 0811 16:06:57.928739 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:57.945136 (+ 16397us) service_pool.cc:227] Handling call
0811 16:06:58.032936 (+ 87800us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.107604 (+ 74668us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:06:58.375489 (+267885us) log.cc:842] Serialized 14 byte log entry
0811 16:06:58.693973 (+318484us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:58.694032 (+    59us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:06:58.703334 (+  9302us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.049443 (+346109us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b1800344bc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:06:59.050173 (+   730us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b5400354b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:59.050240 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:59.050462 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6011,"prepare.queue_time_us":409580,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":6136,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7720,"spinlock_wait_cycles":179006208,"thread_start_us":563883,"threads_started":2,"wal-append.queue_time_us":454126}
I20260811 16:06:59.097936 22377 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:59.148793 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122228us
I20260811 16:06:59.130982 13744 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:06:59.152904 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 113898us
I20260811 16:06:59.109508 22266 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.150913 13824 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
W20260811 16:06:59.164990 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 137985us
I20260811 16:06:59.171968 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:59.172758 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2906) took 2528 ms. Trace:
I20260811 16:06:59.176532 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:06:59.178591 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94511.3us
I20260811 16:06:59.184588 22165 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:06:59.186923 22394 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.529s	user 0.000s	sys 0.003s
W20260811 16:06:59.187364 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63228.7us
I20260811 16:06:59.187485 22125 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:59.184829 22326 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:06:59.192041 13820 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:06:59.193657 22326 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.176232 22292 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.203970 13824 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:06:59.206593 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.207427 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1662) took 3247 ms. Trace:
I20260811 16:06:59.207713 14573 raft_consensus.cc:2396] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260811 16:06:59.207842 14581 rpcz_store.cc:276] 0811 16:06:55.960359 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:55.960877 (+   518us) service_pool.cc:227] Handling call
0811 16:06:56.736265 (+775388us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:59.028489 (+2292224us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.065480 (+ 36991us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b540067d9d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:59.201386 (+135906us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540067d9d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:59.207359 (+  5973us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7041970176}
I20260811 16:06:59.206653 22326 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.210201 22326 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:59.165982 21602 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.191468 22125 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:59.214833 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:59.217329 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.223456 14541 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:06:59.225432 13820 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:06:59.226725 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.192319 22284 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.226622 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.230101 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2695) took 3662 ms. Trace:
I20260811 16:06:59.230305 22042 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:06:59.227370 13740 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:06:59.230815 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.235345 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.218406 22219 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:59.241611 22104 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:59.241640 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.242673 13907 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:59.243438 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.243619 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:59.244226 13909 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:06:59.244863 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.245361 22268 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:59.247629 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.248376 13903 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:59.249404 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.250677 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:59.231282 22001 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:59.256021 22342 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:06:59.256574 22342 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:59.257643 22342 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:59.235090 21878 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.279s	user 0.021s	sys 0.034s
W20260811 16:06:59.259462 21878 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.440s	user 0.021s	sys 0.035s
I20260811 16:06:59.238082 22297 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260811 16:06:59.263269 22219 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.265596 22219 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.266553 22341 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.169497 22377 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.230580 13735 rpcz_store.cc:276] 0811 16:06:55.464466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.262302 (+797836us) service_pool.cc:227] Handling call
0811 16:06:56.292375 (+ 30073us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:56.492330 (+199955us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:56.492367 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:58.402435 (+1910068us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b2c0004cec8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:58.403189 (+   754us) log.cc:842] Serialized 26 byte log entry
0811 16:06:58.685759 (+282570us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:06:59.088562 (+402803us) log.cc:842] Serialized 14 byte log entry
0811 16:06:59.090244 (+  1682us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.090358 (+   114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:06:59.090415 (+    57us) raft_consensus.cc:1671] finished
0811 16:06:59.114521 (+ 24106us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:59.126379 (+ 11858us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39044,"prepare.queue_time_us":320761,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":102064,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":14086,"spinlock_wait_cycles":19610880,"thread_start_us":834962,"threads_started":3,"wal-append.queue_time_us":438226}
I20260811 16:06:59.268260 22042 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:06:59.268827 22042 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.242532 22104 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.270925 13736 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:59.274919 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.276350 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.276654 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.277280 13740 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:06:59.278335 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.283061 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.284096 13824 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:59.279930 13821 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:59.289459 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:06:59.291647 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 124722us
W20260811 16:06:59.294238 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 137720us
I20260811 16:06:59.295166 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.276292 22387 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.228464 21994 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260811 16:06:59.300082 22051 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:59.308324 22051 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:59.273079 22373 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.308809 22051 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:59.311091 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:59.311585 22125 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.313117 22125 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.315425 22341 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:06:59.315923 22341 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:59.316345 22341 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:06:59.319510 22387 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:06:59.311446 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 91668.5us
I20260811 16:06:59.306465 22342 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.323570 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.324488 13901 raft_consensus.cc:2379] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:59.330653 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.330956 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.331239 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.331881 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:59.332581 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:59.333118 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.279222 22263 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:59.334288 22263 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:59.331396 13907 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
W20260811 16:06:59.294173 22102 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.001s
I20260811 16:06:59.345191 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:06:59.308343 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 93618.7us
I20260811 16:06:59.282614 22104 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:59.319450 22001 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260811 16:06:59.350462 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:59.351691 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.363391 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:59.334625 22263 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:59.363478 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.364250 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:06:59.360849 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.365079 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.366389 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.368183 13736 raft_consensus.cc:595] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:06:59.370795 13736 raft_consensus.cc:603] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:06:59.380012 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.380025 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:59.381549 14580 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:59.381918 13820 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260811 16:06:59.382144 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.379853 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:06:59.368701 13824 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:59.380755 13817 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:59.390452 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.389374 13909 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:06:59.398749 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:59.398978 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.294450 22327 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.173130 13741 rpcz_store.cc:276] 0811 16:06:56.644327 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.560421 (+1916094us) service_pool.cc:227] Handling call
0811 16:06:58.590634 (+ 30213us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.625207 (+ 34573us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:58.931683 (+306476us) log.cc:842] Serialized 14 byte log entry
0811 16:06:59.172423 (+240740us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:59.172476 (+    53us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:59.172519 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.172565 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:59.172694 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":363668,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":129,"thread_start_us":496365,"threads_started":2}
I20260811 16:06:59.400071 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:59.352977 22102 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.409284 22102 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:59.387979 22384 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:59.387655 22219 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:06:59.411337 22377 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:06:59.416590 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 72975.5us
I20260811 16:06:59.418399 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:59.418510 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.419307 13821 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:59.419672 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:06:59.420437 14582 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:06:59.422811 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.409925 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.297603 22042 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.424150 22130 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:59.424664 22130 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:59.424731 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44094.7us
I20260811 16:06:59.424914 22042 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:06:59.425119 22130 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:59.427834 13817 raft_consensus.cc:1261] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:06:59.410517 22384 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:06:59.436244 14542 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.424038 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:06:59.438820 13824 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260811 16:06:59.442649 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.427846 22387 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:59.405438 22284 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:06:59.447193 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.430953 22327 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:59.456314 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.463323 14573 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:59.456955 13739 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260811 16:06:59.454234 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.462067 13817 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260811 16:06:59.464380 13823 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:59.465150 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.465494 13818 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:06:59.466581 13709 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:59.458611 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1743) took 1081 ms. Trace:
I20260811 16:06:59.469585 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:59.440864 22384 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:59.465840 13909 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:06:59.475979 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:59.469585 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.477943 13741 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:06:59.477834 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:59.468730 13743 rpcz_store.cc:276] 0811 16:06:58.377322 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:58.662061 (+284739us) service_pool.cc:227] Handling call
0811 16:06:58.679510 (+ 17449us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:06:58.755891 (+ 76381us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:06:59.111641 (+355750us) log.cc:842] Serialized 14 byte log entry
0811 16:06:59.364937 (+253296us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:06:59.364987 (+    50us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:06:59.365029 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:06:59.458278 (+ 93249us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:06:59.458362 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:06:59.458533 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":253891,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":28,"raft.queue_time_us":18436,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9143,"spinlock_wait_cycles":92968320,"thread_start_us":524486,"threads_started":2}
I20260811 16:06:59.481393 13821 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:06:59.482587 13820 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:06:59.487038 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.488849 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.463614 22014 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:59.490238 13817 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:06:59.469905 22393 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:59.493453 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:06:59.493485 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.445451 22292 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260811 16:06:59.498034 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.453956 22266 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:59.490309 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.498788 13742 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:59.470745 22376 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:06:59.498682 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.503306 13827 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:06:59.507778 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.502262 13821 raft_consensus.cc:2362] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22. Re-sending same reply.
I20260811 16:06:59.485409 22335 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:06:59.512168 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.515458 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.471134 21987 consensus_queue.cc:1046] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260811 16:06:59.516505 13827 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:06:59.496997 21994 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:06:59.497036 22304 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:59.514488 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.515167 13818 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:06:59.529932 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:59.529718 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:59.536917 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89603.5us
I20260811 16:06:59.540552 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:59.546927 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:59.565498 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:59.543218 22103 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:59.527001 13621 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 18 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 19 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:59.521739 22376 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.525707 22219 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260811 16:06:59.528975 22393 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.549574 22134 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:59.549259 22342 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:06:59.543864 22179 tablet_copy_client.cc:531] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:06:59.546499 21994 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:59.573045 22103 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:06:59.609122 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 221298us
I20260811 16:06:59.612360 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.566825 22106 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260811 16:06:59.565435 22316 consensus_queue.cc:1035] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260811 16:06:59.614017 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:06:59.602404 22244 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:06:59.534021 22304 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.583587 22134 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:06:59.603735 13621 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 5 to 17. New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:06:59.618379 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 67566.6us
I20260811 16:06:59.589200 22342 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:06:59.630652 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 246016us
I20260811 16:06:59.565382 22051 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:06:59.621979 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 141202us
I20260811 16:06:59.623641 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.634646 13903 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:59.627686 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:06:59.621760 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 153295us
I20260811 16:06:59.638868 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:06:59.641820 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.636868 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:06:59.628372 22134 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.665413 13907 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:06:59.666750 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.670796 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:06:59.663110 13909 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:06:59.675028 13903 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:06:59.632050 22342 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:59.676954 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:06:59.659849 22278 consensus_meta.cc:287] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
W20260811 16:06:59.686318 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 180143us
I20260811 16:06:59.695432 13823 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:06:59.632809 22292 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260811 16:06:59.682214 22001 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:06:59.715054 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 78313.5us
I20260811 16:06:59.685092 22244 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:06:59.718953 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.720069 13621 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 17, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 17 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:06:59.721222 13787 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:06:59.701107 22373 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260811 16:06:59.724272 22393 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.726045 22376 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:59.726372 22393 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:06:59.727293 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:06:59.701925 22103 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.728566 22051 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:59.729365 22293 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:06:59.728658 22103 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:59.721903 13621 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 21 to 24, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:06:59.726703 22341 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.738443 22244 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:06:59.741218 14580 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:06:59.708357 21994 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.779853 13825 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260811 16:06:59.876150 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 234393us
I20260811 16:06:59.765255 22159 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260811 16:06:59.918514 13742 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:59.919399 13903 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260811 16:06:59.913805 22244 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:06:59.919778 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:06:59.920753 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.921864 22151 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:06:59.922466 22151 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:06:59.922600 22427 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:06:59.923092 22427 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:06:59.923544 22427 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:06:59.923605 22151 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.927580 22381 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:06:59.928377 22381 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.882412 22373 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
W20260811 16:06:59.929937 22411 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.361s	user 0.001s	sys 0.005s
I20260811 16:06:59.930534 22373 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:59.711961 22327 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:06:59.899817 13621 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 20, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:06:59.932339 13621 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 15, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:06:59.903715 22134 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.936827 22134 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:06:59.904793 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.937484 22381 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:06:59.938623 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:06:59.939615 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:06:59.940274 21602 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:06:59.906947 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.942296 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:06:59.934103 13621 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 19, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:06:59.912765 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:06:59.915722 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:06:59.947052 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.905953 22014 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:06:59.948453 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55646.2us
I20260811 16:06:59.947880 13909 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:06:59.951236 13827 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 23. Current term is 24. Ops: []
I20260811 16:06:59.952231 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.940723 21602 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:06:59.954540 22428 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:06:59.954212 21602 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.951211 22326 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:06:59.906401 22416 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.221s	user 0.004s	sys 0.002s
I20260811 16:06:59.904814 22304 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:06:59.906445 22314 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:06:59.960544 22284 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:06:59.917030 22034 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:06:59.927700 22104 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:06:59.967770 22104 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:06:59.967828 13825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3390) took 3523 ms (client timeout 2471 ms). Trace:
W20260811 16:06:59.968344 13825 rpcz_store.cc:269] 0811 16:06:56.444381 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:56.444514 (+   133us) service_pool.cc:227] Handling call
0811 16:06:59.967533 (+3523019us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:06:59.967744 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7492774784}
I20260811 16:06:59.968711 22104 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.930948 22373 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.969542 22244 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:06:59.970644 22373 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.972067 22373 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:59.943557 22327 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:06:59.973388 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:06:59.973912 22327 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.894851 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:06:59.975171 22327 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:06:59.975576 13904 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
W20260811 16:06:59.889854 22413 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.200s	user 0.016s	sys 0.001s
I20260811 16:06:59.914556 13817 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.955118 22428 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:06:59.916059 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 367199us
I20260811 16:06:59.956192 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.962819 14583 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:06:59.960180 22326 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:06:59.964299 13626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 311) took 47963 ms (client timeout 15000 ms). Trace:
I20260811 16:06:59.964582 13621 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:06:59.965898 21602 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:06:59.910387 22263 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:06:59.976689 22014 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:00.004753 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52301.3us
I20260811 16:06:59.991549 22326 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.011384 13621 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 17, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:00.012893 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:00.013202 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 371540us
I20260811 16:07:00.011438 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:00.006843 22042 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.009s
W20260811 16:07:00.021345 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64645.4us
I20260811 16:07:00.024291 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:00.021744 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.002880 22102 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:00.027293 22244 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:00.034122 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50227.9us
I20260811 16:07:00.034277 14577 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:07:00.035502 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.036880 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:00.035322 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:06:59.997673 22304 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260811 16:07:00.039834 13706 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:00.039855 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:00.030205 22419 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.007s
W20260811 16:07:00.045751 22433 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260811 16:07:00.048688 22425 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:00.043298 13621 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 15 to 21, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:00.051992 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 424372us
I20260811 16:07:00.030102 22381 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:00.053735 13908 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:00.035451 22244 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.063791 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.042898 22278 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:00.062022 13621 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 14 to 15, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 15 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:00.068974 22412 log.cc:924] Time spent T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.488s	user 0.000s	sys 0.004s
I20260811 16:07:00.066992 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:00.072175 22341 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.076867 22263 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:00.077761 22384 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.005s
I20260811 16:07:00.078471 22384 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.079457 22439 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:00.079993 22439 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.080391 22439 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.081528 22384 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.081743 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.082175 22384 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.082818 22384 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:00.083356 22284 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:06:59.989331 13626 rpcz_store.cc:269] 0811 16:06:11.921035 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.928296 (+  7261us) service_pool.cc:227] Handling call
0811 16:06:59.767806 (+47839510us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:06:49.273781 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:06:49.301681 (+ 27900us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:06:49.301746 (+    65us) write_op.cc:435] Acquired schema lock
0811 16:06:49.301762 (+    16us) tablet.cc:660] Decoding operations
0811 16:06:49.341413 (+ 39651us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:06:49.341846 (+   433us) write_op.cc:641] Partition lock acquired for write op
0811 16:06:49.341927 (+    81us) tablet.cc:683] Acquiring locks for 15 operations
0811 16:06:49.563985 (+222058us) tablet.cc:699] Row locks acquired
0811 16:06:49.564031 (+    46us) write_op.cc:260] PREPARE: finished
0811 16:06:49.564224 (+   193us) write_op.cc:270] Start()
0811 16:06:49.564394 (+   170us) write_op.cc:276] Timestamp: P: 1786464409564153 usec, L: 0
0811 16:06:49.564430 (+    36us) op_driver.cc:331] REPLICATION: starting
0811 16:06:49.572267 (+  7837us) log.cc:842] Serialized 6098 byte log entry
0811 16:06:49.996238 (+423971us) op_driver.cc:444] REPLICATION: finished
0811 16:06:50.176291 (+180053us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5531c410
0811 16:06:50.667617 (+491326us) write_op.cc:301] APPLY: starting
0811 16:06:50.695858 (+ 28241us) tablet.cc:1365] starting BulkCheckPresence
0811 16:06:51.082906 (+387048us) tablet.cc:1368] finished BulkCheckPresence
0811 16:06:51.082955 (+    49us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:06:51.447016 (+364061us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:06:51.447470 (+   454us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0811 16:06:51.447549 (+    79us) write_op.cc:312] APPLY: finished
0811 16:06:51.447965 (+   416us) log.cc:842] Serialized 139 byte log entry
0811 16:06:52.051298 (+603333us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb
0811 16:06:52.432269 (+380971us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:52.446587 (+ 14318us) write_op.cc:454] Released schema lock
0811 16:06:52.462972 (+ 16385us) write_op.cc:341] FINISH: Updating metrics
0811 16:06:52.479857 (+ 16885us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:06:52.479910 (+    53us) write_op.cc:454] Released schema lock
0811 16:06:52.818381 (+338471us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
Metrics: {"mutex_wait_us":459714,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":543890,"apply.run_cpu_time_us":40600,"apply.run_wall_time_us":1899623,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66707,"num_ops":15,"prepare.queue_time_us":178090,"prepare.run_cpu_time_us":18327,"prepare.run_wall_time_us":456323,"raft.queue_time_us":165762,"raft.run_cpu_time_us":32543,"raft.run_wall_time_us":515610,"replication_time_us":416218,"spinlock_wait_cycles":91577728,"thread_start_us":1754255,"threads_started":5,"wal-append.queue_time_us":1010113,"wal-append.run_cpu_time_us":27239,"wal-append.run_wall_time_us":2674692}]]}
I20260811 16:07:00.086710 22297 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:00.087251 22297 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:07:00.087464 22130 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.662s	user 0.019s	sys 0.000s
I20260811 16:07:00.087688 22297 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.088027 22130 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.058493 22425 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:00.089445 22425 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.089761 22257 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.061736 21987 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:00.091692 21987 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:00.079599 22421 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260811 16:07:00.040457 22293 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260811 16:07:00.079131 13621 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 17 to 18, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:00.087404 14582 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.068871 22244 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.097455 13825 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:00.094696 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.097445 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:07:00.120963 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55670.5us
I20260811 16:07:00.121449 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:00.121840 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:00.122120 13740 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.112116 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:00.123353 13741 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.090989 22130 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.123831 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.131906 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:00.064309 22266 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 23.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260811 16:07:00.133875 13909 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
W20260811 16:07:00.141844 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47228us
I20260811 16:07:00.144369 22266 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:00.145010 22266 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:00.054872 22428 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.147547 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.148121 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.148784 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:00.149020 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.149650 13900 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:00.149837 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.092867 21987 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.148802 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.152163 22425 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.155846 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.156705 22314 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:00.157078 22314 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.157469 22314 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.158167 22381 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.158681 22381 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:00.159680 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.094781 22384 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:00.147605 13905 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260811 16:07:00.144265 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.145983 22266 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.128937 13621 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:00.170516 13905 pending_rounds.cc:76] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 9
I20260811 16:07:00.191569 13905 pending_rounds.cc:97] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260811 16:07:00.191891 13905 raft_consensus.cc:2866] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:00.192015 13621 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:00.194588 22414 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.482s	user 0.003s	sys 0.007s
I20260811 16:07:00.132052 22341 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:00.193692 13621 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 12 to 15, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.094645 22342 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.163219 22278 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:00.202311 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:00.205032 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 168253us
I20260811 16:07:00.206588 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:00.208406 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.182114 22384 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.215551 13621 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.209960 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:00.211370 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 176113us
I20260811 16:07:00.213748 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.162781 22292 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260811 16:07:00.233785 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 63263.6us
I20260811 16:07:00.249017 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.249037 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.186221 22103 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:00.251036 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.203812 22341 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.196354 22102 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:00.249622 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.182863 21994 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260811 16:07:00.268414 13621 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:00.269399 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.270346 13821 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.203030 22425 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:00.210923 22151 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:00.275281 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.276191 22393 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:00.251003 22442 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:00.276629 22014 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:00.278896 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.340442 13904 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.278990 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.279827 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.281834 22244 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.251118 22278 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:00.283203 13907 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:00.286018 22104 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:00.286589 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:00.287819 13909 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.289279 13901 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.292212 22027 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:00.293123 22268 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:00.297585 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.298040 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.298506 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.302320 22435 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260811 16:07:00.281881 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 79676us
I20260811 16:07:00.320786 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.321796 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.353567 13827 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.353993 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.367376 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.352276 22268 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:00.354789 22425 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:00.276974 13621 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 15 to 22, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:00.214243 22434 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:00.266364 22341 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.341521 13900 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.345988 13740 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:00.370961 13821 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
W20260811 16:07:00.375085 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99966.3us
I20260811 16:07:00.380146 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.371922 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.340669 22266 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:00.339740 22327 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:00.391003 14577 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260811 16:07:00.383066 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.395658 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.395886 13907 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:00.352923 22027 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:00.400044 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:00.412206 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.412637 13821 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:00.412038 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.326447 13741 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:00.360517 22435 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:00.420848 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.421571 13743 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 14.
I20260811 16:07:00.421329 13621 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 17, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:00.420240 13742 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.416208 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.424137 14578 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:00.426961 13826 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.427911 13736 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260811 16:07:00.430704 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.432140 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.436784 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.444679 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:00.452019 13907 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:00.452623 14580 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:00.455999 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.382357 22125 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:00.459659 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.467909 14574 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.468247 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.463390 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.349740 22102 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.463651 22457 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:00.382264 22432 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:00.475946 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.490509 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.476744 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.484901 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.484642 13621 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.485481 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.413491 22134 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.485764 13735 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.484732 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.487308 13740 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:00.489391 13739 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:07:00.490180 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.370894 22130 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.080s
I20260811 16:07:00.496872 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.376747 22393 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.090s
I20260811 16:07:00.498436 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:00.501509 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.432402 22435 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:00.504098 13736 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: [18.17-18.17]
I20260811 16:07:00.506902 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.429155 22448 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.510403 14579 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.524188 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.491793 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:00.396543 22278 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260811 16:07:00.529115 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.540158 13741 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:00.529902 14580 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.382005 22425 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.530388 13907 raft_consensus.cc:2396] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260811 16:07:00.541646 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.538570 13738 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.525872 14577 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:00.544483 13739 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260811 16:07:00.418016 22427 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.549189 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.544857 13621 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 15 to 16, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 16 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:00.554598 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:00.563460 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.460336 22327 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.523518 22151 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260811 16:07:00.566339 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 88850.5us
I20260811 16:07:00.579103 13741 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:00.578610 13621 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:00.556401 22417 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260811 16:07:00.395118 22434 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.571266 13736 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.564179 13908 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:00.523267 22342 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.575484 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.575896 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:00.577070 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 209816us
I20260811 16:07:00.591549 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:00.592141 13907 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:00.420357 22268 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:00.566495 22458 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260811 16:07:00.558983 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.596283 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:00.598452 13621 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 11 to 12, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 12 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.593068 13901 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:00.562492 22377 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.624140 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.625108 13907 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:00.529548 22432 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.626343 13621 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 13 to 17, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:00.627489 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 171604us
I20260811 16:07:00.634249 14544 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:00.634927 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 128417us
I20260811 16:07:00.597081 22263 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:00.641125 13621 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:00.644529 14544 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:00.628394 22444 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260811 16:07:00.648983 22268 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:00.657945 22450 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260811 16:07:00.658385 22446 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260811 16:07:00.639122 22326 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260811 16:07:00.557873 22027 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.648453 22442 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:00.630411 22377 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.669986 22427 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:00.670581 22464 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:00.703521 22464 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.672024 22432 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:00.673686 22449 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260811 16:07:00.674428 22448 raft_consensus.cc:3032] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Stepping down as leader of term 20
W20260811 16:07:00.707548 22297 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.004s
W20260811 16:07:00.675715 22455 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260811 16:07:00.707875 22448 raft_consensus.cc:729] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:00.709020 22464 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:00.709035 22297 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:00.652163 13871 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.968s (SENT) [suppressed 18 similar messages]
I20260811 16:07:00.713649 22297 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:00.715482 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63378.2us
I20260811 16:07:00.679486 22179 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:07:00.666972 22463 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:00.684538 22327 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:00.687619 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44180.4us
W20260811 16:07:00.690047 22284 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.004s
I20260811 16:07:00.649734 22263 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:00.695622 22452 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260811 16:07:00.696313 22465 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:00.697388 22102 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:00.698639 22425 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:00.700651 22314 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.002s
W20260811 16:07:00.675504 22447 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260811 16:07:00.647681 13621 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 18 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:00.696357 13900 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:00.651063 13613 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c390fd23cec5435d81b38a50b2988a60 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5088cdd3f79d4c47ba826dc820b3cfaf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.725553 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.653038 22130 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:00.640733 22278 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260811 16:07:00.644624 22441 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.082s
W20260811 16:07:00.741050 13613 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 195820us
I20260811 16:07:00.745483 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:07:00.728435 22439 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.001s
I20260811 16:07:00.745982 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.749085 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.754854 13621 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 16 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.759774 14580 raft_consensus.cc:1226] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
W20260811 16:07:00.763792 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 288135us
I20260811 16:07:00.764940 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.737581 22284 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.764070 13621 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 8 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.726321 22463 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.765408 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.773342 22316 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:00.774015 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.775045 22316 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:00.775956 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.777122 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.781674 13906 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:00.781980 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:00.785895 13904 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:00.720490 22326 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.760679 22134 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:00.780285 13900 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260811 16:07:00.804628 13621 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 14 to 18, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:00.804564 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 210960us
I20260811 16:07:00.763183 22432 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:00.761359 22151 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:00.806779 13900 pending_rounds.cc:76] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 14
I20260811 16:07:00.856909 13900 pending_rounds.cc:97] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260811 16:07:00.804912 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.838519 13621 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 15 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:00.843348 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 72763.4us
I20260811 16:07:00.763667 22130 raft_consensus.cc:686] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:00.840152 14578 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.744304 22314 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.861207 13621 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:00.856163 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.780841 22102 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.856242 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:00.777235 22463 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.868836 13737 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:00.857261 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:00.839267 22381 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.007s
I20260811 16:07:00.857177 13900 raft_consensus.cc:2866] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:00.872924 13900 pending_rounds.cc:97] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260811 16:07:00.873278 13900 raft_consensus.cc:2866] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:00.869844 13744 raft_consensus.cc:2379] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:00.863345 13621 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 reported cstate change: term changed from 9 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:00.762989 22457 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260811 16:07:00.874444 14583 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.762012 22439 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.876580 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:00.879933 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 75104.1us
I20260811 16:07:00.881070 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:00.881625 13827 consensus_meta.cc:287] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260811 16:07:00.882068 13827 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:00.882139 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 105067us
I20260811 16:07:00.883253 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.871714 13903 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:00.839007 22432 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:00.890015 13818 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.849835 22034 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:00.858472 22377 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.891824 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.886198 22381 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.897267 14582 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
W20260811 16:07:00.885263 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 103400us
I20260811 16:07:00.911192 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.891680 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:00.737788 22465 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.911098 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:00.776104 22435 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.908787 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:00.909828 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 133976us
I20260811 16:07:00.912140 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.892544 22102 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:00.915539 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.890686 22387 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:00.918323 13901 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:00.923271 13901 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:00.893846 22432 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:00.906694 22440 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:00.924083 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:00.920507 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.930419 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:00.892688 22473 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:00.920310 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.895542 22479 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:00.931304 13741 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:00.869419 22151 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.932752 13901 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:00.933758 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.895892 22476 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:00.936628 13739 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:00.949445 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:00.953439 13901 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:00.893366 22297 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260811 16:07:00.928978 22034 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:00.896638 22341 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:00.947050 22104 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:07:00.958925 22384 consensus_meta.cc:287] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.720s	user 0.014s	sys 0.000s
I20260811 16:07:00.924530 22477 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:00.979487 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:00.979872 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:00.957334 22381 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.987066 13900 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:00.987279 14574 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:00.990425 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:00.993897 14578 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:00.965279 22475 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:00.947322 22442 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260811 16:07:00.999439 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.993372 13817 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:00.974877 22479 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:00.980406 22263 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:00.982573 22257 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:01.006950 22257 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:01.007534 22257 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:00.982857 22316 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:00.987988 22473 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:00.982772 22104 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:01.003723 22326 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:00.969741 22476 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.010337 14578 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:07:00.988499 22477 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:00.951228 22428 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260811 16:07:01.025588 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:00.998893 22381 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.003023 22334 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.035393 13827 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:01.036690 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:00.989764 22384 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.024703 22104 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:01.053402 13905 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:01.028339 22473 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:00.974038 22130 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.033396 22314 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.032527 22477 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:01.067790 13901 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:07:01.060467 13827 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:01.003850 22159 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260811 16:07:01.070596 14581 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:01.052608 22439 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.027958 22297 consensus_queue.cc:1046] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260811 16:07:01.060912 22334 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.083361 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:01.083956 22465 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.084167 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.089941 13739 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:07:01.084757 22341 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.005765 22475 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.060184 22387 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260811 16:07:01.095008 13706 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:01.109300 13737 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:01.065337 22473 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.113817 22473 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.082158 22435 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.122159 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:01.123591 13871 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:01.127759 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.128391 22134 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.119818 22479 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:01.119385 22469 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260811 16:07:01.119688 22453 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:01.134476 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 214232us
I20260811 16:07:01.145782 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.165486 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.148646 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.164326 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:01.171489 13737 raft_consensus.cc:2379] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:01.171222 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:01.160923 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 240703us
I20260811 16:07:01.119240 22460 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.185321 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.188496 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:01.189306 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.186165 13739 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:01.193943 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:01.196460 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:01.196673 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.189190 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:01.139233 22327 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:01.201820 22473 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:07:01.201874 22327 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:01.203840 22327 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:01.204909 13735 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:01.204819 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.147886 22244 raft_consensus.cc:3032] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:01.141351 22384 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.208514 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.142809 22475 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.147693 22476 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.162389 22151 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:01.207721 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:01.202005 22102 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.140697 22487 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.210578 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.211979 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.145233 22448 consensus_queue.cc:260] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.210677 22244 raft_consensus.cc:729] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:01.251776 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:01.258490 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50878.3us
I20260811 16:07:01.198719 22292 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:01.208952 22278 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:01.165956 22387 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260811 16:07:01.270136 14578 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:01.206645 22341 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.266157 22476 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.314570 22476 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.317129 22476 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:01.258368 22483 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260811 16:07:01.263167 22473 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:01.277732 22491 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.318207 22473 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:01.318681 22473 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:01.279486 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:01.280357 22244 consensus_queue.cc:260] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.281194 13827 raft_consensus.cc:1226] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:01.318404 22491 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:01.281446 22490 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:07:01.282384 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.287314 22292 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.289016 13820 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260811 16:07:01.332882 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.288857 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:01.290582 22487 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.293610 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.296775 22159 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:07:01.278555 22257 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:01.345649 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 139271us
I20260811 16:07:01.214138 22488 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260811 16:07:01.338547 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:01.343555 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.339591 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:01.343698 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50193.9us
I20260811 16:07:01.258384 22465 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:01.340437 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:01.355706 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.356124 22102 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.348250 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:01.362583 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:01.350044 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.348977 13826 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:07:01.358958 13823 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:01.365370 13827 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:07:01.351959 13820 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:01.366799 13820 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260811 16:07:01.356493 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 168133us
I20260811 16:07:01.339689 22278 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:01.326509 22476 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.368901 13901 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:01.345049 22159 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:01.349803 22465 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:01.347244 22244 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:01.331975 22435 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260811 16:07:01.381975 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.389026 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.389611 13739 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:01.390414 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.385481 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.392349 14578 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:01.396821 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.398077 13871 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.390618 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:01.399119 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.392787 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:01.405463 22316 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:01.406078 22316 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:01.410218 22278 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.415541 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:01.415252 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 203369us
I20260811 16:07:01.383783 22159 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:01.383955 22465 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:01.440506 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:01.392585 22488 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:01.394992 22440 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:01.412508 22257 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.441618 13736 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:01.415268 22103 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:01.455905 14580 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:01.412868 22326 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:01.480566 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80279.8us
I20260811 16:07:01.347412 22487 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.380062 22476 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.446605 22335 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:01.486814 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64991us
W20260811 16:07:01.456509 22463 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260811 16:07:01.391234 22314 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260811 16:07:01.416376 22268 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260811 16:07:01.449618 22499 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.478075 22373 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:01.505302 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:01.479074 22103 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:01.507472 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:01.507894 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:01.509819 13906 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:01.509897 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:01.514300 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:01.515076 13902 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:01.521153 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:01.498654 22508 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:01.512573 22103 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:01.542936 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:01.569192 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.533470 22479 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:01.497874 22463 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.528733 22511 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.573225 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:01.555444 22292 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.604709 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:01.576725 22508 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:01.609336 13822 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:01.609422 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:07:01.581660 22479 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:07:01.603850 22104 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.009s
I20260811 16:07:01.595293 22257 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.575074 22326 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260811 16:07:01.601150 22491 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.610118 22001 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.589798 22387 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260811 16:07:01.606594 22297 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:01.602138 22014 consensus_queue.cc:1046] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260811 16:07:01.646756 22327 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.649030 22327 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.649704 22525 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.631376 22479 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:01.629652 22505 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:01.624459 22284 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
W20260811 16:07:01.682814 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 87059.2us
I20260811 16:07:01.670573 22334 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:01.579164 22513 consensus_queue.cc:1046] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.139s
I20260811 16:07:01.500496 22335 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.691252 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:01.699980 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 75501.8us
W20260811 16:07:01.687338 22477 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.000s
I20260811 16:07:01.678805 22491 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:01.706013 22509 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260811 16:07:01.705673 22491 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.642530 22104 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.691636 22334 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:01.702340 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.712570 22014 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:01.713063 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:07:01.701527 22437 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.441s	user 0.002s	sys 0.006s
I20260811 16:07:01.650276 22525 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:01.711283 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 295821us
I20260811 16:07:01.683926 22527 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.667965 22297 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.716892 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.709570 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:01.699046 22487 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:01.722615 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45738.8us
W20260811 16:07:01.714519 22498 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260811 16:07:01.727252 13739 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:01.692690 22219 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260811 16:07:01.734524 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:01.709671 22476 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:01.760679 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51823.3us
W20260811 16:07:01.787762 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53595.4us
I20260811 16:07:01.789186 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:01.723295 22512 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260811 16:07:01.810508 22502 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260811 16:07:01.812654 22517 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:01.813222 22517 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:01.816766 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2734) took 1377 ms. Trace:
I20260811 16:07:01.749158 13736 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:01.814247 22517 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.714133 22505 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260811 16:07:01.835956 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 71498us
I20260811 16:07:01.837148 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:01.841101 22525 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.841326 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "111ca2b9029e420191db21651d7c7015"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:01.841924 13736 raft_consensus.cc:595] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:01.842311 13736 raft_consensus.cc:603] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:07:01.842614 22335 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.844166 22104 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:01.844275 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 127414us
I20260811 16:07:01.845151 22284 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:07:01.827236 22504 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260811 16:07:01.846256 22297 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.829368 22463 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:01.847635 22515 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260811 16:07:01.848362 22517 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:01.817193 13742 rpcz_store.cc:276] 0811 16:07:00.439481 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:00.473392 (+ 33911us) service_pool.cc:227] Handling call
0811 16:07:00.497787 (+ 24395us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:00.528145 (+ 30358us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:00.528174 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:01.146483 (+618309us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b2c0004cec8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:01.146884 (+   401us) log.cc:842] Serialized 26 byte log entry
0811 16:07:01.206641 (+ 59757us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:01.444295 (+237654us) log.cc:842] Serialized 14 byte log entry
0811 16:07:01.444511 (+   216us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:01.444594 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:01.816456 (+371862us) raft_consensus.cc:1671] finished
0811 16:07:01.816558 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:01.816693 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43675,"prepare.queue_time_us":419867,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":51579,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":10859,"spinlock_wait_cycles":5580672,"thread_start_us":243282,"threads_started":2,"wal-append.queue_time_us":209303}
I20260811 16:07:01.849782 22434 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.850816 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3347) took 1420 ms. Trace:
I20260811 16:07:01.851610 13904 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260811 16:07:01.848384 22425 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.712620 22334 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:01.860355 22425 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.861014 22334 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:01.831051 22481 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:01.827456 22387 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:01.707928 22477 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:01.863880 22519 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260811 16:07:01.864404 22027 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:01.688947 22508 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.701948 22510 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.127s
I20260811 16:07:01.864539 22477 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.859479 13903 rpcz_store.cc:276] 0811 16:07:00.430471 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:00.459367 (+ 28896us) service_pool.cc:227] Handling call
0811 16:07:01.850604 (+1391237us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54000c8354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:01.850724 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":533393280}
W20260811 16:07:01.906133 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 117092us
W20260811 16:07:01.906345 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77534.5us
I20260811 16:07:01.871522 13740 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:01.900159 13902 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:01.831795 22487 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260811 16:07:01.914196 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55203.6us
I20260811 16:07:01.909909 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1688) took 1445 ms. Trace:
I20260811 16:07:01.910135 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2932) took 1069 ms. Trace:
I20260811 16:07:01.915001 14581 rpcz_store.cc:276] 0811 16:07:00.464353 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:00.465709 (+  1356us) service_pool.cc:227] Handling call
0811 16:07:01.909702 (+1443993us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400490554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:01.909851 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1286480640}
I20260811 16:07:01.915819 13740 rpcz_store.cc:276] 0811 16:07:00.841227 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:00.841459 (+   232us) service_pool.cc:227] Handling call
0811 16:07:01.860017 (+1018558us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800001598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:01.860255 (+   238us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:01.909883 (+ 49628us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:01.910082 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3087744}
I20260811 16:07:01.918048 13817 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260811 16:07:01.868037 22425 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:01.920212 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:01.864975 22465 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.924680 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:01.927547 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47559.1us
I20260811 16:07:01.940075 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:01.912221 22373 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:01.940137 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 404064us
I20260811 16:07:01.913074 22487 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:01.946812 22487 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:01.945278 13736 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:01.948685 13902 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260811 16:07:01.948783 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:01.949800 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:01.918898 22453 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:01.953912 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:01.915246 22481 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:01.957065 13740 raft_consensus.cc:595] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:07:01.959442 13740 raft_consensus.cc:603] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:07:01.956468 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.925676 22503 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:01.961943 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:01.967003 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.967795 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.934803 22532 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:01.968668 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2944) took 2506 ms. Trace:
I20260811 16:07:01.971807 13824 rpcz_store.cc:276] 0811 16:06:59.462542 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:59.481058 (+ 18516us) service_pool.cc:227] Handling call
0811 16:06:59.497509 (+ 16451us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:06:59.505442 (+  7933us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:06:59.505483 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:06:59.611168 (+105685us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b2c00012d48. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:06:59.616942 (+  5774us) log.cc:842] Serialized 26 byte log entry
0811 16:07:00.026355 (+409413us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:00.026404 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:00.026506 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:01.580681 (+1554175us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:01.968440 (+387759us) raft_consensus.cc:1671] finished
0811 16:07:01.968464 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:01.968610 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7652,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6819,"spinlock_wait_cycles":12312576,"thread_start_us":362928,"threads_started":1,"wal-append.queue_time_us":502897}
I20260811 16:07:01.958614 22453 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:01.974571 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:01.940572 22535 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:01.958361 22278 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:01.969347 22432 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.005s	user 0.010s	sys 0.005s
I20260811 16:07:01.981501 22432 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.983898 22432 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.929335 22511 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260811 16:07:01.985847 22511 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:01.986213 22511 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:01.987191 13737 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
W20260811 16:07:01.987629 22495 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.639s	user 0.000s	sys 0.004s
I20260811 16:07:01.988497 22528 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:01.989086 22528 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:01.966022 22481 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:01.989761 22014 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:01.990137 22528 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.004092 13743 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260811 16:07:01.933121 22477 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260811 16:07:01.958645 22491 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.995509 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:02.025166 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.996626 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:01.999301 13736 raft_consensus.cc:1226] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260811 16:07:01.987293 22511 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.001966 22219 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260811 16:07:02.003376 22473 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.005s
I20260811 16:07:02.003511 22465 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:01.991192 22481 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:01.975116 22532 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.039404 22473 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.014696 22463 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:07:01.965204 22525 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:01.944175 22327 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260811 16:07:02.017712 22159 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.539s	user 0.003s	sys 0.009s
I20260811 16:07:02.020493 22103 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.023110 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.024259 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:01.995621 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:02.050844 13823 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:02.051206 14581 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:02.026063 13740 raft_consensus.cc:595] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:07:02.028496 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50364.9us
I20260811 16:07:02.029194 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:01.956146 22292 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260811 16:07:02.039172 22427 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.004s
I20260811 16:07:02.044039 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:02.054247 14580 raft_consensus.cc:2379] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:02.053171 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:02.196564 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 143483us
I20260811 16:07:02.203630 13827 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:02.205348 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:02.046682 22244 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.003s
I20260811 16:07:02.196169 22159 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:02.213600 22542 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:02.220309 13736 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:02.220583 22159 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:02.220423 22542 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:02.216295 13789 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.790s (SENT)
I20260811 16:07:02.224979 13789 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.226176 22434 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:02.228998 22434 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.231418 22460 consensus_queue.cc:1046] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:02.205160 22481 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:02.243160 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.244778 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.212137 22511 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:02.251320 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:02.252141 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.033499 22278 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.257014 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.060667 22525 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.264416 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.261507 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.219671 22534 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.212379 22435 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:02.262969 13823 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:02.261094 13738 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260811 16:07:02.258286 13743 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:02.226416 22335 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.269390 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.243254 22481 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:02.274013 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.281358 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:02.277601 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3420) took 2148 ms. Trace:
I20260811 16:07:02.283394 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:02.283397 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:02.257581 22257 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.261721 22460 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:02.292130 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:02.292793 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:02.285077 13825 rpcz_store.cc:276] 0811 16:07:00.129584 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:00.161492 (+ 31908us) service_pool.cc:227] Handling call
0811 16:07:00.196088 (+ 34596us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:00.460834 (+264746us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:00.460866 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:00.480080 (+ 19214us) log.cc:842] Serialized 26 byte log entry
0811 16:07:00.722804 (+242724us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:00.722845 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:02.272459 (+1549614us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b540004e054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:02.272523 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:02.272570 (+    47us) raft_consensus.cc:1671] finished
0811 16:07:02.272585 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:02.277532 (+  4947us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":71422,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9634,"spinlock_wait_cycles":197485312,"thread_start_us":355269,"threads_started":2,"wal-append.queue_time_us":291749}
I20260811 16:07:02.305948 13823 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:02.263355 13742 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:02.311192 13741 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:02.275537 22434 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:02.275323 22542 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.284353 22481 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:02.290282 22491 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:02.272210 22284 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
W20260811 16:07:02.343787 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71529.5us
I20260811 16:07:02.287334 22477 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:02.356734 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 418284us
I20260811 16:07:02.346889 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:02.274521 22435 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.315295 22465 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:02.362746 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:02.389976 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:02.394174 13817 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:02.396351 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 117289us
I20260811 16:07:02.356710 22529 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.273638 22534 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.310503 22257 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.283605 22335 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:02.391269 22316 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.985s	user 0.014s	sys 0.001s
W20260811 16:07:02.399930 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91505.3us
I20260811 16:07:02.417665 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:02.358294 22460 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260811 16:07:02.387995 22491 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:02.389835 22297 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:02.365682 22434 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260811 16:07:02.426908 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:02.433233 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:02.406629 22473 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:02.495874 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 189186us
I20260811 16:07:02.398891 22326 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.497803 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.498042 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:02.498334 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:02.419960 22532 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.351864 22546 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.112s
I20260811 16:07:02.424089 22103 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.504520 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.519773 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:02.515413 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82281.9us
I20260811 16:07:02.521944 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.475443 22327 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:02.522886 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.526961 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:02.526324 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:02.524355 13823 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:07:02.518757 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:02.526381 13738 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:02.537799 22546 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:02.541380 22257 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.435035 22316 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.514222 22543 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:02.520860 22460 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:02.559973 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.420601 22529 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.529767 22327 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:02.564198 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51426.3us
I20260811 16:07:02.507066 22297 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.581781 13735 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:02.586205 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.587065 22506 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:02.576278 22460 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.589520 22102 raft_consensus.cc:3032] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:02.589943 22102 raft_consensus.cc:729] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:02.590502 22460 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.579614 22327 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:02.590853 22102 consensus_queue.cc:260] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.592344 22102 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:02.591334 22569 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.525370 22326 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.601235 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.605095 13741 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:02.564870 22535 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:02.600732 13826 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.009s
I20260811 16:07:02.569020 22525 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.568650 22103 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:02.611435 13826 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.009s	sys 0.009s
I20260811 16:07:02.633128 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 2967) took 2022 ms. Trace:
I20260811 16:07:02.650342 13741 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:02.633685 13818 rpcz_store.cc:276] 0811 16:07:00.610322 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:00.610564 (+   242us) service_pool.cc:227] Handling call
0811 16:07:00.611037 (+   473us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:00.895837 (+284800us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:02.632890 (+1737053us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400219154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:02.633065 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":640945024}
I20260811 16:07:02.719111 13907 raft_consensus.cc:2362] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16. Re-sending same reply.
I20260811 16:07:02.610667 22560 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:02.571756 22543 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.640899 22558 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:02.767692 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 166555us
I20260811 16:07:02.769174 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:02.772886 13823 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:02.770061 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:02.776347 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:02.780578 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 255472us
I20260811 16:07:02.580826 22491 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.633450 22103 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.803566 22579 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:02.805281 22583 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.805564 22103 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.805873 22583 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.806697 22564 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:02.807315 22564 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.608451 22569 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.811322 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2941) took 1392 ms. Trace:
I20260811 16:07:02.811750 13735 rpcz_store.cc:276] 0811 16:07:01.418885 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.419043 (+   158us) service_pool.cc:227] Handling call
0811 16:07:01.419488 (+   445us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:02.599920 (+1180432us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:02.811038 (+211118us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540011dd54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:02.811244 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2672390528}
I20260811 16:07:02.812407 22569 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.781853 22460 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:02.781603 22525 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:02.815124 22377 raft_consensus.cc:3032] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:02.815584 22377 raft_consensus.cc:729] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:02.816408 22377 consensus_queue.cc:260] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.817584 22377 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:02.818818 22335 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.819537 22521 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:02.819955 22521 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:02.820853 22521 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.822151 22521 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:02.824121 22316 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.828198 22529 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:02.830053 22550 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
I20260811 16:07:02.795609 22445 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:02.768165 22577 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:02.769912 22506 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:02.768656 22563 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.782595 22570 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:02.620769 22535 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.797139 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.754295 22567 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.733455 22435 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.841991 22583 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.802544 22257 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.846890 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:02.848752 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:02.824190 22552 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260811 16:07:02.872817 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 259247us
I20260811 16:07:02.873426 13908 raft_consensus.cc:2379] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:02.875279 22577 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:02.875761 22577 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:02.876152 22577 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:02.879680 22541 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.880287 22541 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.882530 22541 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:02.886016 22570 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:02.886541 22577 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.886699 22570 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.890127 22577 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.843526 22564 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:02.831373 22278 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.844787 22445 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:02.901046 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.898356 22448 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:02.901274 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:02.900089 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2943) took 1197 ms. Trace:
I20260811 16:07:02.852252 22506 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:02.906987 13739 rpcz_store.cc:276] 0811 16:07:01.703121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.703664 (+   543us) service_pool.cc:227] Handling call
0811 16:07:02.899873 (+1196209us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b54002779d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:02.900023 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30440192}
I20260811 16:07:02.891000 22577 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260811 16:07:02.928185 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:02.930071 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:02.894551 22257 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.896107 22570 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:02.864916 22460 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.062s
W20260811 16:07:02.945334 22551 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.716s	user 0.000s	sys 0.003s
I20260811 16:07:02.946481 22257 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:02.949908 14578 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:02.951610 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:02.909952 22543 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.954174 22445 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.958104 22595 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:02.894935 22567 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:02.968777 22535 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:02.969460 22567 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:02.970256 13738 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:02.785426 22558 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:02.977182 22540 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.990s	user 0.006s	sys 0.000s
I20260811 16:07:02.978662 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1471) took 1006 ms. Trace:
I20260811 16:07:02.867944 22563 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:02.979725 13824 rpcz_store.cc:276] 0811 16:07:01.972018 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.973165 (+  1147us) service_pool.cc:227] Handling call
0811 16:07:02.978447 (+1005282us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002dcdd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:02.978584 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":592279296}
W20260811 16:07:02.934634 22511 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.674s	user 0.014s	sys 0.000s
I20260811 16:07:03.007695 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:03.008625 13738 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:03.012957 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:02.947065 22562 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260811 16:07:03.013854 13742 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:03.024439 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:03.028045 13735 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:02.979000 22558 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.036676 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:03.036743 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:03.054107 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:03.108168 14582 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:03.119943 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.121688 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:03.122419 14579 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:03.107743 22567 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.124007 22567 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.126034 22567 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:03.128089 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.128772 14573 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:03.010038 22102 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:03.025981 22453 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.021s	user 0.009s	sys 0.004s
I20260811 16:07:03.117478 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.014040 22460 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:03.139483 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 85545.9us
I20260811 16:07:03.116664 22569 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.021052 22326 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:03.149253 13825 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.040s	sys 0.070s
W20260811 16:07:03.149941 13825 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.041s	sys 0.070s
W20260811 16:07:03.127007 22479 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.443s	user 0.006s	sys 0.004s
I20260811 16:07:03.151183 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:03.033325 22463 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.155045 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:03.160090 22381 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.160236 22219 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.165014 22381 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.165130 22219 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.167263 22584 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260811 16:07:03.167680 22545 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.956s	user 0.000s	sys 0.011s
I20260811 16:07:03.143740 22577 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260811 16:07:03.169567 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1468) took 1315 ms. Trace:
I20260811 16:07:03.169404 22463 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.170019 13821 rpcz_store.cc:276] 0811 16:07:01.854514 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.855050 (+   536us) service_pool.cc:227] Handling call
0811 16:07:01.855627 (+   577us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:01.855992 (+   365us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:01.856025 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:01.856509 (+   484us) log.cc:842] Serialized 26 byte log entry
0811 16:07:01.925703 (+ 69194us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:01.925774 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:01.925875 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:03.166916 (+1241041us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:03.169239 (+  2323us) raft_consensus.cc:1671] finished
0811 16:07:03.169265 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:03.169500 (+   235us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2732,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":773357440,"thread_start_us":68705,"threads_started":1,"wal-append.queue_time_us":168242}
I20260811 16:07:03.151574 22460 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.171949 22463 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.167665 22381 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.107913 22586 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:03.137513 22511 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:03.173695 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 284360us
I20260811 16:07:03.184494 14580 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260811 16:07:03.143082 22570 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:02.958868 22595 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.192106 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.137007 22574 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:03.176088 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 148844us
I20260811 16:07:03.215587 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.189838 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:03.210312 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.030s	sys 0.021s
W20260811 16:07:03.218189 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.030s	sys 0.021s
I20260811 16:07:03.152400 22457 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:03.218586 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 805916us
I20260811 16:07:03.193710 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.173363 22460 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.223505 13738 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:03.223659 13904 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:03.225869 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:03.218155 14575 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:03.180670 22326 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:03.234308 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.235440 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.236109 13826 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:03.228627 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.232056 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:03.228420 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:03.290951 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:03.352444 14573 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:03.144989 22102 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.289175 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:03.313048 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 100758us
I20260811 16:07:03.228420 21602 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.018260 22506 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:03.313630 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94416.4us
I20260811 16:07:03.240779 22326 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:03.311457 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.329893 14582 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:03.186443 22567 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:03.180321 22479 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.218094 22508 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:03.347442 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130989us
I20260811 16:07:03.452529 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:03.349824 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:03.228272 22589 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.209484 22511 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.173722 22569 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.145331 22453 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.456081 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.456933 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:03.323447 22460 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.457063 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:03.460145 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 110447us
W20260811 16:07:03.451349 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 223028us
I20260811 16:07:03.233381 22570 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:03.468093 22514 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.010s	sys 0.005s
I20260811 16:07:03.510479 14582 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:03.420845 22326 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:03.561156 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.563109 14574 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:03.467324 22594 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:03.568542 13736 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 18: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:03.568665 14577 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:03.193792 22586 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.564770 22491 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.241259 22457 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:03.556193 22514 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.006s
I20260811 16:07:03.575094 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:03.408516 21602 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.236881 22574 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.595903 14582 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:03.569928 22334 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.708s	user 0.017s	sys 0.000s
I20260811 16:07:03.565570 22219 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:03.590060 22327 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.998s	user 0.008s	sys 0.005s
I20260811 16:07:03.620239 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.624845 14577 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:03.470047 22508 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.588091 22555 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:03.587798 22596 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.589442 22584 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.639727 22569 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.636070 22327 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.595916 22440 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:03.597312 22563 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:03.509930 22589 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.650795 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.660961 14582 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
W20260811 16:07:03.656163 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 271489us
I20260811 16:07:03.658852 13909 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:03.657208 13900 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:03.645632 22588 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260811 16:07:03.534191 22460 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.603381 22594 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260811 16:07:03.648038 22499 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.682737 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:03.683405 13789 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:03.683670 13906 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:03.684262 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 227310us
I20260811 16:07:03.684412 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.693156 14582 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:03.694949 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:03.694880 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.699352 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.700264 13823 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:03.692890 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:03.595646 22491 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:03.701553 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 236379us
W20260811 16:07:03.690068 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 357813us
I20260811 16:07:03.703500 13738 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:03.704298 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.682263 22577 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.711162 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.711931 13824 raft_consensus.cc:2379] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:07:03.708648 14579 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.005s
I20260811 16:07:03.709100 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.713163 13820 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:03.713615 13909 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:03.710085 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:03.714773 13823 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:03.717586 13823 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:03.720306 14579 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:03.723991 13818 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:07:03.724066 14582 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:07:03.728965 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.730486 13824 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
W20260811 16:07:03.733379 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53953us
I20260811 16:07:03.727690 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:03.735389 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:03.683082 22563 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260811 16:07:03.711735 22102 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.720181 22599 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:03.725584 22594 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.756163 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1476) took 1743 ms. Trace:
I20260811 16:07:03.766876 13826 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:03.760340 13825 rpcz_store.cc:276] 0811 16:07:02.012779 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.306357 (+293578us) service_pool.cc:227] Handling call
0811 16:07:02.346833 (+ 40476us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:02.428349 (+ 81516us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:02.428383 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:02.477461 (+ 49078us) log.cc:842] Serialized 26 byte log entry
0811 16:07:03.150527 (+673066us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:03.150587 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:03.150694 (+   107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:03.755873 (+605179us) raft_consensus.cc:1671] finished
0811 16:07:03.755904 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:03.756078 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":14206,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2353,"thread_start_us":659776,"threads_started":2,"wal-append.queue_time_us":806350}
W20260811 16:07:03.750332 22517 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.901s	user 0.016s	sys 0.000s
I20260811 16:07:03.772027 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.772792 13820 raft_consensus.cc:1799] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Handling vote request from an unknown peer 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:03.773468 13820 raft_consensus.cc:2396] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:03.744182 22453 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.720582 22577 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.750619 22511 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.746630 22569 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:03.789456 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:03.781333 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:03.784310 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.799302 13825 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:03.765561 22567 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:03.799191 14580 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:03.755438 22479 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:03.801220 14573 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:03.760290 22595 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.777956 22608 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:03.821173 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 295183us
I20260811 16:07:03.821928 22517 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:03.852268 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:03.805928 22477 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.417s	user 0.010s	sys 0.005s
I20260811 16:07:03.784452 22570 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:03.655941 22584 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.650060 22555 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:03.769562 22594 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.653057 22596 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:03.827117 22578 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:03.821677 22511 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:03.703123 22499 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.791251 21602 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:03.863739 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 136028us
I20260811 16:07:03.856083 22508 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:03.855010 22599 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:03.843984 22586 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:03.845834 22327 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:03.843459 22102 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.863481 22477 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:03.860109 22517 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:03.893636 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:04.026628 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:04.018013 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:03.909952 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2748) took 1387 ms. Trace:
W20260811 16:07:04.187777 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 161247us
I20260811 16:07:03.909600 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:04.188709 13825 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:04.029950 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1600) took 2005 ms. Trace:
I20260811 16:07:04.188752 13741 rpcz_store.cc:276] 0811 16:07:02.522232 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.522921 (+   689us) service_pool.cc:227] Handling call
0811 16:07:03.909698 (+1386777us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b54001040d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:03.909870 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":176980864}
I20260811 16:07:04.189775 14574 rpcz_store.cc:276] 0811 16:07:02.024743 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.024916 (+   173us) service_pool.cc:227] Handling call
0811 16:07:02.035376 (+ 10460us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:03.566063 (+1530687us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:04.029598 (+463535us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003dcf54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:04.029868 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3512862464}
W20260811 16:07:03.962575 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 240293us
I20260811 16:07:04.086205 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48244 (request call id 77) took 2050 ms. Trace:
I20260811 16:07:04.192818 13740 rpcz_store.cc:276] 0811 16:07:01.994511 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.996462 (+  1951us) service_pool.cc:227] Handling call
0811 16:07:04.044794 (+2048332us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003a9420. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c518a1dc0 00007f5c519069c2 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:04.045191 (+   397us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":351768832}
W20260811 16:07:03.985687 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 452116us
I20260811 16:07:04.011757 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.018486 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:03.969237 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 724) took 2784 ms. Trace:
I20260811 16:07:04.230620 13817 raft_consensus.cc:1226] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
W20260811 16:07:03.938973 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80230us
I20260811 16:07:04.197769 13735 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:04.245941 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:03.969509 22598 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
I20260811 16:07:04.206699 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:04.025741 22601 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.370s	user 0.003s	sys 0.000s
W20260811 16:07:03.911535 22487 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.964s	user 0.010s	sys 0.007s
W20260811 16:07:03.952117 22602 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260811 16:07:04.251966 13821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.007s
I20260811 16:07:04.244176 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:04.303570 13821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.008s
W20260811 16:07:04.304276 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60221.6us
W20260811 16:07:04.000490 22521 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.178s	user 0.015s	sys 0.000s
I20260811 16:07:04.241623 13905 rpcz_store.cc:276] 0811 16:07:01.175405 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.195585 (+ 20180us) service_pool.cc:227] Handling call
0811 16:07:03.959372 (+2763787us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:03.959837 (+   465us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1199957760}
I20260811 16:07:04.281423 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.312811 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.313126 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.313541 13826 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:04.313782 13905 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:04.314258 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2980) took 1813 ms. Trace:
I20260811 16:07:04.314455 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.314538 13905 rpcz_store.cc:276] 0811 16:07:02.501180 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.312840 (+1811660us) service_pool.cc:227] Handling call
0811 16:07:04.314205 (+  1365us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.315737 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:04.316234 13905 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24. Re-sending same reply.
I20260811 16:07:04.316934 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2986) took 1538 ms. Trace:
I20260811 16:07:04.317227 13905 rpcz_store.cc:276] 0811 16:07:02.778974 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.315477 (+1536503us) service_pool.cc:227] Handling call
0811 16:07:04.316886 (+  1409us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.284638 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:03.936491 22574 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:04.064162 22448 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.137s	user 0.006s	sys 0.009s
W20260811 16:07:04.292346 13824 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.012s
W20260811 16:07:04.350122 13824 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.012s
W20260811 16:07:04.008069 22606 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260811 16:07:04.297307 22327 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:04.001679 22453 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.310s
I20260811 16:07:04.321128 22566 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:03.992435 22505 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.963903 22460 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.008697 22555 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:04.019704 22596 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:04.018283 22544 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.761s	user 0.000s	sys 0.002s
I20260811 16:07:04.019400 22638 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.043471 22491 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.010645 22001 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:04.450431 22001 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.450871 22633 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:04.451565 22633 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.452714 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.452868 22001 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:04.453455 13818 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:04.453745 22633 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:04.297940 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 91375.3us
I20260811 16:07:04.454380 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.460642 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:04.402367 22448 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:03.984599 22627 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:03.882746 22632 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:04.102448 22618 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:03.951269 21602 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:03.948688 22589 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.243431 22334 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260811 16:07:04.283942 22528 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.267s	user 0.014s	sys 0.028s
I20260811 16:07:04.041939 22594 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:04.307785 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:04.301030 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 391514us
W20260811 16:07:04.290536 22481 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.914s	user 0.015s	sys 0.003s
I20260811 16:07:04.301658 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2751) took 1376 ms. Trace:
I20260811 16:07:04.025094 22534 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.229986 22579 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:04.500964 22579 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.285707 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.020336 22587 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.277s
I20260811 16:07:04.348240 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1792) took 1003 ms. Trace:
I20260811 16:07:04.083886 22326 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.517242 22326 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:04.392840 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.401402 22599 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.518402 13826 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:04.519743 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:04.521332 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.393992 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.490108 21602 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:04.522902 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2987) took 1743 ms (client timeout 2215 ms). Trace:
W20260811 16:07:04.523336 13905 rpcz_store.cc:269] 0811 16:07:02.779445 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.329742 (+1550297us) service_pool.cc:227] Handling call
0811 16:07:04.522832 (+193090us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.524346 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:04.525278 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2989) took 1650 ms (client timeout 2154 ms). Trace:
W20260811 16:07:04.525712 13905 rpcz_store.cc:269] 0811 16:07:02.874399 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.524067 (+1649668us) service_pool.cc:227] Handling call
0811 16:07:04.525208 (+  1141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.297667 22586 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:04.399674 14541 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:04.528231 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 128696us
W20260811 16:07:04.293088 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 399593us
I20260811 16:07:04.230855 22102 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.471990 22596 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:04.533142 22102 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.143059 22103 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.537501 22103 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.538704 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.537811 22635 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:04.540113 22635 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:04.539687 14582 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:04.541601 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.338742 22428 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:04.327514 22477 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:04.544888 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1552) took 1960 ms (client timeout 1804 ms). Trace:
W20260811 16:07:04.545307 13906 rpcz_store.cc:269] 0811 16:07:02.584282 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.846602 (+262320us) service_pool.cc:227] Handling call
0811 16:07:04.544652 (+1698050us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400007b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:04.544800 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1863141632}
I20260811 16:07:04.391218 22538 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.396703 22393 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.443455 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.397321 22584 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:04.335273 22487 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.550907 22103 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.552141 22477 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.552779 22487 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:04.553460 22538 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:04.455646 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2985) took 1940 ms (client timeout 2169 ms). Trace:
W20260811 16:07:04.555347 13909 rpcz_store.cc:269] 0811 16:07:02.515548 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:03.450129 (+934581us) service_pool.cc:227] Handling call
0811 16:07:04.455447 (+1005318us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000230d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:04.455575 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":343438080}
I20260811 16:07:04.556380 22538 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.556571 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.557389 13909 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:04.557175 22393 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.557955 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2990) took 1683 ms. Trace:
I20260811 16:07:04.558311 13909 rpcz_store.cc:276] 0811 16:07:02.874703 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.556272 (+1681569us) service_pool.cc:227] Handling call
0811 16:07:04.557893 (+  1621us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.544459 22428 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:04.559209 22428 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:04.561169 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.564587 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1788) took 1712 ms. Trace:
I20260811 16:07:04.565804 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.567328 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.568032 13902 raft_consensus.cc:2354] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
W20260811 16:07:04.569461 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2983) took 2067 ms (client timeout 1946 ms). Trace:
W20260811 16:07:04.570010 13902 rpcz_store.cc:269] 0811 16:07:02.501917 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.519501 (+ 17584us) service_pool.cc:227] Handling call
0811 16:07:04.569206 (+2049705us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:04.569372 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4708602752}
I20260811 16:07:04.457172 22638 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.459357 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1787) took 1609 ms. Trace:
I20260811 16:07:04.573902 22638 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:04.574810 22638 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:04.577284 22638 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.462888 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:04.578550 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3451) took 2167 ms. Trace:
I20260811 16:07:04.464522 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2750) took 1555 ms. Trace:
I20260811 16:07:04.578940 13817 rpcz_store.cc:276] 0811 16:07:02.410997 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.411183 (+   186us) service_pool.cc:227] Handling call
0811 16:07:02.417287 (+  6104us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:04.247831 (+1830544us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:04.578289 (+330458us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400219654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:04.578486 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4169729920}
I20260811 16:07:04.579515 13739 rpcz_store.cc:276] 0811 16:07:02.908744 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.910430 (+  1686us) service_pool.cc:227] Handling call
0811 16:07:02.944297 (+ 33867us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:03.038738 (+ 94441us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:03.038791 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:03.118900 (+ 80109us) log.cc:842] Serialized 26 byte log entry
0811 16:07:03.576099 (+457199us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:03.731485 (+155386us) log.cc:842] Serialized 14 byte log entry
0811 16:07:03.763697 (+ 32212us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:03.763799 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:04.464316 (+700517us) raft_consensus.cc:1671] finished
0811 16:07:04.464336 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:04.464463 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":173391,"prepare.queue_time_us":76021,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":307135,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":24842,"thread_start_us":512441,"threads_started":3,"wal-append.queue_time_us":560106}
I20260811 16:07:04.580792 22034 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:04.581410 22034 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:04.581746 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.582208 22445 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:04.582701 13906 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:04.583178 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1559) took 1371 ms. Trace:
I20260811 16:07:04.583827 13906 rpcz_store.cc:276] 0811 16:07:03.211965 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.581437 (+1369472us) service_pool.cc:227] Handling call
0811 16:07:04.583095 (+  1658us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.475364 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.584582 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:04.490051 13908 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.003s
I20260811 16:07:04.492200 13709 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:04.498564 13743 rpcz_store.cc:276] 0811 16:07:02.925362 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.926275 (+   913us) service_pool.cc:227] Handling call
0811 16:07:02.926755 (+   480us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:02.927036 (+   281us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:07:03.402325 (+475289us) log.cc:842] Serialized 14 byte log entry
0811 16:07:04.039471 (+637146us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b180040d560. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b
0811 16:07:04.229924 (+190453us) log.cc:842] Serialized 14 byte log entry
0811 16:07:04.301132 (+ 71208us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:04.301214 (+    82us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:04.301279 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:04.301375 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:04.301562 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":200926,"prepare.queue_time_us":738638,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":3685,"raft.queue_time_us":137151,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":42775,"spinlock_wait_cycles":12078720,"thread_start_us":590136,"threads_started":2,"wal-append.queue_time_us":300564}
I20260811 16:07:04.586483 13908 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:04.506819 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2958) took 1327 ms. Trace:
I20260811 16:07:04.587461 13741 rpcz_store.cc:276] 0811 16:07:03.179098 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.248520 (+1069422us) service_pool.cc:227] Handling call
0811 16:07:04.506753 (+258233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.569104 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.446399 22460 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:04.511440 22579 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.572850 13737 rpcz_store.cc:276] 0811 16:07:02.850346 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.850483 (+   137us) service_pool.cc:227] Handling call
0811 16:07:02.850934 (+   451us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:02.863445 (+ 12511us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:02.863482 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:02.871603 (+  8121us) log.cc:842] Serialized 52 byte log entry
0811 16:07:03.227336 (+355733us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:03.504606 (+277270us) log.cc:842] Serialized 14 byte log entry
0811 16:07:03.509294 (+  4688us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:03.509381 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:04.459102 (+949721us) raft_consensus.cc:1671] finished
0811 16:07:04.459124 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:04.459298 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24990,"prepare.queue_time_us":420045,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":58258,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":23169,"thread_start_us":511509,"threads_started":2,"wal-append.queue_time_us":395306}
W20260811 16:07:04.594048 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 101989us
W20260811 16:07:04.498139 22528 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.481s	user 0.018s	sys 0.028s
I20260811 16:07:04.548483 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:04.526868 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:03.979095 22615 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260811 16:07:04.565137 13744 rpcz_store.cc:276] 0811 16:07:02.851935 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.852077 (+   142us) service_pool.cc:227] Handling call
0811 16:07:02.871006 (+ 18929us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:03.119551 (+248545us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:03.119581 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:03.135331 (+ 15750us) log.cc:842] Serialized 26 byte log entry
0811 16:07:03.467704 (+332373us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:03.467752 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:04.564003 (+1096251us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400280fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:04.564085 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:04.564161 (+    76us) raft_consensus.cc:1671] finished
0811 16:07:04.564184 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:04.564505 (+   321us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":180183,"raft.queue_time_us":151171,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12770,"spinlock_wait_cycles":243949824,"thread_start_us":332034,"threads_started":1,"wal-append.queue_time_us":493591}
I20260811 16:07:04.468597 22632 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:04.468473 22618 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:04.546811 22635 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:04.522066 13826 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:04.581840 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.458642 22499 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.402756 22574 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:04.579092 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 116297us
I20260811 16:07:04.648753 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:04.507547 13740 rpcz_store.cc:276] 0811 16:07:03.344525 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.194455 (+849930us) service_pool.cc:227] Handling call
0811 16:07:04.348158 (+153703us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.007906 22621 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:04.590989 13735 raft_consensus.cc:2379] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:04.474344 22334 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:04.543495 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:04.664587 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 121195us
I20260811 16:07:04.664885 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.665423 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:04.585435 13818 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:04.593104 13825 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:04.597230 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.607187 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:04.599221 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.669001 13909 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260811 16:07:04.669426 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2976) took 2170 ms. Trace:
I20260811 16:07:04.669727 13909 rpcz_store.cc:276] 0811 16:07:02.499093 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.596106 (+2097013us) service_pool.cc:227] Handling call
0811 16:07:04.669366 (+ 73260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.596673 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.599982 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.436321 22505 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.524680 21602 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:04.467198 22268 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.129s
I20260811 16:07:04.601455 13741 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:07:04.601543 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.601543 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.750494 13817 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:04.644353 22517 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:04.621821 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73426.5us
I20260811 16:07:04.644038 22387 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:04.608238 13905 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:07:04.764744 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1558) took 1878 ms (client timeout 2211 ms). Trace:
I20260811 16:07:04.618175 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.614426 13737 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:04.582830 22034 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.475948 22627 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.663046 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.508236 22481 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:04.729878 13686 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 962f3dc40b494dc48647abd894784e8d, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:04.807717 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 962f3dc40b494dc48647abd894784e8d, TS cec0688f86d54789b9b9ecc924ddecf3 -> TS 8d98491a0db549d0b671b60b90c9cdea move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.740819 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.644723 22618 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:04.472373 22448 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.667469 14579 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:04.766070 14582 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:07:04.812543 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.747460 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:04.825996 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78666.1us
I20260811 16:07:04.827196 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:04.671063 13906 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260811 16:07:04.749070 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:04.601264 22538 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:04.616580 22555 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:04.750626 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1791) took 1406 ms. Trace:
I20260811 16:07:04.617848 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.758441 13740 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
W20260811 16:07:04.757072 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150076us
I20260811 16:07:04.762506 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.645784 22566 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:04.673415 22326 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:04.853797 14577 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:04.765242 13905 rpcz_store.cc:269] 0811 16:07:02.886710 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.526462 (+1639752us) service_pool.cc:227] Handling call
0811 16:07:04.764638 (+238176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.730445 22292 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:04.756721 22642 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:04.616844 22632 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:04.600786 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:04.768260 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.730474 22596 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.777062 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.778237 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.752051 22534 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:04.809258 13909 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260811 16:07:04.606528 22460 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.756882 22584 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:04.752261 22102 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:04.834718 22633 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:04.757105 22587 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.755188 22103 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:07:04.798518 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 111649us
I20260811 16:07:04.823366 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:04.848232 13741 rpcz_store.cc:276] 0811 16:07:03.344226 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.588421 (+1244195us) service_pool.cc:227] Handling call
0811 16:07:04.594905 (+  6484us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:04.750328 (+155423us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:04.750565 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.746132 22473 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:04.849781 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.850778 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.772764 22027 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
W20260811 16:07:04.852632 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.035s	sys 0.029s
W20260811 16:07:04.894213 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.035s	sys 0.029s
I20260811 16:07:04.676548 22334 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:04.855082 13739 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:04.742952 22487 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:04.761902 22510 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:04.803627 22579 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:04.674476 22574 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:04.832829 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 83868.3us
I20260811 16:07:04.802887 22643 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:04.667299 22621 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:04.862851 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.775029 22517 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:04.875102 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.876845 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.835569 22463 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:04.830506 22538 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:04.834563 22465 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:04.831072 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2981) took 2329 ms. Trace:
I20260811 16:07:04.948943 13906 rpcz_store.cc:276] 0811 16:07:02.501466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.596303 (+2094837us) service_pool.cc:227] Handling call
0811 16:07:04.830955 (+234652us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:04.881095 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.882755 13744 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:04.886598 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:04.952167 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65694.7us
I20260811 16:07:04.892714 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.895871 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.955098 14573 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:04.889240 14579 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:04.864092 22292 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.893959 22027 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:04.893977 22102 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.899801 22460 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:04.901412 14542 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.022s	sys 0.033s
W20260811 16:07:04.972769 14542 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.022s	sys 0.033s
I20260811 16:07:04.903318 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.866047 22326 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:04.900136 22428 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.889961 22534 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.804416 22387 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.963266 22538 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:04.935727 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.936442 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:04.936342 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.998747 13817 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:04.859217 22555 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:04.938620 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.858793 22566 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:04.939697 14574 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:04.891470 22103 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:04.947603 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:04.962178 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.894253 22587 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:05.008291 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71950us
I20260811 16:07:04.877931 22596 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.028982 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.969010 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.978425 13740 raft_consensus.cc:595] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:07:04.938465 22427 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:04.872228 22642 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:04.973176 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 597802us
I20260811 16:07:04.918772 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:04.987519 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.054997 13744 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
W20260811 16:07:04.921607 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 320982us
I20260811 16:07:04.961687 22465 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:05.000013 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:05.057271 13741 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:05.057662 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:04.996901 13825 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:04.962136 22638 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.010056 13824 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:04.932610 22487 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:05.012141 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 253857us
I20260811 16:07:05.064838 13874 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:04.950493 13905 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:05.024720 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:04.987404 22510 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:05.022964 22103 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:05.008414 22151 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.025s
I20260811 16:07:05.026661 22505 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.036989 22428 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.037701 22481 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:05.038450 22326 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.097766 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.039621 22627 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.039853 22596 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.040544 22387 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.041240 22102 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.071818 22510 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:05.031260 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1562) took 1022 ms. Trace:
I20260811 16:07:05.070685 22473 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260811 16:07:05.029889 13817 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 12.
I20260811 16:07:05.133535 22525 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:05.134022 22525 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:05.047103 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:04.888628 22584 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.134954 22525 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.136126 22525 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:05.136802 22584 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.062095 13902 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 15: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:05.138262 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:05.138733 22608 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.276s	user 0.016s	sys 0.000s
I20260811 16:07:05.139205 13902 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260811 16:07:05.139744 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3398) took 1146 ms. Trace:
I20260811 16:07:05.140033 13902 rpcz_store.cc:276] 0811 16:07:03.993871 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.137936 (+1144065us) service_pool.cc:227] Handling call
0811 16:07:05.139665 (+  1729us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:05.066072 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3400) took 1060 ms. Trace:
I20260811 16:07:05.141578 13905 rpcz_store.cc:276] 0811 16:07:04.005864 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.860980 (+855116us) service_pool.cc:227] Handling call
0811 16:07:05.065992 (+205012us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:05.062505 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.067204 13739 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:07:05.078279 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:05.087528 13738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2960) took 1907 ms (client timeout 1912 ms). Trace:
I20260811 16:07:05.027581 22463 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:05.096098 13741 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:04.943683 22643 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.050788 22427 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:05.159689 22427 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:05.161597 22574 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.099124 13744 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:05.163231 22555 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.164070 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:05.164870 13905 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:05.166898 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104500us
I20260811 16:07:05.167462 22159 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:05.168002 22159 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.168540 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:05.106410 22448 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.170089 22159 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:05.109959 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 114529us
I20260811 16:07:05.071022 22027 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.122262 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3009) took 1358 ms. Trace:
I20260811 16:07:05.099071 22667 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:05.124812 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.132207 22510 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:05.132680 13906 rpcz_store.cc:276] 0811 16:07:04.008720 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.968540 (+959820us) service_pool.cc:227] Handling call
0811 16:07:05.031165 (+ 62625us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:05.142938 13738 rpcz_store.cc:269] 0811 16:07:03.179776 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:03.231772 (+ 51996us) service_pool.cc:227] Handling call
0811 16:07:05.087324 (+1855552us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400346cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:05.087457 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":975194880}
I20260811 16:07:05.142978 22608 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:05.140936 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:05.134279 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:05.190387 13817 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:05.184407 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1543) took 3237 ms. Trace:
I20260811 16:07:05.191694 13903 rpcz_store.cc:276] 0811 16:07:01.947338 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.947686 (+   348us) service_pool.cc:227] Handling call
0811 16:07:01.948327 (+   641us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:01.959521 (+ 11194us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:01.959552 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:01.959592 (+    40us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:01.959623 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:05.184127 (+3224504us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400321254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:05.184198 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:05.184334 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25329792}
I20260811 16:07:05.193723 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:05.151496 22505 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:05.051214 22621 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.164134 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.062580 22465 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:05.042994 22534 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.166997 22473 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:05.219455 22473 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:05.188278 22442 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:04.949767 22517 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.118328 22638 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:05.081812 22657 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.129s
I20260811 16:07:05.225503 13909 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260811 16:07:05.124131 22653 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260811 16:07:05.175478 13820 rpcz_store.cc:276] 0811 16:07:03.763378 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:03.781132 (+ 17754us) service_pool.cc:227] Handling call
0811 16:07:03.788478 (+  7346us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:03.789217 (+   739us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:03.789256 (+    39us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:03.806159 (+ 16903us) log.cc:842] Serialized 52 byte log entry
0811 16:07:04.894647 (+1088488us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:04.894693 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:04.894779 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:05.121960 (+227181us) raft_consensus.cc:1671] finished
0811 16:07:05.121986 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:05.122184 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4321,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":19281,"thread_start_us":1074131,"threads_started":1,"wal-append.queue_time_us":1223334}
I20260811 16:07:05.136871 22393 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:05.184187 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 126605us
I20260811 16:07:05.185288 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:05.089892 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2961) took 1684 ms. Trace:
I20260811 16:07:05.184995 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:05.158104 22651 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260811 16:07:05.182219 13824 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:05.235654 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:05.187388 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 109250us
I20260811 16:07:05.188683 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.195508 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.155930 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:05.140415 22587 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.209832 22027 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:05.170004 22427 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.204334 22671 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:05.211061 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:05.198891 22667 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:05.215938 22608 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:05.216564 22578 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.333s	user 0.013s	sys 0.003s
I20260811 16:07:05.170459 22102 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:05.253564 22672 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:05.184439 22159 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:05.212457 22661 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260811 16:07:05.232034 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.231050 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:05.230443 22569 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:05.238893 22477 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.234279 13905 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:05.220523 22473 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.235395 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3401) took 1227 ms. Trace:
W20260811 16:07:05.276471 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65545.5us
I20260811 16:07:05.276903 13906 rpcz_store.cc:276] 0811 16:07:04.007566 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.184679 (+1177113us) service_pool.cc:227] Handling call
0811 16:07:05.235325 (+ 50646us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:05.277420 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46441.8us
I20260811 16:07:05.236114 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.236312 22517 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.187072 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:05.236539 22656 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260811 16:07:05.230278 13743 rpcz_store.cc:276] 0811 16:07:03.405729 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.589119 (+1183390us) service_pool.cc:227] Handling call
0811 16:07:04.589557 (+   438us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:04.589814 (+   257us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:07:04.642695 (+ 52881us) log.cc:842] Serialized 14 byte log entry
0811 16:07:05.089451 (+446756us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:05.089527 (+    76us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:05.089590 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:05.089677 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:05.089813 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":56750,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1191,"raft.queue_time_us":31113,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":6212,"spinlock_wait_cycles":6415232,"thread_start_us":446224,"threads_started":2,"wal-append.queue_time_us":381738}
I20260811 16:07:05.239948 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:05.239661 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.185144 22654 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:05.224743 22268 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:05.186012 22632 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.220505 22442 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:05.295742 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55852.8us
I20260811 16:07:05.268128 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:05.239627 22534 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:05.243947 22669 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:05.234184 22643 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.273775 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.275585 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.235594 22657 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:05.278246 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:05.213292 22505 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:05.278982 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50647.2us
I20260811 16:07:05.280813 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:05.282341 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 95402.7us
I20260811 16:07:05.285022 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.290913 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.269109 22159 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.262876 22578 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:05.224983 22638 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:05.296562 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:05.318499 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.309266 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.319414 13820 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:05.318640 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:05.296701 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:05.296574 13824 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:05.288326 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.294210 22102 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:05.299670 22680 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:05.313155 22674 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:05.303303 22566 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.332764 13902 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:05.315457 22682 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:05.321410 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72873us
I20260811 16:07:05.266706 22608 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.322391 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.324791 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.297331 22477 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:05.336138 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.335655 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:05.310858 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.339335 13738 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:05.321434 13905 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:05.339546 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:05.293394 22654 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:05.321362 22445 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.004s
I20260811 16:07:05.304870 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:05.320364 13707 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:05.338236 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.325325 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:05.328398 13737 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:05.340552 13744 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:05.327175 22463 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:05.254329 22672 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.277932 22569 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.342306 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:05.324355 22393 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:05.310283 22487 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:05.407630 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69517.4us
W20260811 16:07:05.412184 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 91868.8us
I20260811 16:07:05.424568 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:05.413808 22690 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:05.440912 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:05.414085 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 103317us
I20260811 16:07:05.331789 22428 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:05.443126 22677 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:05.443538 13744 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 21. Ops: []
W20260811 16:07:05.416563 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 111786us
I20260811 16:07:05.444983 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:05.442488 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.446544 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:05.417608 22654 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:05.302695 22657 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:05.324079 22638 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:05.336231 22608 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.415872 13738 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:05.437510 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:05.324542 22427 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:05.336140 22477 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:05.447479 13901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1539) took 3924 ms (client timeout 2179 ms). Trace:
I20260811 16:07:05.300813 22534 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.442488 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.316083 22667 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.407658 22587 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:05.435995 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.446348 13905 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:05.444195 22159 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.406178 22599 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:05.317288 22481 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:05.423727 22566 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:05.464061 22627 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:05.336705 22680 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:05.424468 22643 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:05.443137 22428 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.433727 22578 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:05.337874 22642 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.472090 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.289726 22671 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.303352 22268 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:05.432153 22297 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.532311 22555 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:05.532702 22428 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:05.470120 13901 rpcz_store.cc:269] 0811 16:07:01.506716 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.506862 (+   146us) service_pool.cc:227] Handling call
0811 16:07:05.431359 (+3924497us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400143054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:05.431541 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1628456704}
I20260811 16:07:05.534940 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.535823 13901 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:05.536338 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3399) took 1532 ms. Trace:
I20260811 16:07:05.449003 22445 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:05.333392 22102 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.492283 22632 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.496690 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:05.497110 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61271.2us
I20260811 16:07:05.514098 22680 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:05.484977 22334 consensus_meta.cc:287] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.000s
I20260811 16:07:05.479135 22477 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:05.504508 22566 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:05.443970 22677 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.497429 22481 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:05.510358 22159 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:05.489394 22672 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.475064 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:05.452874 22657 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.536679 13901 rpcz_store.cc:276] 0811 16:07:04.003806 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.534647 (+1530841us) service_pool.cc:227] Handling call
0811 16:07:05.536266 (+  1619us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:05.574611 22657 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:05.574743 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.575464 13901 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:07:05.511349 22525 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:05.532330 22268 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:05.550182 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:05.582376 13871 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:05.583774 22268 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:05.584184 22268 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:05.584600 22268 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:05.584944 22635 consensus_meta.cc:287] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.911s	user 0.014s	sys 0.000s
I20260811 16:07:05.415122 22596 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:05.519914 22578 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:05.559345 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.559916 22334 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.483590 22690 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.567492 13817 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:05.599308 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.576439 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.601244 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.602108 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:05.560964 22566 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:05.566841 22481 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:05.578878 13824 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:05.620345 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.621022 13824 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:05.578545 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 108615us
I20260811 16:07:05.587646 13820 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:05.612744 22525 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:05.586404 22445 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:05.600041 13817 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:07:05.622790 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:05.624586 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.626741 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.512781 22463 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.636479 14579 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260811 16:07:05.641779 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.577956 22688 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:05.649564 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.657136 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.659189 13905 raft_consensus.cc:2379] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:05.599985 22578 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:05.671983 14573 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:05.667411 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.592672 22159 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:05.585403 22635 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.661222 13824 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:05.660776 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.685405 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:05.696556 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.705134 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:05.620400 22505 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.691071 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.720152 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.690645 14582 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:05.706266 13901 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:05.632854 22525 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:05.564360 22679 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:05.724181 22525 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:05.728013 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:05.639887 22690 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.747947 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.616400 22596 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.684056 22668 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260811 16:07:05.693841 22445 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:05.686470 22587 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:05.693001 22599 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:05.802040 22686 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:05.824097 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.686559 22442 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.721908 22569 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:05.844586 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.846730 13817 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:07:05.854988 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 536437us
I20260811 16:07:05.862594 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.864992 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.866688 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.867367 13824 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
W20260811 16:07:05.867980 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 210945us
I20260811 16:07:05.824611 22102 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:05.869366 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.878556 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:05.879709 22687 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
W20260811 16:07:05.880110 22685 log.cc:924] Time spent T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260811 16:07:05.855072 22668 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:05.857970 22686 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:05.888419 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:05.890408 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2395) took 2951 ms. Trace:
I20260811 16:07:05.864318 22316 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:05.896665 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:05.868053 22587 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:05.881965 22477 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:05.901070 13789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.158s (SENT) [suppressed 13 similar messages]
I20260811 16:07:05.900192 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:05.904134 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:05.898439 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:05.874898 22534 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:05.958694 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:06.118999 13824 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:06.118541 13817 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:05.976245 14578 rpcz_store.cc:276] 0811 16:07:02.939416 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.939582 (+   166us) service_pool.cc:227] Handling call
0811 16:07:02.943662 (+  4080us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:02.950450 (+  6788us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:05.890049 (+2939599us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b540063e2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:05.890322 (+   273us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13802368}
W20260811 16:07:06.079242 13900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2974) took 3580 ms (client timeout 1573 ms). Trace:
W20260811 16:07:05.927409 22027 consensus_meta.cc:287] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.009s
I20260811 16:07:06.133932 13874 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:07:06.034948 22538 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.994s	user 0.024s	sys 0.005s
W20260811 16:07:05.933439 22669 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.005s
W20260811 16:07:06.141497 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 241429us
I20260811 16:07:05.953747 22334 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.062435 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1796) took 1625 ms. Trace:
W20260811 16:07:05.986202 22103 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.881s	user 0.022s	sys 0.006s
W20260811 16:07:05.995721 22179 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260811 16:07:06.031879 22547 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 3.625s	user 0.011s	sys 0.022s
W20260811 16:07:05.985342 22510 consensus_meta.cc:287] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.786s	user 0.017s	sys 0.006s
W20260811 16:07:06.065754 22618 consensus_meta.cc:287] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.213s	user 0.011s	sys 0.003s
W20260811 16:07:06.144405 13900 rpcz_store.cc:269] 0811 16:07:02.498556 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.526670 (+ 28114us) service_pool.cc:227] Handling call
0811 16:07:06.078894 (+3552224us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400320d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:06.079115 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2534106880}
W20260811 16:07:06.003095 22465 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.778s	user 0.013s	sys 0.000s
I20260811 16:07:06.232699 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:05.898869 22442 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.239840 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3471) took 1296 ms. Trace:
I20260811 16:07:06.240267 22442 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.240330 13825 rpcz_store.cc:276] 0811 16:07:04.943503 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.058870 (+115367us) service_pool.cc:227] Handling call
0811 16:07:05.087042 (+ 28172us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:05.087526 (+   484us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:05.087559 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:05.097524 (+  9965us) log.cc:842] Serialized 26 byte log entry
0811 16:07:05.294241 (+196717us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:05.301356 (+  7115us) log.cc:842] Serialized 14 byte log entry
0811 16:07:06.093834 (+792478us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b180025bd00. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:07:06.094031 (+   197us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.094140 (+   109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:06.225369 (+131229us) raft_consensus.cc:1671] finished
0811 16:07:06.239593 (+ 14224us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.239773 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":375,"prepare.queue_time_us":8721,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3852,"raft.queue_time_us":118815,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4193,"spinlock_wait_cycles":88021248,"thread_start_us":214798,"threads_started":2,"wal-append.queue_time_us":235446}
W20260811 16:07:06.242137 22553 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 3.729s	user 0.012s	sys 0.019s
W20260811 16:07:06.066151 22643 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.017s
I20260811 16:07:06.243435 22643 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:06.245272 14582 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:06.239840 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1569) took 1038 ms. Trace:
I20260811 16:07:06.128934 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:06.167608 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.246007 13905 rpcz_store.cc:276] 0811 16:07:05.201208 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.554968 (+353760us) service_pool.cc:227] Handling call
0811 16:07:06.239641 (+684673us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b54000c7454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:06.239773 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140021120}
I20260811 16:07:06.246467 14578 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
W20260811 16:07:06.246958 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 79430.6us
I20260811 16:07:06.242986 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:06.164122 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:06.142323 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 243964us
I20260811 16:07:05.976991 22668 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:07:05.901513 22102 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:06.171309 13903 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:06.163211 22656 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:06.139055 22316 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:06.174779 22477 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.163578 22694 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:05.998796 22608 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:06.176990 13735 rpcz_store.cc:276] 0811 16:07:04.437241 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.731669 (+294428us) service_pool.cc:227] Handling call
0811 16:07:04.769313 (+ 37644us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:05.027253 (+257940us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:05.027293 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:05.027334 (+    41us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:05.027360 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.062152 (+1034792us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400104ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:06.062218 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.062367 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":592621952}
W20260811 16:07:06.238969 22615 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.486s	user 0.002s	sys 0.002s
I20260811 16:07:06.057607 22671 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.077734 22596 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.034360 22635 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:06.326892 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3439) took 4931 ms. Trace:
I20260811 16:07:06.327427 13827 rpcz_store.cc:276] 0811 16:07:01.395308 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.395455 (+   147us) service_pool.cc:227] Handling call
0811 16:07:01.395691 (+   236us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:02.204146 (+808455us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.326581 (+4122435us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400174154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:06.326815 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1850738048}
W20260811 16:07:06.169303 22657 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.009s
I20260811 16:07:06.181944 22104 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260811 16:07:06.252756 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.248387 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.259101 13825 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:06.331511 13905 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:06.258994 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:07:06.260051 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.017s	sys 0.052s
I20260811 16:07:06.178200 22669 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:05.925001 22268 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.263182 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:06.336155 14578 raft_consensus.cc:3037] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:06.333166 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.077105 22578 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:06.309994 22326 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.020s	sys 0.024s
I20260811 16:07:06.298760 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3445) took 4305 ms. Trace:
I20260811 16:07:06.259404 13817 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:07:06.306195 13738 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.010s	sys 0.034s
I20260811 16:07:06.016660 22566 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.247540 22654 consensus_meta.cc:287] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.796s	user 0.006s	sys 0.008s
I20260811 16:07:06.143213 22525 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:05.963567 22445 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.178294 22538 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:06.332687 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.018s	sys 0.053s
W20260811 16:07:06.386349 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 928640us
W20260811 16:07:06.333092 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74204.9us
I20260811 16:07:06.387853 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:06.345350 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.389426 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.390023 13900 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:06.356093 22326 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.020s	sys 0.024s
W20260811 16:07:06.314944 22667 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.005s	sys 0.030s
I20260811 16:07:06.346647 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:06.264441 22691 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260811 16:07:06.349879 13738 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.011s	sys 0.034s
I20260811 16:07:06.227156 22103 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.353111 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:06.362640 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.012s	sys 0.028s
I20260811 16:07:06.347728 13822 rpcz_store.cc:276] 0811 16:07:01.955622 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.955764 (+   142us) service_pool.cc:227] Handling call
0811 16:07:01.967440 (+ 11676us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:01.974501 (+  7061us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:01.974533 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:01.976267 (+  1734us) log.cc:842] Serialized 26 byte log entry
0811 16:07:02.305222 (+328955us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:02.305264 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:02.305338 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:06.241511 (+3936173us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:06.244749 (+  3238us) raft_consensus.cc:1671] finished
0811 16:07:06.244776 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.261378 (+ 16602us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9555,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":23824,"spinlock_wait_cycles":82258688,"thread_start_us":264912,"threads_started":1,"wal-append.queue_time_us":354715}
I20260811 16:07:06.324594 22694 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:06.375669 13744 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.009s	sys 0.023s
I20260811 16:07:06.378458 13824 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:06.326565 22608 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.375190 13825 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:06.252749 22465 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.253614 22618 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.244822 22510 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.299234 22587 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:06.340044 22151 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:06.466755 14580 raft_consensus.cc:2379] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:06.467428 13744 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.011s	sys 0.028s
I20260811 16:07:06.185433 22027 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:06.387070 13709 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:06.393879 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3030) took 1157 ms. Trace:
W20260811 16:07:06.386979 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.000s	sys 0.040s
I20260811 16:07:06.307499 22102 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:06.402083 13735 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:06.450032 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.014s	sys 0.022s
W20260811 16:07:06.479599 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.014s	sys 0.023s
W20260811 16:07:06.375561 22470 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 4.132s	user 0.000s	sys 0.027s
I20260811 16:07:06.360684 22583 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:06.347368 22596 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:06.340058 22442 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.384436 22686 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.390789 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:06.457813 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1616) took 1860 ms. Trace:
I20260811 16:07:06.498158 14577 rpcz_store.cc:276] 0811 16:07:04.597133 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.597265 (+   132us) service_pool.cc:227] Handling call
0811 16:07:04.643570 (+ 46305us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:04.861625 (+218055us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.457442 (+1595817us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:06.457721 (+   279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":482853632}
I20260811 16:07:06.499536 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:06.500380 14577 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:06.501247 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:06.502476 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:06.489797 22583 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:06.503664 22583 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:06.504266 22103 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.508467 22538 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.508842 22579 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:06.509508 22579 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:06.469607 22151 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:06.430613 22656 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:06.486807 22470 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 4.244s	user 0.001s	sys 0.027s
I20260811 16:07:06.469266 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3476) took 1178 ms. Trace:
I20260811 16:07:06.518006 13824 rpcz_store.cc:276] 0811 16:07:05.290811 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.468478 (+1177667us) service_pool.cc:227] Handling call
0811 16:07:06.468796 (+   318us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.468969 (+   173us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.468993 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.469035 (+    42us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:06.469065 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.469122 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.469213 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.471832 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:06.473511 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.001s	sys 0.040s
I20260811 16:07:06.473399 13817 rpcz_store.cc:276] 0811 16:07:05.236876 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.349604 (+1112728us) service_pool.cc:227] Handling call
0811 16:07:06.393175 (+ 43571us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.393427 (+   252us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.393467 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.393535 (+    68us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:06.393588 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.393662 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.393803 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.519371 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:06.416227 13741 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:06.478562 13826 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
W20260811 16:07:06.480712 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 93726.3us
I20260811 16:07:06.487447 22387 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:06.470419 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3478) took 1178 ms. Trace:
W20260811 16:07:06.452920 22688 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.006s
W20260811 16:07:06.467029 22680 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.899s	user 0.021s	sys 0.004s
I20260811 16:07:06.470288 22691 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:06.486996 13874 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:07:06.470430 22159 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.008s	sys 0.036s
I20260811 16:07:06.375488 22654 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.490942 13743 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:06.451574 22457 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.450764 22316 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:06.481984 22481 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.008s
I20260811 16:07:06.496548 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:06.533236 13735 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:06.473193 22027 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:06.457685 22268 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:06.470242 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.016s	sys 0.036s
I20260811 16:07:06.514261 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.515307 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3479) took 1222 ms. Trace:
W20260811 16:07:06.520624 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 1.07817e+06us
I20260811 16:07:06.520759 13824 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:06.521553 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:06.401757 22667 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.005s	sys 0.030s
I20260811 16:07:06.519757 13905 raft_consensus.cc:2362] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19. Re-sending same reply.
I20260811 16:07:06.522305 13825 rpcz_store.cc:276] 0811 16:07:05.292191 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.469542 (+1177351us) service_pool.cc:227] Handling call
0811 16:07:06.469882 (+   340us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.470100 (+   218us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.470153 (+    53us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.470189 (+    36us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:06.470218 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.470265 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.470363 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:06.525013 14574 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.006s	sys 0.034s
I20260811 16:07:06.519357 22151 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:06.491916 22596 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.547042 13787 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:06.518743 22506 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:06.533598 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1489) took 1227 ms. Trace:
I20260811 16:07:06.551789 13817 rpcz_store.cc:276] 0811 16:07:05.306237 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.524014 (+1217777us) service_pool.cc:227] Handling call
0811 16:07:06.532988 (+  8974us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.533186 (+   198us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.533224 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.533281 (+    57us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:06.533325 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.533392 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.533528 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.518113 22442 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:06.524310 22387 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:06.563483 22387 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:06.538575 22381 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.013s	sys 0.025s
W20260811 16:07:06.564229 22381 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.013s	sys 0.025s
W20260811 16:07:06.565235 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 43761.1us
I20260811 16:07:06.566035 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:06.526656 22159 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.008s	sys 0.037s
I20260811 16:07:06.567276 22159 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:06.568298 22316 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:06.569036 22316 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:06.568436 22159 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:06.544162 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 1.10667e+06us
I20260811 16:07:06.544653 13900 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:06.543705 13822 rpcz_store.cc:276] 0811 16:07:05.292828 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.470958 (+1178130us) service_pool.cc:227] Handling call
0811 16:07:06.514648 (+ 43690us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.514880 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.514916 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.514966 (+    50us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:07:06.515003 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.515070 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.515238 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:06.529579 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 370066us
W20260811 16:07:06.543742 14574 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.007s	sys 0.034s
I20260811 16:07:06.527421 22326 raft_consensus.cc:2781] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:06.525699 22688 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260811 16:07:06.548035 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:06.577018 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 675935us
I20260811 16:07:06.577782 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.578789 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:06.579236 13905 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:06.554057 22457 raft_consensus.cc:2741] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260811 16:07:06.555243 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1491) took 1248 ms. Trace:
I20260811 16:07:06.555117 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:06.580965 14544 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:06.556185 22694 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.558429 22566 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.526721 22691 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:06.541026 22027 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:06.540854 22481 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.562114 22638 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.081s	user 0.011s	sys 0.011s
I20260811 16:07:06.574481 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:06.562708 22442 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.574642 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.520008 22656 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.525166 22463 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.012s	sys 0.016s
I20260811 16:07:06.580595 13825 rpcz_store.cc:276] 0811 16:07:05.306774 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.547756 (+1240982us) service_pool.cc:227] Handling call
0811 16:07:06.554628 (+  6872us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.554822 (+   194us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.554850 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.554895 (+    45us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:06.554928 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.554981 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.555166 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.569504 22316 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:06.587996 22466 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:06.585747 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.593588 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3032) took 1182 ms. Trace:
I20260811 16:07:06.594102 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.526878 22680 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.596197 22578 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.667754 22680 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:06.668723 22698 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260811 16:07:06.669895 22442 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:06.583966 22686 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:06.583719 22704 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:06.670570 22465 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.617818 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:06.649308 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:06.652920 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 78527.7us
I20260811 16:07:06.656803 13824 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:06.586018 13789 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.946s (SENT)
I20260811 16:07:06.663348 13822 rpcz_store.cc:276] 0811 16:07:05.411302 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.574299 (+1162997us) service_pool.cc:227] Handling call
0811 16:07:06.592973 (+ 18674us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.593194 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.593224 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.593280 (+    56us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:07:06.593321 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.593382 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.593513 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.649804 22618 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.597222 22525 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.595755 22531 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.592032 22567 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.670979 22704 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:06.671988 22683 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:06.591952 22521 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:06.591928 22102 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:06.674031 22481 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:06.646541 22463 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.013s	sys 0.016s
I20260811 16:07:06.596593 22381 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.083s
I20260811 16:07:06.588426 22538 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.618599 22244 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:06.618316 22326 raft_consensus.cc:686] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:06.653784 13900 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:06.679047 22638 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.680137 22596 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.652570 22335 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260811 16:07:06.686658 22608 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.689184 22327 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.592208 22425 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:06.661800 14578 raft_consensus.cc:2454] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:07:06.663770 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78109.5us
I20260811 16:07:06.701431 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.700778 13735 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:06.748567 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.749265 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2772) took 1120 ms. Trace:
I20260811 16:07:06.749698 13735 rpcz_store.cc:276] 0811 16:07:05.629008 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.589223 (+960215us) service_pool.cc:227] Handling call
0811 16:07:06.749169 (+159946us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.751061 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:06.752192 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2773) took 1122 ms. Trace:
I20260811 16:07:06.752655 13735 rpcz_store.cc:276] 0811 16:07:05.629345 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.750687 (+1121342us) service_pool.cc:227] Handling call
0811 16:07:06.752118 (+  1431us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:06.710167 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50071us
I20260811 16:07:06.714148 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:06.698335 22707 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:06.693697 22466 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:06.719374 22671 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:06.729852 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:06.794886 14573 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
W20260811 16:07:06.730147 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 112479us
I20260811 16:07:06.712307 22683 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:06.754511 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 168539us
I20260811 16:07:06.731370 22381 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:06.753875 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:06.716801 22567 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.783823 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 69789.8us
I20260811 16:07:06.721170 22510 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.712324 22531 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.798746 13789 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.967s (SENT)
I20260811 16:07:06.827171 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.728612 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.730939 22682 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:06.828668 13900 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260811 16:07:06.829389 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2999) took 1241 ms. Trace:
I20260811 16:07:06.829126 22682 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.829890 13900 rpcz_store.cc:276] 0811 16:07:05.587718 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.728334 (+1140616us) service_pool.cc:227] Handling call
0811 16:07:06.829303 (+100969us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.807461 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.745942 22284 raft_consensus.cc:2741] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260811 16:07:06.712021 22704 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:06.831319 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58257us
W20260811 16:07:06.862092 13707 connection.cc:232] RPC call timeout handler was delayed by -1.118703386047855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260811 16:07:06.862262 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:06.828154 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2776) took 1197 ms. Trace:
W20260811 16:07:06.862788 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 64091.6us
I20260811 16:07:06.863087 13735 rpcz_store.cc:276] 0811 16:07:05.630337 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.753503 (+1123166us) service_pool.cc:227] Handling call
0811 16:07:06.828070 (+ 74567us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:06.863483 13789 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.170s (SENT)
I20260811 16:07:06.863883 13789 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:06.864118 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:06.796202 22179 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260811 16:07:06.833338 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:06.794687 22466 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:06.754431 22463 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:06.839308 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.804867 22654 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.841698 22656 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:06.844609 22567 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.750828 22244 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.747570 22327 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.854171 22533 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 4.860s	user 0.010s	sys 0.017s
I20260811 16:07:06.795249 22596 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:06.755640 22686 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260811 16:07:06.794467 22425 raft_consensus.cc:686] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:06.726146 22538 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.839902 22503 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.942780 22503 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.720688 22521 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.794930 22671 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:06.804695 22683 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:06.864964 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2775) took 1235 ms. Trace:
I20260811 16:07:06.958209 13735 rpcz_store.cc:276] 0811 16:07:05.630003 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.863842 (+1233839us) service_pool.cc:227] Handling call
0811 16:07:06.864903 (+  1061us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:06.959290 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:06.959887 13735 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:06.884404 13900 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:06.885069 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 51830.6us
I20260811 16:07:06.907546 22463 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.960897 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:06.805617 22381 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:06.861665 22465 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:06.883389 22525 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:06.883083 22335 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:06.934003 13906 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:06.890759 22103 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:06.941970 22244 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:06.900449 22506 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260811 16:07:06.954609 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 118733us
I20260811 16:07:06.925019 22654 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:06.969336 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2381) took 5515 ms. Trace:
I20260811 16:07:06.924787 22505 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:06.981570 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:06.896293 22583 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:06.984730 13907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2969) took 4530 ms (client timeout 1790 ms). Trace:
I20260811 16:07:06.958278 22671 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:06.962162 22686 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:06.954671 22503 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:06.989082 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 125629us
W20260811 16:07:06.973897 22721 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260811 16:07:06.982066 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79993.7us
I20260811 16:07:06.925851 22151 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:06.993515 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:06.995735 13900 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:07.026805 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.027657 22159 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:07.027817 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3406) took 1849 ms. Trace:
I20260811 16:07:06.976311 22714 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:07.028008 22654 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.028198 22159 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:07.028848 22159 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:07.028822 22654 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:07.031575 22716 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260811 16:07:06.896188 22326 consensus_queue.cc:237] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.028343 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2995) took 1443 ms. Trace:
I20260811 16:07:07.034664 13901 rpcz_store.cc:276] 0811 16:07:05.585082 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.727652 (+142570us) service_pool.cc:227] Handling call
0811 16:07:07.028157 (+1300505us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400301454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.028287 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2532700416}
I20260811 16:07:07.036278 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:07.001094 13907 rpcz_store.cc:269] 0811 16:07:02.449297 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.497040 (+ 47743us) service_pool.cc:227] Handling call
0811 16:07:06.979068 (+4482028us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002acbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:06.979217 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":438972800}
I20260811 16:07:07.037757 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:07.026975 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:07.039054 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:06.989077 22103 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:06.993074 14583 rpcz_store.cc:276] 0811 16:07:01.443897 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:01.446803 (+  2906us) service_pool.cc:227] Handling call
0811 16:07:01.489707 (+ 42904us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:01.498566 (+  8859us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:01.498598 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:01.507907 (+  9309us) log.cc:842] Serialized 26 byte log entry
0811 16:07:01.904389 (+396482us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:01.904454 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:01.904549 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:06.744913 (+4840364us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:06.943085 (+198172us) raft_consensus.cc:1671] finished
0811 16:07:06.943108 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:06.958868 (+ 15760us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":11599,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3007,"spinlock_wait_cycles":1313204992,"thread_start_us":347168,"threads_started":1,"wal-append.queue_time_us":450882}
I20260811 16:07:07.042063 13900 rpcz_store.cc:276] 0811 16:07:05.177973 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.026460 (+1848487us) service_pool.cc:227] Handling call
0811 16:07:07.027740 (+  1280us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:07.042906 14580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1712) took 2388 ms (client timeout 1726 ms). Trace:
W20260811 16:07:07.043485 14580 rpcz_store.cc:269] 0811 16:07:04.654745 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.800880 (+146135us) service_pool.cc:227] Handling call
0811 16:07:07.042727 (+2241847us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.042850 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3630925568}
I20260811 16:07:06.993027 22587 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.047246 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:07.049571 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:06.994477 22335 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.059166 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1699) took 4128 ms. Trace:
I20260811 16:07:07.059657 14581 rpcz_store.cc:276] 0811 16:07:02.931223 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.931363 (+   140us) service_pool.cc:227] Handling call
0811 16:07:02.947521 (+ 16158us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:02.947920 (+   399us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:02.947952 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:06.233033 (+3285081us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:06.306520 (+ 73487us) log.cc:842] Serialized 26 byte log entry
0811 16:07:06.697734 (+391214us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:06.729512 (+ 31778us) log.cc:842] Serialized 14 byte log entry
0811 16:07:06.729739 (+   227us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.729823 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:07.030710 (+300887us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b18003b6bc0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:07.058840 (+ 28130us) raft_consensus.cc:1671] finished
0811 16:07:07.058870 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:07.059049 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":33104,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":54,"raft.queue_time_us":8638,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":64282624,"thread_start_us":351567,"threads_started":1,"wal-append.queue_time_us":480241}
I20260811 16:07:07.062101 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.062765 14581 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:07.064332 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.065918 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:06.991736 22506 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:06.971421 22463 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.074168 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.074607 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.078121 13901 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:07.078536 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.079574 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.077528 14575 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
W20260811 16:07:07.081533 14575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1605) took 3860 ms (client timeout 2215 ms). Trace:
W20260811 16:07:07.081919 14575 rpcz_store.cc:269] 0811 16:07:03.221660 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:03.228562 (+  6902us) service_pool.cc:227] Handling call
0811 16:07:07.073913 (+3845351us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:07:07.081457 (+  7544us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35228416}
I20260811 16:07:07.075829 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2994) took 1491 ms. Trace:
I20260811 16:07:07.076687 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.032776 22638 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:07.045293 22555 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:07.095559 22555 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:07.095784 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.096124 22555 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:07.047988 22503 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:07.103852 13901 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:07.004236 22505 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.087961 22521 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.088531 22034 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:07.088613 22691 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.084216 22561 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:07.089903 22151 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.045543 22103 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:07.080955 22266 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:07.120452 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:07.090955 22709 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260811 16:07:07.127034 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.073453 22587 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.092728 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.073907 22335 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.082871 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1572) took 1220 ms. Trace:
I20260811 16:07:07.083396 13907 rpcz_store.cc:276] 0811 16:07:05.584770 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.037704 (+1452934us) service_pool.cc:227] Handling call
0811 16:07:07.075758 (+ 38054us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.063387 22510 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.104477 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.105261 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.106123 22503 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:07.137549 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 66346.3us
W20260811 16:07:07.107821 22712 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260811 16:07:07.108428 22654 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.040148 22425 consensus_queue.cc:237] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.040663 22686 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.122668 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2427) took 1074 ms. Trace:
I20260811 16:07:07.083376 22506 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:07.133481 13900 rpcz_store.cc:276] 0811 16:07:05.862406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.042688 (+1180282us) service_pool.cc:227] Handling call
0811 16:07:07.082799 (+ 40111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.181221 22159 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.167634 22510 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.142369 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.047426 22381 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.187840 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1574) took 1324 ms. Trace:
I20260811 16:07:07.147902 22503 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:07.195600 22387 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.003s
I20260811 16:07:07.148619 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.149680 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.154991 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1800) took 2631 ms. Trace:
I20260811 16:07:07.155349 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1718) took 1530 ms. Trace:
I20260811 16:07:07.197017 13737 rpcz_store.cc:276] 0811 16:07:04.523483 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.970102 (+446619us) service_pool.cc:227] Handling call
0811 16:07:04.970587 (+   485us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:05.407318 (+436731us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.154700 (+1747382us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400208fd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:07.154916 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":822440704}
I20260811 16:07:07.170311 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.098210 22027 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.176373 14582 rpcz_store.cc:276] 0811 16:07:06.048188 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.566705 (+518517us) service_pool.cc:227] Handling call
0811 16:07:06.567069 (+   364us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.668506 (+101437us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.668538 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.668582 (+    44us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:06.668612 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.122329 (+453717us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54006dfbd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:07.122402 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:07.122576 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":232765184}
I20260811 16:07:07.199036 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.204298 13737 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:07.204358 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.173806 22151 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:07.180167 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:07.225986 13908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2982) took 4724 ms (client timeout 1967 ms). Trace:
I20260811 16:07:07.197196 14574 rpcz_store.cc:276] 0811 16:07:05.625221 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.625537 (+   316us) service_pool.cc:227] Handling call
0811 16:07:05.625925 (+   388us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:05.658710 (+ 32785us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:07:05.658753 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:05.673912 (+ 15159us) log.cc:842] Serialized 26 byte log entry
0811 16:07:06.574596 (+900684us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:06.574638 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.574717 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:07.155089 (+580372us) raft_consensus.cc:1671] finished
0811 16:07:07.155115 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:07.155285 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8166,"raft.queue_time_us":8353,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"thread_start_us":815682,"threads_started":1,"wal-append.queue_time_us":1022774}
W20260811 16:07:07.225322 13820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3480) took 1931 ms (client timeout 1737 ms). Trace:
W20260811 16:07:07.238848 13820 rpcz_store.cc:269] 0811 16:07:05.294258 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.445595 (+151337us) service_pool.cc:227] Handling call
0811 16:07:07.225077 (+1779482us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b5400125054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.225227 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":157582080}
I20260811 16:07:07.235460 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2767) took 2347 ms. Trace:
I20260811 16:07:07.241278 13739 rpcz_store.cc:276] 0811 16:07:04.888193 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.917553 (+ 29360us) service_pool.cc:227] Handling call
0811 16:07:07.235127 (+2317574us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b54002099d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.235342 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":131624704}
W20260811 16:07:07.220162 13741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2770) took 2241 ms (client timeout 2026 ms). Trace:
I20260811 16:07:07.234459 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1808) took 1922 ms. Trace:
W20260811 16:07:07.243022 13741 rpcz_store.cc:269] 0811 16:07:04.978899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.155507 (+176608us) service_pool.cc:227] Handling call
0811 16:07:07.219831 (+2064324us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540011e254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.220056 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2690503552}
I20260811 16:07:07.243847 13743 rpcz_store.cc:276] 0811 16:07:05.312182 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.341981 (+ 29799us) service_pool.cc:227] Handling call
0811 16:07:07.234053 (+1892072us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400346cd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.234285 (+   232us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2454265216}
I20260811 16:07:07.244940 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.245594 13743 raft_consensus.cc:2354] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:07.246289 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.246891 13743 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:07.181699 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.136168 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
W20260811 16:07:07.182102 22724 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260811 16:07:07.189013 13907 rpcz_store.cc:276] 0811 16:07:05.863121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.133716 (+1270595us) service_pool.cc:227] Handling call
0811 16:07:07.187738 (+ 54022us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.157995 22531 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.202922 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.204865 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2771) took 1576 ms. Trace:
I20260811 16:07:07.224437 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1487) took 2626 ms. Trace:
I20260811 16:07:07.205029 14582 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 14.
I20260811 16:07:07.220784 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3029) took 2009 ms. Trace:
I20260811 16:07:07.251546 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1810) took 1623 ms. Trace:
I20260811 16:07:07.124763 22561 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.218513 22473 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:07.418429 13737 rpcz_store.cc:276] 0811 16:07:05.628698 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.198764 (+1570066us) service_pool.cc:227] Handling call
0811 16:07:07.204809 (+  6045us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.420467 14575 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:07.258975 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:07.252513 13909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2988) took 4472 ms (client timeout 3158 ms). Trace:
I20260811 16:07:07.289952 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:07.426245 13909 rpcz_store.cc:269] 0811 16:07:02.779832 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.870004 (+2090172us) service_pool.cc:227] Handling call
0811 16:07:07.236167 (+2366163us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400000d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.252400 (+ 16233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":650755456}
I20260811 16:07:07.251750 14581 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:07.429451 13706 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:07.233238 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1496) took 1334 ms. Trace:
I20260811 16:07:07.366981 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.434571 14583 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:07.433506 13824 rpcz_store.cc:276] 0811 16:07:05.899959 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.703673 (+803714us) service_pool.cc:227] Handling call
0811 16:07:07.231299 (+527626us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:07.231557 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:07.231594 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:07.231652 (+    58us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:07.231695 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.231788 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:07.232780 (+   992us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400125050. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.233091 (+   311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1162345216}
W20260811 16:07:07.237211 13908 rpcz_store.cc:269] 0811 16:07:02.501715 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.894792 (+393077us) service_pool.cc:227] Handling call
0811 16:07:07.225774 (+4330982us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54001b1554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.225903 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1960976256}
I20260811 16:07:07.430871 13827 rpcz_store.cc:276] 0811 16:07:05.211077 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.344095 (+1133018us) service_pool.cc:227] Handling call
0811 16:07:06.344546 (+   451us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.511428 (+166882us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.511479 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.511540 (+    61us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:06.511600 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.220501 (+708901us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54000d6454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:07.220583 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:07.220721 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":383170304}
I20260811 16:07:07.346441 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.436760 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.434824 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.441725 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.361991 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.389818 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.439440 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.290328 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.263537 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:07.422188 13743 rpcz_store.cc:276] 0811 16:07:05.628319 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.246080 (+1617761us) service_pool.cc:227] Handling call
0811 16:07:07.251440 (+  5360us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.441962 13735 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:07.261905 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.453820 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:07.454643 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1812) took 1306 ms (client timeout 1666 ms). Trace:
W20260811 16:07:07.457779 13735 rpcz_store.cc:269] 0811 16:07:06.148092 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.958975 (+810883us) service_pool.cc:227] Handling call
0811 16:07:07.454577 (+495602us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.458844 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.460214 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.456297 13908 raft_consensus.cc:2396] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260811 16:07:07.456390 14582 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:07.456267 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.454123 13825 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:07.455598 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.462800 14581 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:07.463270 13737 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:07:07.460186 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.463729 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2780) took 1826 ms. Trace:
I20260811 16:07:07.464052 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2778) took 1833 ms. Trace:
I20260811 16:07:07.464461 13735 rpcz_store.cc:276] 0811 16:07:05.630981 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.459973 (+1828992us) service_pool.cc:227] Handling call
0811 16:07:07.463992 (+  4019us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.465428 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.464414 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.466565 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.467164 14575 raft_consensus.cc:2396] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 21 because replica has last-logged OpId of term: 18 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
I20260811 16:07:07.334553 22564 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.467823 22564 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:07.468437 22668 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.170s	user 0.015s	sys 0.000s
I20260811 16:07:07.464074 13737 rpcz_store.cc:276] 0811 16:07:05.637698 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.455287 (+1817589us) service_pool.cc:227] Handling call
0811 16:07:07.463664 (+  8377us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.468946 22668 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.470171 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.470418 22564 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:07.213938 22316 consensus_meta.cc:287] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260811 16:07:07.468492 14575 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:07.471249 22316 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.472940 14575 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
W20260811 16:07:07.416323 22736 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260811 16:07:07.473815 22316 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.453867 13900 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:07.475649 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.476444 13909 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:07.476514 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.474097 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.474813 22463 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.478233 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2783) took 1491 ms. Trace:
I20260811 16:07:07.478339 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.478668 13741 rpcz_store.cc:276] 0811 16:07:05.986823 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.244730 (+1257907us) service_pool.cc:227] Handling call
0811 16:07:07.478163 (+233433us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.479559 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.223076 22027 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:07.480423 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.462175 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.481398 14574 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:07.480839 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 304989us
I20260811 16:07:07.481710 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3004) took 1876 ms. Trace:
I20260811 16:07:07.482204 13908 rpcz_store.cc:276] 0811 16:07:05.605502 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.439065 (+1833563us) service_pool.cc:227] Handling call
0811 16:07:07.481642 (+ 42577us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.482398 13743 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:07.483557 14541 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
W20260811 16:07:07.422145 22466 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260811 16:07:07.484052 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.485534 14541 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:07.486577 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:07.206847 22527 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.489418 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.230854 22381 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:07.214943 22292 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:07.491987 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 243528us
I20260811 16:07:07.488646 13735 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:07.291967 22707 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:07.500401 13909 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 25.
I20260811 16:07:07.232137 22244 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.205003 22159 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.488157 22463 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:07.416960 22510 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.491420 13907 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:07.427807 13823 rpcz_store.cc:276] 0811 16:07:04.598380 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.599049 (+   669us) service_pool.cc:227] Handling call
0811 16:07:04.599378 (+   329us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:04.906108 (+306730us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:07:04.941538 (+ 35430us) log.cc:842] Serialized 14 byte log entry
0811 16:07:04.997823 (+ 56285us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:04.997896 (+    73us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:04.997993 (+    97us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.223997 (+2226004us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002ac1d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:07.224072 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:07.224371 (+   299us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":40802,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":424,"spinlock_wait_cycles":746140288,"thread_start_us":55388,"threads_started":1,"wal-append.queue_time_us":130560,"wal-append.run_cpu_time_us":1594,"wal-append.run_wall_time_us":1081484}
I20260811 16:07:07.558203 22179 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:07.559542 22179 tablet_bootstrap.cc:492] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:07.560472 22179 ts_tablet_manager.cc:1397] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 6.881s	user 0.071s	sys 0.062s
I20260811 16:07:07.561671 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:07.499418 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.517881 22618 raft_consensus.cc:2781] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:07.495893 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.494815 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.514550 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.290548 22151 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.515084 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.494971 22735 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:07:07.583185 14581 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:07.516026 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.252643 22538 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.493888 14580 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:07.456638 22669 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
W20260811 16:07:07.561586 22683 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.589s	user 0.004s	sys 0.008s
I20260811 16:07:07.524572 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.599459 13822 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:07.334399 22583 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.533766 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.535601 14582 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:07.524734 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:07.546545 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.334398 22738 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:07.546941 14542 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:07.385946 22654 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:07.548332 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.550406 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.610558 13735 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:07.611922 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.203042 22387 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.502468 22564 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:07.592798 22691 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.563566 13741 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:07.493259 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.564833 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.514951 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:07.639554 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:07:07.640488 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 125604us
I20260811 16:07:07.641991 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.575099 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:07.644057 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.660025 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.673532 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.642812 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:07.717376 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 73640us
I20260811 16:07:07.664217 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.745774 13822 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:07.674576 13900 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:07.782686 13904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2971) took 5285 ms (client timeout 2170 ms). Trace:
I20260811 16:07:07.549631 22707 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:07.783277 13904 rpcz_store.cc:269] 0811 16:07:02.497663 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.497801 (+   138us) service_pool.cc:227] Handling call
0811 16:07:07.782417 (+5284616us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54000c7e54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:07.782591 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1165694848}
I20260811 16:07:07.784735 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.605587 22669 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:07.867625 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.867857 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.868788 13825 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:07.870389 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.870814 22669 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.584698 13820 raft_consensus.cc:2379] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:07.875236 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.875963 13820 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:07.876830 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.877939 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:07.882330 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 163400us
I20260811 16:07:07.883247 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:07.884212 22422 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:07.884793 22387 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.885468 22387 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:07.886008 22387 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:07.886422 22387 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:07.885540 22151 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.560491 22577 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:07.554486 22244 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.888008 13904 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:07.888799 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2973) took 5390 ms. Trace:
I20260811 16:07:07.889133 22244 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:07.588310 22579 consensus_meta.cc:287] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.078s	user 0.012s	sys 0.003s
I20260811 16:07:07.889086 13904 rpcz_store.cc:276] 0811 16:07:02.498277 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.887395 (+5389118us) service_pool.cc:227] Handling call
0811 16:07:07.887805 (+   410us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:07.888502 (+   697us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.888741 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.889915 22579 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.635354 22564 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:07.891419 22564 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:07.892189 22579 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.588721 22618 raft_consensus.cc:686] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:07.893488 22618 consensus_queue.cc:237] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.581709 22510 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:07.895390 22510 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:07.895844 22510 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:07.786854 22741 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:07.896750 22741 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:07.589768 22587 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:07.897116 22741 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:07:07.590672 22714 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.006s
I20260811 16:07:07.897725 22714 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:07.636090 22654 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.606187 22103 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.605072 22683 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.905540 22103 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:07.905747 22683 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.909631 13904 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260811 16:07:07.524317 13787 leader_election.cc:398] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:07.596573 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:07.915676 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 272953us
I20260811 16:07:07.600157 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:07.916090 13787 leader_election.cc:401] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260811 16:07:07.916623 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:07.916970 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 316897us
W20260811 16:07:07.917285 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 421179us
I20260811 16:07:07.918239 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:07.604290 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2431) took 1048 ms. Trace:
I20260811 16:07:07.496371 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.601621 13824 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:07.565770 22668 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:07.505643 22466 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.594493 22735 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:07.607990 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61194.1us
I20260811 16:07:07.620666 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.618551 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.523945 22316 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:07.631950 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.863947 22538 consensus_queue.cc:1046] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.012s
I20260811 16:07:07.885510 22422 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:07.624946 22583 raft_consensus.cc:2781] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:07.549409 22541 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:07.920193 13908 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:07.919435 14582 rpcz_store.cc:276] 0811 16:07:06.556303 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.482167 (+925864us) service_pool.cc:227] Handling call
0811 16:07:07.535323 (+ 53156us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:07.604022 (+ 68699us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.604232 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.928158 13825 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:07.965257 22583 raft_consensus.cc:686] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:07.966503 13737 raft_consensus.cc:2379] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:07.966276 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:07.966981 13907 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 22
I20260811 16:07:07.967054 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:07.919107 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:07.971016 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52001.1us
I20260811 16:07:07.972036 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:07.977102 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:07.879058 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:07.929410 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2975) took 5430 ms. Trace:
I20260811 16:07:07.990337 13904 rpcz_store.cc:276] 0811 16:07:02.498836 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.890248 (+5391412us) service_pool.cc:227] Handling call
0811 16:07:07.890663 (+   415us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:07.923076 (+ 32413us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.929315 (+  6239us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.495203 22527 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.918869 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:07.582752 22463 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:07.944547 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:07.886570 22561 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:08.020128 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:07.950440 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:07.950922 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.953977 13741 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:07.954670 13827 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:07:08.034144 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 83829.9us
I20260811 16:07:07.612778 13735 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:08.035007 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.035329 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2978) took 1126 ms. Trace:
I20260811 16:07:08.035198 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:08.035812 13735 rpcz_store.cc:276] 0811 16:07:06.908879 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.611535 (+702656us) service_pool.cc:227] Handling call
0811 16:07:08.035264 (+423729us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.956548 14577 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:08.035007 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.039674 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.037339 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:07.934041 13823 raft_consensus.cc:2354] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:08.043418 13743 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:08.046486 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:07.957180 22316 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:08.058259 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 139465us
I20260811 16:07:08.062026 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:08.065326 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45592.9us
I20260811 16:07:08.067441 14574 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:08.068464 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1734) took 1089 ms. Trace:
I20260811 16:07:08.068979 14574 rpcz_store.cc:276] 0811 16:07:06.978623 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.066741 (+1088118us) service_pool.cc:227] Handling call
0811 16:07:08.067202 (+   461us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.068121 (+   919us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.068396 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:07.992803 13904 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 16. Current term is 17. Ops: []
I20260811 16:07:07.944001 22608 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:07.951653 22244 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:07.947824 22587 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:07.569645 13901 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:07.952234 22103 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:08.118052 13820 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:07.968492 22422 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:08.111713 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:07.627398 22738 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:07.966423 22714 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:07.957080 22735 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:08.112090 22531 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:08.022146 22151 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:08.119869 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.205189 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48244 (request call id 78) took 3580 ms. Trace:
I20260811 16:07:08.163290 22654 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.205662 13740 rpcz_store.cc:276] 0811 16:07:04.614560 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:04.677839 (+ 63279us) service_pool.cc:227] Handling call
0811 16:07:08.195050 (+3517211us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002788d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c51906bc3 00007f5c5685081a 00007f5c4ff43d04 00007f5c4ff43c92 00007f5c4ff43bc1 00007f5c4ff43b3c 00007f5c4ff42df2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.195198 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":299550080}
I20260811 16:07:07.975848 22541 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:08.130260 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 205405us
I20260811 16:07:08.050897 22565 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:08.051363 22577 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:08.160892 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:08.177702 13827 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:08.173976 13825 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:08.222770 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3484) took 1188 ms. Trace:
I20260811 16:07:08.223201 13825 rpcz_store.cc:276] 0811 16:07:07.034419 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.869993 (+835574us) service_pool.cc:227] Handling call
0811 16:07:08.222690 (+352697us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.217943 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2757) took 5175 ms. Trace:
I20260811 16:07:08.212284 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:08.224409 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:08.184316 14580 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.001s
I20260811 16:07:08.167446 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2438) took 1182 ms. Trace:
I20260811 16:07:08.021848 22743 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:08.115639 22683 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:08.053885 22691 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:08.112465 22579 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:08.113516 22316 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:08.194324 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2969) took 3145 ms. Trace:
I20260811 16:07:08.159718 22713 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260811 16:07:07.966305 22583 consensus_queue.cc:237] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.195899 13907 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:08.171563 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3010) took 1181 ms. Trace:
I20260811 16:07:08.104449 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2978) took 5603 ms. Trace:
I20260811 16:07:08.178632 22103 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:08.185289 22629 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:08.226965 14574 rpcz_store.cc:276] 0811 16:07:06.985410 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.166248 (+1180838us) service_pool.cc:227] Handling call
0811 16:07:08.166739 (+   491us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.166980 (+   241us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.167003 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.167050 (+    47us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:08.167093 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.167209 (+   116us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.167364 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.224459 13742 rpcz_store.cc:276] 0811 16:07:03.027732 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:03.141871 (+114139us) service_pool.cc:227] Handling call
0811 16:07:03.142286 (+   415us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:03.636946 (+494660us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:03.636980 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:03.637021 (+    41us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:03.637052 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.202392 (+4565340us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54001045d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:08.202461 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.202691 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1137127168}
I20260811 16:07:08.226702 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:08.269313 13909 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
W20260811 16:07:08.268508 13902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3395) took 4299 ms (client timeout 2187 ms). Trace:
W20260811 16:07:08.274039 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47443.7us
W20260811 16:07:08.274591 13902 rpcz_store.cc:269] 0811 16:07:03.968929 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.140683 (+1171754us) service_pool.cc:227] Handling call
0811 16:07:08.268274 (+3127591us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b54002c0bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.268416 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23092096}
I20260811 16:07:08.276410 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:08.277271 13902 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:08.278990 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:08.293922 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:08.221678 22466 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:08.297840 13743 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:08.299281 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.223083 22654 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:08.238229 22743 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:08.311030 13902 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260811 16:07:08.244789 22579 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:08.312496 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2984) took 5797 ms. Trace:
I20260811 16:07:08.312978 13902 rpcz_store.cc:276] 0811 16:07:02.514892 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.303978 (+5789086us) service_pool.cc:227] Handling call
0811 16:07:08.310555 (+  6577us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.312138 (+  1583us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.312422 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.226745 14580 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:08.238694 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.114682 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:08.320236 13740 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:08.320385 13824 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:08.321652 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.322098 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.239454 13744 rpcz_store.cc:276] 0811 16:07:05.048968 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.451950 (+402982us) service_pool.cc:227] Handling call
0811 16:07:05.452325 (+   375us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:05.578566 (+126241us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:07:06.467864 (+889298us) log.cc:842] Serialized 14 byte log entry
0811 16:07:06.732539 (+264675us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:06.732618 (+    79us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:06.732691 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.194038 (+1461347us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:08.194091 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.194254 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1071213,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":16794,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":49731,"spinlock_wait_cycles":289579776,"thread_start_us":1147823,"threads_started":2,"wal-append.queue_time_us":474803,"wal-append.run_cpu_time_us":1267,"wal-append.run_wall_time_us":1001444}
I20260811 16:07:08.322960 13740 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:08.323879 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:08.324100 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:08.197580 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:08.324864 13740 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:08.325201 13820 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:08.246064 22683 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:08.327445 22683 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:08.249544 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.330541 13825 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:08.331085 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3483) took 1297 ms. Trace:
I20260811 16:07:08.331449 13825 rpcz_store.cc:276] 0811 16:07:07.034167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.233134 (+1198967us) service_pool.cc:227] Handling call
0811 16:07:08.331007 (+ 97873us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.250533 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3474) took 3255 ms. Trace:
I20260811 16:07:08.333535 13826 rpcz_store.cc:276] 0811 16:07:04.995439 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.069027 (+ 73588us) service_pool.cc:227] Handling call
0811 16:07:05.073321 (+  4294us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.521080 (+1447759us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.250146 (+1729066us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400240c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:08.250443 (+   297us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3231360256}
I20260811 16:07:08.254633 13900 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 22. Ops: []
I20260811 16:07:08.254511 13901 rpcz_store.cc:276] 0811 16:07:06.990476 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.452273 (+461797us) service_pool.cc:227] Handling call
0811 16:07:08.171465 (+719192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.254577 13904 rpcz_store.cc:276] 0811 16:07:02.500670 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.991956 (+5491286us) service_pool.cc:227] Handling call
0811 16:07:07.992418 (+   462us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.083068 (+ 90650us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.104282 (+ 21214us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.254967 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:08.323127 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:08.320056 22326 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.043s
I20260811 16:07:08.324865 13744 raft_consensus.cc:2379] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:08.054280 22179 raft_consensus.cc:348] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:08.298563 22528 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:08.293081 22587 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:08.358749 13907 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:08.359503 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3391) took 5751 ms. Trace:
I20260811 16:07:08.359802 13907 rpcz_store.cc:276] 0811 16:07:02.607699 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.336468 (+5728769us) service_pool.cc:227] Handling call
0811 16:07:08.358571 (+ 22103us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.359203 (+   632us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.359446 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:08.331118 22704 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.440s	user 0.005s	sys 0.009s
I20260811 16:07:08.342321 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.364758 13826 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:08.319084 22579 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:08.319497 22425 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.016s	sys 0.029s
I20260811 16:07:08.235781 22714 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:08.220340 22151 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:08.338114 22506 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.132s	user 0.006s	sys 0.007s
I20260811 16:07:08.317196 22743 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:08.348670 22326 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.000s	sys 0.044s
I20260811 16:07:08.253643 22691 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.345088 22707 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.213253 22422 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:08.357467 22473 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.919s	user 0.012s	sys 0.000s
I20260811 16:07:08.380107 22541 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:08.354633 22528 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:08.401496 22528 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:08.405882 22151 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.406262 22316 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.386018 22506 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.409513 22316 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.298399 22629 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.412977 22629 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:08.368602 22425 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.016s	sys 0.029s
I20260811 16:07:08.353633 22179 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:08.368425 22704 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:08.390103 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 487922us
I20260811 16:07:08.414492 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1625) took 1545 ms. Trace:
I20260811 16:07:08.313501 22654 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:08.376802 22503 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.178s	user 0.014s	sys 0.001s
I20260811 16:07:08.385602 22714 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:08.383129 22564 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.400347 22463 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.409986 22464 raft_consensus.cc:979] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:07:08.382779 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1730) took 2316 ms. Trace:
I20260811 16:07:08.419484 14581 rpcz_store.cc:276] 0811 16:07:06.869151 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.584604 (+715453us) service_pool.cc:227] Handling call
0811 16:07:08.414217 (+829613us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54005f3628. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c5682e2dc 00007f5c5686237c 00007f5c5684d80b 00007f5c5684d2a2 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c
0811 16:07:08.414428 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":647696256}
W20260811 16:07:08.389106 22555 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.292s	user 0.005s	sys 0.010s
I20260811 16:07:08.410907 22506 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.389364 22527 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:08.421947 22671 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.397s	user 0.011s	sys 0.002s
I20260811 16:07:08.430687 14577 rpcz_store.cc:276] 0811 16:07:06.066124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.597468 (+531344us) service_pool.cc:227] Handling call
0811 16:07:06.597782 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.051095 (+1453313us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.382494 (+331399us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540058cfd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:08.382707 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3124486528}
I20260811 16:07:08.421069 22278 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:08.419018 22629 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:08.423645 22503 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.437635 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:08.443848 14581 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:08.445849 14581 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260811 16:07:08.446735 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1633) took 1104 ms. Trace:
W20260811 16:07:08.436174 22618 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.009s	sys 0.027s
I20260811 16:07:08.435508 22616 raft_consensus.cc:1067] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:07:08.429225 22714 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:08.450333 22618 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.028s
I20260811 16:07:08.437664 22278 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.440727 22629 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.452090 22738 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:08.433895 22555 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:08.437134 22671 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.493248 22629 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.493248 22555 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.497268 22682 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.493270 22654 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.503525 22503 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.508795 22704 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.514582 22627 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:08.495389 22564 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.521867 22627 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:08.532644 22743 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:08.532908 22627 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:08.533919 22627 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:08.540089 22714 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:08.539395 22677 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.540838 22621 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:08.526983 22683 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:08.535049 22743 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.536006 22691 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:08.538951 22671 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:08.583603 22741 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.003s
I20260811 16:07:08.584388 22741 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.591786 22741 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.565532 22735 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:08.640933 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 492166us
I20260811 16:07:08.642016 13737 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:08.642071 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1804) took 3467 ms. Trace:
I20260811 16:07:08.643838 13738 rpcz_store.cc:276] 0811 16:07:05.173899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.463635 (+289736us) service_pool.cc:227] Handling call
0811 16:07:05.464042 (+   407us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:06.466344 (+1002302us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:06.732350 (+266006us) log.cc:842] Serialized 14 byte log entry
0811 16:07:06.900816 (+168466us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:06.901564 (+   748us) log.cc:842] Serialized 52 byte log entry
0811 16:07:06.901742 (+   178us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:06.906894 (+  5152us) log.cc:842] Serialized 14 byte log entry
0811 16:07:06.907325 (+   431us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:06.907559 (+   234us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:08.588632 (+1681073us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b180035c860. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:08.641182 (+ 52550us) raft_consensus.cc:1671] finished
0811 16:07:08.641279 (+    97us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.641755 (+   476us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2167,"prepare.queue_time_us":200047,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":3037,"raft.queue_time_us":90632,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":21336,"spinlock_wait_cycles":22569472,"thread_start_us":1336824,"threads_started":3,"wal-append.queue_time_us":149805}
I20260811 16:07:08.649117 13742 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:08.648954 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.654068 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:08.658775 13743 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:08.658198 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:08.659873 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.684048 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:08.687970 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:08.692698 13820 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:08.695034 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.696305 13820 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:08.697615 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:08.698638 13820 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:08.368213 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:08.727880 13824 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:08.729990 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.731769 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3494) took 1684 ms. Trace:
I20260811 16:07:08.732260 13824 rpcz_store.cc:276] 0811 16:07:07.047422 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.729375 (+1681953us) service_pool.cc:227] Handling call
0811 16:07:08.731684 (+  2309us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.357697 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:08.384768 13907 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 21. Ops: []
I20260811 16:07:08.585680 22686 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.774077 22671 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:08.776429 22654 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:08.435312 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:08.780092 22683 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:08.526813 22510 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.006s
I20260811 16:07:08.771176 13818 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:08.782065 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.451654 14581 rpcz_store.cc:276] 0811 16:07:07.342691 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.444944 (+1102253us) service_pool.cc:227] Handling call
0811 16:07:08.445451 (+   507us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:08.446365 (+   914us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.446663 (+   298us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.782459 22590 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:08.781368 14577 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:08.769150 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:08.794606 22735 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.796164 22654 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:08.783929 22692 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:07:08.783000 22381 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.259s	user 0.013s	sys 0.001s
W20260811 16:07:08.797351 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 477923us
I20260811 16:07:08.785584 22327 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.695024 13738 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 12. Current term is 13. Ops: []
I20260811 16:07:08.780128 13904 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:08.819373 22692 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:08.802460 13826 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:08.803051 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1738) took 1794 ms. Trace:
I20260811 16:07:08.804167 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:08.804662 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1553) took 5919 ms. Trace:
I20260811 16:07:08.802714 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3004) took 5572 ms. Trace:
I20260811 16:07:08.811750 13825 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 20
W20260811 16:07:08.811923 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3397) took 4827 ms (client timeout 2576 ms). Trace:
W20260811 16:07:08.813555 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1565) took 3636 ms (client timeout 1639 ms). Trace:
W20260811 16:07:08.813694 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44482.4us
I20260811 16:07:08.436549 22179 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:08.815310 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56292 (request call id 1579) took 1787 ms. Trace:
I20260811 16:07:08.823997 22692 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:08.826575 22583 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:08.823868 13907 rpcz_store.cc:276] 0811 16:07:02.885230 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.360549 (+5475319us) service_pool.cc:227] Handling call
0811 16:07:08.384537 (+ 23988us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.803797 (+419260us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.804310 (+   513us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.780021 22671 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:08.825057 13906 rpcz_store.cc:269] 0811 16:07:05.176890 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.290618 (+113728us) service_pool.cc:227] Handling call
0811 16:07:08.813045 (+3522427us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000352d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.813308 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3730597632}
I20260811 16:07:08.830888 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1806) took 3595 ms. Trace:
I20260811 16:07:08.833752 13738 rpcz_store.cc:276] 0811 16:07:05.232559 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.683251 (+3450692us) service_pool.cc:227] Handling call
0811 16:07:08.686847 (+  3596us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.827624 (+140777us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.827969 (+   345us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:08.824869 13903 rpcz_store.cc:269] 0811 16:07:03.984513 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.195132 (+1210619us) service_pool.cc:227] Handling call
0811 16:07:08.811394 (+3616262us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54000c7954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.811663 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2127403392}
I20260811 16:07:08.825340 13908 rpcz_store.cc:276] 0811 16:07:07.027365 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.643194 (+615829us) service_pool.cc:227] Handling call
0811 16:07:08.814757 (+1171563us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b54002ad5d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.815047 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":118179072}
I20260811 16:07:08.823318 14582 rpcz_store.cc:276] 0811 16:07:06.988258 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.242761 (+1254503us) service_pool.cc:227] Handling call
0811 16:07:08.293283 (+ 50522us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:08.294550 (+  1267us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.294580 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:08.337546 (+ 42966us) log.cc:842] Serialized 26 byte log entry
0811 16:07:08.782365 (+444819us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:08.782471 (+   106us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.782616 (+   145us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:08.782693 (+    77us) raft_consensus.cc:1671] finished
0811 16:07:08.782718 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.782993 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":865,"raft.queue_time_us":1646,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":13695,"thread_start_us":433234,"threads_started":1,"wal-append.queue_time_us":180679}
I20260811 16:07:08.839418 22583 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.839332 22590 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:08.840150 22671 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:08.842782 22583 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.824365 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:08.838843 22460 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:08.826454 22743 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:08.845752 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:08.848363 13787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.002s	sys 0.012s
I20260811 16:07:08.837050 22654 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.853262 22743 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.854875 22510 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.857960 22743 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.860204 13735 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:08.860818 13744 raft_consensus.cc:595] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:08.861268 13744 raft_consensus.cc:603] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:07:08.863166 13826 raft_consensus.cc:1226] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:08.863384 22179 ts_tablet_manager.cc:1428] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 1.302s	user 0.011s	sys 0.015s
W20260811 16:07:08.855700 13787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.002s	sys 0.013s
W20260811 16:07:08.863960 22179 ts_tablet_manager.cc:1460] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Tablet startup took 1303ms
I20260811 16:07:08.823943 13821 rpcz_store.cc:276] 0811 16:07:03.230091 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:03.231274 (+  1183us) service_pool.cc:227] Handling call
0811 16:07:03.238626 (+  7352us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:03.642633 (+404007us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:07:03.681303 (+ 38670us) log.cc:842] Serialized 14 byte log entry
0811 16:07:04.304012 (+622709us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:04.304068 (+    56us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:04.304129 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.800506 (+4496377us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400174654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:08.800611 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.802397 (+  1786us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39576,"prepare.queue_time_us":257969,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":5951,"raft.queue_time_us":2597,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":40667,"spinlock_wait_cycles":928370432,"thread_start_us":655222,"threads_started":2,"wal-append.queue_time_us":793096,"wal-append.run_cpu_time_us":1248,"wal-append.run_wall_time_us":1019110}
I20260811 16:07:08.869549 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:08.876519 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:08.878423 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:08.871258 13736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 2953) took 6475 ms (client timeout 2048 ms). Trace:
I20260811 16:07:08.864215 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3486) took 1829 ms. Trace:
I20260811 16:07:08.881079 14581 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:08.879913 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1554) took 5994 ms. Trace:
I20260811 16:07:08.848881 22590 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:08.891845 13906 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:08.888190 13826 rpcz_store.cc:276] 0811 16:07:07.034928 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.838039 (+1803111us) service_pool.cc:227] Handling call
0811 16:07:08.862900 (+ 24861us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.863818 (+   918us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.864088 (+   270us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.854977 22654 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.891295 13903 rpcz_store.cc:276] 0811 16:07:02.885546 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.840990 (+5955444us) service_pool.cc:227] Handling call
0811 16:07:08.843283 (+  2293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.879419 (+ 36136us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.879447 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.879515 (+    68us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:08.879603 (+    88us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.879679 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.879822 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:08.887810 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 200159us
W20260811 16:07:08.887892 13736 rpcz_store.cc:269] 0811 16:07:02.355657 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:02.356441 (+   784us) service_pool.cc:227] Handling call
0811 16:07:08.799282 (+6442841us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400311d54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.831039 (+ 31757us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2699174144}
I20260811 16:07:08.895828 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1556) took 6009 ms. Trace:
I20260811 16:07:08.896097 13906 rpcz_store.cc:276] 0811 16:07:02.886124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.865287 (+5979163us) service_pool.cc:227] Handling call
0811 16:07:08.889479 (+ 24192us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.893362 (+  3883us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.895774 (+  2412us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.866135 22510 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.897476 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1636) took 1530 ms. Trace:
I20260811 16:07:08.898187 22593 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
W20260811 16:07:08.898715 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 878652us
I20260811 16:07:08.899216 22668 raft_consensus.cc:3032] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:08.902518 14581 rpcz_store.cc:276] 0811 16:07:07.363582 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.880041 (+1516459us) service_pool.cc:227] Handling call
0811 16:07:08.880615 (+   574us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.893880 (+ 13265us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.894092 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.865687 22460 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.903987 22593 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:08.907382 22668 raft_consensus.cc:729] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:08.924603 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1807) took 3630 ms. Trace:
I20260811 16:07:08.924973 13738 rpcz_store.cc:276] 0811 16:07:05.292291 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.847516 (+3555225us) service_pool.cc:227] Handling call
0811 16:07:08.897287 (+ 49771us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.920875 (+ 23588us) raft_consensus.cc:1520] Early marking committed up to index 12
0811 16:07:08.920901 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.922627 (+  1726us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:08.922657 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.922699 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.922785 (+    86us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.928542 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:08.933086 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:08.940006 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3389) took 6306 ms. Trace:
I20260811 16:07:08.945068 13736 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260811 16:07:08.949160 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2430) took 2393 ms. Trace:
I20260811 16:07:08.949216 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:08.937680 22505 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.950589 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2774) took 3318 ms. Trace:
I20260811 16:07:08.953836 13736 rpcz_store.cc:276] 0811 16:07:05.629666 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.911096 (+3281430us) service_pool.cc:227] Handling call
0811 16:07:08.932207 (+ 21111us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.947491 (+ 15284us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.948348 (+   857us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:08.951315 13740 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.017s
I20260811 16:07:08.949779 14575 rpcz_store.cc:276] 0811 16:07:06.555955 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.475071 (+919116us) service_pool.cc:227] Handling call
0811 16:07:07.475458 (+   387us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:07.605060 (+129602us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:07.605089 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:07.605135 (+    46us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:07.605165 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.938192 (+1333027us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54006cbe54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:08.940683 (+  2491us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.948947 (+  8264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":297546496}
I20260811 16:07:08.960980 22574 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:08.963588 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:08.967993 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2444) took 1346 ms. Trace:
I20260811 16:07:08.968523 14581 rpcz_store.cc:276] 0811 16:07:07.621588 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.911261 (+1289673us) service_pool.cc:227] Handling call
0811 16:07:08.929466 (+ 18205us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.957162 (+ 27696us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.957198 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.959377 (+  2179us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:08.967692 (+  8315us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.967795 (+   103us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.967918 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:08.970489 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1555) took 6084 ms. Trace:
W20260811 16:07:08.973624 13823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3050) took 1684 ms (client timeout 1758 ms). Trace:
I20260811 16:07:08.973773 22680 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260811 16:07:08.974125 13823 rpcz_store.cc:269] 0811 16:07:07.289362 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.564538 (+275176us) service_pool.cc:227] Handling call
0811 16:07:08.973133 (+1408595us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540025f654. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.973399 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":676406528}
W20260811 16:07:08.976044 13741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2789) took 1356 ms (client timeout 1758 ms). Trace:
W20260811 16:07:08.976536 13741 rpcz_store.cc:269] 0811 16:07:07.619856 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.659622 (+ 39766us) service_pool.cc:227] Handling call
0811 16:07:08.975569 (+1315947us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001db854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.975802 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":570373504}
I20260811 16:07:08.977773 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:08.978549 13741 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:08.946679 22668 consensus_queue.cc:260] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:08.980268 22668 raft_consensus.cc:3037] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:08.981182 13739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1814) took 2725 ms (client timeout 1645 ms). Trace:
W20260811 16:07:08.981711 13739 rpcz_store.cc:269] 0811 16:07:06.255482 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.242495 (+987013us) service_pool.cc:227] Handling call
0811 16:07:08.980678 (+1738183us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000a9bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:08.980944 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2762672896}
I20260811 16:07:08.966591 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2447) took 1039 ms. Trace:
I20260811 16:07:08.970947 13908 rpcz_store.cc:276] 0811 16:07:02.885829 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.857115 (+5971286us) service_pool.cc:227] Handling call
0811 16:07:08.969347 (+112232us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:08.969681 (+   334us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.970084 (+   403us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.970126 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.970196 (+    70us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:08.970254 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.970304 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.970407 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28352896}
I20260811 16:07:08.985128 14575 rpcz_store.cc:276] 0811 16:07:07.927328 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.965086 (+1037758us) service_pool.cc:227] Handling call
0811 16:07:08.965603 (+   517us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.966075 (+   472us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.966106 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.966182 (+    76us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:08.966279 (+    97us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.966350 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.966493 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.000582 13820 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:09.001484 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:09.002758 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3495) took 1922 ms. Trace:
I20260811 16:07:09.003014 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.943349 13901 rpcz_store.cc:276] 0811 16:07:02.595937 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.334889 (+5738952us) service_pool.cc:227] Handling call
0811 16:07:08.357527 (+ 22638us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.357773 (+   246us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:07:08.788590 (+430817us) log.cc:842] Serialized 14 byte log entry
0811 16:07:08.850641 (+ 62051us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.864482 (+ 13841us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:08.888969 (+ 24487us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:08.891596 (+  2627us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:08.902162 (+ 10566us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8470,"prepare.queue_time_us":441225,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":98,"raft.queue_time_us":11171,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":2545,"spinlock_wait_cycles":5525888,"thread_start_us":452189,"threads_started":2,"wal-append.queue_time_us":62130}
I20260811 16:07:08.997031 13740 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:09.003218 13820 rpcz_store.cc:276] 0811 16:07:07.080386 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.001724 (+1921338us) service_pool.cc:227] Handling call
0811 16:07:09.002153 (+   429us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.002406 (+   253us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.002435 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.002478 (+    43us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:09.002512 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.002570 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.002679 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.009099 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:08.976069 22434 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Stepping down as leader of term 12
W20260811 16:07:09.018476 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 69636.4us
I20260811 16:07:09.020524 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:09.022593 13736 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:09.023195 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2784) took 2937 ms. Trace:
I20260811 16:07:09.023563 13736 rpcz_store.cc:276] 0811 16:07:06.085521 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.021701 (+2936180us) service_pool.cc:227] Handling call
0811 16:07:09.022235 (+   534us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.022931 (+   696us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.023100 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.026754 22680 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:09.026363 13820 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 14. Current term is 15. Ops: []
I20260811 16:07:09.028697 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3047) took 1942 ms. Trace:
I20260811 16:07:09.029281 13820 rpcz_store.cc:276] 0811 16:07:07.086060 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.016290 (+1930230us) service_pool.cc:227] Handling call
0811 16:07:09.026116 (+  9826us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.028076 (+  1960us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.028498 (+   422us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.030886 14577 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:09.034304 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 114221us
I20260811 16:07:09.035480 13825 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:09.040503 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:09.016074 22434 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:09.041867 22766 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260811 16:07:08.866605 22179 ts_tablet_manager.cc:1462] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Trace:
0811 16:06:52.258543 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:52.258678 (+   135us) service_pool.cc:227] Handling call
0811 16:06:52.480129 (+221451us) ts_tablet_manager.cc:928] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
0811 16:06:53.317475 (+837346us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c4e9c65fe 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e062a 00007f5c4e9e0552 00007f5c567fd691
0811 16:06:55.633877 (+2316402us) tablet_copy_client.cc:361] Tablet copy session begun
0811 16:06:56.386549 (+752672us) tablet_metadata.cc:641] Metadata flushed
0811 16:06:56.414433 (+ 27884us) tablet_copy_client.cc:490] Wrote new tablet metadata
0811 16:06:58.205064 (+1790631us) tablet_copy_client.cc:411] Wrote new consensus metadata
0811 16:06:58.308826 (+103762us) tablet_replica.cc:205] Creating consensus instance
0811 16:06:58.309281 (+   455us) ts_tablet_manager.cc:983] Replica registered.
0811 16:06:58.309512 (+   231us) inbound_call.cc:173] Queueing success response
0811 16:07:00.678796 (+2369284us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0811 16:07:07.560881 (+6882085us) ts_tablet_manager.cc:1429] Starting tablet replica
0811 16:07:07.879865 (+318984us) tablet_replica.cc:259] Starting instrumentation
0811 16:07:07.880939 (+  1074us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":82115,"mutex_wait_us":2345,"raft.queue_time_us":5390,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201,"spinlock_wait_cycles":80034048,"tablet-copy.queue_time_us":203088,"tablet-download-pool.queue_time_us":50844,"tablet-download-pool.run_cpu_time_us":1808,"tablet-download-pool.run_wall_time_us":1020690,"thread_start_us":1409522,"threads_started":2}
I20260811 16:07:09.085493 13736 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:09.079773 22460 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:08.962517 22593 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.050625 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:09.048270 22103 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.755s	user 0.005s	sys 0.013s
W20260811 16:07:09.048724 22387 consensus_meta.cc:287] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.064s	user 0.016s	sys 0.008s
W20260811 16:07:09.052738 22767 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260811 16:07:09.054080 22422 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:09.054270 22481 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:09.055296 22574 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:09.055805 14575 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:09.056135 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3392) took 5108 ms. Trace:
W20260811 16:07:09.057672 13822 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.311s	user 0.022s	sys 0.006s
I20260811 16:07:09.058104 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1504) took 1089 ms. Trace:
I20260811 16:07:09.099885 13825 rpcz_store.cc:276] 0811 16:07:07.969258 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.332339 (+363081us) service_pool.cc:227] Handling call
0811 16:07:09.057993 (+725654us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.101229 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:09.087430 22593 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:09.063243 13818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3027) took 3884 ms (client timeout 2253 ms). Trace:
I20260811 16:07:09.065085 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:07:09.066638 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2441) took 1862 ms. Trace:
W20260811 16:07:09.068073 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 2993) took 3483 ms (client timeout 2489 ms). Trace:
I20260811 16:07:09.068696 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2781) took 3430 ms. Trace:
I20260811 16:07:09.104436 13825 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:09.069113 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 149301us
I20260811 16:07:09.073001 14579 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:09.076054 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2790) took 1455 ms. Trace:
I20260811 16:07:09.078096 14573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2424) took 3229 ms. Trace:
I20260811 16:07:09.044442 22692 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.092696 13907 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:09.058153 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2977) took 6557 ms. Trace:
I20260811 16:07:09.104501 14574 rpcz_store.cc:276] 0811 16:07:07.203758 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.273809 (+1070051us) service_pool.cc:227] Handling call
0811 16:07:08.274181 (+   372us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.424484 (+150303us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.424534 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:08.424595 (+    61us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:08.424642 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.065982 (+641340us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540052c954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.066063 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.066401 (+   338us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":344939904}
I20260811 16:07:09.104765 13738 rpcz_store.cc:276] 0811 16:07:05.638140 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.941303 (+3303163us) service_pool.cc:227] Handling call
0811 16:07:08.961979 (+ 20676us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.040690 (+ 78711us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.040734 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.068298 (+ 27564us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:07:09.068353 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.068437 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.068585 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.099550 13908 rpcz_store.cc:276] 0811 16:07:03.947983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.014066 (+5066083us) service_pool.cc:227] Handling call
0811 16:07:09.054435 (+ 40369us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.055277 (+   842us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.055334 (+    57us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.055460 (+   126us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:09.055551 (+    91us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.055720 (+   169us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.055985 (+   265us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.111464 22460 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:09.111922 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61960.9us
I20260811 16:07:09.112987 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:09.113211 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:09.114235 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:09.114542 22579 consensus_meta.cc:287] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.013s
W20260811 16:07:09.105582 13905 rpcz_store.cc:269] 0811 16:07:05.584458 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.587499 (+1003041us) service_pool.cc:227] Handling call
0811 16:07:09.067641 (+2480142us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54000c7454. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.067834 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4794090752}
I20260811 16:07:09.115031 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:09.101568 22387 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.107210 13822 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:09.124336 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:09.106271 13737 rpcz_store.cc:276] 0811 16:07:07.620184 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.976192 (+356008us) service_pool.cc:227] Handling call
0811 16:07:09.075696 (+1099504us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54002094d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.075958 (+   262us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1043569024}
I20260811 16:07:09.107626 13909 rpcz_store.cc:276] 0811 16:07:02.500388 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.954796 (+5454408us) service_pool.cc:227] Handling call
0811 16:07:08.268951 (+314155us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:08.293472 (+ 24521us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.057626 (+764154us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54002c0bd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.057909 (+   283us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":715085696}
I20260811 16:07:09.125896 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:09.105501 14573 rpcz_store.cc:276] 0811 16:07:05.849167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.849401 (+   234us) service_pool.cc:227] Handling call
0811 16:07:05.871087 (+ 21686us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:06.801565 (+930478us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.077460 (+2275895us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400571054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.077845 (+   385us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2037179776}
I20260811 16:07:09.117125 13905 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:09.117092 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1557) took 6230 ms. Trace:
I20260811 16:07:09.157691 13907 rpcz_store.cc:276] 0811 16:07:02.886420 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.974679 (+6088259us) service_pool.cc:227] Handling call
0811 16:07:08.995947 (+ 21268us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.107271 (+111324us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.117007 (+  9736us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.118058 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1817) took 2310 ms. Trace:
I20260811 16:07:09.125211 13738 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:09.161944 14575 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
W20260811 16:07:09.103976 13818 rpcz_store.cc:269] 0811 16:07:05.179053 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.239133 (+ 60080us) service_pool.cc:227] Handling call
0811 16:07:09.062913 (+3823780us) spinlock_profiling.cc:243] Waited 3.48 s on lock 0x7b54002db4d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.063110 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8001180928}
I20260811 16:07:09.164065 13741 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:09.132614 13822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3051) took 1770 ms (client timeout 1935 ms). Trace:
I20260811 16:07:09.159489 13740 rpcz_store.cc:276] 0811 16:07:06.807574 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.116829 (+2309255us) service_pool.cc:227] Handling call
0811 16:07:09.117315 (+   486us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.117655 (+   340us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.117688 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.117757 (+    69us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:09.117784 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.117842 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.117968 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.177253 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1573) took 3314 ms. Trace:
I20260811 16:07:09.177915 13905 rpcz_store.cc:276] 0811 16:07:05.862829 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.116206 (+3253377us) service_pool.cc:227] Handling call
0811 16:07:09.116719 (+   513us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.172195 (+ 55476us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.177178 (+  4983us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.179358 13825 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:09.179809 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2979) took 2253 ms. Trace:
I20260811 16:07:09.180472 13738 rpcz_store.cc:276] 0811 16:07:06.926623 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.124459 (+2197836us) service_pool.cc:227] Handling call
0811 16:07:09.124963 (+   504us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.179521 (+ 54558us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.179748 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.124305 22481 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:09.168926 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1813) took 2942 ms. Trace:
W20260811 16:07:09.168015 13822 rpcz_store.cc:269] 0811 16:07:07.362726 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.602249 (+239523us) service_pool.cc:227] Handling call
0811 16:07:09.132493 (+1530244us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.182550 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3405) took 4723 ms. Trace:
I20260811 16:07:09.195247 13908 rpcz_store.cc:276] 0811 16:07:04.459270 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.126413 (+4667143us) service_pool.cc:227] Handling call
0811 16:07:09.126816 (+   403us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.127132 (+   316us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.155902 (+ 28770us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.166308 (+ 10406us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:09.182203 (+ 15895us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.182305 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.182482 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.193849 13736 rpcz_store.cc:276] 0811 16:07:06.226915 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.024347 (+2797432us) service_pool.cc:227] Handling call
0811 16:07:09.081576 (+ 57229us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.091551 (+  9975us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.168651 (+ 77100us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54002094d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.168844 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":130508672}
I20260811 16:07:09.099524 22103 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:09.124922 22528 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.014s
I20260811 16:07:09.199461 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3390) took 6595 ms. Trace:
I20260811 16:07:09.116911 22692 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:09.115480 22428 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:09.175559 22743 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:09.128504 22460 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:09.197957 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:09.196802 13709 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.737s (SENT)
I20260811 16:07:09.203629 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:09.208186 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:09.199857 13904 rpcz_store.cc:276] 0811 16:07:02.603971 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.335261 (+5731290us) service_pool.cc:227] Handling call
0811 16:07:08.335600 (+   339us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.824286 (+488686us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.167752 (+343466us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002c10d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.199393 (+ 31641us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":948849024}
I20260811 16:07:09.218724 22565 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:09.193684 22481 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:09.211493 13824 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
W20260811 16:07:09.223455 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 108577us
I20260811 16:07:09.225643 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1495) took 3899 ms. Trace:
I20260811 16:07:09.225828 13905 raft_consensus.cc:1226] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:09.218442 21878 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260811 16:07:09.227241 14581 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:07:09.219504 22428 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.225988 14541 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:09.116473 22434 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.231117 13740 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:09.231920 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2980) took 2292 ms. Trace:
I20260811 16:07:09.207548 22743 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:09.207595 22460 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:09.115114 22579 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.227262 21878 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:09.125272 22574 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.235754 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3419) took 2405 ms. Trace:
I20260811 16:07:09.244838 13905 rpcz_store.cc:276] 0811 16:07:06.830406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.209456 (+2379050us) service_pool.cc:227] Handling call
0811 16:07:09.225540 (+ 16084us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.233894 (+  8354us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.235682 (+  1788us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.232348 13740 rpcz_store.cc:276] 0811 16:07:06.939970 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.183518 (+2243548us) service_pool.cc:227] Handling call
0811 16:07:09.229928 (+ 46410us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.231616 (+  1688us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.231853 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.239388 13736 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 14. Current term is 15. Ops: []
I20260811 16:07:09.240195 13907 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:09.199076 22528 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.247452 13737 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:09.237112 22743 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:09.249334 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1575) took 3385 ms. Trace:
I20260811 16:07:09.251585 13907 rpcz_store.cc:276] 0811 16:07:05.863441 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.166794 (+3303353us) service_pool.cc:227] Handling call
0811 16:07:09.220465 (+ 53671us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.249040 (+ 28575us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.249269 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.240815 22460 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:09.251026 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1820) took 2116 ms. Trace:
I20260811 16:07:09.256243 13737 rpcz_store.cc:276] 0811 16:07:07.135165 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.208352 (+2073187us) service_pool.cc:227] Handling call
0811 16:07:09.243093 (+ 34741us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.249118 (+  6025us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.250976 (+  1858us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.226136 13817 rpcz_store.cc:276] 0811 16:07:05.325696 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.553062 (+1227366us) service_pool.cc:227] Handling call
0811 16:07:06.597782 (+ 44720us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:06.692866 (+ 95084us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:06.692917 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:06.693484 (+   567us) log.cc:842] Serialized 26 byte log entry
0811 16:07:06.799668 (+106184us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:06.799707 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.211260 (+2411553us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b540021a554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.219373 (+  8113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:09.219449 (+    76us) raft_consensus.cc:1671] finished
0811 16:07:09.219466 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.225423 (+  5957us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3594,"raft.queue_time_us":9344,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":3786,"spinlock_wait_cycles":209120000,"thread_start_us":81209,"threads_started":1,"wal-append.queue_time_us":235201,"wal-append.run_cpu_time_us":1879,"wal-append.run_wall_time_us":1002681}
I20260811 16:07:09.247061 13736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 2986) took 1817 ms. Trace:
I20260811 16:07:09.258968 13736 rpcz_store.cc:276] 0811 16:07:07.429873 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.204238 (+1774365us) service_pool.cc:227] Handling call
0811 16:07:09.236781 (+ 32543us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.246566 (+  9785us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.247004 (+   438us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.242902 21878 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:09.255568 13741 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260811 16:07:09.269059 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2788) took 1909 ms. Trace:
I20260811 16:07:09.269805 13741 rpcz_store.cc:276] 0811 16:07:07.359953 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.196641 (+1836688us) service_pool.cc:227] Handling call
0811 16:07:09.240973 (+ 44332us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.268609 (+ 27636us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.268967 (+   358us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.257656 13908 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260811 16:07:09.268965 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:09.248778 22387 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:09.272663 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1582) took 2148 ms. Trace:
I20260811 16:07:09.274418 13908 rpcz_store.cc:276] 0811 16:07:07.124412 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.213860 (+2089448us) service_pool.cc:227] Handling call
0811 16:07:09.228797 (+ 14937us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.271420 (+ 42623us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.272583 (+  1163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.275753 14577 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:09.279532 22627 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.716s	user 0.016s	sys 0.008s
I20260811 16:07:09.279901 22440 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:09.280962 21878 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.279626 22278 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:09.287670 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:09.289000 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 105495us
I20260811 16:07:09.299714 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1732) took 3162 ms. Trace:
I20260811 16:07:09.300372 22574 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.300702 14578 rpcz_store.cc:276] 0811 16:07:06.136792 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:06.744025 (+607233us) service_pool.cc:227] Handling call
0811 16:07:07.042911 (+298886us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:07.043541 (+   630us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:07.043581 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:07.043623 (+    42us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:07.043663 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:07.043724 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.298056 (+2254332us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54007305d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.299487 (+  1431us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1331,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":16014,"spinlock_wait_cycles":686448384}
I20260811 16:07:09.302203 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1577) took 2951 ms. Trace:
I20260811 16:07:09.303772 22528 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.298496 22680 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:09.307691 22680 raft_consensus.cc:686] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:09.307902 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1805) took 4133 ms. Trace:
I20260811 16:07:09.308341 13742 rpcz_store.cc:276] 0811 16:07:05.174246 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.300418 (+3126172us) service_pool.cc:227] Handling call
0811 16:07:08.330614 (+ 30196us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.649853 (+319239us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.307522 (+657669us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54002099d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.307809 (+   287us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":730948480}
I20260811 16:07:09.309260 22434 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:07:09.308838 22680 consensus_queue.cc:237] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.307961 22453 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260811 16:07:09.302802 13909 rpcz_store.cc:276] 0811 16:07:06.350350 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.192176 (+2841826us) service_pool.cc:227] Handling call
0811 16:07:09.245842 (+ 53666us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.301816 (+ 55974us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.301843 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.301911 (+    68us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:09.301943 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.302004 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.302136 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:09.314301 22773 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260811 16:07:09.314911 22428 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.315717 22428 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:09.316498 22314 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:09.316987 22314 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:09.317396 22314 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:09.316300 22546 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:09.319571 22621 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:09.319972 22621 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:09.320932 22621 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.322324 22621 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:09.323927 14579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1727) took 3405 ms (client timeout 1851 ms). Trace:
I20260811 16:07:09.324162 21878 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:09.324405 14579 rpcz_store.cc:269] 0811 16:07:05.918574 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:05.958252 (+ 39678us) service_pool.cc:227] Handling call
0811 16:07:09.323655 (+3365403us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b54004c22d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.323825 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6787992448}
I20260811 16:07:09.326043 13743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2795) took 1043 ms. Trace:
I20260811 16:07:09.326474 13743 rpcz_store.cc:276] 0811 16:07:08.282699 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.299011 (+ 16312us) service_pool.cc:227] Handling call
0811 16:07:09.325782 (+1026771us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54002779d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.325977 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":823037312}
I20260811 16:07:09.328027 13743 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:09.328981 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 725) took 3420 ms. Trace:
I20260811 16:07:09.336226 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3046) took 2299 ms. Trace:
I20260811 16:07:09.333433 14583 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:09.339354 22654 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:09.341245 22565 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:09.369303 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2434) took 2486 ms. Trace:
I20260811 16:07:09.370150 22565 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.372309 22579 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:09.368108 13826 rpcz_store.cc:276] 0811 16:07:07.036805 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.901946 (+1865141us) service_pool.cc:227] Handling call
0811 16:07:08.917591 (+ 15645us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.941007 (+ 23416us) raft_consensus.cc:1520] Early marking committed up to index 17
0811 16:07:09.024891 (+ 83884us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.192981 (+168090us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.335467 (+142486us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18004c6de0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:07:09.335684 (+   217us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.335749 (+    65us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:09.335803 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.335893 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.336037 (+   144us) inbound_call.cc:173] Queueing success response
0811 16:07:09.352934 (+ 16897us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18004c6de0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
Metrics: {"mutex_wait_us":126271,"prepare.queue_time_us":112882,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":147962,"raft.run_cpu_time_us":597,"raft.run_wall_time_us":18196,"spinlock_wait_cycles":9364480,"thread_start_us":222367,"threads_started":2,"wal-append.queue_time_us":193310}
I20260811 16:07:09.374112 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3497) took 2235 ms. Trace:
I20260811 16:07:09.374480 13826 rpcz_store.cc:276] 0811 16:07:07.139009 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.373120 (+2234111us) service_pool.cc:227] Handling call
0811 16:07:09.373597 (+   477us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.373812 (+   215us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.373834 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.373873 (+    39us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:09.373899 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.373947 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.374047 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:09.351325 13735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37780 (request call id 2786) took 2335 ms (client timeout 3046 ms). Trace:
W20260811 16:07:09.351987 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 217580us
I20260811 16:07:09.354974 22584 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:09.354157 13744 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:09.392514 13738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2787) took 2243 ms. Trace:
I20260811 16:07:09.351948 22692 raft_consensus.cc:3037] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:09.353071 22278 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:09.395408 22278 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:09.395591 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2443) took 2004 ms. Trace:
I20260811 16:07:09.395923 22278 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:09.396083 14582 rpcz_store.cc:276] 0811 16:07:07.385954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.904124 (+1518170us) service_pool.cc:227] Handling call
0811 16:07:08.922961 (+ 18837us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.962345 (+ 39384us) raft_consensus.cc:1520] Early marking committed up to index 17
0811 16:07:09.192897 (+230552us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.386634 (+193737us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.386684 (+    50us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:09.386728 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.389981 (+  3253us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.390116 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":229680,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":78,"raft.queue_time_us":17337,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":306034,"threads_started":2}
I20260811 16:07:09.352217 22686 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:09.369730 14583 rpcz_store.cc:276] 0811 16:07:06.882761 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.609874 (+727113us) service_pool.cc:227] Handling call
0811 16:07:09.332964 (+1723090us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.368403 (+ 35439us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.369102 (+   699us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54006b44d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.369246 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3566290176}
I20260811 16:07:09.352716 13740 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260811 16:07:09.400370 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1561) took 6121 ms. Trace:
I20260811 16:07:09.402253 13740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2792) took 1781 ms. Trace:
I20260811 16:07:09.402818 13740 rpcz_store.cc:276] 0811 16:07:07.620726 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.254818 (+1634092us) service_pool.cc:227] Handling call
0811 16:07:09.352249 (+ 97431us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.401895 (+ 49646us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.402178 (+   283us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.385138 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:09.348528 22528 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260811 16:07:09.341504 13822 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:09.358424 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1560) took 6125 ms. Trace:
I20260811 16:07:09.360579 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 2979) took 6859 ms. Trace:
I20260811 16:07:09.362680 13874 leader_election.cc:398] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:09.411898 13874 leader_election.cc:401] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:09.402302 13903 rpcz_store.cc:276] 0811 16:07:03.278915 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.920035 (+5641120us) service_pool.cc:227] Handling call
0811 16:07:08.939709 (+ 19674us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.959239 (+ 19530us) raft_consensus.cc:1520] Early marking committed up to index 16
0811 16:07:09.016858 (+ 57619us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.399651 (+382793us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.399728 (+    77us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:09.399794 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.400129 (+   335us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.400298 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":169295,"prepare.queue_time_us":21458,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":203451,"thread_start_us":149872,"threads_started":1,"wal-append.queue_time_us":231139}
I20260811 16:07:09.411330 13906 rpcz_store.cc:276] 0811 16:07:03.233468 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.912894 (+5679426us) service_pool.cc:227] Handling call
0811 16:07:08.932374 (+ 19480us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.357999 (+425625us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.358034 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.358093 (+    59us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:09.358149 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.358217 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.358354 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":398322,"raft.queue_time_us":399063,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":111}
I20260811 16:07:09.328220 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37780 (request call id 2793) took 1707 ms. Trace:
I20260811 16:07:09.413727 13737 rpcz_store.cc:276] 0811 16:07:07.621003 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.271609 (+1650606us) service_pool.cc:227] Handling call
0811 16:07:09.327557 (+ 55948us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.327829 (+   272us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.327858 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.327930 (+    72us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:09.327962 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.328042 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.328165 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.414489 14577 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:09.367676 13904 rpcz_store.cc:276] 0811 16:07:05.908485 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.236041 (+3327556us) service_pool.cc:227] Handling call
0811 16:07:09.328867 (+ 92826us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.339030 13824 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260811 16:07:09.417953 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3049) took 2280 ms. Trace:
I20260811 16:07:09.418437 13824 rpcz_store.cc:276] 0811 16:07:07.137484 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.338055 (+2200571us) service_pool.cc:227] Handling call
0811 16:07:09.338516 (+   461us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.417516 (+ 79000us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.417842 (+   326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.376680 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:09.369248 14578 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:09.410781 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3493) took 2363 ms. Trace:
I20260811 16:07:09.357368 22460 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.380211 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3388) took 6782 ms. Trace:
I20260811 16:07:09.331877 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:07:09.332809 14580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1629) took 2354 ms (client timeout 2203 ms). Trace:
I20260811 16:07:09.349213 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1505) took 1326 ms. Trace:
W20260811 16:07:09.389804 13735 rpcz_store.cc:269] 0811 16:07:07.015610 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.119469 (+1103859us) service_pool.cc:227] Handling call
0811 16:07:09.351063 (+1231594us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540004ef54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.351269 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1504396544}
I20260811 16:07:09.360867 22268 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:09.364009 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3403) took 5355 ms. Trace:
W20260811 16:07:09.354491 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 531820us
I20260811 16:07:09.395435 13744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1811) took 3255 ms. Trace:
W20260811 16:07:09.353403 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 104414us
I20260811 16:07:09.350665 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3488) took 2315 ms. Trace:
I20260811 16:07:09.399719 13738 rpcz_store.cc:276] 0811 16:07:07.149370 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.205782 (+2056412us) service_pool.cc:227] Handling call
0811 16:07:09.240900 (+ 35118us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.359560 (+118660us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.390966 (+ 31406us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.392157 (+  1191us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:09.392213 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.392305 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.392443 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.327481 13825 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:09.448467 13827 rpcz_store.cc:276] 0811 16:07:08.023058 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.039328 (+ 16270us) service_pool.cc:227] Handling call
0811 16:07:09.348809 (+1309481us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400241154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.349017 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":315507072}
I20260811 16:07:09.447384 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:07:09.411612 13900 rpcz_store.cc:276] 0811 16:07:02.500923 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.033812 (+5532889us) service_pool.cc:227] Handling call
0811 16:07:08.254435 (+220623us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:08.334717 (+ 80282us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.360116 (+1025399us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b5400087ad0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.360368 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":172693376}
I20260811 16:07:09.458860 13827 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:09.459762 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:09.447793 14580 rpcz_store.cc:269] 0811 16:07:06.978032 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:07.248030 (+269998us) service_pool.cc:227] Handling call
0811 16:07:09.332426 (+2084396us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b54006b44d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.332599 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":157194496}
I20260811 16:07:09.459894 13821 rpcz_store.cc:276] 0811 16:07:07.035475 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.873508 (+1838033us) service_pool.cc:227] Handling call
0811 16:07:09.349297 (+475789us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.349620 (+   323us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.349648 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.349704 (+    56us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:09.349732 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.349787 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.350490 (+   703us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400241150. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.350603 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1092989824}
W20260811 16:07:09.453286 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 91022.1us
I20260811 16:07:09.454319 13744 rpcz_store.cc:276] 0811 16:07:06.139992 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.022556 (+2882564us) service_pool.cc:227] Handling call
0811 16:07:09.353907 (+331351us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.392810 (+ 38903us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.395113 (+  2303us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540004ef50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.395334 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":761169280}
I20260811 16:07:09.452497 13901 rpcz_store.cc:276] 0811 16:07:04.008344 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.038403 (+5030059us) service_pool.cc:227] Handling call
0811 16:07:09.050345 (+ 11942us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.050852 (+   507us) raft_consensus.cc:1520] Early marking committed up to index 17
0811 16:07:09.056758 (+  5906us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.363637 (+306879us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.363701 (+    64us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:09.363749 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.363821 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.363949 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":122915,"prepare.queue_time_us":5223,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":123072,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":183205,"threads_started":1,"wal-append.queue_time_us":272540}
I20260811 16:07:09.401599 22584 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:09.469245 13743 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:09.472357 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3052) took 1985 ms. Trace:
I20260811 16:07:09.472842 13827 rpcz_store.cc:276] 0811 16:07:07.480466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.458221 (+1977755us) service_pool.cc:227] Handling call
0811 16:07:09.458663 (+   442us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.465502 (+  6839us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.465759 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.420639 13823 rpcz_store.cc:276] 0811 16:07:07.047111 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.984592 (+1937481us) service_pool.cc:227] Handling call
0811 16:07:09.000458 (+ 15866us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.000871 (+   413us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:07:09.185526 (+184655us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.410261 (+224735us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.410343 (+    82us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:09.410409 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.410511 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.410702 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":93020,"prepare.queue_time_us":66938,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":146269,"thread_start_us":212341,"threads_started":2}
I20260811 16:07:09.484297 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:09.410244 22428 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260811 16:07:09.359120 22743 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.457147 22579 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:09.454064 13902 rpcz_store.cc:276] 0811 16:07:02.585213 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:08.313993 (+5728780us) service_pool.cc:227] Handling call
0811 16:07:08.318170 (+  4177us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:08.895184 (+577014us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:08.901672 (+  6488us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:08.935454 (+ 33782us) log.cc:842] Serialized 26 byte log entry
0811 16:07:09.177453 (+241999us) raft_consensus.cc:1631] Marking committed up to 8
0811 16:07:09.177485 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.207523 (+ 30038us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:09.288684 (+ 81161us) raft_consensus.cc:1671] finished
0811 16:07:09.288705 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.367199 (+ 78494us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14661,"raft.queue_time_us":47263,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6238,"thread_start_us":721127,"threads_started":2,"wal-append.queue_time_us":334403}
I20260811 16:07:09.467911 22654 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:09.515409 13827 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260811 16:07:09.516196 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3054) took 1967 ms. Trace:
I20260811 16:07:09.516283 22314 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.516580 13827 rpcz_store.cc:276] 0811 16:07:07.549118 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.479763 (+1930645us) service_pool.cc:227] Handling call
0811 16:07:09.515000 (+ 35237us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.515866 (+   866us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.516109 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.518077 13827 raft_consensus.cc:1226] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: []
I20260811 16:07:09.518597 22314 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.507170 22481 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.519032 22546 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:09.520013 22481 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:09.520540 22546 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:09.521117 22546 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.522939 22583 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:09.523592 22583 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:09.514789 22460 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.525043 22583 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.529316 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3053) took 1997 ms. Trace:
I20260811 16:07:09.534240 13821 rpcz_store.cc:276] 0811 16:07:07.532012 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.464033 (+1932021us) service_pool.cc:227] Handling call
0811 16:07:09.508015 (+ 43982us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.528843 (+ 20828us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.528885 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.528959 (+    74us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:09.529002 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.529077 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.529239 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.538897 13825 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:09.541589 13820 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:09.544211 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3502) took 2045 ms. Trace:
I20260811 16:07:09.544785 13825 rpcz_store.cc:276] 0811 16:07:07.498612 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.467787 (+1969175us) service_pool.cc:227] Handling call
0811 16:07:09.504069 (+ 36282us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.543844 (+ 39775us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.544135 (+   291us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.553355 22314 raft_consensus.cc:2741] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260811 16:07:09.559646 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59036.6us
I20260811 16:07:09.560242 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3496) took 2447 ms. Trace:
I20260811 16:07:09.564064 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3058) took 1926 ms. Trace:
I20260811 16:07:09.564989 13827 rpcz_store.cc:276] 0811 16:07:07.637672 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.517398 (+1879726us) service_pool.cc:227] Handling call
0811 16:07:09.517899 (+   501us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.549544 (+ 31645us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.563980 (+ 14436us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.560791 13822 rpcz_store.cc:276] 0811 16:07:07.113213 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.205565 (+2092352us) service_pool.cc:227] Handling call
0811 16:07:09.341210 (+135645us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.436117 (+ 94907us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.555133 (+119016us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002dcdd0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.560143 (+  5010us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":234265984}
I20260811 16:07:09.454150 22686 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:09.566656 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 111677us
I20260811 16:07:09.558292 22671 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:09.480051 22268 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.539909 22583 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:09.589736 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130069us
I20260811 16:07:09.605711 13822 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:09.606506 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3064) took 1589 ms. Trace:
I20260811 16:07:09.606904 13822 rpcz_store.cc:276] 0811 16:07:08.017025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.582021 (+1564996us) service_pool.cc:227] Handling call
0811 16:07:09.605532 (+ 23511us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.606232 (+   700us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.606434 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.608880 13822 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260811 16:07:09.609318 13822 pending_rounds.cc:76] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 15
I20260811 16:07:09.609582 13822 pending_rounds.cc:97] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260811 16:07:09.609927 13822 raft_consensus.cc:2866] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:09.610774 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1506) took 1577 ms. Trace:
I20260811 16:07:09.613390 13822 rpcz_store.cc:276] 0811 16:07:08.033245 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.607950 (+1574705us) service_pool.cc:227] Handling call
0811 16:07:09.608423 (+   473us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.610486 (+  2063us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.610704 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.629498 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1509) took 1433 ms. Trace:
I20260811 16:07:09.632038 13822 rpcz_store.cc:276] 0811 16:07:08.195985 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.614658 (+1418673us) service_pool.cc:227] Handling call
0811 16:07:09.615750 (+  1092us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.621241 (+  5491us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.621293 (+    52us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.629116 (+  7823us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:09.629171 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.629247 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.629418 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.634689 13820 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260811 16:07:09.635555 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1510) took 1424 ms. Trace:
I20260811 16:07:09.635974 13820 rpcz_store.cc:276] 0811 16:07:08.211349 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.631671 (+1420322us) service_pool.cc:227] Handling call
0811 16:07:09.634249 (+  2578us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.635243 (+   994us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.635482 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.593686 22579 consensus_queue.cc:1046] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260811 16:07:09.620452 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3057) took 2028 ms. Trace:
W20260811 16:07:09.660674 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 163243us
I20260811 16:07:09.667027 13823 rpcz_store.cc:276] 0811 16:07:07.591615 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.490291 (+1898676us) service_pool.cc:227] Handling call
0811 16:07:09.574511 (+ 84220us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.613282 (+ 38771us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.613325 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.613390 (+    65us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:09.619807 (+  6417us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.619912 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.620356 (+   444us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.682539 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:09.685300 13827 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:09.689795 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3061) took 1740 ms. Trace:
I20260811 16:07:09.690258 13827 rpcz_store.cc:276] 0811 16:07:07.949754 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.566545 (+1616791us) service_pool.cc:227] Handling call
0811 16:07:09.678464 (+111919us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.689063 (+ 10599us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.689710 (+   647us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.656813 13822 raft_consensus.cc:1226] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:09.687443 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:09.696992 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57474.5us
W20260811 16:07:09.686033 22668 consensus_meta.cc:287] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.005s
I20260811 16:07:09.699005 22692 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:09.635572 21878 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:09.702136 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1512) took 1401 ms. Trace:
I20260811 16:07:09.703406 13822 rpcz_store.cc:276] 0811 16:07:08.301285 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.644427 (+1343142us) service_pool.cc:227] Handling call
0811 16:07:09.656480 (+ 12053us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.698062 (+ 41582us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.702066 (+  4004us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:09.699698 22546 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.705559 13741 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260811 16:07:09.709854 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3059) took 1842 ms. Trace:
W20260811 16:07:09.708791 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 154153us
I20260811 16:07:09.718771 22668 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:09.710500 13825 rpcz_store.cc:276] 0811 16:07:07.860029 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.545985 (+1685956us) service_pool.cc:227] Handling call
0811 16:07:09.596313 (+ 50328us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.604596 (+  8283us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.604645 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.623389 (+ 18744us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:09.623453 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.701666 (+ 78213us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b5400173c54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.701738 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.701909 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":525,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":8428800}
I20260811 16:07:09.698812 22743 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:09.703024 21878 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:09.734709 13621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 328) took 20743 ms (client timeout 15000 ms). Trace:
I20260811 16:07:09.719295 22268 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:09.698575 22314 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:09.719537 22668 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:09.647887 22584 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:09.756870 22778 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260811 16:07:09.751014 22740 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Stepping down as leader of term 14
W20260811 16:07:09.769479 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111249us
I20260811 16:07:09.771730 21878 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.725451 22546 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260811 16:07:09.786437 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:09.789969 13826 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:09.740175 22422 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260811 16:07:09.770859 22740 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:09.796972 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 114785us
I20260811 16:07:09.799790 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3499) took 2592 ms. Trace:
I20260811 16:07:09.801266 13826 rpcz_store.cc:276] 0811 16:07:07.207646 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.391202 (+2183556us) service_pool.cc:227] Handling call
0811 16:07:09.787818 (+396616us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.793914 (+  6096us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.799542 (+  5628us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400174150. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:09.799710 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":724090752}
I20260811 16:07:09.777715 22686 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:09.810364 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:09.802981 22268 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
W20260811 16:07:09.805320 22779 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.208s	user 0.000s	sys 0.004s
I20260811 16:07:09.815178 22159 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:09.815874 22159 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:09.816884 22159 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.820850 13871 leader_election.cc:398] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Vote denied by peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411) with higher term. Message: Invalid argument: T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:09.822499 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:09.824110 21878 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:09.824661 22740 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.826370 22740 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:09.806425 13739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1815) took 3237 ms. Trace:
I20260811 16:07:09.818632 22278 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:09.832114 13739 rpcz_store.cc:276] 0811 16:07:06.569425 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.084700 (+2515275us) service_pool.cc:227] Handling call
0811 16:07:09.100845 (+ 16145us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.101221 (+   376us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:09.400785 (+299564us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.800443 (+399658us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.800601 (+   158us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:09.806111 (+  5510us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.806237 (+   126us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.806369 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11646,"prepare.queue_time_us":426158,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":13296,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":11390,"thread_start_us":522833,"threads_started":2}
I20260811 16:07:09.805481 22680 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:09.844858 22780 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.222s	user 0.000s	sys 0.002s
I20260811 16:07:09.859234 22266 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:09.834368 22314 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260811 16:07:09.864550 22327 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260811 16:07:09.863953 22692 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:09.892174 22440 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:09.868602 22579 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.024s
W20260811 16:07:09.891817 22786 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260811 16:07:09.862391 22679 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260811 16:07:09.880322 22686 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260811 16:07:09.925171 13824 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:09.891032 22680 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.891013 22560 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
W20260811 16:07:09.945195 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 146625us
W20260811 16:07:09.741493 13621 rpcz_store.cc:269] 0811 16:06:49.041976 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:49.062985 (+ 21009us) service_pool.cc:227] Handling call
0811 16:07:09.734359 (+20671374us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:01.638902 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:01.816474 (+177572us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:01.838330 (+ 21856us) write_op.cc:435] Acquired schema lock
0811 16:07:01.868481 (+ 30151us) tablet.cc:660] Decoding operations
0811 16:07:02.826989 (+958508us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:02.827121 (+   132us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:02.827185 (+    64us) tablet.cc:683] Acquiring locks for 32 operations
0811 16:07:02.829919 (+  2734us) tablet.cc:699] Row locks acquired
0811 16:07:02.829972 (+    53us) write_op.cc:260] PREPARE: finished
0811 16:07:02.830174 (+   202us) write_op.cc:270] Start()
0811 16:07:02.830349 (+   175us) write_op.cc:276] Timestamp: P: 1786464422830104 usec, L: 0
0811 16:07:02.830387 (+    38us) op_driver.cc:331] REPLICATION: starting
0811 16:07:02.966685 (+136298us) log.cc:842] Serialized 12679 byte log entry
0811 16:07:05.041762 (+2075077us) op_driver.cc:444] REPLICATION: finished
0811 16:07:05.218838 (+177076us) write_op.cc:301] APPLY: starting
0811 16:07:05.218937 (+    99us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:07.223250 (+2004313us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:07.223481 (+   231us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:08.514531 (+1291050us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:08.515087 (+   556us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0811 16:07:08.515131 (+    44us) write_op.cc:312] APPLY: finished
0811 16:07:08.515760 (+   629us) log.cc:842] Serialized 276 byte log entry
0811 16:07:08.783253 (+267493us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:08.784750 (+  1497us) write_op.cc:454] Released schema lock
0811 16:07:08.784954 (+   204us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:08.785721 (+   767us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:08.785764 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":103786,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":158836,"apply.run_cpu_time_us":79229,"apply.run_wall_time_us":3604838,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137631,"num_ops":32,"prepare.queue_time_us":288514,"prepare.run_cpu_time_us":36066,"prepare.run_wall_time_us":2030921,"raft.queue_time_us":430407,"raft.run_cpu_time_us":23209,"raft.run_wall_time_us":86475,"replication_time_us":2211261,"thread_start_us":1241861,"threads_started":5,"wal-append.queue_time_us":731227,"wal-append.run_cpu_time_us":107641,"wal-append.run_wall_time_us":3402795}]]}
I20260811 16:07:09.925899 22671 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:09.874665 22668 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:09.954416 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 403662us
I20260811 16:07:09.901461 22440 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.967540 13739 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:07:09.969830 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3501) took 2546 ms. Trace:
I20260811 16:07:09.970283 13824 rpcz_store.cc:276] 0811 16:07:07.423797 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.419482 (+1995685us) service_pool.cc:227] Handling call
0811 16:07:09.482039 (+ 62557us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.944603 (+462564us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.969552 (+ 24949us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400125a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:09.969746 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":994493184}
I20260811 16:07:09.971832 22565 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:09.972313 22565 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:09.973425 22565 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:09.955469 22671 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:09.975008 22565 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:09.987085 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3060) took 2038 ms. Trace:
I20260811 16:07:10.007608 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3048) took 2870 ms. Trace:
I20260811 16:07:10.008225 13817 rpcz_store.cc:276] 0811 16:07:07.137110 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.277216 (+2140106us) service_pool.cc:227] Handling call
0811 16:07:09.339957 (+ 62741us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:09.340608 (+   651us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:09.340658 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:09.379538 (+ 38880us) log.cc:842] Serialized 26 byte log entry
0811 16:07:09.481589 (+102051us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:09.481633 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.481706 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:10.007307 (+525601us) raft_consensus.cc:1671] finished
0811 16:07:10.007338 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:10.007524 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":93831,"threads_started":1,"wal-append.queue_time_us":361740}
I20260811 16:07:10.003579 13821 rpcz_store.cc:276] 0811 16:07:07.948679 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.557252 (+1608573us) service_pool.cc:227] Handling call
0811 16:07:09.601850 (+ 44598us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.642869 (+ 41019us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:09.670404 (+ 27535us) log.cc:842] Serialized 14 byte log entry
0811 16:07:09.986536 (+316132us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:09.986603 (+    67us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:09.986650 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:09.986738 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:09.987006 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":32549,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":8041,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6632,"thread_start_us":267842,"threads_started":1}
I20260811 16:07:10.019816 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.024190 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.030673 22440 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.031114 13620 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.033845 13620 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.037492 13739 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:10.039407 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:10.044081 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.049816 14579 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:09.998163 22621 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260811 16:07:10.051839 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46931.2us
W20260811 16:07:10.057914 22783 log.cc:924] Time spent T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260811 16:07:10.038216 22680 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:10.057924 22787 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260811 16:07:10.067914 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.071434 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.061833 22278 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:10.062717 22481 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:10.046527 22579 consensus_queue.cc:1046] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260811 16:07:10.067317 22593 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.082347 22481 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:10.095558 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 91627.1us
I20260811 16:07:10.080963 22314 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Stepping down as leader of term 14
I20260811 16:07:10.083000 22686 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.089756 22422 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:10.101449 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.059265 22671 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.109733 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1834) took 1114 ms. Trace:
I20260811 16:07:10.110294 13742 rpcz_store.cc:276] 0811 16:07:08.995674 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.309596 (+313922us) service_pool.cc:227] Handling call
0811 16:07:09.309955 (+   359us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:09.310286 (+   331us) raft_consensus.cc:1520] Early marking committed up to index 16
0811 16:07:09.716295 (+406009us) log.cc:842] Serialized 14 byte log entry
0811 16:07:10.109215 (+392920us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:10.109301 (+    86us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:10.109362 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:10.109473 (+   111us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:10.109640 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4158,"prepare.queue_time_us":266201,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"thread_start_us":786020,"threads_started":2}
I20260811 16:07:10.082213 22584 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260811 16:07:10.100333 22481 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:10.124575 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.125643 13742 raft_consensus.cc:2379] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 25: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:10.127772 13620 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.090234 22593 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.105306 22422 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:10.102852 22314 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:07:10.127796 22790 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260811 16:07:10.116096 22791 log.cc:924] Time spent T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260811 16:07:10.097579 22278 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260811 16:07:10.152613 22422 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.171710 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.107024 22686 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.176638 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.178856 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.180104 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.181003 13736 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:10.169072 22671 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:10.188114 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.189662 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.175626 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.172957 22266 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:10.200691 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:10.204774 22686 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.208629 13739 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 13: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:10.186082 22159 raft_consensus.cc:3032] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:10.130540 13620 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 23 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.214300 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.220194 22593 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:10.224211 13620 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 13 to 16, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 16 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:10.227825 13709 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.580s (SENT)
I20260811 16:07:10.229096 22266 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.237172 13620 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 8 to 18. New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.213020 22159 raft_consensus.cc:729] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:10.243734 22159 consensus_queue.cc:260] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.244562 22314 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:07:10.246223 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63161.5us
I20260811 16:07:10.246558 22314 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
W20260811 16:07:10.251276 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 282520us
W20260811 16:07:10.253008 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 348483us
I20260811 16:07:10.275386 22686 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:10.303889 22686 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.306720 22686 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:10.294034 13787 connection.cc:232] RPC call timeout handler was delayed by -1.0391110619530082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260811 16:07:10.307907 22278 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.308661 22278 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.309708 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:10.311509 22692 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:10.315769 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.316849 13620 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 18, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 18 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:10.319988 13742 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:07:10.325297 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.327975 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.334383 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.337090 22686 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:10.337966 22686 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:10.338164 21878 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.003s
W20260811 16:07:10.339339 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 49989.4us
I20260811 16:07:10.339520 22679 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.275660 22584 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260811 16:07:10.343730 22740 consensus_queue.cc:1046] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:10.338689 22686 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.346451 22740 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:10.335734 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.365437 13742 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:07:10.377305 13709 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.522s (SENT)
W20260811 16:07:10.368885 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 145826us
I20260811 16:07:10.378149 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:10.381976 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47697.3us
W20260811 16:07:10.383421 22583 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.769s	user 0.013s	sys 0.004s
I20260811 16:07:10.383004 22593 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:10.384117 22278 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:10.408740 22027 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:10.410212 22584 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Stepping down as leader of term 25
I20260811 16:07:10.410940 22159 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:10.369680 21878 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:10.454824 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 77587.1us
W20260811 16:07:10.458384 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 116084us
W20260811 16:07:10.466288 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 219259us
I20260811 16:07:10.433557 22327 raft_consensus.cc:3032] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
W20260811 16:07:10.467600 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 75861.9us
I20260811 16:07:10.436316 22027 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:10.440320 22584 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:10.476344 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 163148us
I20260811 16:07:10.452867 22692 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:10.493412 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.493758 22027 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.495376 22027 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:10.498950 22584 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.500728 22584 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:10.507962 22692 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.469849 22327 raft_consensus.cc:729] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:10.512749 22327 consensus_queue.cc:260] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.514001 22327 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:10.468725 22278 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260811 16:07:10.518339 22679 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:10.518040 22686 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.481746 22740 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:10.519651 22740 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.521080 22481 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.521929 22740 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.514022 13901 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:10.539060 22560 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:10.539875 22560 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:10.540331 22668 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.541428 22668 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.468250 21878 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.543285 22422 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.544509 13743 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.546571 21878 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:10.532718 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50738us
W20260811 16:07:10.549667 13709 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.754s (SENT)
I20260811 16:07:10.553380 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:10.564862 22278 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:10.569052 22278 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.570629 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.580392 13902 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:07:10.505900 13620 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.583113 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.583159 22822 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:10.564415 22740 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:10.575743 22440 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:10.600915 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.603804 13900 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:10.600934 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:10.600773 22822 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.605216 14579 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.605600 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.602244 22244 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:10.602377 22740 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.601701 14580 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:10.607038 22822 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.607079 22244 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.608449 22740 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:10.603724 13901 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:10.574950 22422 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.610600 22244 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.611482 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.612228 22278 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.614413 22244 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:10.614794 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:10.629329 14579 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
W20260811 16:07:10.629084 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 64290.4us
I20260811 16:07:10.572238 22481 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:10.635957 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.541469 22560 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.656592 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.656932 22560 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:10.650363 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:10.660347 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 110708us
I20260811 16:07:10.664428 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.665354 13900 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:10.645049 22278 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:10.669358 13709 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.697s (SENT)
I20260811 16:07:10.677929 13901 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:10.685686 22686 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:10.687294 22278 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.689849 22278 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:10.691910 22815 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260811 16:07:10.692826 13620 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 13 to 18, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.652822 22244 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:10.669919 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:10.706446 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:10.712550 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 54055.3us
W20260811 16:07:10.714121 13789 connection.cc:232] RPC call timeout handler was delayed by -1.7197740959236398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260811 16:07:10.709625 13900 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:10.714632 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.709817 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.716990 13742 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.708814 13743 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
W20260811 16:07:10.715642 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 244212us
I20260811 16:07:10.716746 13744 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:10.721426 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.718739 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:10.726003 13904 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:07:10.713027 22244 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:10.718269 22824 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260811 16:07:10.742676 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:10.770229 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.770793 13821 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:10.743876 13824 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:10.746882 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:10.773548 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.773792 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.726068 22440 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:10.774362 13741 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:10.752481 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.775194 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.775967 13903 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:10.773813 13901 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260811 16:07:10.777019 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.777827 13909 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:10.779474 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.710414 22668 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:10.712381 13620 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 12 to 15, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 15 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:10.780520 13787 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.781456 22686 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:10.782065 22686 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:10.763845 22244 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.774302 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:10.783063 22686 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:10.786820 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.774158 13817 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
W20260811 16:07:10.789485 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66337us
I20260811 16:07:10.788250 13903 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:10.793373 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.794124 13904 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.794169 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:10.805312 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86748.6us
I20260811 16:07:10.808871 13906 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:10.780588 22278 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:10.812098 13741 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:10.821069 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.822795 13901 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:10.815562 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.827808 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:10.831481 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:10.835614 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:10.836820 13825 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:10.838423 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:10.839545 13822 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:07:10.841601 13818 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260811 16:07:10.842267 13818 pending_rounds.cc:76] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 11
I20260811 16:07:10.842598 13818 pending_rounds.cc:97] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.12
I20260811 16:07:10.782245 13620 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 12 to 16, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 16 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:10.843569 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:10.844769 14578 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:10.847311 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:10.848389 13826 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:10.856137 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:10.857318 14583 raft_consensus.cc:2354] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:10.862033 13824 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:07:10.814020 22278 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:10.863950 22278 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:10.862579 13902 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:10.868376 22692 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.869192 22692 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:10.870193 22828 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:07:10.862130 13620 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:10.862890 13824 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:07:10.877022 13824 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:10.843058 13818 raft_consensus.cc:2894] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Aborting config change with OpId 18.12: Aborted: Op aborted by new leader
I20260811 16:07:10.882272 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:10.883524 13743 raft_consensus.cc:2379] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:10.880573 13904 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
W20260811 16:07:10.885700 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78233.3us
I20260811 16:07:10.887629 14541 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:10.804524 22805 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:10.894683 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.895826 13900 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:07:10.897070 13818 raft_consensus.cc:2866] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:10.895815 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
W20260811 16:07:10.902679 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 239843us
I20260811 16:07:10.902712 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.914908 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.915989 13743 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:10.923889 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:10.927974 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:10.932343 13825 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:10.935133 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:10.937376 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:10.938364 13743 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:10.919008 22692 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:10.908506 22422 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.948499 22422 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:10.952031 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:10.952407 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:10.960759 13743 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:10.956164 13822 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:10.953445 13900 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:10.964773 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:10.972975 13743 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:10.965761 13817 raft_consensus.cc:2362] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26. Re-sending same reply.
I20260811 16:07:10.981598 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:10.968784 13909 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:10.984371 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:10.927070 22830 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:10.991788 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52448 (request call id 5) took 11373 ms. Trace:
I20260811 16:07:10.993408 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.000108 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:10.978796 22584 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:10.984239 22314 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.010571 14583 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:11.007543 13738 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:10.902778 22805 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:11.009472 13824 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.015172 13824 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:11.015753 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:11.017547 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 127545us
I20260811 16:07:11.016429 13900 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:07:11.001766 22621 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:11.026108 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:11.011957 13742 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:10.994594 13818 rpcz_store.cc:276] 0811 16:06:59.618011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:59.618261 (+   250us) service_pool.cc:227] Handling call
0811 16:07:00.016512 (+398251us) log.cc:842] Serialized 501 byte log entry
0811 16:07:01.362139 (+1345627us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b180019e4c0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:10.970770 (+9608631us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50929,"raft.queue_time_us":146982,"raft.run_cpu_time_us":2118,"raft.run_wall_time_us":173113,"spinlock_wait_cycles":28127488,"thread_start_us":300636,"threads_started":2,"wal-append.queue_time_us":281747,"wal-append.run_cpu_time_us":4164,"wal-append.run_wall_time_us":1583607}
I20260811 16:07:11.027201 13743 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:11.004141 22830 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:11.029462 13743 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:11.030508 14583 raft_consensus.cc:1226] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:11.031574 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:11.033793 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79811.5us
I20260811 16:07:11.012871 22314 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.036007 13817 raft_consensus.cc:2354] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22.
I20260811 16:07:11.016341 22805 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:11.036053 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.040164 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.046190 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.047345 13821 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:07:11.049579 22833 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260811 16:07:11.052742 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:11.055229 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.055972 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.055557 13742 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:11.011960 22584 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.036536 22621 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:11.064357 13824 raft_consensus.cc:2396] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260811 16:07:11.063712 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.054395 13743 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.072247 13822 raft_consensus.cc:2362] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21. Re-sending same reply.
I20260811 16:07:11.072525 14581 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:11.077167 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.052973 22692 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:11.052227 22422 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.097952 22830 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.18, Last appended by leader: 18, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.106784 13900 raft_consensus.cc:1261] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260811 16:07:11.110553 22314 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:11.104635 22528 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.007s
W20260811 16:07:11.113123 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260811 16:07:11.116145 22621 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.117265 22278 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.119365 13743 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:11.119542 13707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.461s (SENT) [suppressed 47 similar messages]
I20260811 16:07:11.061689 22244 consensus_queue.cc:1046] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260811 16:07:11.119979 22798 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.120886 14578 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:11.138283 13821 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260811 16:07:11.139278 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.139019 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:11.141538 13742 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:11.144790 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.149299 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:11.146240 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:11.154932 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.155676 13818 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:11.159354 13738 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:11.159826 13735 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:11.160302 13824 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:07:11.152673 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65608.9us
W20260811 16:07:11.162935 13871 connection.cc:232] RPC call timeout handler was delayed by -1.2416127419564873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260811 16:07:11.164279 13743 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:11.166118 13741 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: [18.17-20.18]
I20260811 16:07:11.124321 22314 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:11.171478 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.176875 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.178754 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.185089 13909 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:11.188159 13826 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:11.190289 13902 raft_consensus.cc:3032] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:11.190762 13902 raft_consensus.cc:729] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:11.189970 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.196043 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.202258 13738 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260811 16:07:11.203260 13737 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260811 16:07:11.192272 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.196226 13821 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 12 FOLLOWER]: Advancing to term 13
I20260811 16:07:11.209210 13923 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20ad41e4f434442792e36eb47449b101 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:07:11.209950 13923 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20ad41e4f434442792e36eb47449b101 on tablet 20ad41e4f434442792e36eb47449b101 with peer 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:11.210556 22836 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260811 16:07:11.215514 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.216779 13901 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:11.218781 13900 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:11.128234 22798 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.227260 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:11.196919 22838 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.141s	user 0.004s	sys 0.000s
I20260811 16:07:11.190989 22244 raft_consensus.cc:3032] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:11.237316 13909 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:11.189930 22560 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.247931 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.248414 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.200084 22812 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:11.228399 13906 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:11.220022 13902 consensus_queue.cc:260] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.236828 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.237625 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.256844 13902 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:11.185842 22278 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.259410 13903 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:11.249198 13826 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:11.270946 13742 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:11.272716 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.263888 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.280191 13904 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:11.195650 22314 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.275453 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.244794 22244 raft_consensus.cc:729] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:11.288192 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.248404 21878 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.285843 13907 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:11.290957 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.293931 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.287712 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.301838 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.302306 13906 raft_consensus.cc:2379] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:11.260084 22812 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:11.304735 13901 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:11.308303 13826 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:11.304145 13822 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:11.258991 22692 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:11.301038 22621 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.036s
W20260811 16:07:11.308069 22839 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260811 16:07:11.284838 22560 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.336019 21878 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.334968 22812 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:11.317108 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.270339 22278 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:11.356557 13909 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:11.336604 22833 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260811 16:07:11.307803 22840 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:11.336930 22244 consensus_queue.cc:260] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.365154 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.313534 13902 raft_consensus.cc:1261] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260811 16:07:11.344611 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.243811 22680 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260811 16:07:11.307984 22843 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.366299 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.364778 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.384449 14581 raft_consensus.cc:2354] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20.
I20260811 16:07:11.364399 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.358616 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.385262 13909 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:11.370007 13824 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:11.370200 13902 pending_rounds.cc:76] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 14
I20260811 16:07:11.370021 13908 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:11.386550 13902 pending_rounds.cc:97] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260811 16:07:11.386866 13902 raft_consensus.cc:2866] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:11.387759 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.388370 13826 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:11.373404 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.395893 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.346105 22584 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.394811 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.400115 14582 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:11.398918 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:11.406720 22842 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260811 16:07:11.415902 22844 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260811 16:07:11.416515 22528 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.417089 22528 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.397784 22843 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.422020 22843 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.425118 22314 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.427919 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.403693 13906 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:07:11.430002 22668 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:11.430269 22846 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:11.431286 22846 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:11.430500 22668 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:11.431910 22668 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:11.431583 22692 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.432422 22846 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.434971 22560 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.431468 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.435987 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.437114 13824 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 15: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:11.437995 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.438200 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.438896 14583 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:11.440366 13817 raft_consensus.cc:1261] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:11.440514 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.441473 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.442283 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.442584 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.443115 13825 raft_consensus.cc:2379] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:11.443369 13823 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:11.443961 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.444942 22244 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:11.362738 21878 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.389767 22840 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:11.446794 22668 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:11.448230 22833 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260811 16:07:11.435950 13822 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:11.447531 22840 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.442286 13817 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:11.449138 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.449805 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.452800 13821 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 13.
I20260811 16:07:11.455230 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.456064 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.456796 13820 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:11.458458 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.465015 13707 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:11.467628 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.468007 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.468698 13824 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
I20260811 16:07:11.468636 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.469756 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.470250 13821 raft_consensus.cc:2379] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:11.473727 22798 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:11.474462 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.475255 14582 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:07:11.478715 13824 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:11.476246 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.480916 13826 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:11.482745 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:11.483407 14583 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:11.483916 13901 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:11.487950 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:11.488884 13825 raft_consensus.cc:2362] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20. Re-sending same reply.
I20260811 16:07:11.492193 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.494628 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.496721 13821 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:11.498415 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.391090 22278 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.495496 13906 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:11.500033 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.515961 13826 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:11.521787 13742 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260811 16:07:11.503324 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.523716 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.435916 22805 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.526779 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.528595 13909 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:11.528721 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.501364 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.532541 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.485809 22798 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:11.496068 22560 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.538452 13824 raft_consensus.cc:2396] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260811 16:07:11.533453 13902 raft_consensus.cc:2362] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25. Re-sending same reply.
I20260811 16:07:11.528334 22584 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.553288 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:11.498389 22528 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:11.544031 13821 raft_consensus.cc:1226] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:11.500625 22668 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.566484 22668 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:11.567246 22668 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:11.567381 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.567696 22668 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:11.568269 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.532191 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:11.571504 13737 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:11.564836 13907 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:11.572352 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.572973 13902 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:11.565007 13821 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:11.565551 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.566414 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.567240 22560 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.574775 13906 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:11.574856 13909 raft_consensus.cc:2362] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20. Re-sending same reply.
I20260811 16:07:11.576706 22560 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.577948 22440 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:11.578347 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.470868 22847 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260811 16:07:11.580080 22847 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:11.580531 22847 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:11.580899 22847 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:11.540441 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 203362us
I20260811 16:07:11.582671 14583 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:07:11.578454 22440 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:11.590071 22422 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:11.591506 22668 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:11.592926 22278 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.604346 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.608628 13874 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:11.620869 14577 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:11.623056 13823 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:11.833376 13909 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:11.620101 13818 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:11.834035 13826 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:11.834466 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.835201 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:11.532888 22843 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:11.633282 13901 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15.
I20260811 16:07:11.638155 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.640066 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.650218 13902 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:11.664944 14579 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19. Ops: []
W20260811 16:07:11.667538 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 198971us
I20260811 16:07:11.639906 22851 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:11.677589 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.555217 22798 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.836793 13906 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:11.838030 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:11.688113 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.689203 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.693140 22560 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.629597 22849 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.132s
I20260811 16:07:11.621840 22584 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.715044 13827 raft_consensus.cc:2454] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:11.841665 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.735405 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:07:11.737972 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.842350 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:11.738965 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 153706us
I20260811 16:07:11.838973 13821 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:07:11.751579 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 271707us
I20260811 16:07:11.751634 13817 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260811 16:07:11.751608 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:11.753531 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.754655 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:11.770538 22314 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.776408 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.847851 13903 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:11.723757 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 268668us
I20260811 16:07:11.779599 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.780411 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.848781 13902 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:11.848915 13904 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:11.796727 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.790908 22805 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:11.808718 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.816766 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:11.837404 13709 connection.cc:232] RPC call timeout handler was delayed by -1.1361891250126064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260811 16:07:11.840780 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.742787 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.853392 13901 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:11.853508 13909 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:11.781234 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:11.854223 13709 connection.cc:232] RPC call timeout handler was delayed by -1.0328292059712112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260811 16:07:11.851693 13824 raft_consensus.cc:2396] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260811 16:07:11.851837 14581 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260811 16:07:11.855432 13709 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.868s (SENT)
I20260811 16:07:11.831073 22440 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:11.857198 14573 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:11.830870 22422 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:11.863111 13904 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:11.864156 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.864787 13906 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:11.864745 13904 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:07:11.855840 13709 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:11.865564 13908 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:11.838294 22851 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:11.871909 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.880760 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.882649 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:11.883635 22857 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260811 16:07:11.849781 21878 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260811 16:07:11.883706 22860 consensus_queue.cc:1046] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.005s
I20260811 16:07:11.889482 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.890295 14573 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:11.884136 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:11.892148 22680 raft_consensus.cc:3032] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:11.892570 22680 raft_consensus.cc:729] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:11.893517 22680 consensus_queue.cc:260] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.899080 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2483) took 1098 ms. Trace:
I20260811 16:07:11.899603 14577 rpcz_store.cc:276] 0811 16:07:10.801101 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:10.801279 (+   178us) service_pool.cc:227] Handling call
0811 16:07:10.818722 (+ 17443us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:11.833476 (+1014754us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:11.898861 (+ 65385us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540052b7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:11.899019 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1801029504}
I20260811 16:07:11.844741 22812 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.902061 22812 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:11.904695 22798 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.905427 22798 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:11.905839 22798 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:11.906230 22798 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:11.907028 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:11.907681 14582 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:11.887399 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49463.8us
I20260811 16:07:11.909061 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:11.909688 14580 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:11.910176 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:11.916114 14544 connection.cc:232] RPC call timeout handler was delayed by -1.3489914130186662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260811 16:07:11.917845 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:11.918242 14544 connection.cc:232] RPC call timeout handler was delayed by -1.3407198359491304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260811 16:07:11.918913 14544 connection.cc:232] RPC call timeout handler was delayed by -1.3336914130486548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260811 16:07:11.917135 13903 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:11.857769 22843 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:11.917371 13787 leader_election.cc:398] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20.
W20260811 16:07:11.922336 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 313795us
I20260811 16:07:11.841398 22560 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.926421 13904 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260811 16:07:11.919345 14544 connection.cc:232] RPC call timeout handler was delayed by -1.3147914130240679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260811 16:07:11.919013 13707 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:11.923039 13787 leader_election.cc:401] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:07:11.928761 14544 connection.cc:232] RPC call timeout handler was delayed by -1.300039766007103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260811 16:07:11.923833 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:11.925800 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:11.929448 14544 connection.cc:232] RPC call timeout handler was delayed by -1.2723198359599337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260811 16:07:11.920517 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:11.924201 13901 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
W20260811 16:07:11.917241 22867 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260811 16:07:11.918120 22812 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.857575 22314 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.919920 21878 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:11.878139 22851 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:11.876757 22829 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260811 16:07:11.918664 22846 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:11.936138 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59043.2us
I20260811 16:07:11.943500 22584 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:11.922132 22840 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:11.928567 22869 raft_consensus.cc:2741] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260811 16:07:11.928319 22858 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.948839 22680 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:11.935398 22422 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:11.954689 22668 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:11.962327 22560 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:11.963399 14580 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:11.941285 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:12.011642 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73542.1us
I20260811 16:07:11.947746 22843 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:11.949362 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.022467 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:12.042308 13817 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:12.010828 22278 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:11.940156 22868 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260811 16:07:12.039465 13707 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:11.950879 13909 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:11.950955 22686 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20.
I20260811 16:07:12.040381 13823 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260811 16:07:12.042943 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 187539us
I20260811 16:07:11.927845 22847 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.043576 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:12.054365 13709 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.901s (SENT)
I20260811 16:07:11.952924 22314 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:12.046675 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 230052us
I20260811 16:07:12.046020 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:11.939206 22860 consensus_queue.cc:1035] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260811 16:07:12.055004 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:12.056211 13825 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:12.057040 13824 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:12.058811 22422 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:12.038800 22840 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:11.935622 22854 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.108s
I20260811 16:07:12.037456 22584 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:12.054591 13817 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:12.035086 21878 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:12.063083 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.080013 13707 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:11.950443 22812 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.013543 22244 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260811 16:07:12.078182 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:12.077518 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141944us
I20260811 16:07:12.093046 13817 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:12.094072 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:12.042768 22878 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:12.094285 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:12.062150 22583 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:11.963894 22861 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
W20260811 16:07:12.106480 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60572.9us
I20260811 16:07:12.106609 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:12.107211 13825 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 25.
I20260811 16:07:12.077270 22843 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:12.086565 22830 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:12.108651 13900 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:12.038403 22856 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260811 16:07:12.077600 22584 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.032451 22846 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.115340 22843 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:12.118636 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.061353 22278 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:12.106238 22886 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:12.127110 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.119521 22583 consensus_queue.cc:1035] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260811 16:07:12.119771 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 170479us
I20260811 16:07:12.114668 22830 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.099767 22868 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:12.126557 14582 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:12.138747 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.140797 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:12.167546 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:12.169543 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 84357.9us
I20260811 16:07:12.170739 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:07:12.179529 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 125202us
I20260811 16:07:12.179678 13822 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260811 16:07:12.180208 13822 pending_rounds.cc:76] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 12
I20260811 16:07:12.180455 13822 pending_rounds.cc:97] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260811 16:07:12.180716 13822 raft_consensus.cc:2866] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:12.122154 22869 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:12.038005 22858 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.133683 22546 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260811 16:07:12.186810 13709 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.903s (SENT)
I20260811 16:07:12.189015 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:12.184540 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44711.8us
I20260811 16:07:12.125684 22584 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:12.134493 22830 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:12.133873 22868 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.115060 21878 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260811 16:07:12.185321 22244 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:12.185011 22621 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:12.207873 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 117161us
I20260811 16:07:12.195498 22832 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:12.195550 22546 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:12.220866 22890 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:12.198215 22868 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:12.197608 22829 raft_consensus.cc:2741] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260811 16:07:12.229138 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 88465.8us
I20260811 16:07:12.231567 13707 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:12.199162 22881 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:12.223783 22843 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.240831 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:12.196552 22855 consensus_queue.cc:1035] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260811 16:07:12.243397 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:12.230786 22546 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:12.247287 22880 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260811 16:07:12.228204 22840 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:12.235801 22881 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.237875 22278 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:12.263442 22888 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260811 16:07:12.287058 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:12.266741 22812 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:12.267565 22881 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:12.217795 22440 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:12.288205 14582 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:12.317193 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 376015us
I20260811 16:07:12.318225 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:12.319247 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 128442us
W20260811 16:07:12.311319 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 81033.1us
I20260811 16:07:12.252174 22855 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:12.321265 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.324707 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.252107 22847 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:12.333886 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:12.334316 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:12.334817 13817 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:12.337045 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.237708 22894 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260811 16:07:12.338354 13741 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:12.338640 13825 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 27: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:12.344218 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:12.344916 13739 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:12.355347 14582 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:12.357918 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:12.356236 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 116141us
I20260811 16:07:12.325930 22244 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:12.366560 22244 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.368600 13743 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260811 16:07:12.369266 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:12.369510 22904 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:12.369813 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:12.370064 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:12.338060 22896 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:12.370488 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:12.370633 13742 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:12.371031 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:12.371124 13736 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:12.371874 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:12.372555 22902 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:12.373143 22902 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:12.383565 13744 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
I20260811 16:07:12.369947 13735 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:12.341029 22847 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:12.374140 22902 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:12.389617 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 209273us
W20260811 16:07:12.394102 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72900.7us
I20260811 16:07:12.390041 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.395172 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.370640 13743 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:12.357800 22855 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:12.350447 22840 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:12.338196 22812 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:12.397645 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.398977 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.349676 21878 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:12.413021 22583 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:12.413803 22880 consensus_queue.cc:1225] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:07:12.416482 13709 leader_election.cc:398] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22.
W20260811 16:07:12.423105 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 191646us
I20260811 16:07:12.425706 13709 leader_election.cc:401] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260811 16:07:12.424121 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.428556 22812 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:12.429162 22812 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.429574 22812 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:12.433200 22908 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260811 16:07:12.440409 13739 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 27.
I20260811 16:07:12.393671 22846 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:12.443446 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48399.1us
I20260811 16:07:12.447247 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.403591 22886 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:12.441157 22583 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:12.449674 13787 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:12.451885 13744 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:12.436305 22840 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:12.442415 22829 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:12.444504 22858 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:12.498013 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45439.4us
I20260811 16:07:12.393769 22896 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260811 16:07:12.504139 13707 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:12.462817 22583 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:12.522135 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 74994us
I20260811 16:07:12.455662 22886 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.491474 22840 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.439234 21878 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.488651 22846 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader election won for term 27
W20260811 16:07:12.528069 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 111734us
I20260811 16:07:12.529084 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:12.507699 22314 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260811 16:07:12.530509 22440 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:12.532470 22895 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260811 16:07:12.535787 22798 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.008s
I20260811 16:07:12.537393 22901 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22.
W20260811 16:07:12.612865 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 108831us
I20260811 16:07:12.493685 22829 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:12.497593 22860 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:12.609475 14582 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:12.601909 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:12.451934 22900 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.161s
I20260811 16:07:12.528898 22840 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:12.505167 22847 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:12.615096 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 104525us
I20260811 16:07:12.525573 22886 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:12.693102 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:12.693581 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:12.703511 13900 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:12.694396 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:12.529731 22546 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.704726 13909 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:12.703325 13906 raft_consensus.cc:2362] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21. Re-sending same reply.
I20260811 16:07:12.673000 22829 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:12.668165 22846 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:12.724844 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.731925 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.694433 22440 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:12.734145 13905 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:12.730120 13900 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:12.738018 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.706457 22857 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:12.694666 22860 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:12.741434 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:12.750792 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58374.2us
I20260811 16:07:12.742645 13904 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:12.671550 22878 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260811 16:07:12.752189 13904 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:12.756201 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 233186us
I20260811 16:07:12.761220 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:12.757266 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:12.762550 13905 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:12.750103 13908 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:12.755134 13904 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.727576 22914 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:12.777280 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:12.784550 13900 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:12.672552 22798 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:12.737470 22440 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:12.778802 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:12.768839 22680 raft_consensus.cc:2741] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260811 16:07:12.751545 22244 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:12.804430 13903 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:12.764245 22860 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:12.790618 13904 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:12.775691 22805 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:12.777113 22857 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:12.791188 22621 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:12.795295 22440 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:12.767069 22853 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260811 16:07:12.861948 13900 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:12.863099 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:12.868615 13744 raft_consensus.cc:595] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
W20260811 16:07:12.892679 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 290858us
I20260811 16:07:12.897418 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:12.898303 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:12.899233 13900 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:07:12.903645 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 162109us
I20260811 16:07:12.933357 13821 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260811 16:07:12.968883 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190187us
I20260811 16:07:12.970136 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:12.981971 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:12.854104 22920 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:12.994354 13904 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
W20260811 16:07:12.996706 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 69385.8us
I20260811 16:07:12.903358 22560 raft_consensus.cc:2741] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260811 16:07:12.875875 21878 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.012022 13900 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:13.020051 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:12.925945 22902 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:13.010782 22584 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.008s
W20260811 16:07:13.029366 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 55889.7us
W20260811 16:07:13.031165 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61134us
W20260811 16:07:13.031729 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134394us
I20260811 16:07:13.032210 14544 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:12.791613 22914 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:12.848174 22846 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:12.997236 22680 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:13.043393 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:13.051716 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:12.851297 22847 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:13.090234 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46924us
I20260811 16:07:13.096855 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:13.101442 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:13.102607 13744 raft_consensus.cc:595] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:07:13.102974 13744 raft_consensus.cc:603] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:07:13.104856 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:12.981717 22621 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260811 16:07:13.042253 22546 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.124064 22882 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:13.109910 22899 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.485s	user 0.000s	sys 0.002s
W20260811 16:07:13.124184 13708 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.010s	sys 0.012s
W20260811 16:07:13.141685 13708 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.010s	sys 0.012s
W20260811 16:07:13.113914 22868 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.878s	user 0.013s	sys 0.000s
I20260811 16:07:13.124503 22916 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:13.104316 21878 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:13.108136 22854 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:13.113597 22900 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
W20260811 16:07:13.148535 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 116458us
I20260811 16:07:13.045477 22853 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260811 16:07:13.115851 22912 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.039520 22902 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.124883 22882 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:13.124182 22936 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260811 16:07:13.171550 22798 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.164806 22900 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:13.165444 22868 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:13.166990 22927 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:07:13.119923 22926 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260811 16:07:13.170768 14579 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:13.171128 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:13.029456 22584 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:13.153414 22922 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260811 16:07:13.163797 22915 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
W20260811 16:07:13.193066 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 141456us
I20260811 16:07:13.150687 21878 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:13.033214 22857 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.171914 22901 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:13.202967 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 107311us
W20260811 16:07:13.207022 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 498385us
I20260811 16:07:13.184509 22916 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:13.111450 22920 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.080s
I20260811 16:07:13.209702 13744 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:13.222570 13744 raft_consensus.cc:595] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Received request to transfer leadership to TS 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:13.209880 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:13.213073 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:13.223528 13871 leader_election.cc:398] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:13.195433 22936 consensus_queue.cc:1225] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:07:13.215457 14577 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:13.224601 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:13.225077 13907 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260811 16:07:13.219830 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:13.215745 22680 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:13.219939 22900 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.210638 21878 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:13.221298 22546 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260811 16:07:13.220590 22584 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.186995 22912 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:13.221211 22891 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.019s	sys 0.060s
I20260811 16:07:13.223891 13871 leader_election.cc:401] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260811 16:07:13.229496 13740 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:13.238348 22880 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:13.244130 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:13.240612 13744 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:13.220947 22918 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:13.239003 22928 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260811 16:07:13.240432 22830 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.030s	user 0.013s	sys 0.000s
W20260811 16:07:13.255324 22855 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.007s
W20260811 16:07:13.264719 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50267.8us
W20260811 16:07:13.267019 13789 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 3.158s (SENT)
I20260811 16:07:13.277048 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:13.249917 22891 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.020s	sys 0.061s
W20260811 16:07:13.273629 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46927.8us
I20260811 16:07:13.239068 22914 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.252364 22880 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:13.277779 13902 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
W20260811 16:07:13.242250 22583 consensus_meta.cc:287] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
I20260811 16:07:13.270313 22584 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22.
I20260811 16:07:13.283352 22244 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:13.276355 22861 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260811 16:07:13.285171 22882 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.285959 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:13.301319 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.245142 22902 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.277155 22830 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.243423 22946 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election won for term 25
W20260811 16:07:13.293452 13905 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.003s
I20260811 16:07:13.217509 22925 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
W20260811 16:07:13.277631 22851 consensus_meta.cc:287] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.264s	user 0.013s	sys 0.003s
W20260811 16:07:13.299086 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 90930.6us
I20260811 16:07:13.271567 22901 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:13.302743 13905 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
W20260811 16:07:13.303180 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 76807.4us
I20260811 16:07:13.294464 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:13.293852 22855 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:13.310952 13736 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e"
dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
mode: GRACEFUL
new_leader_uuid: "8d98491a0db549d0b671b60b90c9cdea"
 from {username='slave'} at 127.0.0.1:48244
I20260811 16:07:13.311374 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:13.311743 13736 raft_consensus.cc:595] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Received request to transfer leadership to TS 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:13.312117 13736 raft_consensus.cc:603] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:07:13.316732 13707 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:13.240888 22934 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.076s
I20260811 16:07:13.318027 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:13.274458 22937 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260811 16:07:13.268157 22918 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:13.326378 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47769.1us
I20260811 16:07:13.302495 22583 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.239622 22916 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.311019 22946 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:13.322477 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:13.318482 22805 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:13.344218 13902 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260811 16:07:13.370699 22945 log.cc:924] Time spent T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:07:13.393667 22583 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:13.394366 22939 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:13.360822 14582 raft_consensus.cc:1226] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:13.395339 22904 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:13.397789 22946 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.472064 22849 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:13.460564 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 119788us
I20260811 16:07:13.399430 22868 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:13.486018 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87570.7us
I20260811 16:07:13.312788 22851 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.321485 22440 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:13.401691 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 143373us
I20260811 16:07:13.368621 22941 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.408586 13900 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:13.325515 22902 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:13.323169 22584 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:13.323062 22244 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
W20260811 16:07:13.429060 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 117009us
I20260811 16:07:13.561590 13709 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:13.418375 22840 consensus_meta.cc:287] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.001s
W20260811 16:07:13.561257 13787 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.686s (SENT)
I20260811 16:07:13.466190 22830 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.467187 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.467365 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:13.468012 22953 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260811 16:07:13.469408 22918 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:13.469518 22929 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.359s	user 0.003s	sys 0.000s
W20260811 16:07:13.428032 22860 consensus_meta.cc:287] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.008s
I20260811 16:07:13.343581 22925 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.332795 22856 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:13.564749 22849 consensus_queue.cc:1225] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260811 16:07:13.481197 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:13.522403 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 209783us
I20260811 16:07:13.531158 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 3017) took 1731 ms. Trace:
I20260811 16:07:13.644559 13741 rpcz_store.cc:276] 0811 16:07:11.791213 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:11.791356 (+   143us) service_pool.cc:227] Handling call
0811 16:07:11.792324 (+   968us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:12.341428 (+549104us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:13.522193 (+1180765us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400311354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:13.522454 (+   261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1255311104}
I20260811 16:07:13.483924 14541 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:13.563369 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:13.567618 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:13.646224 13900 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:13.568799 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:13.484956 22812 consensus_meta.cc:287] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.045s	user 0.015s	sys 0.000s
I20260811 16:07:13.460743 22904 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:13.461504 22939 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:13.620258 13736 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:13.437882 22937 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.137s
I20260811 16:07:13.523947 22668 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:13.460345 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:13.685869 14579 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:13.637207 22440 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.640341 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.640169 13901 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b"
dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
mode: GRACEFUL
new_leader_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:36246
I20260811 16:07:13.692112 13740 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:13.560830 22854 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:13.649529 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:13.569568 22868 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:13.644223 13821 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:07:13.656304 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 172671us
I20260811 16:07:13.704334 22948 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Leader election won for term 13
I20260811 16:07:13.656574 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:13.706184 13823 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:07:13.656792 22936 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.624872 22244 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:13.661597 13871 connection.cc:232] RPC call timeout handler was delayed by -1.5160290370695293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260811 16:07:13.712476 13871 connection.cc:232] RPC call timeout handler was delayed by -1.4440290371421725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260811 16:07:13.655557 22881 consensus_meta.cc:287] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.327s	user 0.011s	sys 0.004s
I20260811 16:07:13.532598 22857 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.113s
I20260811 16:07:13.689189 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.723649 13736 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:13.686335 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.725075 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.725263 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.649731 22912 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:13.692005 13901 raft_consensus.cc:595] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Received request to transfer leadership to TS 5f46150fac70458986206ec7af67a403
I20260811 16:07:13.728287 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:13.728780 13901 raft_consensus.cc:603] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260811 16:07:13.531057 22902 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:13.621081 22840 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.695148 13706 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:13.702276 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.707692 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:13.742486 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.709363 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:13.710426 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 147264us
I20260811 16:07:13.659875 22849 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:13.712459 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:13.713013 13871 connection.cc:232] RPC call timeout handler was delayed by -1.3270290370564908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260811 16:07:13.683902 13900 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
W20260811 16:07:13.752884 13871 connection.cc:232] RPC call timeout handler was delayed by -1.2955290371319279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260811 16:07:13.681051 22853 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:13.753233 13871 connection.cc:232] RPC call timeout handler was delayed by -1.2397290370427072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260811 16:07:13.753532 13871 connection.cc:232] RPC call timeout handler was delayed by -1.1101290370570496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260811 16:07:13.753619 22853 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.754530 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:13.755033 22829 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 1.012s	user 0.010s	sys 0.003s
I20260811 16:07:13.755400 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.755859 22853 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.755498 22829 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.758036 22829 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.640841 22926 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260811 16:07:13.765373 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:13.755447 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:13.736825 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.728952 14574 raft_consensus.cc:2362] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 15. Re-sending same reply.
I20260811 16:07:13.675335 22951 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:13.569747 22941 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.640313 22925 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.742067 13740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:13.658041 22812 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.750346 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.781700 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260811 16:07:13.751307 13739 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 27: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:13.752133 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1614) took 1031 ms. Trace:
I20260811 16:07:13.685197 22546 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.726548 22948 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:13.758040 13743 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260811 16:07:13.759627 14579 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:13.675426 22918 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.632889 22860 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:13.762604 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 67652us
I20260811 16:07:13.763640 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:13.784461 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:07:13.837739 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.839027 14579 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:13.685325 22668 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:13.759367 22962 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260811 16:07:13.775619 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:13.728168 22881 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.743853 22902 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:13.781940 14575 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:13.836598 22918 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.832998 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:13.768546 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:13.840816 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.781515 22921 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:13.778012 13740 raft_consensus.cc:2396] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260811 16:07:13.974067 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:13.720546 22936 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:13.842650 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 216134us
I20260811 16:07:13.841878 22244 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.866600 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:13.772294 22894 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:13.832356 22886 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.113s	user 0.011s	sys 0.003s
W20260811 16:07:13.786224 21878 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.002s
I20260811 16:07:13.823859 22912 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:13.876215 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:13.987171 13902 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:13.887171 14580 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:13.842753 22546 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.889358 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.823967 22939 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:13.892529 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 48470.2us
W20260811 16:07:13.892432 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 116908us
W20260811 16:07:13.902846 22961 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260811 16:07:13.903569 22931 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:13.904820 22956 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260811 16:07:13.906309 22969 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260811 16:07:13.889288 22440 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:14.014997 22440 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:14.016045 22440 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.742460 22904 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:13.934145 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:14.028103 13743 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:13.934652 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 185322us
I20260811 16:07:13.776125 22849 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.029469 13902 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:13.898386 22668 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.939941 22840 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.894259 22798 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:13.940534 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:13.941264 22959 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260811 16:07:13.941639 22812 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.943187 22941 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.043305 22976 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:14.043946 22976 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.780084 22853 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:13.967384 13822 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:14.046195 22976 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.046728 22976 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:13.825065 13906 rpcz_store.cc:276] 0811 16:07:12.720405 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.720677 (+   272us) service_pool.cc:227] Handling call
0811 16:07:12.721199 (+   522us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:13.025157 (+303958us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:13.025190 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:13.038854 (+ 13664us) log.cc:842] Serialized 26 byte log entry
0811 16:07:13.181013 (+142159us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:13.195943 (+ 14930us) log.cc:842] Serialized 14 byte log entry
0811 16:07:13.200431 (+  4488us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:13.200502 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:13.751903 (+551401us) raft_consensus.cc:1671] finished
0811 16:07:13.751934 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:13.752073 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43422,"prepare.queue_time_us":19283,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":262527,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":18331,"thread_start_us":297739,"threads_started":2,"wal-append.queue_time_us":172139}
I20260811 16:07:14.047508 13741 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 23: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:14.048499 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.049182 13818 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:13.973994 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:14.050022 14575 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:14.050640 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1538) took 2016 ms. Trace:
I20260811 16:07:14.051106 22849 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.857455 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:07:14.068161 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2500) took 1289 ms. Trace:
I20260811 16:07:14.068753 14582 rpcz_store.cc:276] 0811 16:07:12.778665 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.778813 (+   148us) service_pool.cc:227] Handling call
0811 16:07:12.779162 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:13.432748 (+653586us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:14.055454 (+622706us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54006d38d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:14.068073 (+ 12619us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1336864640}
I20260811 16:07:14.070291 13743 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:13.978142 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:13.980084 13904 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260811 16:07:13.979812 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:13.966466 22860 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:13.984021 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 119969us
W20260811 16:07:13.976451 22869 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.760s	user 0.011s	sys 0.015s
I20260811 16:07:13.884763 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:14.050892 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:13.989358 14573 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:13.893483 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:13.982138 22916 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.010s
W20260811 16:07:13.989951 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 276098us
I20260811 16:07:13.991439 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:13.993116 13900 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:13.993055 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:13.886034 22854 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:07:14.084412 22869 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.868s	user 0.011s	sys 0.015s
I20260811 16:07:13.908746 22948 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.986109 22894 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.003504 22546 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.005527 22936 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.005864 22925 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.111702 22925 consensus_queue.cc:1046] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:14.112910 22925 raft_consensus.cc:3032] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:14.113276 22925 raft_consensus.cc:729] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:14.114089 22925 consensus_queue.cc:260] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:13.985961 22886 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.115834 22686 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:14.116446 22686 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.116906 22886 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.986795 22912 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:14.117815 22912 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:14.118582 22686 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.120178 13825 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:14.009033 22584 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:14.010589 22881 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.013422 22958 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:13.877058 22851 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:13.986503 22926 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:14.153429 22940 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:14.149792 22857 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:14.154517 22857 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.156770 22857 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.018460 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.164641 13740 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:14.024821 22971 consensus_queue.cc:1046] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:14.152082 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:13.996377 22931 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:14.027032 22918 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:13.986631 21878 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.031193 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:13.936005 22947 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:14.036144 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:14.036721 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.176244 13826 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:14.176290 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 140257us
W20260811 16:07:14.032665 22901 consensus_meta.cc:287] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
I20260811 16:07:14.042243 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:14.047474 22965 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:14.051067 13827 rpcz_store.cc:276] 0811 16:07:12.034231 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.034358 (+   127us) service_pool.cc:227] Handling call
0811 16:07:12.034760 (+   402us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:12.060395 (+ 25635us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:12.060433 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:12.077201 (+ 16768us) log.cc:842] Serialized 26 byte log entry
0811 16:07:12.198416 (+121215us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:12.218708 (+ 20292us) log.cc:842] Serialized 14 byte log entry
0811 16:07:12.219328 (+   620us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:12.539463 (+320135us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800264580. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:12.945211 (+405748us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b1800264580. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9b1f96 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9
0811 16:07:13.252263 (+307052us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800264580. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:14.050284 (+798021us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400355554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:14.050341 (+    57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:14.050395 (+    54us) raft_consensus.cc:1671] finished
0811 16:07:14.050409 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:14.050557 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":10921,"prepare.run_wall_time_us":2668,"raft.queue_time_us":140,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":138,"spinlock_wait_cycles":105770112,"thread_start_us":99198,"threads_started":1,"wal-append.queue_time_us":125108,"wal-append.run_cpu_time_us":2269,"wal-append.run_wall_time_us":1020271}
I20260811 16:07:13.977095 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:14.053200 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:14.183027 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 152276us
I20260811 16:07:14.054363 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:14.055794 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3462) took 1317 ms. Trace:
I20260811 16:07:14.184846 13826 raft_consensus.cc:2454] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:14.090044 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:14.084331 14579 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:14.185487 14575 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:14.186180 14579 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:14.091426 13743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:14.098325 13823 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:07:13.999739 14581 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 13.
I20260811 16:07:14.104270 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
W20260811 16:07:14.105492 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 114165us
I20260811 16:07:14.106024 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:14.108635 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:14.188431 13739 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:14.097102 22916 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.001s	sys 0.010s
I20260811 16:07:14.120501 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:14.188457 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 134182us
I20260811 16:07:14.122653 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:14.065599 22976 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.108114 22812 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:14.106243 22869 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:14.170784 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 138231us
I20260811 16:07:14.174990 22931 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:14.053663 22840 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:14.183890 13905 rpcz_store.cc:276] 0811 16:07:12.738430 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.315723 (+577293us) service_pool.cc:227] Handling call
0811 16:07:13.316105 (+   382us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:13.320319 (+  4214us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:13.320356 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:13.320814 (+   458us) log.cc:842] Serialized 26 byte log entry
0811 16:07:13.524006 (+203192us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:13.524045 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:13.524229 (+   184us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:14.055574 (+531345us) raft_consensus.cc:1671] finished
0811 16:07:14.055596 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:14.055732 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3807,"raft.queue_time_us":10662,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":45988,"thread_start_us":189952,"threads_started":1,"wal-append.queue_time_us":336876}
I20260811 16:07:14.072781 14582 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260811 16:07:14.188009 13736 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:14.190661 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:14.259460 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 70716.7us
I20260811 16:07:14.167652 22912 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.196976 13874 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:14.193874 14574 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:14.165045 22958 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.182360 22546 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
W20260811 16:07:14.214166 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63031.9us
I20260811 16:07:14.243064 13742 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
W20260811 16:07:14.265799 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 79418.4us
I20260811 16:07:14.280438 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.262580 22840 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.281810 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.189536 22901 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:14.301201 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 195260us
I20260811 16:07:14.302594 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:14.302932 13739 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
W20260811 16:07:14.283751 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 86859.9us
I20260811 16:07:14.305949 13874 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:14.212468 22886 raft_consensus.cc:3032] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:14.214782 22918 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:14.150523 22902 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:14.309626 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49000.3us
W20260811 16:07:14.281515 22953 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260811 16:07:14.267083 22849 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260811 16:07:14.326577 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:14.320799 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78192.1us
W20260811 16:07:14.316092 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 338792us
I20260811 16:07:14.310509 22584 raft_consensus.cc:2781] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:14.316167 22918 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:14.361042 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 80097.4us
I20260811 16:07:14.359965 13871 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:14.363767 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61278.4us
I20260811 16:07:14.311308 22886 raft_consensus.cc:729] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:14.189888 22947 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.317163 22278 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:14.315287 22546 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:14.367895 21878 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.320314 22896 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:14.321933 22936 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:14.366815 22926 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:14.281306 22812 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.344251 22916 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:07:14.408411 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48593.3us
W20260811 16:07:14.363631 22978 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260811 16:07:14.413614 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57809.6us
I20260811 16:07:14.413936 13901 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:14.414503 22903 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:14.193295 22965 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.414851 22936 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:14.418169 22992 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:14.418411 22902 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:14.403545 22901 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:14.390578 22918 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:14.419808 22840 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.422361 13871 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.389972 22584 raft_consensus.cc:686] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:14.442656 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76816.9us
I20260811 16:07:14.447619 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:14.463923 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:14.419837 22989 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:07:14.464591 13823 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:14.457690 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:07:14.469841 13789 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.587s (SENT)
I20260811 16:07:14.471469 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:14.472427 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.473057 13826 raft_consensus.cc:2362] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20. Re-sending same reply.
I20260811 16:07:14.473914 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.475071 13818 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:14.475453 13818 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:14.479511 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.449762 22936 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:14.478315 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.481534 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:14.458277 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 176559us
I20260811 16:07:14.482757 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.459020 22966 consensus_queue.cc:1046] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260811 16:07:14.428773 22916 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:14.458986 22440 consensus_queue.cc:1046] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:14.483646 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:14.483693 13823 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:14.485033 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.486462 13826 raft_consensus.cc:1226] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260811 16:07:14.451579 22901 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:14.476208 13818 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.462622 22903 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:14.491041 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2506) took 1086 ms. Trace:
I20260811 16:07:14.494771 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.506069 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.506992 13821 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:14.497859 13818 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:14.501160 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 98327.2us
I20260811 16:07:14.503758 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.508359 13824 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:14.503758 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.512128 13826 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:14.514328 22970 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
W20260811 16:07:14.515086 22994 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260811 16:07:14.515017 22584 consensus_queue.cc:237] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.515908 22905 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
W20260811 16:07:14.516937 22993 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260811 16:07:14.391014 22869 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.466231 22894 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.505177 14577 rpcz_store.cc:276] 0811 16:07:13.405092 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.405389 (+   297us) service_pool.cc:227] Handling call
0811 16:07:13.414031 (+  8642us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:13.530895 (+116864us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:13.530928 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:13.568768 (+ 37840us) log.cc:842] Serialized 26 byte log entry
0811 16:07:13.978952 (+410184us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:13.979008 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:13.979104 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:14.490800 (+511696us) raft_consensus.cc:1671] finished
0811 16:07:14.490825 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:14.490972 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71651,"raft.queue_time_us":109864,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":35489,"thread_start_us":339180,"threads_started":1,"wal-append.queue_time_us":437936}
W20260811 16:07:14.536164 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43948.8us
I20260811 16:07:14.537384 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.544346 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.522083 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.555759 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1612) took 1862 ms. Trace:
I20260811 16:07:14.556218 13907 rpcz_store.cc:276] 0811 16:07:12.693011 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.693175 (+   164us) service_pool.cc:227] Handling call
0811 16:07:12.715836 (+ 22661us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:13.227061 (+511225us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:14.555474 (+1328413us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54000c6f54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:14.555690 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1163609984}
I20260811 16:07:14.492033 22916 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:14.485854 22912 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.474856 22971 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260811 16:07:14.504863 22901 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:14.531499 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:14.495105 22798 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260811 16:07:14.563757 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 80189.7us
I20260811 16:07:14.521250 22940 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:14.577593 13823 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:14.587371 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.559255 22941 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:14.589686 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.588096 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.462239 22886 consensus_queue.cc:260] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:14.565014 22903 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:14.633428 13824 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:14.496225 22546 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.566313 22958 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:14.606881 13820 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 13.
I20260811 16:07:14.569453 22846 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:07:14.558979 22946 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:14.643090 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.598547 13823 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:14.558360 13821 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:14.607750 22992 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:14.596386 22976 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:14.644671 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.645285 13821 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:14.647080 13824 raft_consensus.cc:2379] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:14.577786 22798 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:14.586875 22940 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:14.635807 13826 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:14.634598 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:14.641139 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 109758us
I20260811 16:07:14.642973 13818 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260811 16:07:14.597682 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.714650 13736 raft_consensus.cc:2454] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
W20260811 16:07:14.781026 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 183443us
I20260811 16:07:14.781792 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:14.697916 23002 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:07:14.692811 23005 raft_consensus.cc:2741] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260811 16:07:14.713912 13821 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:14.686321 22933 raft_consensus.cc:2741] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260811 16:07:14.681231 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:14.872023 23006 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260811 16:07:14.872509 13824 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:14.873805 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:14.874408 22925 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:14.874809 13824 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 23: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
W20260811 16:07:14.777602 13789 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.635s (SENT)
I20260811 16:07:14.714540 13903 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:07:14.651831 22946 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:14.643473 22886 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:14.938702 13824 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
W20260811 16:07:14.685590 22986 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260811 16:07:14.568667 22860 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
I20260811 16:07:14.683449 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.715910 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:14.766970 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:14.945137 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 178288us
I20260811 16:07:14.760605 13823 raft_consensus.cc:2454] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:07:14.947602 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:14.948462 14582 raft_consensus.cc:2379] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:14.843348 13737 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 24. Current term is 25. Ops: []
W20260811 16:07:14.948876 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 171342us
I20260811 16:07:14.949368 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:14.950899 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:14.984792 14544 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:14.990885 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 275074us
I20260811 16:07:14.762020 22947 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:14.983662 22860 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:14.998628 22980 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:14.999013 13820 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:14.999254 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:15.001410 13741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37376 (request call id 1883) took 1291 ms. Trace:
W20260811 16:07:14.951478 22959 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260811 16:07:14.792402 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:14.786319 22798 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:14.681006 22846 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:14.786383 22940 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:14.851593 13787 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:14.795222 22948 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:14.860797 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:14.990605 22855 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:14.999265 22980 raft_consensus.cc:686] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:14.871547 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:14.757854 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 199844us
W20260811 16:07:15.089951 13817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.062s	sys 0.101s
W20260811 16:07:15.090740 13817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.062s	sys 0.102s
I20260811 16:07:14.818178 22902 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:14.893559 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3095) took 1959 ms. Trace:
I20260811 16:07:14.894945 22858 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:15.101984 13822 rpcz_store.cc:276] 0811 16:07:12.934017 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.934649 (+   632us) service_pool.cc:227] Handling call
0811 16:07:12.996151 (+ 61502us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:14.046605 (+1050454us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:14.893276 (+846671us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54000d5054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:14.893475 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1946022656}
W20260811 16:07:14.901829 13744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 3032) took 1611 ms (client timeout 1979 ms). Trace:
W20260811 16:07:15.111172 13744 rpcz_store.cc:269] 0811 16:07:13.290294 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.290478 (+   184us) service_pool.cc:227] Handling call
0811 16:07:14.901519 (+1611041us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400209ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:14.901739 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2191018240}
I20260811 16:07:14.909713 22904 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:14.932947 14578 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:14.934844 22829 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:15.118171 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:14.935014 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1880) took 1736 ms. Trace:
I20260811 16:07:15.119280 13742 rpcz_store.cc:276] 0811 16:07:13.198410 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.198593 (+   183us) service_pool.cc:227] Handling call
0811 16:07:13.211529 (+ 12936us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:14.280233 (+1068704us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:14.892675 (+612442us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540020a3d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:14.934926 (+ 42251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2304085376}
I20260811 16:07:14.936738 22987 raft_consensus.cc:3032] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:14.880859 22869 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:14.938730 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2501) took 2087 ms. Trace:
I20260811 16:07:14.780272 13818 pending_rounds.cc:76] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 13
I20260811 16:07:15.001930 13741 rpcz_store.cc:276] 0811 16:07:13.709946 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.743557 (+ 33611us) service_pool.cc:227] Handling call
0811 16:07:15.001164 (+1257607us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400281ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:15.001335 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":174071040}
I20260811 16:07:14.795967 22992 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:14.940574 22965 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:15.043131 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 191678us
W20260811 16:07:15.145812 13787 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Timed out: RequestConsensusVote RPC to 127.12.23.196:37251 timed out after 1.981s (SENT)
I20260811 16:07:15.146440 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:15.003612 23005 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:15.005923 22958 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260811 16:07:15.091635 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.109812 22858 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.092211 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:14.876231 13735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37376 (request call id 1878) took 1678 ms. Trace:
I20260811 16:07:15.095655 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:14.788407 22812 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.035285 22976 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:15.115919 13821 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:15.079581 22314 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:15.140179 13818 pending_rounds.cc:97] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260811 16:07:15.140002 14580 rpcz_store.cc:276] 0811 16:07:12.851572 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.851754 (+   182us) service_pool.cc:227] Handling call
0811 16:07:12.852140 (+   386us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:13.989401 (+1137261us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:14.938401 (+949000us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540052c954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:14.938639 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2355182464}
I20260811 16:07:15.168087 13818 raft_consensus.cc:2866] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:15.154408 13735 rpcz_store.cc:276] 0811 16:07:13.197410 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.197527 (+   117us) service_pool.cc:227] Handling call
0811 16:07:13.212700 (+ 15173us) raft_consensus.cc:1457] Updating replica for 3 ops
0811 16:07:13.224521 (+ 11821us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:13.224560 (+    39us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0811 16:07:13.232773 (+  8213us) log.cc:842] Serialized 78 byte log entry
0811 16:07:14.299922 (+1067149us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b180017a040. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:07:14.457376 (+157454us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:14.457799 (+   423us) log.cc:842] Serialized 14 byte log entry
0811 16:07:14.458009 (+   210us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:14.458103 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:14.875770 (+417667us) raft_consensus.cc:1671] finished
0811 16:07:14.875944 (+   174us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:14.876156 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":818,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":90725,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":8612,"spinlock_wait_cycles":23517824,"thread_start_us":157213,"threads_started":1,"wal-append.queue_time_us":1360288}
I20260811 16:07:15.168854 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:14.809386 22908 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.375s	user 0.003s	sys 0.033s
I20260811 16:07:15.149128 14578 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260811 16:07:15.181080 13900 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.068s	sys 0.097s
I20260811 16:07:15.151578 13826 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:15.164220 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.117772 22829 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.169992 13821 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260811 16:07:15.158562 22958 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:15.108037 22966 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260811 16:07:15.114933 22902 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.157130 13787 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:15.205713 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.149349 22987 raft_consensus.cc:729] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:15.181385 13900 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.068s	sys 0.097s
I20260811 16:07:15.185551 13906 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:15.169482 13908 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22. Re-sending same reply.
W20260811 16:07:15.180894 22968 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.006s	sys 0.017s
I20260811 16:07:15.208389 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.208936 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.080766 22948 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:15.189157 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 239500us
W20260811 16:07:15.182417 22908 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.746s	user 0.003s	sys 0.033s
I20260811 16:07:15.159584 22889 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260811 16:07:15.182835 22882 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260811 16:07:15.189275 22958 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 13 FOLLOWER]: Advancing to term 14
W20260811 16:07:15.206526 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49503.4us
W20260811 16:07:15.129317 22936 consensus_meta.cc:287] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260811 16:07:15.233254 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:15.213048 13789 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.686s (SENT)
I20260811 16:07:15.214535 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.234263 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.214850 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.180039 22868 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.181669 22314 raft_consensus.cc:686] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:15.146687 22869 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.165355 23007 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:15.211900 22968 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.007s	sys 0.019s
I20260811 16:07:15.184897 13820 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:15.206727 22860 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.213961 22812 raft_consensus.cc:2781] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:15.233970 13908 raft_consensus.cc:2362] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22. Re-sending same reply.
I20260811 16:07:15.169044 22976 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:15.237349 13789 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.710s (SENT)
I20260811 16:07:15.233093 22946 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.213122 22988 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260811 16:07:15.259754 13789 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:15.233078 22829 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.239845 22971 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:15.262379 22919 consensus_queue.cc:1046] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
W20260811 16:07:15.265548 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 1661) took 1537 ms (client timeout 1981 ms). Trace:
W20260811 16:07:15.265947 14581 rpcz_store.cc:269] 0811 16:07:13.728507 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.742072 (+ 13565us) service_pool.cc:227] Handling call
0811 16:07:15.265393 (+1523321us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540056ed54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:15.265493 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":577984384}
I20260811 16:07:15.263625 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3458) took 2528 ms. Trace:
I20260811 16:07:15.268743 13904 rpcz_store.cc:276] 0811 16:07:12.734959 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.038952 (+303993us) service_pool.cc:227] Handling call
0811 16:07:13.039456 (+   504us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.071807 (+1032351us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.263290 (+1191483us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400087ad4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:15.263504 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2156419328}
I20260811 16:07:15.264099 13737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37768 (request call id 3020) took 2904 ms. Trace:
I20260811 16:07:15.269892 13737 rpcz_store.cc:276] 0811 16:07:12.359559 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.359716 (+   157us) service_pool.cc:227] Handling call
0811 16:07:12.369638 (+  9922us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:14.949223 (+2579585us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.263794 (+314571us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b54001dc754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:15.264024 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5688618368}
I20260811 16:07:15.185860 22846 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.244314 23007 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:15.312182 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.316301 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:15.261126 23012 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260811 16:07:15.263630 23017 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260811 16:07:15.221153 22980 consensus_queue.cc:237] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.315909 22314 consensus_queue.cc:237] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:15.323635 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86314.6us
I20260811 16:07:15.324026 22856 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:15.234385 22858 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.241393 22868 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.328616 22948 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:15.330219 13789 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.718s (SENT)
I20260811 16:07:15.310714 22946 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.238139 22992 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.094s
I20260811 16:07:15.101761 22855 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.342926 13789 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:14.915928 22880 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.237401 22936 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.338471 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:15.316331 23007 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:15.265144 22812 raft_consensus.cc:686] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:15.341490 22856 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.349210 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:07:15.351655 13821 raft_consensus.cc:1203] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Deduplicated request from leader. Original: 19.11->[21.12-21.12]   Dedup: 21.12->[]
I20260811 16:07:15.330840 22889 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:15.353857 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.371239 13904 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:15.366298 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:15.367499 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:15.348094 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 209733us
I20260811 16:07:15.364445 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:15.372927 13821 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260811 16:07:15.264953 22860 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.330364 23005 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:15.373258 13737 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.364454 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:15.371317 13742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:15.378469 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48316.4us
I20260811 16:07:15.372985 13735 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
W20260811 16:07:15.394683 13789 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 2.001s (SENT)
I20260811 16:07:15.395279 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.403177 13874 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:15.399695 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.405623 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:15.407203 13908 raft_consensus.cc:2354] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16.
I20260811 16:07:15.409258 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.409202 22942 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 24.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:15.410032 13904 raft_consensus.cc:2362] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22. Re-sending same reply.
I20260811 16:07:15.411567 14578 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:15.416260 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:15.416651 23014 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260811 16:07:15.356976 22946 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.419179 22946 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:15.423977 22869 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.427842 22829 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.378113 22971 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260811 16:07:15.416324 23022 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260811 16:07:15.436546 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:15.411226 22889 raft_consensus.cc:2741] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260811 16:07:15.447830 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.413798 22965 raft_consensus.cc:2781] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:15.446107 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.430707 22858 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:15.407992 23020 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:15.442214 23035 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:15.480857 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 82659.9us
I20260811 16:07:15.449955 22861 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:15.507634 22886 consensus_meta.cc:287] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.563s	user 0.013s	sys 0.005s
I20260811 16:07:15.507782 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.508564 13908 raft_consensus.cc:2379] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 16: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:15.509497 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.510048 13908 raft_consensus.cc:2362] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21. Re-sending same reply.
I20260811 16:07:15.510818 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.511541 13908 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:15.511865 23027 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260811 16:07:15.512233 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.512804 13908 raft_consensus.cc:2362] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21. Re-sending same reply.
I20260811 16:07:15.513551 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:15.515303 22916 consensus_meta.cc:287] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.946s	user 0.013s	sys 0.005s
I20260811 16:07:15.514206 13908 raft_consensus.cc:2379] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:15.515769 22916 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.518663 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.519906 22936 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.523675 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3475) took 1530 ms. Trace:
I20260811 16:07:15.523829 22868 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.525142 22916 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.524156 13909 rpcz_store.cc:276] 0811 16:07:13.992834 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:13.993271 (+   437us) service_pool.cc:227] Handling call
0811 16:07:13.993579 (+   308us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:13.993995 (+   416us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:13.994028 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:14.904357 (+910329us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:14.904917 (+   560us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.347523 (+442606us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:15.347560 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.347649 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:15.523296 (+175647us) raft_consensus.cc:1671] finished
0811 16:07:15.523321 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.523608 (+   287us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":3487104,"thread_start_us":442180,"threads_started":1,"wal-append.queue_time_us":616408}
I20260811 16:07:15.526384 13827 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:15.526165 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.527283 13909 raft_consensus.cc:2362] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19. Re-sending same reply.
I20260811 16:07:15.504956 13900 raft_consensus.cc:2354] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20.
I20260811 16:07:15.528546 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:15.528734 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.527864 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3545) took 1056 ms. Trace:
I20260811 16:07:15.443190 22926 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260811 16:07:15.533965 22926 raft_consensus.cc:3032] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:15.534525 22926 raft_consensus.cc:729] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:15.536460 13827 rpcz_store.cc:276] 0811 16:07:14.471614 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.479392 (+  7778us) service_pool.cc:227] Handling call
0811 16:07:15.527699 (+1048307us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400174154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:15.527810 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2306306816}
W20260811 16:07:15.552311 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58736.6us
I20260811 16:07:15.484764 23020 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:15.535465 22926 consensus_queue.cc:260] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.563649 22244 raft_consensus.cc:979] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: : Instructing follower 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:07:15.565199 22244 raft_consensus.cc:1067] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Signalling peer 5f46150fac70458986206ec7af67a403 to start an election
I20260811 16:07:15.567975 22668 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:15.568771 23021 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260811 16:07:15.573638 23032 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260811 16:07:15.574656 22966 consensus_queue.cc:1046] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:15.575748 22878 raft_consensus.cc:3032] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:15.576234 22878 raft_consensus.cc:729] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:15.576879 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3478) took 1018 ms. Trace:
I20260811 16:07:15.577313 22878 consensus_queue.cc:260] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.579190 22878 raft_consensus.cc:3037] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:15.579320 23033 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:15.577301 13907 rpcz_store.cc:276] 0811 16:07:14.558174 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.560614 (+  2440us) service_pool.cc:227] Handling call
0811 16:07:14.587742 (+ 27128us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.587983 (+   241us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.588011 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:14.603051 (+ 15040us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.141772 (+538721us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:15.141814 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.141891 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:15.576613 (+434722us) raft_consensus.cc:1671] finished
0811 16:07:15.576634 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.576815 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":426775,"threads_started":1,"wal-append.queue_time_us":595551}
I20260811 16:07:15.580031 23033 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.581149 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.582170 13907 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 23: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:15.582523 23033 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.583575 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:15.585615 22903 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.952s	user 0.006s	sys 0.003s
I20260811 16:07:15.586064 22903 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:15.585794 22987 consensus_queue.cc:260] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.587090 22987 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:15.587512 22869 consensus_queue.cc:1046] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:07:15.591354 22954 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:15.591850 22954 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.592676 22954 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.594426 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3549) took 1121 ms. Trace:
I20260811 16:07:15.594570 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.595244 13741 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:15.597687 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
W20260811 16:07:15.598476 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 1.52615e+06us
I20260811 16:07:15.599380 13736 raft_consensus.cc:1226] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:15.430975 22940 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.601994 22940 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.603682 13905 raft_consensus.cc:2354] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:15.606251 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:15.608265 23023 log.cc:924] Time spent T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260811 16:07:15.609287 22900 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.609696 22855 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.609797 22900 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.610391 22855 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.560508 22868 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:15.612057 22868 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:15.612947 23018 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.537s	user 0.001s	sys 0.000s
I20260811 16:07:15.614333 22868 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:15.616506 22798 consensus_meta.cc:287] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.004s
I20260811 16:07:15.617228 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3093) took 2892 ms. Trace:
I20260811 16:07:15.617734 13825 rpcz_store.cc:276] 0811 16:07:12.724581 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:12.736462 (+ 11881us) service_pool.cc:227] Handling call
0811 16:07:12.766616 (+ 30154us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:14.120569 (+1353953us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.616930 (+1496361us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000d5a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:15.617147 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3112449408}
I20260811 16:07:15.495668 22812 consensus_queue.cc:237] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.621410 13901 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 27.
I20260811 16:07:15.612387 22900 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:15.530037 22931 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.229s	user 0.014s	sys 0.000s
I20260811 16:07:15.645848 13737 raft_consensus.cc:2454] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:15.499230 22965 raft_consensus.cc:686] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:15.593834 22954 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:15.617005 22798 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.629881 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:15.442742 22902 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.594815 13817 rpcz_store.cc:276] 0811 16:07:14.472882 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.473024 (+   142us) service_pool.cc:227] Handling call
0811 16:07:14.473477 (+   453us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.476259 (+  2782us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.476312 (+    53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:14.476952 (+   640us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.092524 (+615572us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:15.092565 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.092628 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:15.594202 (+501574us) raft_consensus.cc:1671] finished
0811 16:07:15.594223 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.594366 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2179,"raft.queue_time_us":3271,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6756,"thread_start_us":535931,"threads_started":1,"wal-append.queue_time_us":920334}
I20260811 16:07:15.634675 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:15.663472 14574 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 15.
I20260811 16:07:15.662508 13905 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:15.653838 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:15.593317 13907 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:15.645974 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1544) took 1168 ms. Trace:
I20260811 16:07:15.648418 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:15.555868 22942 consensus_queue.cc:1225] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer cec0688f86d54789b9b9ecc924ddecf3 log is divergent from this leader: its last log entry 25.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260811 16:07:15.672034 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.673460 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.678710 13736 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260811 16:07:15.558058 22976 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.666719 13823 rpcz_store.cc:276] 0811 16:07:14.477270 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.953384 (+476114us) service_pool.cc:227] Handling call
0811 16:07:14.953727 (+   343us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.990251 (+ 36524us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.990284 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:14.998586 (+  8302us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.216219 (+217633us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:15.216290 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.216385 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:15.572929 (+356544us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:15.620560 (+ 47631us) raft_consensus.cc:1671] finished
0811 16:07:15.620585 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.645907 (+ 25322us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":979,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":15789,"spinlock_wait_cycles":8568704,"thread_start_us":216192,"threads_started":1,"wal-append.queue_time_us":365471}
I20260811 16:07:15.682969 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:15.684090 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.687561 13905 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 24. Current term is 25. Ops: [24.11-24.11]
I20260811 16:07:15.622162 23020 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:15.634707 22832 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.610913 22855 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.680542 22936 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:15.705914 13787 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:15.706348 22798 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:15.707033 13903 raft_consensus.cc:2354] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 18. Current term is 19.
I20260811 16:07:15.656066 22900 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.708091 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1553) took 1144 ms. Trace:
I20260811 16:07:15.673619 22903 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.741927 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:15.686249 22912 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:15.751024 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1556) took 1036 ms. Trace:
I20260811 16:07:15.680565 22951 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:15.518812 23039 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.257s
I20260811 16:07:15.767730 13738 raft_consensus.cc:1226] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:15.767911 14574 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:07:15.738209 22976 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.768982 22976 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.748768 13736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:15.749436 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3"
I20260811 16:07:15.770186 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:15.769012 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.742578 13905 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:15.751681 13737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.751466 13826 rpcz_store.cc:276] 0811 16:07:14.715221 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.792008 (+ 76787us) service_pool.cc:227] Handling call
0811 16:07:15.750851 (+958843us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400355a54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:15.750966 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":334651264}
I20260811 16:07:15.750391 14582 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:15.769603 13743 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 22. Current term is 23. Ops: [20.12-22.13]
I20260811 16:07:15.750016 22900 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.766851 22903 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.781598 13735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cec0688f86d54789b9b9ecc924ddecf3" is_pre_election: true
I20260811 16:07:15.655673 22931 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.753620 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:15.745795 13822 rpcz_store.cc:276] 0811 16:07:14.564144 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.119090 (+554946us) service_pool.cc:227] Handling call
0811 16:07:15.146059 (+ 26969us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:15.146304 (+   245us) raft_consensus.cc:1520] Early marking committed up to index 17
0811 16:07:15.344286 (+197982us) log.cc:842] Serialized 14 byte log entry
0811 16:07:15.707649 (+363363us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:15.707723 (+    74us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:15.707784 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.707870 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.708018 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":116312,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":4423,"thread_start_us":527016,"threads_started":2}
I20260811 16:07:15.785483 14579 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:15.783653 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:15.787997 13905 raft_consensus.cc:1226] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260811 16:07:15.746577 22878 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.536263 23005 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.753628 22942 raft_consensus.cc:2781] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:15.707800 22805 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:435: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
W20260811 16:07:15.784463 23037 log.cc:924] Time spent T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260811 16:07:15.819355 14579 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:15.820472 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1543) took 1343 ms. Trace:
I20260811 16:07:15.820824 22976 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.820861 13824 rpcz_store.cc:276] 0811 16:07:14.477003 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.962089 (+485086us) service_pool.cc:227] Handling call
0811 16:07:14.987339 (+ 25250us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.990504 (+  3165us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.990531 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.029176 (+ 38645us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.314756 (+285580us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:15.315380 (+   624us) log.cc:842] Serialized 14 byte log entry
0811 16:07:15.321500 (+  6120us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:15.321622 (+   122us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:15.820262 (+498640us) raft_consensus.cc:1671] finished
0811 16:07:15.820288 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:15.820413 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12539,"prepare.queue_time_us":268,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":8996,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":28359,"thread_start_us":157592,"threads_started":1,"wal-append.queue_time_us":367034}
I20260811 16:07:15.823549 14577 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:15.823648 23007 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.774024 22856 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.825871 23007 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.826138 22856 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.784123 22965 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.828805 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:15.801631 22901 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.215s	user 0.013s	sys 0.002s
I20260811 16:07:15.804121 13906 raft_consensus.cc:2354] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:15.804404 22903 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.805389 22942 raft_consensus.cc:686] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:15.812480 22855 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.812915 22860 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.708568 22546 consensus_queue.cc:1046] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
W20260811 16:07:15.818236 22918 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.350s	user 0.014s	sys 0.000s
I20260811 16:07:15.822700 22900 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.803498 22931 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:15.743367 22832 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.846236 22926 raft_consensus.cc:3037] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.814397 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
I20260811 16:07:15.878674 22918 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.884645 13908 raft_consensus.cc:2354] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
I20260811 16:07:15.886080 22918 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.853756 22583 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:15.887197 22583 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.889510 22583 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.890668 22832 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.857209 23020 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.859534 22546 raft_consensus.cc:3032] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:15.891631 22546 raft_consensus.cc:729] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.892562 22546 consensus_queue.cc:260] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.893913 22546 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.854859 22942 consensus_queue.cc:237] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:15.896173 13909 raft_consensus.cc:2354] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:15.897034 23020 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.835495 22901 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.899614 22901 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:15.900367 13744 raft_consensus.cc:1226] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:15.868714 22952 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:15.902455 22952 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:15.902927 22832 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:15.836848 22904 consensus_meta.cc:287] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.006s
I20260811 16:07:15.903534 22952 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.904501 13900 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260811 16:07:15.905040 13900 pending_rounds.cc:76] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 11
I20260811 16:07:15.905263 13900 pending_rounds.cc:97] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260811 16:07:15.905476 13900 raft_consensus.cc:2866] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:15.908617 22583 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.909421 22583 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.913105 22583 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:15.903484 22832 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:15.914744 22878 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:15.905041 22952 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:15.917476 22832 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:15.907018 22958 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.007s
W20260811 16:07:15.751678 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 346910us
I20260811 16:07:15.934116 22937 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:15.938771 22936 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:15.981204 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:15.993686 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.988358 23007 consensus_queue.cc:1046] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:16.010499 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 327597us
W20260811 16:07:16.017746 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 329284us
W20260811 16:07:16.014087 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 246230us
I20260811 16:07:16.023092 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:15.981930 22583 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.025161 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.010435 22668 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:15.982012 22958 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.006942 22878 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.009853 23050 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260811 16:07:16.038120 13789 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.006s	sys 0.030s
W20260811 16:07:16.038651 13789 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.030s
I20260811 16:07:16.012603 22987 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.043804 13905 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.022610 22901 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:15.993598 22937 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.052695 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.026777 22936 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:07:16.040259 22314 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.012s
I20260811 16:07:16.028734 22904 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:16.038956 22941 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.083079 13909 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 21. Ops: []
I20260811 16:07:16.085057 13905 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260811 16:07:16.086592 13908 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:16.090982 13908 raft_consensus.cc:1226] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.056275 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:16.056838 22829 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.004s
I20260811 16:07:16.098505 13742 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
W20260811 16:07:16.081723 22314 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.012s
I20260811 16:07:16.046617 22668 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.130419 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.131606 13908 raft_consensus.cc:2379] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 16: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.039646 23020 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260811 16:07:16.039068 22583 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.136716 13908 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260811 16:07:16.139318 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.143682 13909 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:16.038667 22878 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.106302 22936 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:16.146435 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.077373 22903 consensus_queue.cc:1046] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
W20260811 16:07:16.156515 13706 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.013s	sys 0.032s
I20260811 16:07:16.077319 22901 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.056849 22911 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260811 16:07:16.139739 22812 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.154588 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:16.054140 22987 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.158322 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:16.159195 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 764506us
I20260811 16:07:16.107626 22941 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.149991 22918 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:16.157015 13706 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.013s	sys 0.032s
I20260811 16:07:16.164851 13736 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
W20260811 16:07:16.158463 23044 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260811 16:07:16.100248 22965 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.173338 13909 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.179800 13817 raft_consensus.cc:1226] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:16.174177 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.180971 13908 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:16.175372 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:16.176496 13709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.804s (SENT) [suppressed 39 similar messages]
I20260811 16:07:16.182017 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.182868 13908 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.177277 13826 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:16.187362 22869 consensus_queue.cc:1046] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:16.188591 22869 raft_consensus.cc:3032] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:16.188639 13817 raft_consensus.cc:1261] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
W20260811 16:07:16.189209 23051 log.cc:924] Time spent T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260811 16:07:16.189543 22941 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:16.189968 23045 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260811 16:07:16.191262 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.172621 22812 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.193553 22958 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.193935 22812 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.196012 22878 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.187201 22918 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.197994 22987 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.199363 22918 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.199672 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.201233 14573 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:16.202379 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.203498 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.203588 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.203861 13823 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260811 16:07:16.204218 14574 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:16.204877 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.205380 14574 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 14 LEARNER]: Advancing to term 16
W20260811 16:07:16.205655 23056 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260811 16:07:16.206307 14573 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.189095 22869 raft_consensus.cc:729] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.207965 14582 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:16.212581 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.213486 13817 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:16.214365 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 190106us
I20260811 16:07:16.213122 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.217697 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.218526 14579 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.219184 13908 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:16.219632 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.220216 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.220949 13824 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260811 16:07:16.222394 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.214895 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.225610 13826 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:16.229529 14582 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: []
I20260811 16:07:16.235085 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.236035 13824 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.235934 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.244169 14579 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:16.249993 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.255594 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.258644 13826 raft_consensus.cc:2454] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:16.261247 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.265030 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.266520 13826 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:16.269321 13908 raft_consensus.cc:1226] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:16.274930 13827 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:16.275492 13827 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:16.278560 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.279318 13818 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.273311 13824 raft_consensus.cc:2454] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:16.284909 13825 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:07:16.285531 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.286190 13909 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:16.287256 22812 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:16.288290 23067 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260811 16:07:16.287890 22812 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.289937 23068 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260811 16:07:16.208119 22965 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.253526 22798 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.318452 13825 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7"
dest_uuid: "5f46150fac70458986206ec7af67a403"
 from {username='slave'} at 127.0.0.1:40896
I20260811 16:07:16.287024 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.222499 22912 consensus_queue.cc:1046] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260811 16:07:16.319789 13825 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:07:16.317608 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.294359 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.346586 13825 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.346840 14579 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.321904 13827 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.323246 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.347868 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:16.348352 13820 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:16.294749 13818 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:16.324862 13826 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:16.325838 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.348795 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.327005 13824 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260811 16:07:16.252980 22901 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.349798 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.332484 22583 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.338255 14574 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:07:16.292186 22869 consensus_queue.cc:260] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.344345 22798 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.345280 23007 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.346167 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.348691 13817 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:16.319556 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.348548 13827 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:16.350915 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.351653 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.180866 22668 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.349481 13823 raft_consensus.cc:2454] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:16.279474 22911 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:16.373611 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54121.9us
I20260811 16:07:16.376608 13826 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:16.252234 22856 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.263302 23020 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.359666 13824 raft_consensus.cc:1226] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 19. Ops: []
I20260811 16:07:16.291869 23058 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.391573 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.405332 13821 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:16.405825 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.406477 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.406975 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.407419 13821 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:16.407799 13827 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260811 16:07:16.408613 13823 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:07:16.393173 22901 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.410053 22901 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.410548 22901 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.410722 22941 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.411361 22941 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.412356 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.413466 22941 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.413563 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:16.393860 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.394894 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:16.414168 13908 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.397527 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.405083 22856 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.416517 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.417332 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.414986 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.418104 13909 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:16.418574 13905 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:16.419407 23058 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.421173 22422 raft_consensus.cc:3032] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:16.421597 22422 raft_consensus.cc:729] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.421813 22965 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.410640 22918 consensus_queue.cc:1035] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260811 16:07:16.291226 22812 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.419826 13909 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260811 16:07:16.422494 22422 consensus_queue.cc:260] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.420396 23050 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260811 16:07:16.424585 22422 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.425988 22798 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.392027 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:16.411476 23015 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:16.404421 13874 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.418061 22856 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.428612 13905 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260811 16:07:16.430497 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 408283us
I20260811 16:07:16.431411 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.432464 13824 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:16.403369 13789 connection.cc:232] RPC call timeout handler was delayed by -1.6499711909564212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3093s for a response
W20260811 16:07:16.433535 13789 connection.cc:232] RPC call timeout handler was delayed by -1.6437075131107122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260811 16:07:16.434396 13874 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.435561 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3480) took 1836 ms. Trace:
I20260811 16:07:16.436101 13874 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.437129 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:07:16.437826 13789 connection.cc:232] RPC call timeout handler was delayed by -1.633807513047941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260811 16:07:16.439193 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5933075130451471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260811 16:07:16.441438 13789 connection.cc:232] RPC call timeout handler was delayed by -1.591507513076067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260811 16:07:16.439942 13825 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.420459 13906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3052) took 1326 ms (client timeout 1718 ms). Trace:
W20260811 16:07:16.447127 13906 rpcz_store.cc:269] 0811 16:07:15.094501 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.214255 (+119754us) service_pool.cc:227] Handling call
0811 16:07:16.420281 (+1206026us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002c15d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.420405 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1309191040}
I20260811 16:07:16.448016 13825 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.435920 13901 rpcz_store.cc:276] 0811 16:07:14.632516 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.634293 (+  1777us) service_pool.cc:227] Handling call
0811 16:07:16.435370 (+1801077us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54003b01d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.435493 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1935892864}
I20260811 16:07:16.416599 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.429409 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1759) took 2528 ms. Trace:
I20260811 16:07:16.493089 13826 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:16.422932 22919 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.497157 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.500409 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.424321 23020 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.503971 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.506234 13824 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:16.511026 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:16.509038 13908 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.513244 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.422060 23058 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:16.513751 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 420209us
I20260811 16:07:16.511377 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.518042 13826 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:16.491784 22924 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.521085 22924 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.519840 22903 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.524647 22903 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.525192 22903 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:16.519961 13903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3054) took 1424 ms (client timeout 1881 ms). Trace:
W20260811 16:07:16.528342 13903 rpcz_store.cc:269] 0811 16:07:15.095113 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.214622 (+119509us) service_pool.cc:227] Handling call
0811 16:07:16.519749 (+1305127us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000c8354. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.519895 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1084624768}
I20260811 16:07:16.530345 22924 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:16.530730 23069 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260811 16:07:16.537209 22860 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:16.392702 23007 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.429234 22968 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:16.540819 22968 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.541201 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44131.7us
I20260811 16:07:16.512355 22918 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.543053 22918 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.543334 22832 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:16.517388 13901 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:16.543778 13825 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:16.495915 22546 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260811 16:07:16.545393 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.546192 22546 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:16.546830 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.548256 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.549347 22621 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:16.549834 22621 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.550235 22621 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:16.550520 22903 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.551892 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:16.505525 22919 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.553328 22919 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.555429 22897 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:16.556075 22897 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.556553 22897 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.495571 22798 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:16.543447 22918 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.558180 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1673) took 1114 ms. Trace:
I20260811 16:07:16.543062 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:16.566283 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 149758us
I20260811 16:07:16.491348 22965 raft_consensus.cc:2781] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:16.492659 22912 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:16.561199 14578 rpcz_store.cc:276] 0811 16:07:15.444285 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.479089 (+ 34804us) service_pool.cc:227] Handling call
0811 16:07:15.481078 (+  1989us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:15.494602 (+ 13524us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:15.494648 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.500303 (+  5655us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.600656 (+100353us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b48000606d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:07:16.078126 (+477470us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:16.111227 (+ 33101us) log.cc:842] Serialized 14 byte log entry
0811 16:07:16.497871 (+386644us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.497944 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:16.557744 (+ 59800us) raft_consensus.cc:1671] finished
0811 16:07:16.557909 (+   165us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:16.558101 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":399335,"prepare.queue_time_us":60635,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":49,"raft.queue_time_us":406309,"raft.run_cpu_time_us":1132,"raft.run_wall_time_us":97274,"spinlock_wait_cycles":14183808,"thread_start_us":457663,"threads_started":1,"wal-append.queue_time_us":936110}
I20260811 16:07:16.427511 22869 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:16.491573 22878 raft_consensus.cc:2781] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:16.576231 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.577291 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.578394 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.582173 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.403445 22911 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.584573 22942 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.585170 22942 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.586356 22911 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.579749 22952 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:16.587589 22832 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:16.588536 22914 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:16.588771 23020 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.558756 22926 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.559626 22798 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.558223 22829 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:16.571516 23015 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:16.571607 22847 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.449535 22812 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.608165 13903 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260811 16:07:16.599054 22952 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:16.616472 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.599236 22829 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.608592 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:16.599815 22926 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.618718 22965 raft_consensus.cc:686] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.616631 22952 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.599841 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:16.619690 22952 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:16.620198 22926 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.619918 22965 consensus_queue.cc:237] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.617712 22829 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.620582 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.627679 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.629184 14574 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.617161 22901 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.633219 22901 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.618467 13908 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:16.628662 22798 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.598692 22878 raft_consensus.cc:686] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.613623 23015 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:16.635717 23015 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.635914 22878 consensus_queue.cc:237] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.624336 22812 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.640491 23054 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:16.640946 22812 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.640636 22829 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.641299 23054 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.599475 23065 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:16.643412 23065 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:16.643882 23065 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.594290 22924 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:16.646625 22546 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:16.590306 22912 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.598380 22903 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.593070 22942 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.660003 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.677572 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:16.595868 22951 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
W20260811 16:07:16.684702 13709 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.016s	sys 0.023s
I20260811 16:07:16.667645 22829 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.694789 13908 raft_consensus.cc:1226] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:16.658090 22911 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260811 16:07:16.624513 22847 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:16.691044 13709 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.016s	sys 0.024s
I20260811 16:07:16.707204 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:16.707985 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84637.3us
I20260811 16:07:16.709741 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:16.808180 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98521.7us
I20260811 16:07:16.705060 22903 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:16.707412 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 530917us
I20260811 16:07:16.799722 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.819516 14579 raft_consensus.cc:3037] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:16.820041 22621 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.813180 22903 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.824442 22903 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.828087 22936 raft_consensus.cc:3032] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:16.828668 22936 raft_consensus.cc:729] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.829572 22936 consensus_queue.cc:260] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.830706 22936 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:16.833164 22847 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.835029 23015 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.836404 22931 raft_consensus.cc:3032] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:16.836826 22931 raft_consensus.cc:729] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.837379 23015 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:16.837741 22931 consensus_queue.cc:260] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.813017 22924 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:16.839195 22918 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:16.839890 22924 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:16.840338 22924 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:16.841929 22918 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.780121 22941 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:16.843402 22941 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:16.843742 22931 raft_consensus.cc:3037] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:16.844445 22941 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.813716 22901 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:16.814736 22919 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.708537 22912 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.827126 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43028 (request call id 1766) took 1123 ms. Trace:
W20260811 16:07:16.805974 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 405482us
I20260811 16:07:16.865039 14577 rpcz_store.cc:276] 0811 16:07:15.704065 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.742690 (+ 38625us) service_pool.cc:227] Handling call
0811 16:07:16.826926 (+1084236us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.827055 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":121029376}
I20260811 16:07:16.494050 14583 rpcz_store.cc:276] 0811 16:07:13.900591 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.074638 (+174047us) service_pool.cc:227] Handling call
0811 16:07:14.083930 (+  9292us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:14.084307 (+   377us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:14.084334 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.559178 (+1474844us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:15.562339 (+  3161us) log.cc:842] Serialized 26 byte log entry
0811 16:07:15.971425 (+409086us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:15.982265 (+ 10840us) log.cc:842] Serialized 14 byte log entry
0811 16:07:16.428836 (+446571us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b18000eae80. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:07:16.429061 (+   225us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.429161 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:16.429207 (+    46us) raft_consensus.cc:1671] finished
0811 16:07:16.429220 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:16.429350 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9467,"prepare.queue_time_us":20160,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":8102,"raft.queue_time_us":447968,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":44496,"spinlock_wait_cycles":43906688,"thread_start_us":408616,"threads_started":1,"wal-append.queue_time_us":425617}
I20260811 16:07:16.867488 13706 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:16.866310 23054 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:16.869817 23005 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:16.868383 22897 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.873581 22952 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.868249 23065 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:16.881458 23065 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:16.881873 23059 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.457s	user 0.001s	sys 0.001s
W20260811 16:07:16.883396 22981 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260811 16:07:16.886569 22952 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:16.886583 13742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37768 (request call id 3042) took 1517 ms. Trace:
I20260811 16:07:16.888643 13742 rpcz_store.cc:276] 0811 16:07:15.370679 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.371025 (+   346us) service_pool.cc:227] Handling call
0811 16:07:16.886375 (+1515350us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54002783d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.886516 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1622380416}
W20260811 16:07:16.892297 13904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60520 (request call id 3056) took 1795 ms (client timeout 1998 ms). Trace:
W20260811 16:07:16.892818 13904 rpcz_store.cc:269] 0811 16:07:15.097177 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.415942 (+318765us) service_pool.cc:227] Handling call
0811 16:07:16.892034 (+1476092us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400301954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:16.892225 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1490094976}
I20260811 16:07:16.894024 13905 raft_consensus.cc:1226] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:16.870401 23005 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:16.848450 14579 raft_consensus.cc:2454] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:16.858863 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:16.869620 22847 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260811 16:07:16.846989 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:16.870324 13706 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:16.687762 14574 raft_consensus.cc:1261] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260811 16:07:16.904242 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57346.7us
W20260811 16:07:16.904942 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:16.905525 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:16.906140 13871 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:16.906764 13871 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.898332 22668 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.040s	sys 0.046s
W20260811 16:07:16.909296 13871 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:16.911810 13706 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:16.912001 13871 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.913321 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.914054 13871 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.915220 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.897141 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46401.5us
W20260811 16:07:16.899055 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5231075130868703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260811 16:07:16.918381 13789 connection.cc:232] RPC call timeout handler was delayed by -1.5150075131095946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
W20260811 16:07:16.919320 13789 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.866s (SENT)
W20260811 16:07:16.920207 13789 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.881s (SENT)
I20260811 16:07:16.920686 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.924332 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:16.909724 22668 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.042s	sys 0.047s
I20260811 16:07:16.931172 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.925529 14574 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:16.936100 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:16.936800 14582 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:16.934952 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:16.939405 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:16.939544 14578 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:16.939944 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:16.944903 14583 raft_consensus.cc:1226] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:16.946079 14579 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:16.922142 22925 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:16.919512 22901 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:16.990684 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44084.1us
W20260811 16:07:16.991366 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 376862us
W20260811 16:07:16.952529 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:16.994781 13874 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
W20260811 16:07:16.952529 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 497904us
W20260811 16:07:16.996013 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:16.996399 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:16.996855 13871 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.998004 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:16.997028 13789 connection.cc:232] RPC call timeout handler was delayed by -1.4836829259293154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260811 16:07:16.998736 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:17.001688 13871 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:17.002900 14582 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
W20260811 16:07:16.998778 13789 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.978s (SENT)
I20260811 16:07:16.926357 22954 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:17.007067 13787 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.952955 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.008539 14573 raft_consensus.cc:2454] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:17.015420 13874 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.018556 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:17.019315 13817 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:17.020012 13789 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.998s (SENT)
I20260811 16:07:17.021000 13789 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:17.002449 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:17.023857 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:17.019909 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 88876.1us
W20260811 16:07:16.995155 23076 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:07:16.990756 23058 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:16.943387 22908 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260811 16:07:17.025827 13707 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:16.953014 22981 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:16.947034 22812 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:17.025043 23039 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.041s	sys 0.056s
I20260811 16:07:17.036368 13822 raft_consensus.cc:1226] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260811 16:07:17.005631 22847 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.007898 22925 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.019294 22856 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.040664 13823 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260811 16:07:17.027835 22901 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260811 16:07:16.947983 23015 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.090s
I20260811 16:07:17.026575 22932 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260811 16:07:17.049291 13791 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.021s
W20260811 16:07:17.049649 13791 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.000s	sys 0.022s
W20260811 16:07:17.040228 23039 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.041s	sys 0.057s
I20260811 16:07:17.051560 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.054087 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:17.058617 13903 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.061645 13871 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:17.065708 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:17.067938 13909 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:17.069103 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:17.069818 13909 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:17.073244 13909 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260811 16:07:17.075189 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:17.070050 13817 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:17.047607 22925 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:17.049001 22932 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.080482 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:17.077780 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:17.081410 13908 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:17.050412 22901 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.086905 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:17.088199 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 61361.5us
I20260811 16:07:17.089195 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:16.950050 23054 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:17.034535 22918 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260811 16:07:17.081609 13822 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:17.059297 22422 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:17.098127 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78076.6us
I20260811 16:07:17.043411 22812 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.057641 22919 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.098956 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.106889 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.109156 13903 raft_consensus.cc:2454] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:17.073014 23020 raft_consensus.cc:2781] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:17.111047 14582 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260811 16:07:17.100078 13789 connection.cc:232] RPC call timeout handler was delayed by -1.4395829259883612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260811 16:07:16.990212 23005 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:17.111984 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76147.8us
I20260811 16:07:17.113242 14542 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:17.112553 13789 connection.cc:232] RPC call timeout handler was delayed by -1.3828829260310158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260811 16:07:17.066895 22897 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.104224 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:17.106412 14579 raft_consensus.cc:1226] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260811 16:07:17.080118 22937 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.091750 22901 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:17.115540 13908 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:17.116554 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:17.047787 22917 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260811 16:07:17.087586 22932 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:17.042169 22981 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.127079 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.131770 13823 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.121034 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.121979 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:17.115268 13789 connection.cc:232] RPC call timeout handler was delayed by -1.0822829259559512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
I20260811 16:07:17.124409 23085 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:17.124666 22951 raft_consensus.cc:2781] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.125104 23054 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.094259 13909 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:17.046537 22847 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.057895 22856 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.127045 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.136746 14573 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:17.160101 14579 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.135874 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.161299 14582 raft_consensus.cc:2379] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:17.139937 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.162228 14577 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:17.162298 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:17.141281 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:17.163494 14583 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:17.142254 22812 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:17.138813 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:17.181929 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47240.7us
I20260811 16:07:17.143422 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:17.146463 13871 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:17.119319 23082 raft_consensus.cc:2781] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:17.141952 22924 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.196164 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.116734 23080 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:17.153383 13874 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.154805 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:17.182860 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:17.185971 13871 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:17.128091 23020 raft_consensus.cc:686] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:17.187752 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.200273 14582 raft_consensus.cc:2379] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:17.199950 23020 consensus_queue.cc:237] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.201643 23080 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:17.201961 14579 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:17.202121 23080 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.138103 23085 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.203272 23080 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:17.203474 23085 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:17.201951 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47182.6us
I20260811 16:07:17.213768 13789 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.216957 23085 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.220377 13823 raft_consensus.cc:2454] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:17.224538 14574 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260811 16:07:17.160589 22546 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.127168 22942 consensus_queue.cc:1035] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260811 16:07:17.159940 23015 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:17.227725 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.186798 22952 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:17.219520 22812 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260811 16:07:17.242726 23092 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260811 16:07:17.244539 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 146058us
I20260811 16:07:17.188436 22951 raft_consensus.cc:686] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:17.240391 14577 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:17.276753 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 80419.5us
I20260811 16:07:17.243395 22847 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.293736 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:17.222136 23082 raft_consensus.cc:686] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:17.193578 22940 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260811 16:07:17.301970 22924 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.185043 23054 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.300005 14574 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:17.283392 22812 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:17.410607 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 257358us
I20260811 16:07:17.305539 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.275789 23015 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:17.396179 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:17.370610 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66688.9us
W20260811 16:07:17.421221 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 208379us
W20260811 16:07:17.418601 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 113142us
I20260811 16:07:17.369933 14579 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260811 16:07:17.419358 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.302505 22856 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.295094 23058 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:17.296147 23064 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.295377 22919 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:17.427470 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.300154 22422 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.271709 22546 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.430310 13874 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.423348 23015 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:17.371259 13706 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.377650 22847 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.423524 22812 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:17.438686 13789 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.314572 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
W20260811 16:07:17.452507 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 334215us
I20260811 16:07:17.466583 13789 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.296344 22952 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.439540 22942 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:17.476071 13612 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c390fd23cec5435d81b38a50b2988a60 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d98491a0db549d0b671b60b90c9cdea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:17.476789 22880 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:17.476256 22422 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:17.479920 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 108793us
I20260811 16:07:17.480464 22856 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.445159 22919 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.430178 23104 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:17.461952 22981 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.463969 23064 raft_consensus.cc:686] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:17.396571 23039 consensus_queue.cc:1046] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260811 16:07:17.497895 23063 raft_consensus.cc:3032] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:17.397258 23005 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260811 16:07:17.488538 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:17.276369 23098 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.256s
I20260811 16:07:17.446319 23110 consensus_queue.cc:1046] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.084s
I20260811 16:07:17.504130 22919 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:17.504320 22918 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:17.429721 22951 consensus_queue.cc:237] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.546316 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.504635 23113 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:17.468879 22847 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.561797 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.511968 23063 raft_consensus.cc:729] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.522589 23104 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:17.519472 23020 raft_consensus.cc:2781] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.519929 23085 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.428913 23082 consensus_queue.cc:237] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:17.579596 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113124us
W20260811 16:07:17.580631 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150368us
I20260811 16:07:17.582024 13871 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.490603 22942 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.589239 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.594095 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.596179 13789 leader_election.cc:398] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20.
W20260811 16:07:17.597222 22931 consensus_meta.cc:287] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.753s	user 0.013s	sys 0.000s
I20260811 16:07:17.599642 13789 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:17.558449 23113 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:17.572745 23111 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:17.592541 23088 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260811 16:07:17.509589 23101 consensus_queue.cc:1046] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260811 16:07:17.584735 23090 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:17.598951 23085 raft_consensus.cc:2741] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
W20260811 16:07:17.646032 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 127129us
I20260811 16:07:17.616947 22912 raft_consensus.cc:2781] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:17.675190 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1763) took 2050 ms. Trace:
I20260811 16:07:17.685371 14580 rpcz_store.cc:276] 0811 16:07:15.624970 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.625115 (+   145us) service_pool.cc:227] Handling call
0811 16:07:15.625496 (+   381us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:15.625783 (+   287us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:15.625819 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.626336 (+   517us) log.cc:842] Serialized 26 byte log entry
0811 16:07:16.080118 (+453782us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:16.881266 (+801148us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:17.648418 (+767152us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b1800558d00. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f
0811 16:07:17.648636 (+   218us) log.cc:842] Serialized 14 byte log entry
0811 16:07:17.674679 (+ 26043us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.674819 (+   140us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:17.674883 (+    64us) raft_consensus.cc:1671] finished
0811 16:07:17.674900 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:17.675088 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18786,"prepare.queue_time_us":68880,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":26895,"spinlock_wait_cycles":208335104,"thread_start_us":793607,"threads_started":2,"wal-append.queue_time_us":741111}
I20260811 16:07:17.564321 23099 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260811 16:07:17.617811 23113 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:17.699090 22907 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.642237 23005 raft_consensus.cc:2781] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:17.702319 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 183718us
I20260811 16:07:17.643265 22931 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:17.700911 23085 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:17.724861 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.679803 22897 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:17.690346 23111 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.751163 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.645176 22940 consensus_queue.cc:1046] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260811 16:07:17.694442 23054 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:17.764331 23059 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260811 16:07:17.715473 22912 raft_consensus.cc:686] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:17.765455 23112 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260811 16:07:17.765621 22952 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:17.689983 23115 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.719251 23005 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:17.767823 23100 log.cc:924] Time spent T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260811 16:07:17.766973 22942 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.761185 23039 raft_consensus.cc:3032] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:17.748874 22856 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.610107 23064 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.774667 23085 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:17.835932 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 236388us
I20260811 16:07:17.826268 23054 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:17.858491 13789 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.786624 23124 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.755618 23098 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260811 16:07:17.775341 22546 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:17.827230 23088 log.cc:924] Time spent T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260811 16:07:17.737884 22907 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.643566 23063 consensus_queue.cc:260] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.875619 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.841760 23005 raft_consensus.cc:3037] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:17.838165 22940 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.881798 23110 raft_consensus.cc:3032] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:17.774811 22897 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:17.861629 22936 consensus_meta.cc:287] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.031s	user 0.017s	sys 0.000s
W20260811 16:07:17.861029 22901 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.000s
W20260811 16:07:17.886798 23102 log.cc:924] Time spent T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260811 16:07:17.849355 23039 raft_consensus.cc:729] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.871515 23020 raft_consensus.cc:686] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:17.919572 13789 leader_election.cc:398] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
I20260811 16:07:17.919181 22940 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.891466 23054 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:17.909721 22942 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:17.931604 13789 leader_election.cc:401] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260811 16:07:17.859858 23099 consensus_queue.cc:1046] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
W20260811 16:07:17.913427 23106 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260811 16:07:17.913300 23110 raft_consensus.cc:729] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:17.944555 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3142) took 1444 ms. Trace:
I20260811 16:07:17.820583 23111 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:17.881520 23085 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:17.935349 23103 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260811 16:07:17.920835 23125 raft_consensus.cc:3032] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:17.940071 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3496) took 1561 ms. Trace:
I20260811 16:07:17.924773 22422 raft_consensus.cc:3032] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Stepping down as leader of term 25
W20260811 16:07:17.961645 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 284001us
I20260811 16:07:17.925235 22847 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:17.965734 23135 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:17.907178 23101 consensus_queue.cc:1046] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260811 16:07:17.967072 13821 rpcz_store.cc:276] 0811 16:07:16.500578 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.502543 (+  1965us) service_pool.cc:227] Handling call
0811 16:07:16.502863 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:16.993959 (+491096us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.993994 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:17.007861 (+ 13867us) log.cc:842] Serialized 26 byte log entry
0811 16:07:17.144068 (+136207us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:17.144114 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.144183 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:17.944239 (+800056us) raft_consensus.cc:1671] finished
0811 16:07:17.944273 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:17.944474 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":137074,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":599964,"threads_started":2,"wal-append.queue_time_us":394080}
I20260811 16:07:17.985996 13706 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:17.847764 23115 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.976290 13906 rpcz_store.cc:276] 0811 16:07:16.378466 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.506744 (+128278us) service_pool.cc:227] Handling call
0811 16:07:16.507092 (+   348us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:16.516909 (+  9817us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.516946 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:16.569947 (+ 53001us) log.cc:842] Serialized 52 byte log entry
0811 16:07:16.872656 (+302709us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:17.127458 (+254802us) log.cc:842] Serialized 14 byte log entry
0811 16:07:17.411978 (+284520us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.412070 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:17.939804 (+527734us) raft_consensus.cc:1671] finished
0811 16:07:17.939827 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:17.939998 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37248,"prepare.queue_time_us":226225,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":9294,"raft.queue_time_us":59532,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":31988,"spinlock_wait_cycles":73396992,"thread_start_us":706076,"threads_started":3,"wal-append.queue_time_us":559718}
I20260811 16:07:17.958281 23098 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:17.960844 22798 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:17.923653 22901 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.011759 13905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3493) took 1690 ms. Trace:
I20260811 16:07:18.012171 13905 rpcz_store.cc:276] 0811 16:07:16.321121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.431252 (+110131us) service_pool.cc:227] Handling call
0811 16:07:16.893793 (+462541us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:16.894499 (+   706us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.011541 (+1117042us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400301950. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:18.011687 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1062983936}
W20260811 16:07:18.013806 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 262734us
I20260811 16:07:17.975574 22936 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:17.888103 23124 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:17.973481 23122 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:17.985462 22422 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.029037 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.031206 23098 raft_consensus.cc:3032] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:18.018015 23020 consensus_queue.cc:237] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:17.983825 23125 raft_consensus.cc:729] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:18.071120 23086 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260811 16:07:18.071938 23125 consensus_queue.cc:260] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.048483 23116 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:18.073186 23125 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.073297 23116 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.074388 22940 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.047574 23127 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:18.075479 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2525) took 1874 ms. Trace:
I20260811 16:07:17.988338 23136 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:18.049099 23105 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.076332 23136 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:18.076843 23136 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:18.076664 23105 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.078125 23138 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.080256 23085 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:18.080720 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:18.081188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 882091us
W20260811 16:07:18.058106 23080 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.851s	user 0.020s	sys 0.000s
I20260811 16:07:18.082752 23080 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.084137 22954 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:18.084851 22954 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.070287 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.051443 23122 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.076892 23079 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.084245 23115 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.028139 14580 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260811 16:07:18.060250 14583 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.075693 22940 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:18.009235 22847 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
W20260811 16:07:18.094148 22932 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.947s	user 0.014s	sys 0.000s
I20260811 16:07:17.947916 22912 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.098120 23053 raft_consensus.cc:3032] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:17.989621 22942 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260811 16:07:18.075920 14575 rpcz_store.cc:276] 0811 16:07:16.201025 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.201159 (+   134us) service_pool.cc:227] Handling call
0811 16:07:16.201488 (+   329us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:16.503516 (+302028us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.503563 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:16.504123 (+   560us) log.cc:842] Serialized 26 byte log entry
0811 16:07:16.919249 (+415126us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:16.919301 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.919381 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.075240 (+1155859us) raft_consensus.cc:1671] finished
0811 16:07:18.075265 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.075415 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":301472,"raft.queue_time_us":335922,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":414041,"threads_started":1,"wal-append.queue_time_us":1093866}
I20260811 16:07:17.995434 23099 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260811 16:07:18.085062 23080 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.053694 23128 raft_consensus.cc:2781] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:07:18.096953 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 671279us
I20260811 16:07:18.053061 22936 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.058239 23098 raft_consensus.cc:729] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.069698 23133 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:17.970752 22856 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.018963 22798 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.128800 22932 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.195465 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3494) took 1838 ms. Trace:
I20260811 16:07:18.212926 14583 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260811 16:07:18.164593 23116 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.078691 23138 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.051911 23054 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:18.217222 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 135429us
I20260811 16:07:18.170572 14577 raft_consensus.cc:1226] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260811 16:07:18.224805 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:18.116720 22919 consensus_meta.cc:287] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.001s
I20260811 16:07:17.983860 23039 consensus_queue.cc:260] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.069335 22907 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.174798 23128 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:18.122409 22940 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.176347 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.183264 23124 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.262362 13823 raft_consensus.cc:3032] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Stepping down as leader of term 15
I20260811 16:07:18.262812 13823 raft_consensus.cc:729] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:18.258561 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:18.208729 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.196117 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3154) took 1075 ms. Trace:
I20260811 16:07:18.213150 13907 rpcz_store.cc:276] 0811 16:07:16.357402 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.452354 (+ 94952us) service_pool.cc:227] Handling call
0811 16:07:16.516583 (+ 64229us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:16.573139 (+ 56556us) raft_consensus.cc:1520] Early marking committed up to index 16
0811 16:07:16.919596 (+346457us) log.cc:842] Serialized 14 byte log entry
0811 16:07:17.132322 (+212726us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:17.132373 (+    51us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:17.132420 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.481228 (+348808us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b1800292480. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:18.195165 (+713937us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54000875d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:18.195234 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.195396 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23484,"prepare.queue_time_us":517754,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":5587,"raft.queue_time_us":47884,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":39772,"spinlock_wait_cycles":139907840,"thread_start_us":524889,"threads_started":2,"wal-append.queue_time_us":302415}
I20260811 16:07:18.022147 23110 consensus_queue.cc:260] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:18.184803 22880 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.000s
I20260811 16:07:18.163205 23053 raft_consensus.cc:729] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:18.291049 13902 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260811 16:07:18.193344 23052 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 2.218s	user 0.006s	sys 0.000s
W20260811 16:07:18.206859 22925 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.109s	user 0.013s	sys 0.003s
I20260811 16:07:18.239048 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.241534 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.241739 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.229844 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.295488 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.296680 13820 raft_consensus.cc:2396] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260811 16:07:18.171444 23134 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21.
I20260811 16:07:18.190918 22901 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.202349 23126 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:18.206231 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 296375us
I20260811 16:07:18.189514 22897 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.187537 22968 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.200630 23111 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.258982 13825 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:07:18.196147 23113 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:18.269461 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 60782.6us
W20260811 16:07:18.270726 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 100025us
I20260811 16:07:18.263669 13823 consensus_queue.cc:260] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.330991 13823 raft_consensus.cc:3037] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:18.269451 13822 rpcz_store.cc:276] 0811 16:07:17.120837 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:17.123212 (+  2375us) service_pool.cc:227] Handling call
0811 16:07:17.123669 (+   457us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:17.144777 (+ 21108us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:17.144810 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:17.144852 (+    42us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:17.144883 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.195880 (+1050997us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400125554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:18.195937 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.196057 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":47978240}
W20260811 16:07:18.226359 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.236090 23115 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.120781 23005 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.304850 13905 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 20: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.294010 13824 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:18.307610 13789 leader_election.cc:398] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:18.356796 13789 leader_election.cc:401] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260811 16:07:18.186942 23136 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.309047 13874 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:18.360417 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51490.2us
I20260811 16:07:18.361068 23136 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:18.362603 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 55126.6us
I20260811 16:07:18.363276 22931 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:18.321736 22925 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.365985 23124 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:18.366581 13789 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:18.367110 23136 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:18.368292 22925 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:18.370867 23104 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.004s
I20260811 16:07:18.371357 23104 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:18.332901 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.175719 23144 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260811 16:07:18.171846 22422 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.376221 22798 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.258316 23128 raft_consensus.cc:3037] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:18.339851 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.341831 23105 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.377959 22940 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.258080 22919 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.368932 22925 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:18.379364 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 51410.9us
I20260811 16:07:18.380324 22919 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:18.380779 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.382249 22932 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.378973 22925 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.386890 23138 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:18.362473 23090 consensus_meta.cc:287] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.000s
I20260811 16:07:18.388618 23090 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:18.388902 23061 log.cc:924] Time spent T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 1.963s	user 0.000s	sys 0.003s
I20260811 16:07:18.380257 23104 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:18.393414 13823 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260811 16:07:18.393836 14581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1762) took 2770 ms. Trace:
I20260811 16:07:18.394694 22925 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.397382 22941 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:18.405581 13908 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260811 16:07:18.412122 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45555.4us
I20260811 16:07:18.413589 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.343572 22936 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.111562 23079 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.344695 23113 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.339553 23126 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.235560 23116 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260811 16:07:18.288681 23039 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:18.362706 22880 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:18.291767 22881 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:18.375998 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 149673us
I20260811 16:07:18.324978 23099 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.416065 13789 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:18.442318 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.469094 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.470891 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.438110 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.217418 23133 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.394246 14581 rpcz_store.cc:276] 0811 16:07:15.623405 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:15.623574 (+   169us) service_pool.cc:227] Handling call
0811 16:07:15.623957 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:15.624226 (+   269us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:15.624263 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:15.655896 (+ 31633us) log.cc:842] Serialized 26 byte log entry
0811 16:07:16.010974 (+355078us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:16.153268 (+142294us) log.cc:842] Serialized 14 byte log entry
0811 16:07:16.499628 (+346360us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:16.499712 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.388273 (+1888561us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:18.393496 (+  5223us) raft_consensus.cc:1671] finished
0811 16:07:18.393615 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.393773 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":399204,"prepare.queue_time_us":17288,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":346419,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":8378112,"thread_start_us":435637,"threads_started":2,"wal-append.queue_time_us":750959}
I20260811 16:07:18.465440 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.475354 13821 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
W20260811 16:07:18.470402 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.472165 13824 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:18.393875 13823 pending_rounds.cc:76] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 12
I20260811 16:07:18.422744 23135 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:18.393417 23007 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.469094 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.477794 13823 pending_rounds.cc:97] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 15.13
W20260811 16:07:18.484411 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68471.3us
W20260811 16:07:18.469141 23015 consensus_meta.cc:287] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.994s	user 0.014s	sys 0.000s
I20260811 16:07:18.486282 13817 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:18.493170 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.494906 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.495658 14578 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:18.496857 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.497891 14574 raft_consensus.cc:2379] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 14: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:18.505795 22907 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:18.506587 23156 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260811 16:07:18.506661 22907 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.507300 22907 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.288767 23098 consensus_queue.cc:260] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.509356 23098 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:18.509500 22907 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:18.511264 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 69006.5us
W20260811 16:07:18.512822 13871 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:18.513237 13787 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:18.513698 13871 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.494139 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.488668 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.516031 14581 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:18.488776 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.434810 23122 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.482312 22680 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.517023 14583 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.524004 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.525168 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.525691 13905 raft_consensus.cc:1261] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260811 16:07:18.526096 13905 pending_rounds.cc:76] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:07:18.526314 13905 pending_rounds.cc:97] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260811 16:07:18.526538 13905 raft_consensus.cc:2866] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:18.520947 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.525583 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.528236 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.529810 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.530956 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.532261 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.407002 23115 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.533356 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.524699 13821 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:18.545195 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.545298 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:18.492733 22942 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:18.558686 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.560874 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.536525 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.484767 13823 raft_consensus.cc:2866] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:18.563043 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.537446 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.563853 14573 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260811 16:07:18.528908 13905 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:18.565860 13905 raft_consensus.cc:1261] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260811 16:07:18.562847 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.566192 13905 pending_rounds.cc:76] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:07:18.566417 13905 pending_rounds.cc:97] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260811 16:07:18.566612 13905 raft_consensus.cc:2866] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:18.538436 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.540179 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.542270 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.536175 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.568222 14583 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:18.548724 13824 raft_consensus.cc:2454] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:18.569561 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:18.551452 13871 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.545994 13821 raft_consensus.cc:2454] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:18.570178 13905 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260811 16:07:18.561636 13826 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:07:18.563931 14582 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.423689 23104 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:18.558979 13906 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 27.
I20260811 16:07:18.571980 13823 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.572640 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.572820 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.577910 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.574906 14581 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260811 16:07:18.575651 13874 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.581887 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:18.582682 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:18.534121 23122 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.522306 23007 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:18.474054 22881 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.587769 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 14.
I20260811 16:07:18.544399 22314 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.475685 23099 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.514631 23015 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:18.605065 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.596308 14582 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:18.466779 23053 consensus_queue.cc:260] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.607250 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.608309 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.611464 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.614205 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.617215 13823 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:18.604410 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.532274 22680 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.593627 23138 raft_consensus.cc:2781] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:18.623508 13826 raft_consensus.cc:2454] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:18.624230 23153 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.564286 22897 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260811 16:07:18.628602 23126 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.624502 22919 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260811 16:07:18.601946 22968 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:18.632982 22680 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.636368 23115 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.638482 23166 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:18.587395 23020 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260811 16:07:18.604789 23122 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:18.514056 23142 consensus_queue.cc:1159] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d98491a0db549d0b671b60b90c9cdea" responder_term: 21 status { last_received { term: 18 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]" } } last_received_current_leader { term: 0 index: 0 } }
W20260811 16:07:18.648630 13871 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.654904 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.643633 23005 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.640383 22869 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Stepping down as leader of term 13
I20260811 16:07:18.606925 23007 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.616153 22314 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.753770 13823 raft_consensus.cc:2362] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20. Re-sending same reply.
I20260811 16:07:18.744518 13871 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.656116 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:18.760084 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 111482us
W20260811 16:07:18.761512 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:18.764740 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.765198 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:18.622349 22932 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:07:18.641971 22954 consensus_meta.cc:287] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260811 16:07:18.751860 22869 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.767690 13825 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:18.779794 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.786720 13707 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:18.779819 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.751905 23079 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:18.658003 22812 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.134s	user 0.012s	sys 0.003s
W20260811 16:07:18.760397 22918 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 1.203s	user 0.014s	sys 0.000s
W20260811 16:07:18.766465 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:18.788187 13826 raft_consensus.cc:2454] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:18.793164 13823 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:18.710812 23116 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:18.764612 23115 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260811 16:07:18.650077 23138 raft_consensus.cc:686] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:18.777168 23139 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:18.805095 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.816016 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.816808 13823 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:18.797652 23171 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:18.795189 22940 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.820045 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.824419 13826 raft_consensus.cc:2379] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:18.822880 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:18.767216 22968 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.805720 22918 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:18.827603 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 210593us
I20260811 16:07:18.829475 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.809492 23079 consensus_queue.cc:1046] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260811 16:07:18.832722 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.830574 23171 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.835986 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.835805 13825 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:18.841071 13709 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.804s (SENT)
I20260811 16:07:18.850744 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:18.852258 13826 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.804983 22812 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.855489 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.860481 13823 raft_consensus.cc:2379] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:18.810022 23116 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.793813 22954 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.844237 22919 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:18.849014 23015 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.826252 22869 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.867117 23138 consensus_queue.cc:237] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.884827 13818 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:18.886102 13818 raft_consensus.cc:1226] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:18.883133 23015 raft_consensus.cc:3032] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:18.887867 23015 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.888360 22968 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.888722 23015 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.890167 23015 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.890780 14580 raft_consensus.cc:1226] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:18.891782 23152 log.cc:924] Time spent T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.840s	user 0.002s	sys 0.000s
I20260811 16:07:18.891867 22954 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.653839 23153 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.894034 23154 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.894562 23154 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.890172 23133 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.895224 23153 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.895866 22907 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:18.897342 22907 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.898103 23154 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.899467 22907 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.901513 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:18.903093 13823 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:18.880357 13826 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:18.909755 13820 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 26: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:18.831960 22940 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.918325 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3510) took 1050 ms. Trace:
I20260811 16:07:18.918867 13900 rpcz_store.cc:276] 0811 16:07:17.868434 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:17.868646 (+   212us) service_pool.cc:227] Handling call
0811 16:07:17.869038 (+   392us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:18.015566 (+146528us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:18.015621 (+    55us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:18.025781 (+ 10160us) log.cc:842] Serialized 52 byte log entry
0811 16:07:18.039718 (+ 13937us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:18.042716 (+  2998us) log.cc:842] Serialized 14 byte log entry
0811 16:07:18.111405 (+ 68689us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.112514 (+  1109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.891016 (+778502us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:18.910534 (+ 19518us) raft_consensus.cc:1671] finished
0811 16:07:18.918011 (+  7477us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.918240 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":64572,"prepare.queue_time_us":993,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":132228,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":10181,"spinlock_wait_cycles":142794496,"thread_start_us":151527,"threads_started":2,"wal-append.queue_time_us":25130}
I20260811 16:07:18.913695 13826 raft_consensus.cc:1226] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260811 16:07:18.913565 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.914546 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.915525 14582 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260811 16:07:18.923552 14578 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:18.873703 23099 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.933445 14578 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:18.935887 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.937533 13706 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:18.933609 23133 consensus_queue.cc:1046] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260811 16:07:18.912297 22919 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:18.949584 23175 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260811 16:07:18.950137 22940 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.952580 23116 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.954169 23171 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.955320 23133 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:18.955880 23133 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:18.956267 23125 consensus_meta.cc:287] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.004s
I20260811 16:07:18.956811 23133 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.957257 22919 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:18.959270 23179 raft_consensus.cc:3032] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:18.959679 23179 raft_consensus.cc:729] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:18.959811 22314 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:18.960534 23179 consensus_queue.cc:260] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:18.961779 23128 consensus_meta.cc:287] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.002s
I20260811 16:07:18.962247 23128 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:18.966740 23179 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:18.967248 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:18.968792 23122 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:18.971788 23128 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.973713 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:18.978057 22921 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:18.978231 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3075) took 2372 ms. Trace:
W20260811 16:07:18.984758 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:19.004408 13871 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:18.942390 23007 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:18.986953 13901 rpcz_store.cc:276] 0811 16:07:16.606303 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:16.606495 (+   192us) service_pool.cc:227] Handling call
0811 16:07:16.606899 (+   404us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:16.638871 (+ 31972us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:16.638904 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:17.903326 (+1264422us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c000de1d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:17.905334 (+  2008us) log.cc:842] Serialized 52 byte log entry
0811 16:07:18.215112 (+309778us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:18.234890 (+ 19778us) log.cc:842] Serialized 14 byte log entry
0811 16:07:18.250112 (+ 15222us) log.cc:842] Serialized 14 byte log entry
0811 16:07:18.904739 (+654627us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b180026eba0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4764 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:18.977620 (+ 72881us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b180026eba0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c5159b82c 00007f5c4e9c69dc 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7
0811 16:07:18.977837 (+   217us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:18.977949 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:18.977996 (+    47us) raft_consensus.cc:1671] finished
0811 16:07:18.978009 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:18.978169 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32509,"prepare.queue_time_us":674342,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":90569,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":22955,"spinlock_wait_cycles":65521152,"thread_start_us":346951,"threads_started":2,"wal-append.queue_time_us":438802}
W20260811 16:07:19.007598 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:19.112537 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104881us
W20260811 16:07:19.113907 13871 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.114825 22621 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.117453 22812 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.100476 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 292170us
W20260811 16:07:19.048699 22941 consensus_meta.cc:287] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.651s	user 0.014s	sys 0.002s
W20260811 16:07:19.046545 23064 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.006s	sys 0.006s
W20260811 16:07:19.130307 23064 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.006s	sys 0.006s
I20260811 16:07:19.131974 22881 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.139868 13707 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.142057 23180 raft_consensus.cc:3037] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:19.141657 23143 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.147786 23143 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:19.168860 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53889.7us
W20260811 16:07:19.173105 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:19.180902 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 666532us
I20260811 16:07:19.182739 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1626) took 5189 ms. Trace:
I20260811 16:07:19.188175 13902 rpcz_store.cc:276] 0811 16:07:13.993398 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:14.034313 (+ 40915us) service_pool.cc:227] Handling call
0811 16:07:14.034562 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:18.291599 (+4257037us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:19.182000 (+890401us) spinlock_profiling.cc:243] Waited 4.26 s on lock 0x7b5400033ed4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:19.182469 (+   469us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9788237696}
I20260811 16:07:19.198071 14575 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:19.201078 22881 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:19.179024 23098 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.669s	user 0.015s	sys 0.002s
I20260811 16:07:19.168336 22621 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.204854 22621 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.179435 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:19.210094 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:19.210457 13822 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260811 16:07:19.211272 22925 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:07:19.227909 23119 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.329s	user 0.002s	sys 0.003s
I20260811 16:07:19.228782 14574 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260811 16:07:19.230516 23126 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.231658 23126 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.202894 22881 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Stepping down as leader of term 16
W20260811 16:07:19.233124 23108 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.162s	user 0.002s	sys 0.000s
I20260811 16:07:19.233287 22881 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:19.235064 23127 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.235311 22668 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.236115 23127 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.236243 22668 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.242328 22881 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.244853 13817 raft_consensus.cc:1261] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:07:19.245947 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.218364 22869 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 13 FOLLOWER]: Advancing to term 14
I20260811 16:07:19.247306 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.265731 22881 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:19.267797 23007 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.268678 23007 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.269852 14578 raft_consensus.cc:1226] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260811 16:07:19.269718 13787 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.271875 23007 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.288909 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3508) took 2216 ms. Trace:
I20260811 16:07:19.289701 14575 raft_consensus.cc:1261] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260811 16:07:19.290170 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.291059 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.293303 23054 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:19.293946 23054 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:19.294458 23054 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.291160 14579 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:19.296002 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.298532 14575 raft_consensus.cc:2379] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:19.298359 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.298874 23127 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.292322 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.300230 14577 raft_consensus.cc:2362] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18. Re-sending same reply.
I20260811 16:07:19.300685 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260811 16:07:19.302779 22621 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.308355 14574 raft_consensus.cc:2379] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 20: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:19.313697 22314 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.314553 22314 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.317736 22314 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.311225 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.291953 13825 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: []
W20260811 16:07:19.333494 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.721s (SENT)
I20260811 16:07:19.336293 23110 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.335023 14544 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.289508 13903 rpcz_store.cc:276] 0811 16:07:17.072046 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:17.110503 (+ 38457us) service_pool.cc:227] Handling call
0811 16:07:17.110826 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:17.119944 (+  9118us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:17.119981 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:17.147972 (+ 27991us) log.cc:842] Serialized 26 byte log entry
0811 16:07:17.491255 (+343283us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:17.491790 (+   535us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:17.492116 (+   326us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:19.226539 (+1734423us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:19.288254 (+ 61715us) raft_consensus.cc:1671] finished
0811 16:07:19.288281 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:19.288672 (+   391us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":20399,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8156,"spinlock_wait_cycles":4697856,"thread_start_us":236999,"threads_started":1,"wal-append.queue_time_us":633021}
I20260811 16:07:19.344559 23143 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.349897 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.352423 23166 raft_consensus.cc:2781] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:19.352898 23166 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.353286 23166 raft_consensus.cc:3037] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:19.354429 13823 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260811 16:07:19.357388 23180 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:19.369773 22621 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:19.389801 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49373us
I20260811 16:07:19.404515 23063 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:19.418885 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 69375.8us
I20260811 16:07:19.423364 22314 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:19.419318 22981 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.778s	user 0.013s	sys 0.019s
I20260811 16:07:19.420743 22668 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.435619 13709 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:19.437235 23082 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.012s	sys 0.023s
W20260811 16:07:19.440218 23117 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.429s	user 0.003s	sys 0.000s
W20260811 16:07:19.442708 23130 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.392s	user 0.002s	sys 0.002s
W20260811 16:07:19.444141 23082 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.013s	sys 0.023s
I20260811 16:07:19.447508 22314 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.453624 13787 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:19.454282 23161 log.cc:924] Time spent T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.076s	user 0.002s	sys 0.000s
W20260811 16:07:19.444098 22981 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.874s	user 0.013s	sys 0.020s
I20260811 16:07:19.455942 23020 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:19.461997 23020 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.462942 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.468171 23124 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:19.468717 14573 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:19.472285 14580 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:19.473892 23054 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.475502 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.504670 23020 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:19.504891 22422 raft_consensus.cc:3037] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:19.507506 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.517551 14583 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
W20260811 16:07:19.519910 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 2.166s (SENT)
I20260811 16:07:19.524914 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.526065 22621 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260811 16:07:19.527130 22621 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:19.528532 14541 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.512s (SENT)
I20260811 16:07:19.529074 14541 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.528087 22621 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.536485 23054 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.540889 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 87726.8us
W20260811 16:07:19.544483 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109629us
I20260811 16:07:19.557013 22968 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260811 16:07:19.543804 22847 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:19.560667 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:19.560968 22314 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.561803 22968 raft_consensus.cc:2741] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260811 16:07:19.561934 14541 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.556s (SENT)
I20260811 16:07:19.562569 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.564373 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.566771 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.567608 23206 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:19.567438 22936 consensus_queue.cc:1035] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260811 16:07:19.576313 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.578685 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.559753 22621 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.581257 23125 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.581602 22936 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:19.567549 22903 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:19.583520 22903 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.583963 22903 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:19.554040 23020 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260811 16:07:19.572827 23206 raft_consensus.cc:686] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:19.595527 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.607555 23020 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:19.609225 14544 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.609896 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1568) took 1079 ms. Trace:
I20260811 16:07:19.610492 13823 rpcz_store.cc:276] 0811 16:07:18.530479 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:19.110714 (+580235us) service_pool.cc:227] Handling call
0811 16:07:19.252305 (+141591us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:19.354974 (+102669us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:19.609576 (+254602us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5400355050. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:19.609804 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":76263168}
I20260811 16:07:19.611613 22968 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:19.612427 22936 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:19.604396 22621 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:19.614042 22621 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:19.614506 22621 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.615566 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3514) took 1373 ms. Trace:
I20260811 16:07:19.615893 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.616122 13908 rpcz_store.cc:276] 0811 16:07:18.241704 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:18.242064 (+   360us) service_pool.cc:227] Handling call
0811 16:07:18.279893 (+ 37829us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:18.406142 (+126249us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:19.614838 (+1208696us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54001b1554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:19.615262 (+   424us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":162867072}
I20260811 16:07:19.619624 22936 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:19.629478 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.634351 14577 raft_consensus.cc:2379] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:19.554735 23166 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.571520 22881 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:19.643949 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80053.4us
I20260811 16:07:19.646271 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:19.649739 13826 raft_consensus.cc:1261] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260811 16:07:19.650456 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.651628 13823 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260811 16:07:19.651702 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.653685 23015 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.653908 13902 raft_consensus.cc:1226] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 19. Current term is 20. Ops: []
W20260811 16:07:19.659976 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.686s (SENT)
I20260811 16:07:19.649856 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:19.634451 23206 consensus_queue.cc:237] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.663179 23015 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.671208 23105 raft_consensus.cc:2781] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:19.671721 23105 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.672111 23105 raft_consensus.cc:3037] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:19.673044 23201 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260811 16:07:19.669474 22968 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260811 16:07:19.680169 13826 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:19.686403 22954 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:19.687213 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50848.2us
I20260811 16:07:19.695978 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.689317 22954 consensus_queue.cc:1035] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:19.690080 23101 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:19.690353 23058 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.704020 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.690661 22936 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.706280 23166 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.662789 23207 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:19.706423 22936 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.707108 22907 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.709100 22936 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.706051 23082 consensus_queue.cc:1035] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:19.691197 23020 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.711692 23020 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.707247 23207 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.714030 23020 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.714908 23125 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:19.715088 23207 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.735462 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.707999 22907 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.774021 13709 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.779861 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:19.780543 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 53459.7us
W20260811 16:07:19.781205 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48904.8us
I20260811 16:07:19.783579 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.784191 23082 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:19.784348 23101 raft_consensus.cc:3037] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:19.786512 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:19.787472 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 130258us
I20260811 16:07:19.788118 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.789016 13820 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 16.
I20260811 16:07:19.789616 13818 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:19.790045 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.736753 22621 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.733070 23058 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:19.788307 14541 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.687s (SENT)
I20260811 16:07:19.791133 13818 raft_consensus.cc:1261] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260811 16:07:19.795172 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 56361us
I20260811 16:07:19.797379 13826 raft_consensus.cc:1261] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:19.800673 14575 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260811 16:07:19.801478 14541 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.783579 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.792987 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:19.795455 23138 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:19.791999 23211 log.cc:924] Time spent T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260811 16:07:19.778424 23105 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.820988 13824 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:19.795922 22621 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.802655 22907 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.800902 23058 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.818948 22954 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:19.798014 22903 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.833143 13817 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:19.843262 23207 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:19.827512 22812 consensus_queue.cc:1035] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260811 16:07:19.847587 13789 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.834645 23138 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.837953 22907 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
W20260811 16:07:19.854991 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 80721us
I20260811 16:07:19.839455 23058 consensus_queue.cc:1035] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260811 16:07:19.840973 23005 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260811 16:07:19.853030 22954 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:19.848423 23063 consensus_queue.cc:1046] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260811 16:07:19.866734 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78506.2us
I20260811 16:07:19.868985 22903 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.869663 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:19.861822 23207 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:19.860963 22954 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:19.876332 22954 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.876982 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:19.877673 22954 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.877712 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.879626 23133 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:19.879992 13874 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.880259 14574 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:19.880299 23133 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:19.881889 23143 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:19.882121 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:19.883445 23131 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:19.883181 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:19.879547 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.887310 14583 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:19.889951 23050 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:19.890391 23050 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.890723 23050 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.893266 22903 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:19.893841 22903 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:19.894294 22903 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:19.882441 23133 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.900065 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:19.875372 23005 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:19.904615 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.688s (SENT)
I20260811 16:07:19.860308 23125 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260811 16:07:19.886793 22812 raft_consensus.cc:2741] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260811 16:07:19.908839 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.909931 23131 consensus_queue.cc:1046] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:19.919065 23131 raft_consensus.cc:3032] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:19.919474 23131 raft_consensus.cc:729] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:19.919910 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.721s (SENT)
I20260811 16:07:19.910403 23138 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.911751 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:19.920475 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.905239 13709 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:19.906749 23105 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.922456 23131 consensus_queue.cc:260] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.935626 23131 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.941591 23105 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:19.942401 23126 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:19.943547 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47659.7us
I20260811 16:07:19.926484 22812 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:19.945488 23082 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:19.947546 23082 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:19.947477 22812 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.948884 23082 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:19.950374 23082 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:19.946323 23207 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:19.952032 22951 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:19.952482 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.953474 14581 raft_consensus.cc:2396] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260811 16:07:19.950722 22812 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:19.964397 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.964941 23015 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:19.969769 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:19.970552 14578 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:19.975092 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:19.975869 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 86475.2us
W20260811 16:07:19.974042 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:19.974717 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:19.977746 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.959479 23138 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.017s
I20260811 16:07:19.981436 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:19.969833 23063 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:19.985921 23058 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:19.986040 23144 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:19.986392 22947 consensus_queue.cc:1035] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260811 16:07:19.968322 23005 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.992408 23166 raft_consensus.cc:3032] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:19.994618 23053 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:19.995460 22422 raft_consensus.cc:3032] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:19.996318 23128 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:19.973470 23050 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:19.996827 23063 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:19.998190 23213 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260811 16:07:19.999063 23143 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:20.001463 22947 consensus_queue.cc:1035] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:20.015115 23015 raft_consensus.cc:1050] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:20.015247 23143 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
W20260811 16:07:20.015861 23015 raft_consensus.cc:1054] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Unable to promote non-voter 8d98491a0db549d0b671b60b90c9cdea: Illegal state: Leader has not yet committed an operation in its own term
I20260811 16:07:20.016453 23143 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.017849 23143 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.018419 22812 consensus_queue.cc:1046] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260811 16:07:20.024047 23144 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:20.024595 22621 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:20.025835 22968 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Stepping down as leader of term 25
I20260811 16:07:20.026355 22968 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:20.027787 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58621.8us
I20260811 16:07:20.027441 22968 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.032783 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 112898us
I20260811 16:07:20.037987 23206 raft_consensus.cc:3032] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:20.038654 23206 raft_consensus.cc:729] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:20.040011 23206 consensus_queue.cc:260] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.041427 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.740s (SENT)
I20260811 16:07:20.001282 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.009142 23166 raft_consensus.cc:729] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.010231 23128 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.052542 23128 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.052800 22968 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:20.052992 23166 consensus_queue.cc:260] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.054788 23166 raft_consensus.cc:3037] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.009517 22422 raft_consensus.cc:729] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.012543 23050 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.019594 23101 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:20.020219 22951 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:07:20.043639 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.043708 23126 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.044732 23015 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.042537 23005 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.046048 14581 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260811 16:07:20.046761 23215 log.cc:924] Time spent T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260811 16:07:20.004947 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:19.998988 22903 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.071421 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 92043.3us
I20260811 16:07:20.074296 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.075237 14579 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.041457 23206 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:20.072515 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67645.7us
I20260811 16:07:20.076798 14583 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260811 16:07:20.075258 13787 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.077890 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.074395 23015 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.085217 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 84122.1us
I20260811 16:07:20.073923 23138 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:20.086016 14541 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 1.969s (SENT)
I20260811 16:07:20.089272 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:20.063864 22422 consensus_queue.cc:260] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.087364 22314 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:20.092855 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.095191 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:20.086386 13787 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.075462 23126 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.085969 22812 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:20.100766 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.095093 23138 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:20.101471 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.084376 23144 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260811 16:07:20.106380 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.103602 23143 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:20.106180 13817 raft_consensus.cc:2362] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20. Re-sending same reply.
I20260811 16:07:20.117683 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.096035 23005 consensus_queue.cc:1046] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260811 16:07:20.108757 23138 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.122777 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.126245 13822 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:20.121155 22954 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:20.126660 23124 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:20.121385 23143 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.133627 23143 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.129730 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.125115 22947 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:20.141266 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.128285 23138 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.145045 13823 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:20.145305 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.147524 13822 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260811 16:07:20.130225 22954 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:20.119504 22314 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.126994 22907 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:20.152671 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 73862.3us
I20260811 16:07:20.149240 13908 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:20.121963 22812 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.154798 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.161199 13901 raft_consensus.cc:2379] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:20.170873 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 91499.2us
I20260811 16:07:20.160043 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.175743 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.176156 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.176466 13903 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:20.170881 13787 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.154021 23015 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:20.160054 22903 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:20.181576 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 87716.3us
I20260811 16:07:20.183948 13902 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:20.179358 14541 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 2.085s (SENT)
I20260811 16:07:20.188923 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.189953 13817 raft_consensus.cc:2396] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 24 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260811 16:07:20.190526 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.190873 23126 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.191095 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.189038 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.193873 13818 raft_consensus.cc:2379] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:20.195472 23220 log.cc:924] Time spent T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260811 16:07:20.196168 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:20.195598 13709 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.549s (SENT)
W20260811 16:07:20.199231 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 2.092s (SENT)
W20260811 16:07:20.200024 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Timed out: RequestConsensusVote RPC to 127.12.23.193:40411 timed out after 2.140s (SENT)
I20260811 16:07:20.202632 13900 raft_consensus.cc:1226] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:20.204880 22314 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.207600 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.208557 14578 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:20.210778 22812 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.213367 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.214404 23105 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:20.214789 23105 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.214980 23131 raft_consensus.cc:1050] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:20.215168 23105 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.217516 23131 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.219385 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57754.6us
W20260811 16:07:20.220577 13787 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.221145 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.189250 23063 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.227375 22812 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:20.231981 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 49329.9us
I20260811 16:07:20.198586 13901 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
I20260811 16:07:20.236933 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.238095 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.238626 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.239945 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.242403 14575 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:20.243556 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.244194 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.247910 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.238754 14580 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:20.237603 14581 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.255450 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.179471 22907 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.257866 13908 raft_consensus.cc:2396] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 28 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260811 16:07:20.257885 14579 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.258828 13827 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.262327 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.263691 13902 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.233703 22422 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.291694 23128 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.197724 22954 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.267411 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:20.267686 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 72129.8us
I20260811 16:07:20.294358 22954 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:20.296254 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.296696 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.297310 14580 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.268944 22907 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:20.271281 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.300411 13905 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.272848 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.276750 13827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40896 (request call id 3597) took 1747 ms (client timeout 1549 ms). Trace:
I20260811 16:07:20.277890 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.302027 13827 rpcz_store.cc:269] 0811 16:07:18.529225 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:18.539495 (+ 10270us) service_pool.cc:227] Handling call
0811 16:07:20.276511 (+1737016us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540021aa54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:20.276660 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3561105664}
I20260811 16:07:20.302631 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.302799 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.303319 13900 raft_consensus.cc:2454] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
W20260811 16:07:20.262470 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.304479 13900 raft_consensus.cc:1226] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
W20260811 16:07:20.304632 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.305429 14541 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.305684 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48080.3us
I20260811 16:07:20.283964 13901 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:20.285118 22947 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:20.288731 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.270779 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.295660 23128 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.291277 23131 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:20.265925 14575 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEARNER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:07:20.281807 23105 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.305841 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.310731 13907 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
W20260811 16:07:20.310431 13787 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.308784 13901 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260811 16:07:20.314634 13706 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.313288 14581 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:07:20.314231 13903 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.309237 13904 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.314495 13907 pending_rounds.cc:76] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 14
I20260811 16:07:20.315260 13901 pending_rounds.cc:76] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 12
I20260811 16:07:20.317852 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.317155 13907 pending_rounds.cc:97] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260811 16:07:20.317520 13901 pending_rounds.cc:97] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260811 16:07:20.325095 13903 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:07:20.308367 23166 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.323836 13905 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.326998 13907 raft_consensus.cc:2866] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:20.307281 23126 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.330662 14580 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.331250 23126 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.331954 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.688s (SENT)
I20260811 16:07:20.332011 13706 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.332577 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.333135 23144 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:20.326996 13901 raft_consensus.cc:2866] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:20.323583 22968 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:20.319048 23128 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:20.337314 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.340551 13827 raft_consensus.cc:2379] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:20.335801 22951 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260811 16:07:20.342149 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.342650 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.337049 23144 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.346307 14582 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:20.346683 23144 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.344211 13905 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:20.344907 22812 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:20.345432 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.316727 23131 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260811 16:07:20.301532 13622 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 14 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:20.309473 23138 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.355353 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:20.359381 13787 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.360034 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.364430 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.341575 23126 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:20.368134 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.334048 23166 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.334214 23143 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.352646 23128 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.373821 13901 raft_consensus.cc:2454] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:20.377314 13818 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260811 16:07:20.379503 13823 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:20.374953 23015 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.380229 22947 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:20.381587 23015 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.382371 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.382711 22812 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260811 16:07:20.383873 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.383571 13902 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:20.386175 13905 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
W20260811 16:07:20.391491 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 48750.7us
I20260811 16:07:20.392925 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.393543 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88187.4us
I20260811 16:07:20.389655 13827 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:20.396301 23105 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:20.397066 13787 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.397614 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.397863 23138 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.398474 22314 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:20.400185 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.400902 13824 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:20.402163 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.403496 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.403752 13826 raft_consensus.cc:1226] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260811 16:07:20.402938 13903 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.404568 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.405742 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.404093 13824 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.407570 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.408927 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.412163 23166 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.403627 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.404451 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.413914 13904 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.404091 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.420092 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.421267 13901 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.421308 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.421670 13824 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.422183 14580 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.423583 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.423902 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.424500 23105 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:20.425055 23105 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.425482 23105 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:20.425618 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:20.398950 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.434794 22947 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:20.439767 13903 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:20.440562 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 47722.5us
I20260811 16:07:20.441968 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.443354 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.444780 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.446951 13903 raft_consensus.cc:1226] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260811 16:07:20.447732 13827 raft_consensus.cc:3032] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:20.454483 13827 raft_consensus.cc:729] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:20.449503 13904 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:20.450980 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.438107 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:20.453325 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.456758 14577 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:20.457172 14541 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.451735 23138 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:20.460760 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 61839.8us
W20260811 16:07:20.461786 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.462502 13787 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.463056 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.468216 13903 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:20.469256 13900 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:20.468607 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.473417 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.475399 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.471603 13825 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:07:20.483340 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.484633 23144 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260811 16:07:20.485073 13709 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Timed out: RequestConsensusVote RPC to 127.12.23.194:42239 timed out after 1.631s (SENT)
W20260811 16:07:20.487659 13620 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 331) took 31376 ms (client timeout 15000 ms). Trace:
I20260811 16:07:20.476511 13822 raft_consensus.cc:2454] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.500432 13902 raft_consensus.cc:1226] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 27. Current term is 28. Ops: []
I20260811 16:07:20.512614 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.512835 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 74157.7us
I20260811 16:07:20.506438 13827 consensus_queue.cc:260] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.515367 13827 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:20.492985 22812 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:20.520255 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.529556 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.532763 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.525333 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.540917 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:20.528173 23218 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260811 16:07:20.540521 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.564760 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.528700 23143 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:20.471832 23128 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.571044 23231 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260811 16:07:20.573601 13907 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260811 16:07:20.574640 23126 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.564420 22951 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:20.575664 22951 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.575314 23126 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.576193 22951 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:20.597496 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.598373 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.598675 14580 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:20.599663 13909 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:20.600419 23229 log.cc:924] Time spent T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260811 16:07:20.601903 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 109735us
W20260811 16:07:20.604024 23228 log.cc:924] Time spent T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260811 16:07:20.606633 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.632113 23053 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:20.566717 23131 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:20.670065 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 144755us
I20260811 16:07:20.673975 14577 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:20.672369 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 65871.7us
W20260811 16:07:20.676312 13787 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.676832 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 146280us
I20260811 16:07:20.676942 13787 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.606885 23015 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.678862 13706 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.678776 23206 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:20.488153 13620 rpcz_store.cc:269] 0811 16:06:49.115443 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:49.166312 (+ 50869us) service_pool.cc:227] Handling call
0811 16:07:20.487361 (+31321049us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:11.824684 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:11.825346 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:11.825406 (+    60us) write_op.cc:435] Acquired schema lock
0811 16:07:11.825425 (+    19us) tablet.cc:660] Decoding operations
0811 16:07:11.826957 (+  1532us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:11.827079 (+   122us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:11.827161 (+    82us) tablet.cc:683] Acquiring locks for 12 operations
0811 16:07:11.875906 (+ 48745us) tablet.cc:699] Row locks acquired
0811 16:07:11.875952 (+    46us) write_op.cc:260] PREPARE: finished
0811 16:07:11.876145 (+   193us) write_op.cc:270] Start()
0811 16:07:11.876325 (+   180us) write_op.cc:276] Timestamp: P: 1786464431876075 usec, L: 0
0811 16:07:11.876367 (+    42us) op_driver.cc:331] REPLICATION: starting
0811 16:07:11.885856 (+  9489us) log.cc:842] Serialized 4751 byte log entry
0811 16:07:12.120891 (+235035us) op_driver.cc:444] REPLICATION: finished
0811 16:07:12.375612 (+254721us) write_op.cc:301] APPLY: starting
0811 16:07:12.375736 (+   124us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:13.905505 (+1529769us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:13.905670 (+   165us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:15.280982 (+1375312us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:15.398893 (+117911us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0811 16:07:15.398944 (+    51us) write_op.cc:312] APPLY: finished
0811 16:07:15.399384 (+   440us) log.cc:842] Serialized 113 byte log entry
0811 16:07:15.800319 (+400935us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:15.800512 (+   193us) write_op.cc:454] Released schema lock
0811 16:07:15.800576 (+    64us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:15.801000 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:15.801032 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":211937,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":254329,"apply.run_cpu_time_us":158582,"apply.run_wall_time_us":3425979,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54191,"num_ops":12,"prepare.queue_time_us":378131,"prepare.run_cpu_time_us":35030,"prepare.run_wall_time_us":216683,"raft.queue_time_us":99249,"raft.run_cpu_time_us":82181,"raft.run_wall_time_us":227060,"replication_time_us":244411,"thread_start_us":1058395,"threads_started":5,"wal-append.queue_time_us":713776,"wal-append.run_cpu_time_us":17657,"wal-append.run_wall_time_us":2270981}]]}
I20260811 16:07:20.683369 23126 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:20.684620 23005 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:20.675143 23144 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:20.685406 23005 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:20.685590 23144 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.686108 23144 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:20.686578 23005 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:20.695971 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:20.699484 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.704773 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:20.723657 14577 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:07:20.725134 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 203939us
I20260811 16:07:20.725292 13827 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260811 16:07:20.730468 13706 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:20.731344 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55068.5us
I20260811 16:07:20.732496 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.733397 13787 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.733951 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.735409 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.743755 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.744836 13905 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:20.742926 13909 raft_consensus.cc:2354] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19.
I20260811 16:07:20.745708 13906 raft_consensus.cc:1261] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260811 16:07:20.751807 23082 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260811 16:07:20.756194 22812 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:20.756994 22812 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:20.759618 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.760074 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.762238 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.763445 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.764128 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.764745 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:20.765631 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:20.766089 22812 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:20.768522 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.770001 13709 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:20.768814 13901 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
W20260811 16:07:20.812636 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 79266.2us
I20260811 16:07:20.727988 23207 consensus_queue.cc:1046] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.016s
I20260811 16:07:20.822889 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:20.819274 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:20.742782 23131 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260811 16:07:20.824079 13901 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
W20260811 16:07:20.825489 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.830587 14583 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:20.832950 13789 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.834115 23131 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 16:07:20.833904 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71099.7us
W20260811 16:07:20.834630 13871 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:20.837381 13787 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.842819 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.848423 13787 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.848610 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:20.849082 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.849519 13909 raft_consensus.cc:2379] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
W20260811 16:07:20.850593 13787 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.851424 23207 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:20.852275 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.857823 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.853085 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.854866 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:20.864564 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 175855us
I20260811 16:07:20.866878 13907 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260811 16:07:20.856390 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.858119 13823 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:20.852424 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.879213 13821 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 17: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:20.835429 23166 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:20.832345 23015 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:20.833956 22812 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:20.847364 23131 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:20.834793 23082 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:20.856048 23053 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:20.885560 13822 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:20.902240 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:20.905761 13907 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:20.915114 23063 raft_consensus.cc:3037] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:20.915443 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60694.3us
I20260811 16:07:20.878198 23206 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:20.914263 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.884845 23166 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:20.927345 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.887537 23138 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.858974 22422 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260811 16:07:20.927445 13901 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:20.948550 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:20.919963 22954 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.934372 23166 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.919730 23053 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:20.961026 13874 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:20.965209 22907 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:20.963299 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 130363us
I20260811 16:07:20.969566 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.971311 13821 raft_consensus.cc:3037] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 19
I20260811 16:07:20.974658 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:20.976446 13823 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:20.978188 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 127630us
W20260811 16:07:20.979403 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 213169us
W20260811 16:07:20.979442 13787 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.983505 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.985128 13787 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.985577 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:20.986712 13787 leader_election.cc:334] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:20.991616 23058 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:20.992551 23058 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:20.996124 23058 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:20.913196 23082 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.966822 22947 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.009562 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 97990.8us
W20260811 16:07:20.971331 23246 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260811 16:07:21.010993 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:21.010268 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50014.7us
I20260811 16:07:20.927642 22812 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:20.966809 23207 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:07:21.029064 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:21.016544 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:21.017446 12383 thread.cc:536] Waited for 1000ms trying to join with heartbeat (tid 13772)
W20260811 16:07:21.019198 23245 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260811 16:07:20.947912 23138 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.002975 23124 raft_consensus.cc:3032] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 LEADER]: Stepping down as leader of term 27
I20260811 16:07:21.042765 23124 raft_consensus.cc:729] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:21.043201 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.044166 13825 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:21.043934 23144 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.043856 23124 consensus_queue.cc:260] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.046217 23144 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.025009 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.020191 23249 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260811 16:07:21.036567 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:21.037844 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.037955 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:21.038169 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.038975 23268 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:21.040290 23138 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:21.041682 23105 consensus_meta.cc:287] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.616s	user 0.017s	sys 0.003s
I20260811 16:07:21.020782 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.032351 23058 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.118010 14583 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:21.028554 23005 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260811 16:07:21.022428 23082 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.048662 14577 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260811 16:07:21.035988 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:21.054744 13787 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:21.137487 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 101572us
I20260811 16:07:21.137602 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.138621 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 86968.7us
I20260811 16:07:21.140689 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:21.056845 13907 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:21.056488 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:20.968182 22954 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.131031 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 361091us
I20260811 16:07:21.046654 14574 raft_consensus.cc:1261] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:21.035776 23015 raft_consensus.cc:2781] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:21.150830 13787 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.153702 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:21.154683 14583 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:21.144840 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.161013 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.156930 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.162057 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 151081us
I20260811 16:07:21.157141 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:21.163079 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.124449 23124 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:21.034657 22947 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.187716 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.139953 22621 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.153705 23015 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:21.200510 23015 raft_consensus.cc:3037] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:21.202893 23263 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:21.188980 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.153635 23267 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:21.184790 23144 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260811 16:07:21.196341 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 158277us
I20260811 16:07:21.136786 23058 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.203482 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:21.203743 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 255471us
I20260811 16:07:21.203764 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:21.171480 22422 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:07:21.208941 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.138728 23206 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:21.190187 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.205798 22314 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:21.156476 23271 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:21.220310 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.224120 14574 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 19
W20260811 16:07:21.226195 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 173254us
W20260811 16:07:21.229847 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.204788 23251 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.278373 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48600us
I20260811 16:07:21.235733 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.125018 23105 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.263548 13709 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:21.238711 22314 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:21.284999 23281 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:21.285449 23058 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:21.282367 13787 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 164 similar messages]
I20260811 16:07:21.274536 23128 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260811 16:07:21.271123 23005 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.298525 23278 raft_consensus.cc:2781] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:21.299058 23278 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:21.299436 23278 raft_consensus.cc:3037] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:21.299993 22947 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:21.300720 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.303333 14574 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:21.285086 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 94932.4us
W20260811 16:07:21.310096 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:21.263891 23082 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.274495 13818 raft_consensus.cc:1261] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260811 16:07:21.120039 23053 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.313431 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 89382.4us
W20260811 16:07:21.273303 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129283us
I20260811 16:07:21.321089 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.314831 14583 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:21.325598 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.275300 22907 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.294514 23251 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.323477 13821 raft_consensus.cc:2454] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:21.329232 13706 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:21.331667 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111449us
I20260811 16:07:21.304893 22621 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.345640 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.305972 22314 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:21.359637 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.363952 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:21.364675 13821 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:21.358610 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.357240 13823 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:21.367115 13818 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 14.
W20260811 16:07:21.390443 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 44972.3us
I20260811 16:07:21.391438 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.399578 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.330343 23250 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.404067 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:21.365449 22951 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.783s	user 0.016s	sys 0.010s
I20260811 16:07:21.409344 14574 raft_consensus.cc:2354] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:21.404572 14542 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.387931 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58885.5us
I20260811 16:07:21.363629 22812 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.275013 23280 consensus_queue.cc:1035] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.129s
I20260811 16:07:21.328493 23128 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260811 16:07:21.403268 22422 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.405369 22907 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:21.443427 13821 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
W20260811 16:07:21.464350 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59875us
I20260811 16:07:21.465600 23271 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:21.412886 23281 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:21.465027 14577 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:21.466902 13818 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260811 16:07:21.520211 13822 consensus_meta.cc:287] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.002s
I20260811 16:07:21.427248 23126 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:21.471812 23275 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260811 16:07:21.418103 22951 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.523927 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:21.467502 23258 log.cc:924] Time spent T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260811 16:07:21.501873 23138 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.520757 13822 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
W20260811 16:07:21.527635 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 94922.7us
I20260811 16:07:21.537659 14581 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:21.471516 23255 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260811 16:07:21.529438 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47164.8us
I20260811 16:07:21.474428 23105 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:21.551585 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 230620us
I20260811 16:07:21.450464 23270 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260811 16:07:21.522634 22621 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.522617 23281 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:21.628538 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.477775 23166 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.458053 22422 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.536356 23245 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260811 16:07:21.637252 13822 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:21.629998 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:21.555402 23254 log.cc:924] Time spent T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260811 16:07:21.534112 23271 raft_consensus.cc:686] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:21.669070 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:21.672107 14578 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.014s	sys 0.012s
W20260811 16:07:21.672960 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 281620us
W20260811 16:07:21.674335 14578 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.014s	sys 0.012s
I20260811 16:07:21.603170 22954 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.642287 23283 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.660356 23267 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:21.549345 23126 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260811 16:07:21.681671 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:21.705760 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 102588us
I20260811 16:07:21.684916 23271 consensus_queue.cc:237] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.706532 13707 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.706745 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.688479 22422 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.643584 22621 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.693389 23015 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.694468 23063 consensus_meta.cc:287] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.779s	user 0.014s	sys 0.000s
I20260811 16:07:21.695572 23105 raft_consensus.cc:3037] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:21.698125 23131 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.003s
I20260811 16:07:21.698863 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.700944 13824 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:21.702126 23295 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.708048 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:21.740156 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.708629 22907 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:21.709278 23286 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.709352 23166 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.711279 23261 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:21.711776 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:21.752790 14577 raft_consensus.cc:2454] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:21.712304 23290 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260811 16:07:21.712675 23274 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:21.713721 23278 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.702562 22314 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.773005 22314 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:21.775777 23270 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:21.777033 23278 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.777169 22954 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:21.777693 22954 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:21.778813 22621 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:21.751693 23063 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:21.779851 23295 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:21.782478 23295 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.707906 14581 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:21.709589 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.754230 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:21.718091 22947 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.770399 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 71614.4us
I20260811 16:07:21.756596 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:21.788321 23286 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:21.788815 23285 log.cc:924] Time spent T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260811 16:07:21.796516 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:21.798606 23288 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:21.800954 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:21.801676 23294 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260811 16:07:21.805670 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:21.807400 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53262.1us
I20260811 16:07:21.827365 13824 raft_consensus.cc:2379] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 19: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:21.827836 13706 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:21.807981 23295 raft_consensus.cc:2781] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:21.808807 13874 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:21.808446 23281 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.703814 23283 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:21.818434 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 111977us
I20260811 16:07:21.823788 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:21.751801 22422 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:21.847482 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.009s
I20260811 16:07:21.768862 23138 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:21.825910 13823 raft_consensus.cc:2396] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:21.743180 22907 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:21.753206 23292 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election won for term 24
W20260811 16:07:21.829653 14541 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:21.784209 23128 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:21.835459 23307 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260811 16:07:21.809538 23289 consensus_queue.cc:1035] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260811 16:07:21.846534 14542 leader_election.cc:398] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19.
I20260811 16:07:21.853749 14542 leader_election.cc:401] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:07:21.847995 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.010s
I20260811 16:07:21.778630 22954 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.856526 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.830021 23295 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:21.841899 23278 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:21.752360 23131 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.841574 23288 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:21.829782 23063 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.829886 23286 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:21.855973 22422 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.850450 23138 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:21.855789 22907 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:21.867363 23295 raft_consensus.cc:3037] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:21.865437 23292 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:21.859025 23274 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260811 16:07:21.728031 23267 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:21.869467 23298 consensus_queue.cc:1035] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
W20260811 16:07:21.896374 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 347704us
I20260811 16:07:21.855893 22951 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:21.825771 22947 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:21.889974 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 57473.2us
W20260811 16:07:21.887629 23124 consensus_meta.cc:287] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
I20260811 16:07:21.877671 22968 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for earlier term 18. Current term is 19.
I20260811 16:07:21.898959 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.864858 23300 raft_consensus.cc:2781] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:21.883569 23278 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:21.885131 23250 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:21.935585 13825 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 28.
I20260811 16:07:21.892307 23138 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 17
W20260811 16:07:21.954799 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 116823us
I20260811 16:07:21.898023 23268 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:21.901506 22954 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:21.967583 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:22.007910 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 70436.3us
W20260811 16:07:22.031494 12383 thread.cc:536] Waited for 2000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:21.931787 23269 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.090603 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.105101 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:21.901039 23303 raft_consensus.cc:3037] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:22.121572 13826 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.125187 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.133229 13787 leader_election.cc:398] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:22.133671 13787 leader_election.cc:401] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260811 16:07:22.135279 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 236397us
I20260811 16:07:21.890044 23063 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:22.148624 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 43683.9us
I20260811 16:07:22.151293 13707 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.103609 23144 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.163906 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3216) took 1114 ms. Trace:
I20260811 16:07:22.164501 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:22.165828 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:22.157914 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 225700us
W20260811 16:07:22.158383 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 202797us
I20260811 16:07:22.159228 22947 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.160111 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.164304 13825 rpcz_store.cc:276] 0811 16:07:21.049985 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:21.056001 (+  6016us) service_pool.cc:227] Handling call
0811 16:07:22.163727 (+1107726us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54000d5554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:22.163847 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1821516032}
I20260811 16:07:22.104035 23206 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.176445 13823 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 26.
W20260811 16:07:22.169134 13871 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:22.142675 23166 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260811 16:07:22.141817 23263 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.152773 23282 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23.
I20260811 16:07:22.163244 22951 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:22.179039 23128 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.034724 23250 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:22.209858 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44088.3us
I20260811 16:07:22.089186 23268 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.247033 22422 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.247927 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:22.248332 23308 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260811 16:07:22.248814 23268 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.249301 23063 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.249554 23250 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.227063 23131 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.227721 23283 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:22.228924 23312 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260811 16:07:22.252539 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3203) took 1397 ms. Trace:
I20260811 16:07:22.200259 23263 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:22.253621 23105 consensus_meta.cc:287] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.000s
I20260811 16:07:22.252915 13820 rpcz_store.cc:276] 0811 16:07:20.855177 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:20.855324 (+   147us) service_pool.cc:227] Handling call
0811 16:07:20.855691 (+   367us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:21.159510 (+303819us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:21.159629 (+   119us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:21.258246 (+ 98617us) log.cc:842] Serialized 52 byte log entry
0811 16:07:21.855621 (+597375us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:21.855661 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:21.855749 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:22.252298 (+396549us) raft_consensus.cc:1671] finished
0811 16:07:22.252318 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:22.252462 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14406,"raft.queue_time_us":50182,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":13648,"thread_start_us":825574,"threads_started":2,"wal-append.queue_time_us":615046}
I20260811 16:07:22.254846 14582 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260811 16:07:22.229816 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 93664.2us
I20260811 16:07:22.255189 23263 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:22.255491 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48960.7us
W20260811 16:07:22.231895 23306 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260811 16:07:22.178185 23144 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.257578 23286 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.258145 23144 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.213438 23015 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.177331 23269 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.261583 23269 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.193925 23206 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.263811 23206 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.264765 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.215572 23128 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.181421 23292 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.243844 22903 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.267671 22903 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.269992 22903 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.245131 23278 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.271790 23128 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.232282 23313 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:22.227519 23310 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260811 16:07:22.276571 23310 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:22.276981 23310 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:22.277915 23310 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.280460 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.288514 13789 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.289153 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1815) took 1093 ms. Trace:
I20260811 16:07:22.282743 13826 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:22.290794 14580 rpcz_store.cc:276] 0811 16:07:21.189696 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:21.189836 (+   140us) service_pool.cc:227] Handling call
0811 16:07:21.207654 (+ 17818us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:21.213908 (+  6254us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:21.213947 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:21.214610 (+   663us) log.cc:842] Serialized 26 byte log entry
0811 16:07:21.319412 (+104802us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:21.352105 (+ 32693us) log.cc:842] Serialized 14 byte log entry
0811 16:07:21.352432 (+   327us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:21.352550 (+   118us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:22.276743 (+924193us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18004c3900. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:22.279723 (+  2980us) raft_consensus.cc:1671] finished
0811 16:07:22.283028 (+  3305us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:22.283217 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29066,"prepare.queue_time_us":33111,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":64,"raft.queue_time_us":1764,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":16085,"spinlock_wait_cycles":11378944,"thread_start_us":60107,"threads_started":1,"wal-append.queue_time_us":192577}
I20260811 16:07:22.288533 23313 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.306286 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.290423 22903 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.254061 23105 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:22.213099 23298 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:22.236253 23315 log.cc:924] Time spent T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260811 16:07:22.255736 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:22.275513 23166 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:22.273511 22951 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.292900 23143 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.294725 23310 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:22.300084 23289 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.325093 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.326086 13904 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
W20260811 16:07:22.333515 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 454941us
W20260811 16:07:22.339417 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83786.3us
I20260811 16:07:22.331202 22951 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.345474 22951 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.332371 23289 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.351279 23279 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:22.351913 13904 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260811 16:07:22.352116 23311 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:22.352530 23311 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.352880 23311 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:22.296856 23313 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.338187 23143 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.324169 23250 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:22.364547 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.365850 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.382670 13826 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:22.369509 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:22.375320 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 206710us
I20260811 16:07:22.383549 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
W20260811 16:07:22.365017 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:22.390899 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.391925 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.392746 13817 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:22.336866 23166 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:22.407801 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.338965 23294 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:22.414732 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.354772 23138 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.351926 23289 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.387957 22951 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.333451 22903 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.428721 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:22.410710 23250 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:22.432606 23250 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.426815 22951 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.416625 23294 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:22.438588 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.443087 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.443730 13820 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:07:22.444005 14582 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260811 16:07:22.438596 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.437135 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.444888 13818 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
W20260811 16:07:22.443097 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 283538us
W20260811 16:07:22.446457 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57543.7us
I20260811 16:07:22.449201 13709 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:22.452220 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.458794 23313 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:22.453330 23144 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:22.468636 23144 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.469058 23144 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:22.461134 22951 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.463653 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.475481 23015 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:22.477149 23166 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.478232 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.478995 23144 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.475946 13905 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:22.467772 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:22.481371 23206 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:22.481822 23206 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.482244 23206 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:22.482808 23144 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.390441 23279 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260811 16:07:22.445297 13907 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:22.484711 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.485327 14577 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 14 FOLLOWER]: Advancing to term 15
I20260811 16:07:22.485767 23138 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:22.486979 23295 consensus_meta.cc:287] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.005s
I20260811 16:07:22.487329 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.487495 23295 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.489704 23295 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.491199 22903 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.499754 23124 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260811 16:07:22.500160 23303 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:22.500013 14578 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:22.501194 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.501614 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.463737 23143 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:22.503171 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70065us
I20260811 16:07:22.452360 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.502722 22903 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:22.514484 22903 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:22.518334 22903 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.505478 23274 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260811 16:07:22.506345 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57275.5us
I20260811 16:07:22.506337 23105 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:22.448148 23294 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:22.442407 23292 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.508344 22422 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260811 16:07:22.509033 22907 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
I20260811 16:07:22.511162 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.511066 23303 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:22.534536 14580 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:22.536338 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 155684us
I20260811 16:07:22.539180 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.541448 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:22.502836 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:22.542877 23274 raft_consensus.cc:2781] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:22.543383 23274 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.543785 23274 raft_consensus.cc:3037] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.544358 23295 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:22.544013 23292 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.544855 23295 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.545305 23295 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:22.536870 22422 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.546003 22422 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:22.548686 23292 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.550868 23267 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.511966 23144 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:22.504101 13826 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
I20260811 16:07:22.555198 23304 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:22.551749 22907 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.555888 23304 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.557376 13904 raft_consensus.cc:2396] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260811 16:07:22.559091 23251 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.564270 23311 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.570852 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:22.585405 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44017.2us
I20260811 16:07:22.498792 14577 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 15.
W20260811 16:07:22.594063 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 55212.3us
I20260811 16:07:22.596601 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:22.598379 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 95675.4us
I20260811 16:07:22.594023 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.599321 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:22.599977 14582 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:22.599408 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.603391 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:22.604221 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.609513 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.609754 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.610334 14579 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:22.614974 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.618827 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.620258 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2606) took 1193 ms. Trace:
I20260811 16:07:22.620256 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:22.558166 23304 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.619992 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.625340 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.625635 14575 raft_consensus.cc:2379] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 27: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:22.593293 23251 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.557384 22907 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.592927 23300 raft_consensus.cc:686] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:22.599134 23334 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:22.637540 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.637913 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.638224 13820 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:22.620934 14583 rpcz_store.cc:276] 0811 16:07:21.429778 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:21.430091 (+   313us) service_pool.cc:227] Handling call
0811 16:07:21.430582 (+   491us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:21.785181 (+354599us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:21.785229 (+    48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:21.785786 (+   557us) log.cc:842] Serialized 52 byte log entry
0811 16:07:21.984969 (+199183us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:22.593949 (+608980us) log.cc:842] Serialized 14 byte log entry
0811 16:07:22.619917 (+ 25968us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:22.619998 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:22.620043 (+    45us) raft_consensus.cc:1671] finished
0811 16:07:22.620054 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:22.620195 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31990,"prepare.queue_time_us":167939,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":13041,"raft.queue_time_us":76834,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":10072,"thread_start_us":884800,"threads_started":3,"wal-append.queue_time_us":378027}
I20260811 16:07:22.634112 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:22.609318 23267 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:22.613860 23269 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:22.646637 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.614032 23015 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Leader election won for term 15
I20260811 16:07:22.623859 23124 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:22.658367 13706 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:22.645262 23058 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.013s
I20260811 16:07:22.643009 22968 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:22.665238 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.665881 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.627461 23322 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.644212 22954 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:22.629635 23263 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:22.668573 23058 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.012s	sys 0.014s
I20260811 16:07:22.648056 23267 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.679589 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.674891 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.676805 13789 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.655526 23269 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.658228 23124 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.671957 23166 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260811 16:07:22.661397 23334 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.635960 23280 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.676964 13827 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:22.686064 23278 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:22.648758 23251 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.682785 22954 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.689006 23263 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.689471 22422 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.706781 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:22.665963 23015 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:22.674408 23138 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.660990 23303 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:22.737025 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60360.5us
I20260811 16:07:22.779474 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.741529 23344 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:22.741232 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 56394.2us
I20260811 16:07:22.749226 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.787798 13909 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.753995 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.756482 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.761675 13907 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:22.792291 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.793623 13706 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.693547 22314 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.765436 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.732152 23267 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:22.768936 13823 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:22.771895 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:22.791184 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.799443 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.772910 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.733882 23282 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:22.674918 22968 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.771315 22954 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:22.741572 23124 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:22.745194 23275 log.cc:924] Time spent T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260811 16:07:22.693255 23144 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260811 16:07:22.804514 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.810868 13825 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:22.800369 13906 raft_consensus.cc:2454] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:22.738158 23269 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:22.813082 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 180845us
I20260811 16:07:22.823415 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:22.771818 23311 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:22.817966 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.863600 13902 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 20.
I20260811 16:07:22.877318 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:22.878126 13900 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:22.878355 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97465.1us
W20260811 16:07:22.896914 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 96065.7us
I20260811 16:07:22.899663 13827 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 19. Ops: []
I20260811 16:07:22.900291 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:22.684227 23322 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.909857 13874 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.821460 22968 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:22.862447 23283 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.923301 13874 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:22.759912 23280 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.791595 23303 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.924116 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.797425 23138 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.815877 22314 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.939915 23329 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:22.940456 23342 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260811 16:07:22.940943 23342 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:22.941365 23342 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Advancing to term 29
W20260811 16:07:22.931473 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 126309us
I20260811 16:07:22.877450 23206 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.949889 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.953112 23338 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:22.958570 23138 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.960412 23303 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.962401 13904 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:23.047452 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:23.048255 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.053714 13900 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:23.065428 13821 raft_consensus.cc:1226] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:23.066570 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:23.067348 14581 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 22
I20260811 16:07:22.947702 14578 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:23.075471 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:22.960466 23280 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.954843 23338 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.102s
I20260811 16:07:22.988530 22812 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:22.934777 23283 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.998308 23350 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:22.986467 22422 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:22.920370 23015 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.107836 12383 thread.cc:536] Waited for 3000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:22.773782 23334 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:22.814273 23282 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.794906 23300 consensus_queue.cc:237] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:23.136324 23105 consensus_meta.cc:287] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260811 16:07:22.940742 23329 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:22.949462 23274 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.169551 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 246386us
I20260811 16:07:23.102769 23280 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:23.110792 23251 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.187402 14575 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260811 16:07:23.202121 13820 consensus_meta.cc:287] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.003s
I20260811 16:07:23.203528 13820 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 27.
W20260811 16:07:23.192234 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 302710us
I20260811 16:07:23.164636 23372 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:23.216447 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:23.179877 23263 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.233901 23331 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:23.129745 22812 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.189705 23166 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.231568 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.244616 13706 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:23.235072 23318 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:07:23.219834 22903 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:23.235962 23368 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.314631 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 195099us
W20260811 16:07:23.316840 23364 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260811 16:07:23.317055 23274 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.162948 23350 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.318215 23366 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260811 16:07:23.308490 23319 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260811 16:07:23.259660 23331 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.320470 23206 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:23.278546 23294 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.002s
W20260811 16:07:23.318953 23365 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260811 16:07:23.345297 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:23.347131 22812 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.349360 23283 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.217775 23280 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.335676 23263 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:23.291085 23322 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:23.364434 14575 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:23.364871 23294 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.366325 23342 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.367009 23341 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.368113 23355 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260811 16:07:23.269850 23166 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.323287 22314 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.355358 23303 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
W20260811 16:07:23.383679 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50010.8us
I20260811 16:07:23.358126 23274 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.397317 23269 consensus_meta.cc:287] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.009s
W20260811 16:07:23.314879 13909 consensus_meta.cc:287] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.000s
I20260811 16:07:23.381007 23261 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.336369 23332 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.139s
I20260811 16:07:23.424408 13909 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
W20260811 16:07:23.454015 13902 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.017s
W20260811 16:07:23.454413 13902 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.013s	sys 0.017s
W20260811 16:07:23.422746 23374 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.213s	user 0.004s	sys 0.000s
W20260811 16:07:23.470837 13709 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.022s	sys 0.013s
W20260811 16:07:23.472450 13709 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.022s	sys 0.014s
I20260811 16:07:23.423121 23251 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:23.472820 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 572571us
I20260811 16:07:23.424829 23375 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:23.436395 23283 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.437335 23310 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:23.425891 22812 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:23.425702 23206 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:23.456645 23295 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.003s
W20260811 16:07:23.483340 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.023s
W20260811 16:07:23.491379 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.009s	sys 0.023s
I20260811 16:07:23.498021 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.403743 23263 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.405768 23341 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.329005 23368 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.531695 14577 raft_consensus.cc:2396] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260811 16:07:23.439755 23269 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.495384 22954 consensus_meta.cc:287] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.001s
I20260811 16:07:23.544140 23206 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:23.586365 23301 log.cc:924] Time spent T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.708s	user 0.000s	sys 0.010s
I20260811 16:07:23.586674 23206 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.553351 23362 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:23.588325 23376 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260811 16:07:23.587787 23362 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.563469 23320 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260811 16:07:23.592053 23362 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.598021 23131 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:23.496052 23282 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:23.550558 23388 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260811 16:07:23.457675 23274 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.610006 23274 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.530685 23250 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.612393 23350 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.612558 23269 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.446738 23261 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.533223 23015 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.610085 23280 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.622319 23294 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.492189 23283 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.485628 23251 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.574647 23329 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:23.496971 23310 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.496651 23295 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.623106 23368 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.495167 22812 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.613639 23334 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.627561 23294 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.638890 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 451388us
I20260811 16:07:23.625103 23362 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:23.611032 23250 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.661562 13825 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260811 16:07:23.489950 23375 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.616217 22954 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.675521 23368 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.659574 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:23.653169 23288 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.009s	sys 0.040s
W20260811 16:07:23.698603 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:23.703377 23274 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.661141 23267 consensus_meta.cc:287] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.003s
I20260811 16:07:23.713184 13826 raft_consensus.cc:2379] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 19: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:23.714443 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:23.625232 23015 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.717782 13873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.013s
W20260811 16:07:23.713841 23288 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.747s	user 0.009s	sys 0.041s
W20260811 16:07:23.725591 13873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.001s	sys 0.013s
I20260811 16:07:23.692360 23342 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:23.738651 14575 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:23.686239 23294 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.760221 23356 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.638s	user 0.000s	sys 0.008s
I20260811 16:07:23.737237 23166 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.748683 23288 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:23.689180 23362 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:23.783952 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 331357us
I20260811 16:07:23.725275 23368 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.727035 23267 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:23.799757 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:23.808465 23263 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.728101 23274 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.724705 23303 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:23.816426 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:23.823760 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 159694us
I20260811 16:07:23.822956 13902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3564) took 1052 ms. Trace:
I20260811 16:07:23.827921 13902 rpcz_store.cc:276] 0811 16:07:22.770671 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.907283 (+136612us) service_pool.cc:227] Handling call
0811 16:07:22.907694 (+   411us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.908044 (+   350us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.908071 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:22.919748 (+ 11677us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.459830 (+540082us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:23.491343 (+ 31513us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.822645 (+331302us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.822719 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:23.822761 (+    42us) raft_consensus.cc:1671] finished
0811 16:07:23.822773 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:23.822900 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":344234,"prepare.queue_time_us":31274,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":52,"raft.queue_time_us":483599,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":27513,"thread_start_us":509501,"threads_started":1,"wal-append.queue_time_us":715930}
W20260811 16:07:23.827055 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 347112us
W20260811 16:07:23.811672 23347 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.050s	user 0.000s	sys 0.009s
I20260811 16:07:23.850787 23283 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.853600 22954 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.856158 23015 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.861572 23274 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.861865 23368 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:23.823822 23268 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.019s	sys 0.023s
W20260811 16:07:23.862933 23268 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.019s	sys 0.024s
W20260811 16:07:23.865579 22968 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.000s
I20260811 16:07:23.866251 22968 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.821424 23405 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:23.888413 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 197386us
I20260811 16:07:23.834292 23251 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.891080 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.891110 14583 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260811 16:07:23.893528 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:23.872102 23342 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.848999 23292 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.899312 14583 pending_rounds.cc:76] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 16
I20260811 16:07:23.895588 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.909369 14583 pending_rounds.cc:97] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260811 16:07:23.901276 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.909744 14583 raft_consensus.cc:2866] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:23.911607 14542 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Timed out: RequestConsensusVote RPC to 127.12.23.195:42003 timed out after 1.632s (SENT)
I20260811 16:07:23.843129 23341 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.904302 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.910166 14578 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:23.920460 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.917260 13709 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:23.888763 23295 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:23.873687 23300 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260811 16:07:23.904177 23251 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:23.939612 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:23.987977 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 160942us
I20260811 16:07:23.971427 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:23.940482 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:23.900825 23283 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:23.914245 23405 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:23.986340 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 287780us
I20260811 16:07:23.923316 23310 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:23.931105 14577 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:23.995538 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.908914 23342 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:23.999475 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:23.931748 22812 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.014216 14583 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:24.000275 13825 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:24.019448 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:23.996460 23124 consensus_meta.cc:287] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.106s	user 0.009s	sys 0.007s
I20260811 16:07:23.918795 23292 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.025674 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.027133 13825 raft_consensus.cc:2396] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260811 16:07:24.027840 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:24.003566 23375 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.087610 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.112509 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:24.081905 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 53551.7us
I20260811 16:07:24.026443 14582 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260811 16:07:24.096069 23423 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:07:24.096503 23412 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.099666 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2623) took 1482 ms. Trace:
I20260811 16:07:24.028577 23294 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.019732 22947 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:24.027681 23124 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:24.189342 23408 log.cc:924] Time spent T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.327s	user 0.002s	sys 0.001s
W20260811 16:07:24.190703 23378 log.cc:924] Time spent T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260811 16:07:24.191072 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.191891 13824 raft_consensus.cc:2354] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:07:23.999603 23303 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.018671 23405 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.103340 22968 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.104159 23401 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader election won for term 27
I20260811 16:07:23.876789 23288 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.109478 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:23.997319 23417 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:24.027667 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 100284us
I20260811 16:07:24.112972 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.117344 14579 rpcz_store.cc:276] 0811 16:07:22.617218 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.618370 (+  1152us) service_pool.cc:227] Handling call
0811 16:07:22.631640 (+ 13270us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.642574 (+ 10934us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.642623 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:23.594428 (+951805us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:23.594924 (+   496us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.833690 (+238766us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:23.833728 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.833801 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:24.099274 (+265473us) raft_consensus.cc:1671] finished
0811 16:07:24.099298 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.099573 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1211,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12436,"spinlock_wait_cycles":7962240,"thread_start_us":215679,"threads_started":1,"wal-append.queue_time_us":500565}
W20260811 16:07:24.165490 12383 thread.cc:536] Waited for 4000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:24.020994 23283 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.183907 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.185593 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.119160 23341 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260811 16:07:24.185711 23268 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.183656 23375 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.189077 23294 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:24.191221 23124 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.196091 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.101300 13821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3652) took 1448 ms. Trace:
I20260811 16:07:24.194949 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3563) took 1424 ms. Trace:
W20260811 16:07:24.200423 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 87986.6us
I20260811 16:07:24.201148 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:24.188205 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.185557 23058 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.208032 13827 raft_consensus.cc:2396] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260811 16:07:24.237978 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:24.238392 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 50267us
I20260811 16:07:24.230599 13821 rpcz_store.cc:276] 0811 16:07:22.653130 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.656794 (+  3664us) service_pool.cc:227] Handling call
0811 16:07:22.670446 (+ 13652us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.080862 (+410416us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:24.101012 (+1020150us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400240754. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:24.101232 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":893777280}
I20260811 16:07:24.228924 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:24.217322 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.243322 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.243906 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:24.245488 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:24.215046 23397 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.375s	user 0.000s	sys 0.009s
W20260811 16:07:24.247008 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51041.8us
I20260811 16:07:24.251708 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.252393 23323 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.252892 23323 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.254680 23416 raft_consensus.cc:2781] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:24.255127 13902 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260811 16:07:24.255318 23416 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.246145 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:24.256966 14583 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 18: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
W20260811 16:07:24.256896 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44230.8us
I20260811 16:07:24.248620 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.255851 23416 raft_consensus.cc:3037] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:24.263521 13909 raft_consensus.cc:1261] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260811 16:07:24.265604 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.258733 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.256366 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.259531 13817 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260811 16:07:24.213142 22812 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:24.250285 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.237248 13908 rpcz_store.cc:276] 0811 16:07:22.770323 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.884766 (+114443us) service_pool.cc:227] Handling call
0811 16:07:22.885054 (+   288us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.896126 (+ 11072us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.896176 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:22.916895 (+ 20719us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.207582 (+290687us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:23.243854 (+ 36272us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.599556 (+355702us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b48000603d8. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c567b37f1 00007f5c567aa8e7 00007f5c567aa77a 00007f5c5689e95f 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8 00007f5c568b2a58 00007f5c568b2a13 00007f5c568b1cbc 00007f5c55833be6
0811 16:07:23.778855 (+179299us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b18004710a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c4e81f990 00007f5c4e9e1864 00007f5c4e9e1155 00007f5c519043d0 00007f5c51916576 00007f5c519270d7 00007f5c51927058
0811 16:07:23.779100 (+   245us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.779210 (+   110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:23.899066 (+119856us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18004710a0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:24.194750 (+295684us) raft_consensus.cc:1671] finished
0811 16:07:24.194774 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.194894 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":298861,"prepare.queue_time_us":42479,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":6590,"raft.queue_time_us":661450,"raft.run_cpu_time_us":1761,"raft.run_wall_time_us":612598,"spinlock_wait_cycles":165320704,"thread_start_us":265314,"threads_started":1,"wal-append.queue_time_us":372595}
I20260811 16:07:24.268117 13902 raft_consensus.cc:2362] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21. Re-sending same reply.
I20260811 16:07:24.269449 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:24.261062 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.267123 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.271025 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.255899 23418 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:24.229182 22968 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:24.285742 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85685.2us
I20260811 16:07:24.245956 23124 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.268694 14541 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.270040 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.197405 23412 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.286276 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.198912 22947 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.287384 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.287801 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.233155 23401 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:24.293052 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.285575 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.260560 23300 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:24.230748 23251 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
W20260811 16:07:24.294664 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48473.6us
I20260811 16:07:24.246380 23058 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.292835 23274 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.295670 13903 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:24.295066 23286 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:24.285998 23362 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.232985 23268 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.388465 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.288702 23105 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.212589 23425 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.077s
I20260811 16:07:24.260118 23138 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:24.357283 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:24.353942 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 59539.7us
I20260811 16:07:24.289567 23322 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.212167 23417 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:24.365804 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 142260us
I20260811 16:07:24.365918 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:24.363919 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.295835 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:24.366802 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.368631 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.288916 23323 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.295158 23415 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.349578 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.350876 23428 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:24.295480 23427 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:24.413414 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.235493 23375 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.319744 23294 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:24.290073 22812 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.394841 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.394842 13907 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260811 16:07:24.410983 13909 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:24.370579 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 75127.5us
I20260811 16:07:24.294855 22968 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.351069 23368 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260811 16:07:24.295166 23124 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.405262 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.386258 23342 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.429149 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.431185 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:24.439945 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76050.1us
W20260811 16:07:24.441017 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.441519 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.414853 23428 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.422361 23294 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.452226 13821 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:24.420097 23292 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.459875 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3565) took 1688 ms. Trace:
W20260811 16:07:24.456607 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.465744 14541 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.469808 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.403366 23138 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.483974 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.453645 23428 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:24.468863 23441 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.463675 13900 rpcz_store.cc:276] 0811 16:07:22.771587 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.077077 (+305490us) service_pool.cc:227] Handling call
0811 16:07:23.089680 (+ 12603us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:23.093437 (+  3757us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:23.093477 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:23.169121 (+ 75644us) log.cc:842] Serialized 52 byte log entry
0811 16:07:23.442206 (+273085us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:23.473315 (+ 31109us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.822073 (+348758us) log.cc:842] Serialized 14 byte log entry
0811 16:07:23.822272 (+   199us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.822352 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:24.103377 (+281025us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b18004b5440. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e95b4ca 00007f5c5803cf99 00007f5c567b3088 00007f5c567aa6b1 00007f5c567aa657 00007f5c5689e978 00007f5c5689e627 00007f5c568b2b2c 00007f5c568b2ad8
0811 16:07:24.459538 (+356161us) raft_consensus.cc:1671] finished
0811 16:07:24.459572 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.459792 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":993907,"prepare.queue_time_us":31869,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5571,"raft.queue_time_us":494332,"raft.run_cpu_time_us":1814,"raft.run_wall_time_us":308155,"spinlock_wait_cycles":20387456,"thread_start_us":208752,"threads_started":1,"wal-append.queue_time_us":543262}
W20260811 16:07:24.479406 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 66138.2us
W20260811 16:07:24.468289 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.492583 13904 raft_consensus.cc:2396] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260811 16:07:24.458767 23294 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:24.612001 23397 log.cc:924] Time spent T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260811 16:07:24.688568 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 220304us
I20260811 16:07:24.720394 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.461252 23251 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:24.555876 22947 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.570437 23448 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.401836 23286 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.479696 23283 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:24.624377 23434 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260811 16:07:24.616473 23439 log.cc:924] Time spent T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260811 16:07:24.419273 23415 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.548272 13902 raft_consensus.cc:2396] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260811 16:07:24.461585 23420 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:24.571422 23444 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260811 16:07:24.623466 23436 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260811 16:07:24.543191 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:24.617784 23438 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
I20260811 16:07:24.576655 23124 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.625062 23331 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.578498 23138 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.583479 23311 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:24.479389 23405 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.580149 23268 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.553807 23441 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.555123 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.550690 13909 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:24.770150 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.735070 13709 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.726338 13821 raft_consensus.cc:2454] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 29.
I20260811 16:07:24.614279 23450 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.458959 23401 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.668520 23427 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260811 16:07:24.750415 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.787776 14577 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 18.
I20260811 16:07:24.789538 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.750896 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.790674 14583 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:24.751523 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.791275 23268 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:24.753230 13908 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:24.791718 23268 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.792176 23268 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:24.793777 23392 log.cc:924] Time spent T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.477s	user 0.001s	sys 0.003s
I20260811 16:07:24.754051 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.795635 13904 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:24.795823 23353 log.cc:924] Time spent T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 2.028s	user 0.002s	sys 0.006s
I20260811 16:07:24.796603 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.797320 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3123) took 2194 ms. Trace:
I20260811 16:07:24.797742 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.798580 13904 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:24.757893 23286 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.742988 23444 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:24.797780 13901 rpcz_store.cc:276] 0811 16:07:22.603223 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.603365 (+   142us) service_pool.cc:227] Handling call
0811 16:07:22.623781 (+ 20416us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:22.662654 (+ 38873us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.662701 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:22.663096 (+   395us) log.cc:842] Serialized 26 byte log entry
0811 16:07:23.173677 (+510581us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:23.173733 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:23.173830 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:24.793451 (+1619621us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b2400240098. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e83ccf4 00007f5c4e83adfb 00007f5c4e8c9559 00007f5c4e8c91e5 00007f5c4e8c882d 00007f5c5157746e 00007f5c5158ec0c 00007f5c5158df36 00007f5c5158db58 00007f5c51597551
0811 16:07:24.797017 (+  3566us) raft_consensus.cc:1671] finished
0811 16:07:24.797041 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:24.797258 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":91783,"raft.queue_time_us":57946,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"spinlock_wait_cycles":44173568,"thread_start_us":441803,"threads_started":1,"wal-append.queue_time_us":574460}
I20260811 16:07:24.800411 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.737950 23337 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.760114 23283 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:24.763938 23058 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.744274 23447 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:24.801612 23337 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.801865 23283 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.802553 23447 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.803460 23417 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.801599 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.804677 22968 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:24.780323 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45380.2us
I20260811 16:07:24.805694 23337 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.781201 23450 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.807648 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.807943 23447 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.808621 23450 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.809111 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.763968 23322 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:24.787669 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.810170 13909 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 19.
I20260811 16:07:24.809986 23322 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:24.810528 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.811048 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.811275 13901 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:24.812438 13909 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260811 16:07:24.812769 13901 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260811 16:07:24.813040 23274 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:24.789923 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:24.814658 13905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60522 (request call id 3554) took 2051 ms (client timeout 2641 ms). Trace:
I20260811 16:07:24.799566 23444 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:24.739269 23368 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:24.745316 23448 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.814733 13901 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 22. Current term is 23. Ops: []
I20260811 16:07:24.750604 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:24.776854 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 348393us
I20260811 16:07:24.857654 14582 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:24.832980 13908 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 23.
I20260811 16:07:24.823011 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.860354 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:24.732648 23278 consensus_queue.cc:1046] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.090s
I20260811 16:07:24.863427 23448 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.863639 23283 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:24.815040 13905 rpcz_store.cc:269] 0811 16:07:22.762894 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.822764 (+ 59870us) service_pool.cc:227] Handling call
0811 16:07:24.789808 (+1967044us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b580026c798. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9acbce 000000000034aea9 00007f5c567d8a30 00007f5c5689e7b4 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:07:24.814579 (+ 24771us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5522176}
I20260811 16:07:24.823910 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.864145 23261 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:24.866854 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:24.877305 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.872714 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:24.885152 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:24.889992 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:24.865688 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.003s	sys 0.012s
W20260811 16:07:24.895944 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.012s
I20260811 16:07:24.779973 22812 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:24.911672 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:24.908043 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 656695us
I20260811 16:07:24.820364 23415 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:24.916893 13820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.013s	sys 0.014s
W20260811 16:07:24.917402 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 492240us
I20260811 16:07:24.869299 23450 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260811 16:07:24.888634 23448 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.892774 23268 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.910602 23058 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:24.884558 23283 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:24.950917 23283 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.951443 23283 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:24.955907 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:24.948163 13871 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:24.959957 23452 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.960834 23452 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.949021 23281 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:24.965968 23281 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:24.968019 13824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3229) took 2306 ms (client timeout 2245 ms). Trace:
I20260811 16:07:24.903059 23368 raft_consensus.cc:3032] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:24.973539 13818 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
W20260811 16:07:24.968497 13824 rpcz_store.cc:269] 0811 16:07:22.661371 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.662323 (+   952us) service_pool.cc:227] Handling call
0811 16:07:24.967748 (+2305425us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540025f154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:24.967913 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3444720000}
I20260811 16:07:24.957506 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:24.981511 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.968420 23281 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.933513 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:24.934818 23429 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:24.935375 23450 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:24.994222 23450 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Advancing to term 20
W20260811 16:07:24.933038 13820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.013s	sys 0.014s
I20260811 16:07:24.937148 23448 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.998517 23448 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.936647 23441 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:24.940461 23268 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.000753 23429 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:24.942526 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:25.003979 14573 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 20
I20260811 16:07:25.007705 14582 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260811 16:07:24.937908 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.009778 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:24.942260 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.012668 14581 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:25.013827 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.011047 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.019518 23429 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:25.020879 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.013859 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.022717 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.024022 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.028318 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.032269 13789 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:24.932363 23303 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.008s	sys 0.012s
I20260811 16:07:25.043540 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:25.044958 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 63591.8us
I20260811 16:07:25.045665 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.043478 13905 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 29: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:25.045744 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.032677 14573 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:24.958766 23058 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:25.048602 13787 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:25.049031 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 92166us
W20260811 16:07:25.049403 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 115965us
I20260811 16:07:24.976085 23368 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:25.051761 23294 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:25.053299 13790 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.009s	sys 0.007s
W20260811 16:07:25.064797 13790 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.009s	sys 0.007s
W20260811 16:07:25.044972 23303 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.009s	sys 0.012s
I20260811 16:07:25.054262 23271 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260811 16:07:25.056859 23415 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:25.078779 23415 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.081051 23415 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:25.058233 13825 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.011s	sys 0.026s
I20260811 16:07:25.060101 13706 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.061499 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.086301 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.048806 23281 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:25.076205 23368 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.087491 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:25.063002 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.046598 23441 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.033149 23268 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.073982 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.066221 13874 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.079234 23294 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.054001 23322 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:25.088619 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.088907 13825 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.011s	sys 0.026s
I20260811 16:07:25.070079 13789 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.091329 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:24.949352 23420 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.109694 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:25.116178 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 53293.2us
W20260811 16:07:25.117390 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.117849 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.112483 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 46368.2us
I20260811 16:07:25.083317 22812 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.108031 23126 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:25.114202 23406 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.114895 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.060094 23295 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:25.116326 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3237) took 1084 ms. Trace:
W20260811 16:07:25.118999 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.141089 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.088260 23448 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:25.088163 23368 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:25.134924 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 65243.2us
I20260811 16:07:25.146047 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:25.139741 23124 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:25.147102 23406 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:25.151563 23448 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.151458 23450 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.153538 13824 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 20: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.154157 23448 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.155296 23452 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.155383 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1832) took 1662 ms. Trace:
I20260811 16:07:25.108448 22968 consensus_queue.cc:1035] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260811 16:07:25.156553 23450 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:25.156862 23416 consensus_meta.cc:287] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.003s
I20260811 16:07:25.157337 23416 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.158488 23375 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:25.159291 23428 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.004s
I20260811 16:07:25.087512 23281 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.159762 23428 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.160599 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.160944 14583 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:25.161563 23281 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.130874 23322 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:25.165473 23472 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:25.119187 23268 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.166906 23472 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:25.167461 23472 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:25.129653 22422 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:25.168694 23268 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.168591 23472 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.171396 23267 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.171758 13874 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:25.174527 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.174718 13789 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.175124 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3243) took 1033 ms. Trace:
I20260811 16:07:25.175549 13818 rpcz_store.cc:276] 0811 16:07:24.141930 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.417415 (+275485us) service_pool.cc:227] Handling call
0811 16:07:24.968689 (+551274us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.029632 (+ 60943us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.174933 (+145301us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540025f150. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:25.175069 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1264030464}
I20260811 16:07:25.176617 23467 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:25.176761 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.177932 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.178082 23454 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:25.178750 23454 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:25.178642 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.179483 23454 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:25.180081 23442 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:25.180505 23314 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:25.181027 23385 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:25.182485 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.185668 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.170794 23472 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:25.162763 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.196736 14583 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260811 16:07:25.179134 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.155970 14574 rpcz_store.cc:276] 0811 16:07:23.492962 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.493111 (+   149us) service_pool.cc:227] Handling call
0811 16:07:23.537214 (+ 44103us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.663598 (+126384us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:23.663630 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:23.663676 (+    46us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:23.663730 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.155102 (+1491372us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54007305d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.155196 (+    94us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.155328 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":290105728}
I20260811 16:07:25.182380 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.130771 23261 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:25.198772 23463 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.198741 23058 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.201357 23267 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:25.201928 23267 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.139772 23338 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:25.207285 12383 thread.cc:536] Waited for 5000ms trying to join with heartbeat (tid 13772)
I20260811 16:07:25.180713 23442 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:25.209463 23442 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.212247 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1831) took 1719 ms. Trace:
I20260811 16:07:25.212838 14575 rpcz_store.cc:276] 0811 16:07:23.492605 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.493469 (+   864us) service_pool.cc:227] Handling call
0811 16:07:23.536613 (+ 43144us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.764922 (+228309us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.211886 (+1446964us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400635954. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.212155 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":435818240}
I20260811 16:07:25.214380 23283 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.215831 13820 raft_consensus.cc:2379] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 25: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.216897 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.218258 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.193913 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.220324 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3661) took 1231 ms. Trace:
I20260811 16:07:25.220547 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.220911 13826 rpcz_store.cc:276] 0811 16:07:23.989089 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.992552 (+  3463us) service_pool.cc:227] Handling call
0811 16:07:23.992867 (+   315us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.390672 (+397805us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.390717 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:24.390768 (+    51us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:24.390810 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.219975 (+829165us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400174154. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.220047 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.220236 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":914308992}
I20260811 16:07:25.221868 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.223785 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.140859 23300 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260811 16:07:25.131768 23294 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.134430 22812 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.226202 14574 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 20. Ops: []
I20260811 16:07:25.222767 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.228029 22812 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.228863 23416 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.204073 23267 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.231353 23428 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.232118 23406 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260811 16:07:25.232723 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:25.233074 23406 raft_consensus.cc:3032] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:25.233471 13818 raft_consensus.cc:2354] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:07:25.234050 23464 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:25.234953 23268 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:25.235368 23268 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:25.236253 23268 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.236940 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.238129 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.238799 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.239486 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.239921 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.240731 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:25.241145 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:25.239909 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:25.242800 13826 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.243359 14581 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:25.243602 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.214710 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.245787 23283 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.132612 23420 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.246764 23322 raft_consensus.cc:2781] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader election won for term 29
I20260811 16:07:25.247390 23322 raft_consensus.cc:686] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:25.248311 23322 consensus_queue.cc:237] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.251103 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.251942 13874 leader_election.cc:398] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 election: Vote denied by peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) with higher term. Message: Invalid argument: T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18.
I20260811 16:07:25.254055 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.244278 13826 raft_consensus.cc:2454] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 19.
W20260811 16:07:25.258491 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 76202.2us
I20260811 16:07:25.259516 14542 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.249260 23420 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.278425 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:25.278527 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:25.280526 14542 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.313616 14575 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:25.314473 14542 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.268388 23314 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.233500 23406 raft_consensus.cc:729] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:25.324208 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.324944 13818 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 15.
W20260811 16:07:25.325021 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85775.2us
I20260811 16:07:25.325824 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.326574 13818 raft_consensus.cc:2379] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 29: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:25.327507 23396 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:07:25.333334 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.334486 13826 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:25.342025 23428 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:25.348066 23298 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:25.348768 23298 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:25.349211 23298 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:25.351693 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97758.6us
I20260811 16:07:25.354382 23281 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.342303 14575 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:25.361575 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 47230.5us
I20260811 16:07:25.362375 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:25.362680 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.370386 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:25.373399 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:25.261250 23268 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:25.374413 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.393124 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:25.394778 13826 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:25.399230 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:25.396515 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.400995 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.374184 23362 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.018s
I20260811 16:07:25.374432 23314 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:25.385973 23401 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:25.387118 23311 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:25.410389 13787 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.407899 23278 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:25.413391 13907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3567) took 1141 ms. Trace:
I20260811 16:07:25.427601 13907 rpcz_store.cc:276] 0811 16:07:24.271563 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.287899 (+ 16336us) service_pool.cc:227] Handling call
0811 16:07:24.288181 (+   282us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.422835 (+134654us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.413043 (+990208us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001b1054. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.413307 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":244364672}
I20260811 16:07:25.429355 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:25.433272 13907 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 23. Ops: []
I20260811 16:07:25.398119 23271 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260811 16:07:25.437350 23271 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:25.437851 23271 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:07:25.443866 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.444410 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.446187 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.447359 23311 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:25.448097 23311 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260811 16:07:25.449227 23311 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:25.449602 23311 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:25.450821 23311 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.452630 23311 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:25.423899 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:25.425453 13826 raft_consensus.cc:1261] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260811 16:07:25.459542 14575 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:25.409940 23362 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.019s
W20260811 16:07:25.435369 23444 consensus_meta.cc:287] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.006s
I20260811 16:07:25.427194 23278 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:25.437000 23454 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.494469 23464 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260811 16:07:25.466804 13787 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.415934 13909 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.015s
W20260811 16:07:25.498920 13909 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.015s
I20260811 16:07:25.498807 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.500276 13787 leader_election.cc:334] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.500734 13787 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.501896 13901 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.028s
W20260811 16:07:25.502533 13901 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.029s
W20260811 16:07:25.416348 13903 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.009s	sys 0.019s
W20260811 16:07:25.504124 13903 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.009s	sys 0.019s
I20260811 16:07:25.497517 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3126) took 1100 ms. Trace:
I20260811 16:07:25.505898 13904 rpcz_store.cc:276] 0811 16:07:24.397630 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.834424 (+436794us) service_pool.cc:227] Handling call
0811 16:07:25.247492 (+413068us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.247690 (+   198us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:25.247714 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.247767 (+    53us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:25.247800 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.247852 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.497269 (+249417us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000c7e50. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:25.497439 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":949142272}
W20260811 16:07:25.517612 13787 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.518293 13787 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.519893 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.520394 13787 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.521781 13787 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.522323 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.536397 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.537070 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.538487 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.539063 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.528324 23367 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:25.528051 22812 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.498402 23278 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:25.528084 23280 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.550235 23375 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260811 16:07:25.552927 23478 log.cc:924] Time spent T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260811 16:07:25.558425 13787 leader_election.cc:334] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.508378 23267 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:25.557253 23105 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.019s	sys 0.016s
I20260811 16:07:25.530352 23464 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.495549 23444 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.597730 23271 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.515741 23369 consensus_queue.cc:1035] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260811 16:07:25.594200 13787 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.595400 23454 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.598469 23444 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:25.559684 23441 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:25.601647 13787 leader_election.cc:334] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.602272 13707 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.019s
W20260811 16:07:25.613058 13707 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.019s
W20260811 16:07:25.613785 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 526342us
I20260811 16:07:25.605370 14575 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:25.607400 13821 raft_consensus.cc:2396] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260811 16:07:25.609140 13787 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.607842 23425 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.019s
I20260811 16:07:25.637161 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.639218 14575 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
W20260811 16:07:25.599900 23105 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.016s
W20260811 16:07:25.655790 13787 leader_election.cc:334] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.698390 13787 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:25.691097 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.010s
I20260811 16:07:25.693603 14573 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260811 16:07:25.660976 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:25.608672 23464 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:25.712427 13818 raft_consensus.cc:1226] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 18. Current term is 20. Ops: []
W20260811 16:07:25.708895 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.015s	sys 0.010s
I20260811 16:07:25.709964 14573 pending_rounds.cc:76] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Aborting all ops after (but not including) 16
W20260811 16:07:25.640702 23425 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.006s	sys 0.019s
I20260811 16:07:25.643494 23441 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:25.720944 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 60100.5us
I20260811 16:07:25.661235 23420 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:25.696938 23362 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:25.745482 14541 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.014s	sys 0.062s
W20260811 16:07:25.756824 14541 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.014s	sys 0.063s
W20260811 16:07:25.701411 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59416.2us
W20260811 16:07:25.757383 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 598935us
W20260811 16:07:25.716202 23058 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.020s	sys 0.010s
W20260811 16:07:25.759698 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.706738 23271 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:25.746462 14580 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.019s
I20260811 16:07:25.702725 23405 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:25.706378 23476 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:25.661651 23384 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260811 16:07:25.769040 14580 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.004s	sys 0.019s
I20260811 16:07:25.812772 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:25.814455 13787 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:25.876551 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 87785.7us
I20260811 16:07:25.715808 14573 pending_rounds.cc:97] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: Aborting uncommitted NO_OP operation due to leader change: 25.17
W20260811 16:07:25.877663 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 63263.8us
I20260811 16:07:25.878418 14573 raft_consensus.cc:2866] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:25.714879 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 595865us
W20260811 16:07:25.879326 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.880602 13871 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.881078 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.757263 23105 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:25.760679 23058 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.020s	sys 0.010s
I20260811 16:07:25.816176 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:25.900137 13787 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.900501 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:25.901212 13787 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:25.765412 23143 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:25.912995 13787 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:25.882241 23483 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260811 16:07:25.758131 23396 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.148s
I20260811 16:07:25.923633 23143 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.935536 23412 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.877745 23279 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:25.905112 23298 consensus_meta.cc:287] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.007s
I20260811 16:07:25.902514 23126 raft_consensus.cc:3032] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Stepping down as leader of term 15
W20260811 16:07:25.914585 23479 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260811 16:07:25.928869 22903 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:25.783324 23476 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.913676 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:25.930672 23384 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260811 16:07:25.932669 23477 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260811 16:07:25.755849 23278 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:25.876900 23464 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader election won for term 20
I20260811 16:07:25.888823 13903 raft_consensus.cc:2932] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 9 to 12, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:25.979861 23015 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260811 16:07:25.760828 23401 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.145s
I20260811 16:07:25.965276 23250 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:25.906124 23271 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:25.968240 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 152151us
I20260811 16:07:25.901980 23467 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:25.939052 23472 consensus_meta.cc:287] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.004s
I20260811 16:07:25.763124 23362 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.919598 23105 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:25.993227 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1618) took 3079 ms. Trace:
W20260811 16:07:26.001437 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 88486us
I20260811 16:07:25.965894 23298 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.923455 23442 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:26.006821 23441 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:26.016709 23435 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 1.783s	user 0.000s	sys 0.008s
I20260811 16:07:25.893587 23405 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:25.980638 23126 raft_consensus.cc:729] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:26.007496 22907 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.038611 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:26.167109 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 128794us
I20260811 16:07:26.168013 13707 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.041889 23464 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:26.140956 23286 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:26.020642 23402 raft_consensus.cc:3032] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Stepping down as leader of term 18
I20260811 16:07:26.041509 13822 rpcz_store.cc:276] 0811 16:07:22.900758 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:23.002644 (+101886us) service_pool.cc:227] Handling call
0811 16:07:23.064477 (+ 61833us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:23.292969 (+228492us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:23.293019 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:23.293085 (+    66us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:23.293138 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.979982 (+2686844us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400355554. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:25.980063 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.980284 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":524881792}
I20260811 16:07:25.975636 23279 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.042691 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.186434 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 143771us
I20260811 16:07:26.056401 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1634) took 1139 ms. Trace:
I20260811 16:07:26.187948 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:26.118083 23498 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260811 16:07:26.045212 23267 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:26.191425 13787 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.192401 13787 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.042811 23271 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.070283 23491 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.169239 23405 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
W20260811 16:07:26.156459 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 275866us
W20260811 16:07:26.205267 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.187659 13817 rpcz_store.cc:276] 0811 16:07:24.917057 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.926533 (+  9476us) service_pool.cc:227] Handling call
0811 16:07:24.927774 (+  1241us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.941450 (+ 13676us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.941488 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:24.941951 (+   463us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.407218 (+465267us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.407277 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.407373 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.054699 (+647326us) raft_consensus.cc:1671] finished
0811 16:07:26.056128 (+  1429us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.056326 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":464374,"threads_started":1,"wal-append.queue_time_us":754533}
W20260811 16:07:26.206287 13871 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.207404 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.207864 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.208086 12383 thread.cc:536] Waited for 6000ms trying to join with heartbeat (tid 13772)
W20260811 16:07:26.209038 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.209517 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.210629 13871 leader_election.cc:334] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.192919 13787 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.182680 23402 raft_consensus.cc:729] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.186627 23489 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.188896 13822 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 15 FOLLOWER]: Advancing to term 16
I20260811 16:07:26.182956 23472 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.176857 23485 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:26.212026 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.168769 23281 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:26.213258 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:26.255659 13817 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:26.214241 22903 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:26.214627 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.215485 23464 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.206614 23491 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.189952 23278 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.180737 23425 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
W20260811 16:07:26.257401 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:26.219655 23502 log.cc:924] Time spent T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260811 16:07:26.267567 13789 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.225004 23490 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260811 16:07:26.259444 23472 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.253067 23489 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:26.275665 23501 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260811 16:07:26.277735 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1635) took 1345 ms. Trace:
I20260811 16:07:26.281201 14573 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 17.
I20260811 16:07:26.283247 23405 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.211557 23390 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.309188 13789 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.297503 13822 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
I20260811 16:07:26.305209 13820 rpcz_store.cc:276] 0811 16:07:24.932780 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.009693 (+ 76913us) service_pool.cc:227] Handling call
0811 16:07:26.277463 (+1267770us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:26.277654 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":441774848}
I20260811 16:07:26.303257 14579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1731) took 1552 ms. Trace:
I20260811 16:07:26.310873 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.315054 14579 rpcz_store.cc:276] 0811 16:07:24.751192 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.751337 (+   145us) service_pool.cc:227] Handling call
0811 16:07:24.764520 (+ 13183us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.772279 (+  7759us) raft_consensus.cc:1520] Early marking committed up to index 17
0811 16:07:24.783444 (+ 11165us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.082638 (+299194us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.082692 (+    54us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.082738 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.302891 (+1220153us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b54006aefd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:26.302972 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.303168 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18522,"prepare.queue_time_us":11502,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":18918,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":17059072,"thread_start_us":280129,"threads_started":1,"wal-append.queue_time_us":622754}
I20260811 16:07:26.310818 13789 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.319666 13789 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.322239 14577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2652) took 1445 ms. Trace:
I20260811 16:07:26.323695 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3568) took 2034 ms. Trace:
I20260811 16:07:26.328652 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:26.322715 14577 rpcz_store.cc:276] 0811 16:07:24.877118 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.879373 (+  2255us) service_pool.cc:227] Handling call
0811 16:07:24.879729 (+   356us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.897522 (+ 17793us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.897551 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:24.898017 (+   466us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.225390 (+327373us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b18002fb240. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:07:25.641115 (+415725us) raft_consensus.cc:1631] Marking committed up to 16
0811 16:07:25.641162 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.641240 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.290494 (+649254us) raft_consensus.cc:1671] finished
0811 16:07:26.290513 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.322167 (+ 31654us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17362,"raft.queue_time_us":22359,"spinlock_wait_cycles":50992896,"thread_start_us":415532,"threads_started":1,"wal-append.queue_time_us":1068245}
I20260811 16:07:26.324366 13903 rpcz_store.cc:276] 0811 16:07:24.289203 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.811632 (+522429us) service_pool.cc:227] Handling call
0811 16:07:24.812131 (+   499us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.812544 (+   413us) raft_consensus.cc:1520] Early marking committed up to index 11
0811 16:07:25.508402 (+695858us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.778718 (+270316us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.888541 (+109823us) log.cc:842] Serialized 564 byte log entry
0811 16:07:25.888701 (+   160us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.138785 (+250084us) log.cc:842] Serialized 14 byte log entry
0811 16:07:26.139229 (+   444us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.143822 (+  4593us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.323483 (+179661us) raft_consensus.cc:1671] finished
0811 16:07:26.323507 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.323637 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8456,"prepare.queue_time_us":781245,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1272,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":50029,"thread_start_us":961538,"threads_started":2,"wal-append.queue_time_us":758430}
I20260811 16:07:26.200518 23267 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.316788 23497 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260811 16:07:26.341801 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.347909 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.289110 23485 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:26.301321 23486 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.198381 23105 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.353523 13871 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.308629 23349 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:26.315979 23412 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.315533 23446 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260811 16:07:26.155406 23442 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.307324 23476 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.360249 13820 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:26.375052 13817 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 22.
I20260811 16:07:26.319283 23298 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.328047 23380 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260811 16:07:26.327564 22903 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.371245 14574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2664) took 1207 ms. Trace:
I20260811 16:07:26.393028 14574 rpcz_store.cc:276] 0811 16:07:25.163967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.226946 (+ 62979us) service_pool.cc:227] Handling call
0811 16:07:25.249728 (+ 22782us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:25.249993 (+   265us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:25.250031 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.256375 (+  6344us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.696326 (+439951us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:25.696375 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.696452 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.370997 (+674545us) raft_consensus.cc:1671] finished
0811 16:07:26.371019 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.371186 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":365532,"threads_started":1,"wal-append.queue_time_us":791956}
I20260811 16:07:26.340487 23410 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.373486 14579 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:26.341764 23441 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.361068 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3677) took 1184 ms. Trace:
I20260811 16:07:26.396189 13822 rpcz_store.cc:276] 0811 16:07:25.176515 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.334365 (+1157850us) service_pool.cc:227] Handling call
0811 16:07:26.360246 (+ 25881us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.360615 (+   369us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.360650 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.360708 (+    58us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:26.360751 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.360837 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.360991 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.224555 23402 consensus_queue.cc:260] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.356989 23517 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.358573 23491 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.358093 23058 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:26.204003 23126 consensus_queue.cc:260] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.374832 23494 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
W20260811 16:07:26.378559 23311 consensus_meta.cc:287] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Time spent flushing consensus metadata: real 0.923s	user 0.014s	sys 0.001s
I20260811 16:07:26.344879 23390 consensus_queue.cc:1046] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260811 16:07:26.399334 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1640) took 1200 ms. Trace:
I20260811 16:07:26.379614 23412 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:26.381520 23329 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:26.360013 23486 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:26.411713 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 236879us
W20260811 16:07:26.401116 23268 consensus_meta.cc:287] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Time spent flushing consensus metadata: real 1.007s	user 0.013s	sys 0.002s
I20260811 16:07:26.371613 23349 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.425192 13820 raft_consensus.cc:2454] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:26.437376 13817 rpcz_store.cc:276] 0811 16:07:25.253383 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.395255 (+1141872us) service_pool.cc:227] Handling call
0811 16:07:26.398787 (+  3532us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.399006 (+   219us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.399029 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.399064 (+    35us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.399089 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.399186 (+    97us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.399278 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.438473 14578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2642) took 2417 ms. Trace:
I20260811 16:07:26.395540 23518 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260811 16:07:26.447762 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.436791 23505 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260811 16:07:26.418759 23362 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.450877 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.451983 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.403345 23407 consensus_queue.cc:1046] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:07:26.426802 23441 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:26.459846 14583 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 24. Current term is 25. Ops: []
I20260811 16:07:26.493952 14583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43028 (request call id 1836) took 1348 ms. Trace:
I20260811 16:07:26.494302 14583 rpcz_store.cc:276] 0811 16:07:25.145681 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.223418 (+ 77737us) service_pool.cc:227] Handling call
0811 16:07:26.459319 (+1235901us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.459599 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.493711 (+ 34112us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.493895 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54211840}
I20260811 16:07:26.457448 13906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3558) took 3693 ms. Trace:
I20260811 16:07:26.489789 13817 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:26.489727 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.491370 13902 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:26.496318 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.463749 23515 log.cc:924] Time spent T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260811 16:07:26.495349 13906 rpcz_store.cc:276] 0811 16:07:22.764040 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:22.876801 (+112761us) service_pool.cc:227] Handling call
0811 16:07:22.877193 (+   392us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:22.885587 (+  8394us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:22.885622 (+    35us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:22.925050 (+ 39428us) log.cc:842] Serialized 52 byte log entry
0811 16:07:25.216748 (+2291698us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b1800173b00. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c51593411 00007f5c518e05cf
0811 16:07:25.713009 (+496261us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.764688 (+ 51679us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.765244 (+   556us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.767559 (+  2315us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.457052 (+689493us) raft_consensus.cc:1671] finished
0811 16:07:26.457197 (+   145us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.457376 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28701,"prepare.queue_time_us":53754,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":63052,"raft.queue_time_us":85538,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":67951,"spinlock_wait_cycles":3533696,"thread_start_us":496027,"threads_started":1,"wal-append.queue_time_us":3061492}
I20260811 16:07:26.441423 23485 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.19, Last appended by leader: 19, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.400123 23410 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.502735 23513 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260811 16:07:26.504974 23410 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.505968 13909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3577) took 2140 ms. Trace:
I20260811 16:07:26.506448 13909 rpcz_store.cc:276] 0811 16:07:24.366657 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.813250 (+446593us) service_pool.cc:227] Handling call
0811 16:07:24.813545 (+   295us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.866577 (+ 53032us) raft_consensus.cc:1520] Early marking committed up to index 13
0811 16:07:25.499409 (+632832us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.991047 (+491638us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.991917 (+   870us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.992103 (+   186us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.001323 (+  9220us) log.cc:842] Serialized 14 byte log entry
0811 16:07:26.002799 (+  1476us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.003164 (+   365us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.505683 (+502519us) raft_consensus.cc:1671] finished
0811 16:07:26.505712 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.505878 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5636,"prepare.queue_time_us":773141,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":139,"raft.queue_time_us":51834,"raft.run_cpu_time_us":606,"raft.run_wall_time_us":48710,"thread_start_us":983684,"threads_started":2,"wal-append.queue_time_us":627475}
I20260811 16:07:26.444759 23271 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.512770 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3668) took 2397 ms. Trace:
I20260811 16:07:26.513767 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3264) took 1263 ms. Trace:
I20260811 16:07:26.513199 13827 rpcz_store.cc:276] 0811 16:07:24.115267 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.391856 (+276589us) service_pool.cc:227] Handling call
0811 16:07:24.420939 (+ 29083us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.777618 (+356679us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:24.875041 (+ 97423us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.224415 (+349374us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18002ef1e0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:07:25.747813 (+523398us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.818217 (+ 70404us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.818414 (+   197us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.818460 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.818554 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.512471 (+693917us) raft_consensus.cc:1671] finished
0811 16:07:26.512572 (+   101us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.512709 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33180,"prepare.queue_time_us":90667,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":4403,"raft.queue_time_us":225590,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":7391,"spinlock_wait_cycles":40396160,"thread_start_us":846864,"threads_started":2,"wal-append.queue_time_us":1005344}
I20260811 16:07:26.514760 23410 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.458792 23349 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:26.515403 23410 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:25.140899 13825 rpcz_store.cc:276] 0811 16:07:24.031599 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.031962 (+   363us) service_pool.cc:227] Handling call
0811 16:07:24.080756 (+ 48794us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:24.086617 (+  5861us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:24.115752 (+ 29135us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.115943 (+1000191us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.116000 (+    57us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.116057 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.116121 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:25.116258 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33599,"prepare.queue_time_us":30562,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1616,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10786,"thread_start_us":999803,"threads_started":1}
I20260811 16:07:26.516952 23267 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.517573 23410 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.517661 23472 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.518014 13825 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260811 16:07:26.518792 23489 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.399917 22903 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.518994 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3265) took 1173 ms. Trace:
I20260811 16:07:26.520841 22903 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.523774 23442 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.484720 23486 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.525568 23441 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.527799 23441 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.453151 14578 rpcz_store.cc:276] 0811 16:07:24.014498 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.015580 (+  1082us) service_pool.cc:227] Handling call
0811 16:07:24.089333 (+ 73753us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.186484 (+ 97151us) raft_consensus.cc:1520] Early marking committed up to index 14
0811 16:07:24.621228 (+434744us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b180040c780. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c552e1167 00007f5c51916807 00007f5c51925f0f 00007f5c51925e88
0811 16:07:25.063387 (+442159us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.568210 (+504823us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.568820 (+   610us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.568979 (+   159us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:25.569024 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.569121 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.421137 (+852016us) raft_consensus.cc:1671] finished
0811 16:07:26.431319 (+ 10182us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.431516 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":90583,"prepare.queue_time_us":274383,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":98148,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":19879,"spinlock_wait_cycles":13180672,"thread_start_us":893850,"threads_started":2,"wal-append.queue_time_us":927980}
I20260811 16:07:26.530900 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1642) took 1271 ms. Trace:
I20260811 16:07:26.536747 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.467003 23510 log.cc:924] Time spent T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.450s	user 0.001s	sys 0.000s
W20260811 16:07:26.465837 23473 log.cc:924] Time spent T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 1.034s	user 0.000s	sys 0.002s
I20260811 16:07:26.537019 13827 rpcz_store.cc:276] 0811 16:07:25.259406 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.514969 (+1255563us) service_pool.cc:227] Handling call
0811 16:07:26.530448 (+ 15479us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.530619 (+   171us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.530644 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.530681 (+    37us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.530707 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.530753 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.530846 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.547667 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.548864 13904 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:26.519680 13825 rpcz_store.cc:276] 0811 16:07:25.345967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.517046 (+1171079us) service_pool.cc:227] Handling call
0811 16:07:26.517700 (+   654us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:26.518547 (+   847us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.518922 (+   375us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.558399 13707 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.558286 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3683) took 1205 ms. Trace:
I20260811 16:07:26.514396 13817 rpcz_store.cc:276] 0811 16:07:25.250877 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.489280 (+1238403us) service_pool.cc:227] Handling call
0811 16:07:26.489638 (+   358us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.513528 (+ 23890us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.513716 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.559698 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.563669 14542 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.561034 13825 rpcz_store.cc:276] 0811 16:07:25.353240 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.551015 (+1197775us) service_pool.cc:227] Handling call
0811 16:07:26.551484 (+   469us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.557903 (+  6419us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.557943 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.557994 (+    51us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:26.558051 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.558117 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.558220 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.538152 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.563843 13902 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 21.
I20260811 16:07:26.568248 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.569171 13905 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 17.
I20260811 16:07:26.572317 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.576145 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 256575us
I20260811 16:07:26.551990 23401 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.576323 13787 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.576967 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.574239 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:26.626051 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49164us
I20260811 16:07:26.601742 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.599534 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.589970 13817 raft_consensus.cc:1226] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 15. Current term is 16. Ops: []
I20260811 16:07:26.628955 14544 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.601287 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.606383 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.634876 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 61088.2us
W20260811 16:07:26.637339 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 254288us
I20260811 16:07:26.638432 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3684) took 1284 ms. Trace:
I20260811 16:07:26.639204 13817 rpcz_store.cc:276] 0811 16:07:25.353662 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.562248 (+1208586us) service_pool.cc:227] Handling call
0811 16:07:26.589775 (+ 27527us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.632328 (+ 42553us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.638289 (+  5961us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.640997 14544 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.641234 13709 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:26.578926 23418 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:26.644930 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 68793.8us
I20260811 16:07:26.578891 23350 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:26.633436 23263 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:26.633805 22954 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader election won for term 16
I20260811 16:07:26.649567 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3267) took 1206 ms. Trace:
I20260811 16:07:26.651898 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.649621 23281 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:26.654940 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56292 (request call id 1707) took 1269 ms. Trace:
I20260811 16:07:26.656461 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.637586 23425 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.654455 13817 rpcz_store.cc:276] 0811 16:07:25.436953 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.640485 (+1203532us) service_pool.cc:227] Handling call
0811 16:07:26.642863 (+  2378us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.643059 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.643091 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.643133 (+    42us) raft_consensus.cc:1631] Marking committed up to 18
0811 16:07:26.643192 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.643250 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.643360 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.640324 23489 raft_consensus.cc:3037] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:26.657585 13707 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.639397 23362 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260811 16:07:26.648391 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.663465 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.666327 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.660434 13908 rpcz_store.cc:276] 0811 16:07:25.385752 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.385909 (+   157us) service_pool.cc:227] Handling call
0811 16:07:25.386401 (+   492us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 16:07:25.394429 (+  8028us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:25.394478 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 16:07:25.402646 (+  8168us) log.cc:842] Serialized 52 byte log entry
0811 16:07:25.906585 (+503939us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.928086 (+ 21501us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.928348 (+   262us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.928439 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.654703 (+726264us) raft_consensus.cc:1671] finished
0811 16:07:26.654724 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.654883 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10470,"prepare.queue_time_us":21822,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":10536,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7106,"thread_start_us":483476,"threads_started":1,"wal-append.queue_time_us":759415}
I20260811 16:07:26.666831 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.669349 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.670434 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.672367 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.675800 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.653920 23508 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.530s	user 0.004s	sys 0.001s
I20260811 16:07:26.636435 23518 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260811 16:07:26.580248 23410 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.075s
I20260811 16:07:26.677192 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.755378 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:26.678802 14578 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:26.756162 13908 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:26.650296 23429 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.651284 23442 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.650034 23344 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Leader election won for term 17
I20260811 16:07:26.662331 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.775698 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.776930 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.761094 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 113156us
I20260811 16:07:26.761482 23105 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:26.762622 14573 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:26.763321 14579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.763535 14578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.763780 23304 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.764504 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.765426 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:26.587626 23401 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.649930 23350 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:26.689996 13902 raft_consensus.cc:2379] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 21: Already voted for candidate cec0688f86d54789b9b9ecc924ddecf3 in this term.
I20260811 16:07:26.651575 22907 consensus_queue.cc:1046] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.124s
I20260811 16:07:26.804354 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:26.771670 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 123303us
I20260811 16:07:26.774179 14583 raft_consensus.cc:2379] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:26.778959 13874 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:26.769366 13822 raft_consensus.cc:1226] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260811 16:07:26.676105 23362 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:26.786938 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.652074 23329 consensus_queue.cc:1046] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.124s
I20260811 16:07:26.809705 13908 raft_consensus.cc:2454] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:26.680094 22954 raft_consensus.cc:686] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:26.649673 23267 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:26.801553 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:26.806272 13787 leader_election.cc:334] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.772899 23405 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:26.777781 23485 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.812023 13817 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:26.805703 23350 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:26.794559 23344 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:26.815793 13787 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.668466 23425 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.817318 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.819948 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.825484 13787 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.815785 13902 raft_consensus.cc:2379] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 17: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:26.826092 13787 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.827245 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.828388 13817 raft_consensus.cc:2396] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260811 16:07:26.823737 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 166248us
I20260811 16:07:26.830753 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.809895 23418 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:26.814992 23362 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:26.833922 13787 leader_election.cc:334] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.849740 13787 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:26.821012 23482 log.cc:924] Time spent T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.060s	user 0.000s	sys 0.003s
I20260811 16:07:26.848662 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:26.862800 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 64434.6us
I20260811 16:07:26.782167 23442 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.799465 23304 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.807842 23486 consensus_queue.cc:1046] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260811 16:07:26.824575 23263 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:26.841934 23520 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260811 16:07:26.846313 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.842485 23268 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:26.842335 23441 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:26.842549 23329 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:26.913614 13817 raft_consensus.cc:2396] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260811 16:07:26.849221 23372 raft_consensus.cc:3032] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:26.914242 23372 raft_consensus.cc:729] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.915231 23372 consensus_queue.cc:260] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.844349 23485 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.916360 23372 raft_consensus.cc:3037] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:26.892777 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 44230.3us
I20260811 16:07:26.918437 23485 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.919485 23401 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:26.920065 23401 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:26.825138 23528 raft_consensus.cc:3032] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Stepping down as leader of term 24
I20260811 16:07:26.849058 23405 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:26.849167 23310 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:26.924873 23310 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.891222 23105 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:26.870438 23286 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260811 16:07:26.928248 23105 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.930122 23286 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Stepping down as leader of term 19
I20260811 16:07:26.923280 22954 consensus_queue.cc:237] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:26.932051 23527 log.cc:924] Time spent T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260811 16:07:26.933619 23534 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260811 16:07:26.849956 23418 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.937799 23418 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.940734 23304 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.941349 23540 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:26.901093 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.943687 23310 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.904284 14580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2653) took 2026 ms. Trace:
I20260811 16:07:26.944252 14580 rpcz_store.cc:276] 0811 16:07:24.877424 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.877974 (+   550us) service_pool.cc:227] Handling call
0811 16:07:24.878256 (+   282us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.907942 (+ 29686us) raft_consensus.cc:1520] Early marking committed up to index 15
0811 16:07:24.934372 (+ 26430us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.227393 (+293021us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b180033b560. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9e4638 00007f5c4e9e7b11 00007f5c4e9e7ac9 00007f5c4e9e7a59 00007f5c4e9e7a21 00007f5c4e9e6d1d 00007f5c57c48204 00007f5c57c48039 00007f5c4e9c6dc6
0811 16:07:25.228116 (+   723us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180033b560. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e3e22 00007f5c5158d5bb 00007f5c51593063 00007f5c5159357b 00007f5c5191688a
0811 16:07:25.785737 (+557621us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:25.877360 (+ 91623us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.888621 (+ 11261us) raft_consensus.cc:1631] Marking committed up to 15
0811 16:07:25.888672 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.888769 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.544486 (+655717us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:26.904058 (+359572us) raft_consensus.cc:1671] finished
0811 16:07:26.904094 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.904224 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18729,"prepare.queue_time_us":10100,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":73052,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":68353,"spinlock_wait_cycles":59394432,"thread_start_us":557300,"threads_started":1,"wal-append.queue_time_us":1188970}
I20260811 16:07:26.946827 23441 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260811 16:07:26.947345 23531 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260811 16:07:26.947000 23350 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.859711 23344 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.868712 23464 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:26.911777 23268 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.960737 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.961422 13817 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:26.930673 23286 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.909192 23263 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:26.948882 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3248) took 1875 ms. Trace:
I20260811 16:07:26.949671 23425 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:26.952562 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3685) took 1598 ms. Trace:
I20260811 16:07:26.971302 13825 rpcz_store.cc:276] 0811 16:07:25.353986 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.564673 (+1210687us) service_pool.cc:227] Handling call
0811 16:07:26.951858 (+387185us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.952049 (+   191us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.952255 (+   206us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.952282 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.952324 (+    42us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.952355 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.952408 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.952505 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":61482240}
I20260811 16:07:26.972680 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.867878 13787 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.953790 14582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43030 (request call id 2666) took 1750 ms. Trace:
I20260811 16:07:26.923650 23528 raft_consensus.cc:729] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:26.824332 23267 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:26.956878 13901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3582) took 2551 ms. Trace:
I20260811 16:07:26.958161 23489 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260811 16:07:26.983361 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:26.845731 14541 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 122 similar messages]
I20260811 16:07:26.962327 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:26.962990 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.963852 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3266) took 1617 ms. Trace:
I20260811 16:07:26.962078 23268 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:26.967440 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 98920.5us
I20260811 16:07:26.973486 13825 raft_consensus.cc:2396] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260811 16:07:26.955402 13789 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:26.974985 13787 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.969144 13823 rpcz_store.cc:276] 0811 16:07:25.073185 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.074738 (+  1553us) service_pool.cc:227] Handling call
0811 16:07:25.083908 (+  9170us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.227330 (+143422us) raft_consensus.cc:1520] Early marking committed up to index 10
0811 16:07:25.227646 (+   316us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.689452 (+461806us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:25.689519 (+    67us) raft_consensus.cc:1631] Marking committed up to 10
0811 16:07:25.689568 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.948575 (+1259007us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540029fc54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:26.948649 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.948823 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4737,"prepare.queue_time_us":851,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":68,"raft.queue_time_us":1569,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4550,"spinlock_wait_cycles":329229056,"thread_start_us":461368,"threads_started":1,"wal-append.queue_time_us":672146}
I20260811 16:07:26.989832 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.990307 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:26.973749 14582 rpcz_store.cc:276] 0811 16:07:25.203768 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.232477 (+ 28709us) service_pool.cc:227] Handling call
0811 16:07:26.953116 (+1720639us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.953314 (+   198us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.953496 (+   182us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.953524 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.953563 (+    39us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.953594 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.953644 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.953737 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":42250496}
I20260811 16:07:26.991132 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3268) took 1528 ms. Trace:
I20260811 16:07:26.992151 13823 rpcz_store.cc:276] 0811 16:07:25.462988 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.990337 (+1527349us) service_pool.cc:227] Handling call
0811 16:07:26.990643 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.990823 (+   180us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.990848 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.990886 (+    38us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.990915 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.990966 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.991065 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.992661 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3687) took 1526 ms. Trace:
W20260811 16:07:26.992940 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.993440 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.993783 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50506 (request call id 1643) took 1441 ms. Trace:
I20260811 16:07:26.977929 13901 rpcz_store.cc:276] 0811 16:07:24.405899 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.861595 (+455696us) service_pool.cc:227] Handling call
0811 16:07:24.861991 (+   396us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:24.907042 (+ 45051us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:24.907179 (+   137us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:24.912694 (+  5515us) log.cc:842] Serialized 26 byte log entry
0811 16:07:25.503447 (+590753us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:25.883758 (+380311us) log.cc:842] Serialized 14 byte log entry
0811 16:07:25.901962 (+ 18204us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:25.902073 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:26.601585 (+699512us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b44000232cc. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e8f6a95 00007f5c4e8f74b2 00007f5c5159f511 00007f5c5159ae1a 00007f5c5158ebee 00007f5c5158df36 00007f5c5158db58 00007f5c51597551 00007f5c51597509 00007f5c51597499
0811 16:07:26.956600 (+355015us) raft_consensus.cc:1671] finished
0811 16:07:26.956708 (+   108us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.956821 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56033,"prepare.queue_time_us":207203,"prepare.run_cpu_time_us":9109,"prepare.run_wall_time_us":21436,"raft.queue_time_us":75482,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":14055,"spinlock_wait_cycles":17995520,"thread_start_us":892167,"threads_started":2,"wal-append.queue_time_us":765212}
I20260811 16:07:26.994316 23288 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:26.994812 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.984802 13827 rpcz_store.cc:276] 0811 16:07:25.346335 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.547107 (+1200772us) service_pool.cc:227] Handling call
0811 16:07:26.950661 (+403554us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5800003998. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c568622b0 00007f5c5684d7f9 00007f5c5684d2a2 00007f5c4ff33684
0811 16:07:26.950891 (+   230us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.951090 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.951118 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.963522 (+ 12404us) raft_consensus.cc:1631] Marking committed up to 9
0811 16:07:26.963574 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.963654 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.963788 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":65134976}
I20260811 16:07:26.994148 13823 rpcz_store.cc:276] 0811 16:07:25.552055 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.993072 (+1441017us) service_pool.cc:227] Handling call
0811 16:07:26.993355 (+   283us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.993516 (+   161us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.993540 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.993587 (+    47us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:26.993612 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.993656 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.993737 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:26.984083 14580 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
W20260811 16:07:26.984586 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 138904us
I20260811 16:07:26.996203 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3269) took 1443 ms. Trace:
I20260811 16:07:26.996531 13827 rpcz_store.cc:276] 0811 16:07:25.553033 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.995480 (+1442447us) service_pool.cc:227] Handling call
0811 16:07:26.995772 (+   292us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.995927 (+   155us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.995948 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.995982 (+    34us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.996009 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.996070 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.996157 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:26.997385 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:26.990674 23407 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:26.997754 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.998713 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.999289 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:26.999521 23407 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:26.999714 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3688) took 1362 ms. Trace:
I20260811 16:07:27.000087 13823 rpcz_store.cc:276] 0811 16:07:25.637121 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.998943 (+1361822us) service_pool.cc:227] Handling call
0811 16:07:26.999245 (+   302us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.999407 (+   162us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.999436 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.999471 (+    35us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:26.999497 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.999547 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.999666 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:07:27.000841 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.001261 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:27.002430 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.003260 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.003654 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.005055 23407 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:26.987025 23528 consensus_queue.cc:260] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.008383 23263 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.008613 23528 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:27.011547 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 56232.3us
I20260811 16:07:27.012413 13709 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:26.997795 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:26.998577 13907 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:27.015511 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:26.993247 13825 rpcz_store.cc:276] 0811 16:07:25.466530 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.991692 (+1525162us) service_pool.cc:227] Handling call
0811 16:07:26.992054 (+   362us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.992271 (+   217us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.992312 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.992372 (+    60us) raft_consensus.cc:1631] Marking committed up to 12
0811 16:07:26.992417 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:26.992483 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:26.992597 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:07:27.017444 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:27.019685 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 180464us
W20260811 16:07:27.019728 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:27.023412 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 155564us
I20260811 16:07:27.023684 13817 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:27.025098 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:27.026598 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.026957 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:27.017686 14541 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.018591 22907 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.029935 23298 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:27.030469 23298 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:27.030856 23298 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:27.024204 22954 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:27.032150 23362 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.027382 23441 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:07:27.037722 23532 log.cc:924] Time spent T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260811 16:07:27.039340 23533 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260811 16:07:27.040403 23298 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.043520 23442 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.046558 23267 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.046923 23298 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.047220 22947 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.051483 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.055670 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.057778 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 45456.1us
I20260811 16:07:27.021157 23268 raft_consensus.cc:2781] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election won for term 26
W20260811 16:07:27.062481 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.066277 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.066524 13902 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260811 16:07:27.066886 13902 pending_rounds.cc:76] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 16
I20260811 16:07:27.067211 13902 pending_rounds.cc:97] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260811 16:07:27.067520 13902 raft_consensus.cc:2866] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:27.023674 23281 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:27.070204 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:27.077371 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.078372 13909 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:27.081036 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.082583 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.084602 13901 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
I20260811 16:07:27.085570 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.057703 23362 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.087455 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.080415 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.091301 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:27.092337 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.092734 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.064504 23418 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:27.083029 23298 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:27.098649 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:07:27.099647 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.100199 12383 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:27.100301 13909 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:27.101356 12383 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:27.103510 23058 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:27.103969 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.104423 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.104964 13827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3270) took 1489 ms. Trace:
I20260811 16:07:27.106369 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:27.107832 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033357
I20260811 16:07:27.108337 23350 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.105136 23058 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:27.109210 23537 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260811 16:07:27.109315 23281 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.024071 23286 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.084139 23268 raft_consensus.cc:686] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:27.088536 23407 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:27.117369 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.105541 13827 rpcz_store.cc:276] 0811 16:07:25.615106 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.997365 (+1382259us) service_pool.cc:227] Handling call
0811 16:07:26.997675 (+   310us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:27.012080 (+ 14405us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:27.012118 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:27.020883 (+  8765us) log.cc:842] Serialized 26 byte log entry
0811 16:07:27.102152 (+ 81269us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:27.102209 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.102304 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:27.104616 (+  2312us) raft_consensus.cc:1671] finished
0811 16:07:27.104642 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:27.104879 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14035,"raft.queue_time_us":25050,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":17508,"threads_started":1,"wal-append.queue_time_us":45054}
I20260811 16:07:27.111297 23267 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260811 16:07:27.115012 23286 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:27.115888 23268 consensus_queue.cc:237] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.121869 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:27.132259 23143 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:27.139959 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:27.122361 13909 raft_consensus.cc:2454] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
I20260811 16:07:27.141239 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.142403 14542 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:27.142699 13827 raft_consensus.cc:2379] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 24: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:27.143606 23447 raft_consensus.cc:2781] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election won for term 18
I20260811 16:07:27.095901 23288 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.144196 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:27.106745 23298 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.145787 23298 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.113313 23441 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260811 16:07:27.148401 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57618.2us
I20260811 16:07:27.150691 12383 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:27.151862 13824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1636) took 2218 ms. Trace:
I20260811 16:07:27.152231 13824 rpcz_store.cc:276] 0811 16:07:24.933167 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.045494 (+112327us) service_pool.cc:227] Handling call
0811 16:07:27.151627 (+2106133us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002dd2d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.151801 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":244100352}
I20260811 16:07:27.155378 23544 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.156108 13900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60510 (request call id 768) took 2290 ms. Trace:
I20260811 16:07:27.155880 23544 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.156474 13900 rpcz_store.cc:276] 0811 16:07:24.866128 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:24.905359 (+ 39231us) service_pool.cc:227] Handling call
0811 16:07:27.155534 (+2250175us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400142b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c56851c6e 00007f5c4ff48807 00007f5c4ff48792 00007f5c4ff486c1 00007f5c4ff4863c 00007f5c4ff478f2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.156012 (+   478us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2744029568}
I20260811 16:07:27.157994 23544 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.149670 23441 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.158813 23441 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.159425 13826 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 19. Current term is 20. Ops: []
I20260811 16:07:27.160148 13706 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.160795 13826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3260) took 2072 ms. Trace:
I20260811 16:07:27.161144 13826 rpcz_store.cc:276] 0811 16:07:25.088246 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.531688 (+443442us) service_pool.cc:227] Handling call
0811 16:07:27.159237 (+1627549us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:27.159843 (+   606us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.160629 (+   786us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002dd2d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.160743 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3674265344}
I20260811 16:07:27.161532 23401 raft_consensus.cc:2684] T 583cc1a296dd4344b3aaf399b8d5b17f P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Received pre-election callback for term 21 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 16:07:27.162686 23267 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:27.163291 23267 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.167100 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.168033 14574 raft_consensus.cc:2396] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260811 16:07:27.169387 23283 raft_consensus.cc:482] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:27.169930 23283 raft_consensus.cc:504] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.166033 23267 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.171550 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.172142 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.176051 14544 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.178707 13817 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260811 16:07:27.180362 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.144117 23447 raft_consensus.cc:686] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:27.186131 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 162010us
I20260811 16:07:27.167037 23126 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 15 FOLLOWER]: Advancing to term 16
W20260811 16:07:27.204617 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.206043 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 139630us
W20260811 16:07:27.205397 13787 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.218907 23310 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:27.144027 23350 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.224284 14582 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260811 16:07:27.225055 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.226133 23442 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.230338 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.182580 23349 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260811 16:07:27.252668 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99857.2us
I20260811 16:07:27.233016 23283 leader_election.cc:288] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.233848 23447 consensus_queue.cc:237] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.234202 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02554b9e1cd54e1dbcfb941296b23093" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.235340 13787 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.237182 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.248654 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:27.253638 14573 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 25: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:27.253747 13707 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.181828 23429 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.261910 13787 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.263017 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.272732 13824 raft_consensus.cc:1226] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 25. Current term is 26. Ops: []
W20260811 16:07:27.278291 23556 log.cc:924] Time spent T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260811 16:07:27.255402 23442 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.257009 23401 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.284237 23401 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.273972 23283 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
W20260811 16:07:27.286832 13821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40908 (request call id 3253) took 2201 ms (client timeout 1513 ms). Trace:
W20260811 16:07:27.290413 13821 rpcz_store.cc:269] 0811 16:07:25.085388 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.160334 (+ 74946us) service_pool.cc:227] Handling call
0811 16:07:27.286633 (+2126299us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400354b54. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.286768 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1008393984}
I20260811 16:07:27.291778 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.288477 23279 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.264133 23263 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:27.301928 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.307453 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.273689 23525 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.252460 23350 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:27.313766 13871 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:27.269333 23528 consensus_queue.cc:1046] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260811 16:07:27.293781 23554 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:27.302655 23543 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.305961 23472 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:27.310032 23522 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.309185 23442 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.314855 23384 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.337563 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.339996 14575 raft_consensus.cc:2379] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:27.348393 23402 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:27.321147 23554 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.317363 23489 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260811 16:07:27.360751 23350 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.351131 23385 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:27.352334 23401 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.351051 23522 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.338404 23472 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.355105 23441 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.332245 23543 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.378180 23138 raft_consensus.cc:3032] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:27.378481 12383 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:27.380071 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.399401 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.401228 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.410784 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.414316 13907 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260811 16:07:27.414875 13907 pending_rounds.cc:76] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 14
I20260811 16:07:27.415414 13907 pending_rounds.cc:97] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260811 16:07:27.415773 13907 raft_consensus.cc:2866] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:27.418706 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 146401us
I20260811 16:07:27.420461 13826 raft_consensus.cc:1226] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:27.387615 23554 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:27.396705 23138 raft_consensus.cc:729] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:27.444810 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.446580 14542 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:27.454198 13787 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.423659 23331 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.468042 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:27.472326 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48663us
W20260811 16:07:27.472306 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 133145us
W20260811 16:07:27.465548 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 203163us
I20260811 16:07:27.474550 12383 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:27.481838 14583 raft_consensus.cc:1226] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:27.483448 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.484058 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.483588 23406 consensus_queue.cc:260] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.484459 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.485077 23406 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:27.485275 23543 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.488709 23464 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:27.490595 13822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3263) took 2263 ms. Trace:
I20260811 16:07:27.490954 13822 rpcz_store.cc:276] 0811 16:07:25.226972 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.397215 (+1170243us) service_pool.cc:227] Handling call
0811 16:07:26.399712 (+  2497us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:26.807489 (+407777us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.490374 (+682885us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400385254. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.490539 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":823049472}
I20260811 16:07:27.492388 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:27.493283 14581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43030 (request call id 2667) took 2254 ms (client timeout 2018 ms). Trace:
W20260811 16:07:27.493647 14581 rpcz_store.cc:269] 0811 16:07:25.238798 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.244193 (+  5395us) service_pool.cc:227] Handling call
0811 16:07:27.492226 (+2248033us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b5800004b98. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c5689e79b 00007f5c5689e821 00007f5c5684e1b0 00007f5c5684da94 00007f5c4ff35c04 00007f5c4ff35b92
0811 16:07:27.493182 (+   956us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15012736}
I20260811 16:07:27.496002 13903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3583) took 1050 ms. Trace:
I20260811 16:07:27.496759 23485 consensus_queue.cc:1046] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:27.497303 13818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3250) took 2423 ms. Trace:
I20260811 16:07:27.497773 23485 consensus_queue.cc:1225] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer 5f46150fac70458986206ec7af67a403 log is divergent from this leader: its last log entry 26.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260811 16:07:27.497725 13818 rpcz_store.cc:276] 0811 16:07:25.073944 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:25.329062 (+255118us) service_pool.cc:227] Handling call
0811 16:07:25.329355 (+   293us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:25.716871 (+387516us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.497048 (+1780177us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54002ab7d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.497241 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":880497920}
I20260811 16:07:27.496405 13903 rpcz_store.cc:276] 0811 16:07:26.445532 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.446566 (+  1034us) service_pool.cc:227] Handling call
0811 16:07:26.446882 (+   316us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:26.520101 (+ 73219us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:26.520137 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0811 16:07:26.520176 (+    39us) raft_consensus.cc:1631] Marking committed up to 17
0811 16:07:26.520204 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.495779 (+975575us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b5400022bd4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.495826 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:27.495946 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":167951104}
I20260811 16:07:27.477605 22621 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.477020 23267 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:27.507030 23362 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:27.507613 23362 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.451923 23279 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260811 16:07:27.507952 23543 consensus_queue.cc:1046] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:27.509807 23362 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.509860 23401 raft_consensus.cc:3032] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
I20260811 16:07:27.510419 23401 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:27.454384 23525 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:27.511300 23401 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.513268 23401 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.513772 22621 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.514343 22621 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.516091 23441 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:27.516453 22621 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:27.519300 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:27.524134 13787 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.525449 13787 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.525977 13787 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.526973 23405 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260811 16:07:27.529503 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.530387 13825 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 18.
W20260811 16:07:27.528800 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.531780 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 472735us
W20260811 16:07:27.532892 14541 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.535394 14541 leader_election.cc:334] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.536495 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.536945 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.538285 23271 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.542327 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50506 (request call id 1646) took 1317 ms. Trace:
I20260811 16:07:27.542932 13820 rpcz_store.cc:276] 0811 16:07:26.224789 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.311041 (+ 86252us) service_pool.cc:227] Handling call
0811 16:07:27.542080 (+1231039us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54000983d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c519102ae 00007f5c5684dc27 00007f5c4ff35c04 00007f5c4ff35b92 00007f5c4ff35ac1 00007f5c4ff35a3c 00007f5c4ff34cf2 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.542242 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":70453504}
I20260811 16:07:27.545811 23472 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.546649 23138 consensus_queue.cc:260] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.544569 13826 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260811 16:07:27.548431 13826 pending_rounds.cc:76] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 11
I20260811 16:07:27.548696 13826 pending_rounds.cc:97] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260811 16:07:27.548960 13826 raft_consensus.cc:2866] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:27.551014 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:27.552104 14544 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:27.553630 22954 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:27.554090 22954 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:27.554476 22954 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:27.557734 23385 raft_consensus.cc:3032] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Stepping down as leader of term 25
I20260811 16:07:27.558362 23385 raft_consensus.cc:729] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:27.548049 23138 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:27.545549 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.560577 13820 raft_consensus.cc:1226] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:27.560930 23390 raft_consensus.cc:3032] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:27.561445 23390 raft_consensus.cc:729] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:27.567303 13820 raft_consensus.cc:1261] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260811 16:07:27.568578 23271 raft_consensus.cc:2781] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:27.568915 13908 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Advancing to term 20
I20260811 16:07:27.569372 23271 raft_consensus.cc:686] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:27.547464 13823 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
W20260811 16:07:27.532572 13787 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:27.584616 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 295459us
W20260811 16:07:27.585384 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52842.5us
I20260811 16:07:27.586067 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:27.587020 13787 leader_election.cc:334] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.587700 13787 leader_election.cc:302] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.591781 13820 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260811 16:07:27.592046 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.592941 13787 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.597908 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.598706 13818 raft_consensus.cc:1261] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260811 16:07:27.597949 13908 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:27.604370 23420 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:27.609226 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:27.595911 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:27.612411 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 192626us
I20260811 16:07:27.614125 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.616740 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.589321 23540 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:27.623821 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.624615 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:27.562474 23390 consensus_queue.cc:260] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.632122 13787 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.593511 23442 raft_consensus.cc:2726] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:27.641325 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:27.644430 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.648036 22621 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:27.650883 13787 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:27.587277 23298 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.648753 22621 consensus_queue.cc:1035] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260811 16:07:27.694226 23522 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:27.650079 23267 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:27.649950 23369 consensus_queue.cc:1046] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260811 16:07:27.646184 23446 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:27.645649 23271 consensus_queue.cc:237] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.600140 23407 consensus_queue.cc:1035] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260811 16:07:27.599920 23385 consensus_queue.cc:260] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.645910 23441 consensus_queue.cc:1046] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.158s
I20260811 16:07:27.781193 13905 raft_consensus.cc:2396] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
W20260811 16:07:27.803731 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 190705us
W20260811 16:07:27.810660 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 164900us
I20260811 16:07:27.817222 14575 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: []
I20260811 16:07:27.817703 13907 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260811 16:07:27.743328 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:27.820173 13906 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260811 16:07:27.727754 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 86578.5us
I20260811 16:07:27.632057 23544 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:27.822124 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:27.818708 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:27.810077 23126 consensus_meta.cc:287] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.003s
I20260811 16:07:27.638525 23565 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:27.777733 23525 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:27.768992 23543 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:27.781720 23267 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:27.776329 23331 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:27.843410 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:27.864573 13902 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:27.845045 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:27.846279 13907 raft_consensus.cc:1261] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260811 16:07:27.686057 23396 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.146s
I20260811 16:07:27.859500 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:27.861119 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:27.827339 23522 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.819257 23410 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.639731 23540 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.876578 13906 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
W20260811 16:07:27.858673 22947 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.044s	sys 0.047s
I20260811 16:07:27.843565 23385 raft_consensus.cc:3037] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:07:27.880393 22947 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.044s	sys 0.048s
I20260811 16:07:27.888782 13908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60520 (request call id 3161) took 1133 ms. Trace:
I20260811 16:07:27.889429 13908 rpcz_store.cc:276] 0811 16:07:26.755579 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:26.814751 (+ 59172us) service_pool.cc:227] Handling call
0811 16:07:26.815107 (+   356us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:27.604331 (+789224us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.888435 (+284104us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54002ad5d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:27.888698 (+   263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1733344512}
I20260811 16:07:27.901816 13823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3273) took 1702 ms. Trace:
I20260811 16:07:27.902447 13823 rpcz_store.cc:276] 0811 16:07:26.199727 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.003218 (+803491us) service_pool.cc:227] Handling call
0811 16:07:27.547204 (+543986us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:27.588985 (+ 41781us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:27.901565 (+312580us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000983d0. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190ba09 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86 00007f5c4fd3572f
0811 16:07:27.901722 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1250310912}
I20260811 16:07:27.911661 23344 raft_consensus.cc:3032] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:27.912143 23344 raft_consensus.cc:729] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:27.912931 23344 consensus_queue.cc:260] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.921578 13902 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:27.792346 22954 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.853986 23567 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.777572 23554 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:27.942613 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 325016us
I20260811 16:07:27.839246 23446 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260811 16:07:27.950872 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 66775.9us
I20260811 16:07:27.939612 23567 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:27.968516 14582 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260811 16:07:27.943979 23401 raft_consensus.cc:482] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.964088 23429 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:27.971936 23429 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.974115 23429 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:27.984033 23278 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.984848 23278 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.988157 23368 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:27.988813 23368 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.992189 23543 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:07:27.929456 23267 consensus_queue.cc:1035] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260811 16:07:27.880486 23410 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:28.005868 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 50220.1us
I20260811 16:07:27.880439 23522 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:27.960711 23441 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260811 16:07:28.025434 22954 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:28.025650 23571 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260811 16:07:27.984061 23344 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:28.047291 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 45084.4us
I20260811 16:07:28.012723 23329 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.050500 13706 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.053869 13789 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:28.003469 23401 raft_consensus.cc:504] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.032119 23298 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.084667 13706 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.095162 12383 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:28.043800 23278 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.101619 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.105634 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:28.116426 14541 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.024s	sys 0.039s
W20260811 16:07:28.117165 14541 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.025s	sys 0.039s
I20260811 16:07:28.091845 23414 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260811 16:07:28.123018 14582 raft_consensus.cc:1226] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:28.094581 23267 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:28.128780 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.130079 14573 raft_consensus.cc:1226] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:28.048333 23368 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.078074 23441 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260811 16:07:28.123592 14583 raft_consensus.cc:1226] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 17. Current term is 19. Ops: [17.16-17.16]
I20260811 16:07:28.111636 23420 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:28.142212 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.144411 13818 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 27.
I20260811 16:07:28.122395 23540 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:28.142338 14542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.028s
W20260811 16:07:28.152992 14542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.009s	sys 0.029s
I20260811 16:07:28.071211 23329 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.161424 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:28.163451 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.139192 23267 raft_consensus.cc:686] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:28.166944 23522 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.149478 23554 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.168434 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.125991 23128 consensus_queue.cc:1046] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260811 16:07:28.148348 23331 raft_consensus.cc:482] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.194948 14583 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:07:28.204119 23572 log.cc:924] Time spent T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260811 16:07:28.204834 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 595706us
I20260811 16:07:28.154659 23401 leader_election.cc:288] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.236214 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:28.237293 13818 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:28.223608 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.224220 13817 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260811 16:07:28.187594 23576 log.cc:924] Time spent T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260811 16:07:28.253819 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:28.254832 13901 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:28.207410 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:28.235301 13822 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260811 16:07:28.238466 13824 raft_consensus.cc:2454] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:28.257720 13823 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:28.259626 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.277176 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.278350 13824 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
W20260811 16:07:28.227898 23271 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.001s	sys 0.040s
I20260811 16:07:28.215369 23567 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.284371 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:28.285276 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.288568 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:28.289402 13909 raft_consensus.cc:3037] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:28.300854 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e29247552943ad9bfa10e83e0dc5dd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.302641 23271 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.001s	sys 0.040s
I20260811 16:07:28.304365 14581 raft_consensus.cc:1226] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Rejecting Update request from peer 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260811 16:07:28.246083 23522 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.312357 14582 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:28.295619 23298 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260811 16:07:28.236917 23331 raft_consensus.cc:504] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.317476 23522 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.317880 23267 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.343408 23583 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.048s
I20260811 16:07:28.370440 23425 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:28.375000 23574 log.cc:924] Time spent T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260811 16:07:28.310184 23464 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.377054 23464 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.377110 13909 raft_consensus.cc:2396] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260811 16:07:28.328550 14583 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
W20260811 16:07:28.383438 23573 log.cc:924] Time spent T 85bed8270f474c2e80653bbdc5806659 P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
W20260811 16:07:28.348068 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:28.343993 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:28.346382 13617 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.644s	user 0.012s	sys 0.043s
I20260811 16:07:28.343673 13901 raft_consensus.cc:2454] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:28.351107 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.391782 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 47920.2us
I20260811 16:07:28.392585 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.390214 13823 raft_consensus.cc:2454] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 19.
I20260811 16:07:28.393846 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:28.394040 14544 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:28.394917 23536 raft_consensus.cc:2781] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:28.395470 23536 raft_consensus.cc:482] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:28.354990 14582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.400136 13709 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.394246 14542 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:28.407052 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 426004us
I20260811 16:07:28.407364 13709 leader_election.cc:302] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.415000 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.415001 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 285918us
I20260811 16:07:28.353638 23522 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.350255 23331 leader_election.cc:288] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.405797 23536 raft_consensus.cc:3037] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:28.344163 23441 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.076s
I20260811 16:07:28.348929 23565 consensus_queue.cc:1046] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.166s
I20260811 16:07:28.405622 23281 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:28.416975 22954 raft_consensus.cc:2781] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:28.666621 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.666968 13818 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:28.411243 23583 raft_consensus.cc:2781] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:28.419431 23567 raft_consensus.cc:2726] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:28.417475 23274 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:28.667940 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:28.668730 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 248342us
W20260811 16:07:28.802449 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:28.802650 23274 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:28.802933 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:28.410094 23015 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:28.803699 23015 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:28.803982 23015 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:28.335506 23298 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:28.672780 13871 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.001s	sys 0.013s
W20260811 16:07:28.807479 13871 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.001s	sys 0.013s
W20260811 16:07:28.807941 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 648622us
W20260811 16:07:28.802449 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 353807us
I20260811 16:07:28.810261 13709 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:28.672711 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 252038us
I20260811 16:07:28.811602 13707 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:28.811941 23058 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.813071 13707 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:28.743216 23565 consensus_queue.cc:1225] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer 8d98491a0db549d0b671b60b90c9cdea log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260811 16:07:28.752146 23329 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.685771 23579 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.817137 23015 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.756772 23485 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.818265 23579 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.818958 23329 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.818675 23485 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:28.819808 23015 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.671890 23368 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:28.822561 23368 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.807435 23298 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:28.819547 23329 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.820895 23579 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:28.717638 23464 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.752557 12383 tablet_replica.cc:330] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:28.821010 23281 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:28.821023 23485 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:28.687750 23267 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.834249 23414 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:28.787984 23286 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.838773 23410 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.839249 22954 raft_consensus.cc:686] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:28.857640 23138 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:28.839883 23593 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:07:28.841526 23592 log.cc:924] Time spent T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260811 16:07:28.841575 13820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40908 (request call id 3299) took 1026 ms. Trace:
I20260811 16:07:28.867530 13820 rpcz_store.cc:276] 0811 16:07:27.814708 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.814914 (+   206us) service_pool.cc:227] Handling call
0811 16:07:27.834276 (+ 19362us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:28.030132 (+195856us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:28.030183 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:28.034847 (+  4664us) log.cc:842] Serialized 26 byte log entry
0811 16:07:28.417856 (+383009us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:28.417893 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:28.417966 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:28.841320 (+423354us) raft_consensus.cc:1671] finished
0811 16:07:28.841348 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:28.841512 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3459,"raft.queue_time_us":5836,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11008,"thread_start_us":564799,"threads_started":2,"wal-append.queue_time_us":791487}
I20260811 16:07:28.812454 23058 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.877934 23058 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.861660 23138 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.883337 23138 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.861946 22954 consensus_queue.cc:237] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.850688 23441 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:28.861927 23589 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260811 16:07:28.899678 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:28.919589 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:28.872365 23281 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:28.923943 13905 raft_consensus.cc:1261] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260811 16:07:28.924337 13905 pending_rounds.cc:76] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 16
I20260811 16:07:28.924535 13905 pending_rounds.cc:97] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260811 16:07:28.924748 13905 raft_consensus.cc:2866] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260811 16:07:28.936101 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:28.945181 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.874598 23579 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:28.953017 13824 raft_consensus.cc:2379] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 19: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:28.960031 23368 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.866016 23286 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.932888 23058 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.921867 23138 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:28.967345 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:28.919220 23271 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:28.989758 23271 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.968614 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:28.991801 23271 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:28.992518 23286 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.992862 22621 consensus_queue.cc:1035] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260811 16:07:28.969338 13615 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5f46150fac70458986206ec7af67a403 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:28.860761 23267 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.996414 23267 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.997643 13825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3712) took 1118 ms. Trace:
I20260811 16:07:28.998024 13825 rpcz_store.cc:276] 0811 16:07:27.878977 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.879205 (+   228us) service_pool.cc:227] Handling call
0811 16:07:27.879638 (+   433us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:27.942863 (+ 63225us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:27.942896 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:27.943383 (+   487us) log.cc:842] Serialized 26 byte log entry
0811 16:07:28.295742 (+352359us) raft_consensus.cc:1631] Marking committed up to 11
0811 16:07:28.295796 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:28.295890 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:28.997440 (+701550us) raft_consensus.cc:1671] finished
0811 16:07:28.997463 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:28.997589 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62714,"raft.queue_time_us":63882,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":8513,"thread_start_us":328978,"threads_started":1,"wal-append.queue_time_us":769356}
I20260811 16:07:28.903551 23441 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.001597 23441 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:28.971493 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.004241 13818 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
W20260811 16:07:28.973125 23604 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260811 16:07:28.979887 23446 raft_consensus.cc:3032] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:28.987709 23058 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:28.989199 23554 raft_consensus.cc:3032] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Stepping down as leader of term 23
W20260811 16:07:29.005947 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 203530us
I20260811 16:07:28.980746 23329 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.026989 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:29.014428 23446 raft_consensus.cc:729] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:29.014912 23138 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.028781 23446 consensus_queue.cc:260] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.030365 23446 raft_consensus.cc:3037] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:29.023878 23554 raft_consensus.cc:729] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:29.032941 23554 consensus_queue.cc:260] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.20, Last appended by leader: 20, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.033960 23058 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.034196 23554 raft_consensus.cc:3037] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:29.030999 23138 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:28.939622 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 1.824s	user 0.053s	sys 0.044s Metrics: {"bytes_written":5254,"delete_count":0,"lbm_write_time_us":884,"lbm_writes_lt_1ms":5,"reinsert_count":0,"thread_start_us":405326,"threads_started":1,"update_count":193,"wal-append.queue_time_us":582735}
W20260811 16:07:29.019311 23385 consensus_meta.cc:287] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: Time spent flushing consensus metadata: real 1.090s	user 0.021s	sys 0.000s
I20260811 16:07:29.043027 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.312731
I20260811 16:07:29.046928 23298 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.048413 14574 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 27. Current term is 28. Ops: []
I20260811 16:07:29.043076 12383 raft_consensus.cc:2229] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:29.021797 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.054114 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:29.022576 23583 raft_consensus.cc:686] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:29.054979 13874 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:29.052147 23298 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.060220 23406 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.058375 23615 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:29.065475 23402 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:29.046286 23536 raft_consensus.cc:504] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:29.078212 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 265195us
W20260811 16:07:29.083714 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 155181us
W20260811 16:07:29.086323 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.097867 23523 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.099066 23523 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.104220 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.108548 23583 consensus_queue.cc:237] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.077683 23406 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.084470 23402 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:29.124487 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 65161.1us
I20260811 16:07:29.145380 14577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:29.128988 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:29.077920 23344 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.151682 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.152607 14577 raft_consensus.cc:2354] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26.
I20260811 16:07:29.136932 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.139221 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:29.148638 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 331524us
I20260811 16:07:29.154557 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:29.141212 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.154428 13826 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:29.156785 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.156921 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b62f8d4bd2b496fbdc602cfa4bb2ccc" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.134665 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.159576 13818 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.161374 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.162389 13825 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:29.153868 23524 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.151765 23402 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:29.166929 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.179491 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.179491 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:29.185411 13908 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 26
I20260811 16:07:29.186357 13826 raft_consensus.cc:2454] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 28.
I20260811 16:07:29.123780 23523 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.164373 14541 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.192694 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.129104 23329 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.204021 13906 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260811 16:07:29.065626 23281 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.209824 13820 raft_consensus.cc:1226] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260811 16:07:29.205523 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:29.167644 23420 raft_consensus.cc:659] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260811 16:07:29.206738 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.216640 14582 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.20-23.20]
I20260811 16:07:29.154107 23543 raft_consensus.cc:482] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.225775 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:29.202724 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 61312.9us
I20260811 16:07:29.167790 23126 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.223835 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cf6e0832154e35bedbcec9d96701f2" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:29.217249 13901 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:29.230226 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:29.235283 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 277436us
I20260811 16:07:29.237452 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:29.238338 13906 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:29.202623 23579 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.247635 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.166698 23344 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.165011 23524 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.279075 13902 raft_consensus.cc:1226] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 23. Current term is 24. Ops: [23.20-23.20]
I20260811 16:07:29.252439 13908 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:29.254501 13709 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:29.230198 23536 leader_election.cc:288] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.291702 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 139265us
I20260811 16:07:29.242802 23441 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:29.317966 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.320226 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:29.285611 23625 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.212987 23329 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.327041 14544 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:29.240221 23543 raft_consensus.cc:504] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.240480 23126 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.340066 23350 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:29.340426 23524 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.340662 23350 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.340816 23126 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.341198 23350 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:29.343384 23638 raft_consensus.cc:2781] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Leader election won for term 28
I20260811 16:07:29.344462 23638 raft_consensus.cc:686] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:29.345116 14575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43044 (request call id 1762) took 1383 ms. Trace:
I20260811 16:07:29.315956 23441 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.345655 14575 rpcz_store.cc:276] 0811 16:07:27.961623 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.961769 (+   146us) service_pool.cc:227] Handling call
0811 16:07:27.975416 (+ 13647us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:27.998121 (+ 22705us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:27.998161 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:28.841632 (+843471us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b2c00151b38. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c502efe11 00007f5c502ff442 00007f5c51947c11 00007f5c5190c58a 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772
0811 16:07:28.842096 (+   464us) log.cc:842] Serialized 26 byte log entry
0811 16:07:29.054193 (+212097us) raft_consensus.cc:1631] Marking committed up to 14
0811 16:07:29.054231 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:29.055979 (+  1748us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:29.344686 (+288707us) raft_consensus.cc:1671] finished
0811 16:07:29.344739 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:29.345025 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22284,"raft.queue_time_us":25630,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6928,"spinlock_wait_cycles":6837120,"thread_start_us":211645,"threads_started":1,"wal-append.queue_time_us":388385}
I20260811 16:07:29.286501 23579 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.322243 23286 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.375651 23406 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.326376 22954 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.383177 23390 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:29.375001 23344 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.330191 23625 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.384805 22954 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.353984 22947 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.358172 23441 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:29.388916 23543 leader_election.cc:288] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.392346 23579 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.355310 23638 consensus_queue.cc:237] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.395545 23329 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.378206 23286 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:29.401638 23568 log.cc:924] Time spent T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 1.283s	user 0.011s	sys 0.001s
I20260811 16:07:29.402866 23625 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.440377 13817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40896 (request call id 3726) took 1025 ms. Trace:
I20260811 16:07:29.441555 13817 rpcz_store.cc:276] 0811 16:07:28.414847 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:28.415031 (+   184us) service_pool.cc:227] Handling call
0811 16:07:28.415479 (+   448us) raft_consensus.cc:1457] Updating replica for 1 ops
0811 16:07:28.415916 (+   437us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 16:07:28.415956 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0811 16:07:28.416565 (+   609us) log.cc:842] Serialized 26 byte log entry
0811 16:07:29.207420 (+790855us) raft_consensus.cc:1631] Marking committed up to 13
0811 16:07:29.207477 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:29.207571 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 16:07:29.439109 (+231538us) raft_consensus.cc:1671] finished
0811 16:07:29.439265 (+   156us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 16:07:29.439951 (+   686us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":889,"raft.run_cpu_time_us":8019,"raft.run_wall_time_us":264382,"thread_start_us":483901,"threads_started":1,"wal-append.queue_time_us":897917}
W20260811 16:07:29.444649 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 190137us
I20260811 16:07:29.453086 13903 raft_consensus.cc:1226] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18. Ops: [16.13-17.14]
I20260811 16:07:29.460675 13707 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:29.461879 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.466110 13709 leader_election.cc:302] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:29.470239 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.488067 23329 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.488830 22954 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.492063 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.493978 23344 raft_consensus.cc:482] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:29.495067 23344 raft_consensus.cc:504] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.389194 22947 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.498533 23344 leader_election.cc:288] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:29.501571 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 174436us
I20260811 16:07:29.508016 13907 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260811 16:07:29.511775 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.513475 23329 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.516569 23329 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.521142 23402 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.522998 13903 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:29.503859 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 157007us
I20260811 16:07:29.498977 23286 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.541030 23105 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:29.541287 23126 consensus_queue.cc:1046] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260811 16:07:29.544687 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 97536us
I20260811 16:07:29.547343 22947 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.552835 23271 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.560434 23350 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.570578 23350 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.572559 13906 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:29.579317 13825 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 25.
I20260811 16:07:29.584817 13904 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:29.591459 23528 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.592216 23528 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.595368 13904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60522 (request call id 3616) took 1757 ms. Trace:
W20260811 16:07:29.604138 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 57110.9us
I20260811 16:07:29.554147 23271 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.595979 13904 rpcz_store.cc:276] 0811 16:07:27.834124 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:27.834258 (+   134us) service_pool.cc:227] Handling call
0811 16:07:27.834520 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 16:07:29.587912 (+1753392us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 16:07:29.590736 (+  2824us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000c8854. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891471 00007f5c5190cf51 00007f5c5190b99e 00007f5c5684d2e9 00007f5c4ff33684 00007f5c4ff33612 00007f5c4ff33541 00007f5c4ff334bc 00007f5c4ff32772 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:29.591042 (+   306us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4023635840}
I20260811 16:07:29.617161 23368 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.618074 23368 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.621587 23396 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:29.622782 23396 raft_consensus.cc:3032] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 LEADER]: Stepping down as leader of term 27
I20260811 16:07:29.623322 23396 raft_consensus.cc:729] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
W20260811 16:07:29.624303 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 121502us
I20260811 16:07:29.624732 23396 consensus_queue.cc:260] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.626545 23396 raft_consensus.cc:3037] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:29.630103 23401 raft_consensus.cc:2726] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:29.641739 13709 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:29.656430 23402 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.667119 23607 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.668085 23607 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.671324 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:29.675300 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 58469.2us
I20260811 16:07:29.676317 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.678232 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.679080 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.687558 14580 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 17.
I20260811 16:07:29.688042 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.689119 12383 raft_consensus.cc:2258] T 94d079a9604d4ed3832dbb48ba12cd16 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:29.664669 23271 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:29.701942 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 60482us
I20260811 16:07:29.705652 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.690165 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.711230 23615 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:29.713815 23615 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.730356 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.724251 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.724876 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.718961 13903 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260811 16:07:29.725550 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.721459 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.714984 23536 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:29.730417 23528 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.716487 23615 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.733073 23390 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.760344 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "583cc1a296dd4344b3aaf399b8d5b17f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.733230 23414 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.723472 22621 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.723824 23577 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.759820 23647 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.762424 13901 raft_consensus.cc:1226] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Rejecting Update request from peer 8d98491a0db549d0b671b60b90c9cdea for earlier term 21. Current term is 22. Ops: []
I20260811 16:07:29.797087 23647 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.796963 22621 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.763413 13908 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.764413 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.801931 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.802698 13824 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.753161 23329 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:29.804842 23329 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.771425 23536 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Becoming Leader. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:29.771471 23390 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.819727 12383 tablet_replica.cc:330] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:29.821444 23390 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.776613 23441 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.823493 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:29.824597 13826 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 23: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:29.825551 23441 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.777981 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.779518 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.827045 22621 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.782019 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:29.788800 23607 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:29.791467 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 331248us
I20260811 16:07:29.830952 23414 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:29.793460 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 63466.2us
I20260811 16:07:29.797004 23577 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.801780 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.772472 13818 raft_consensus.cc:1261] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260811 16:07:29.765105 23368 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.808056 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1185ca07eaca4954a71d11cfa2256fd3" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.811628 23447 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:29.815466 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.817200 23536 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:29.822566 13906 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
W20260811 16:07:29.775496 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:29.841281 13818 pending_rounds.cc:76] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Aborting all ops after (but not including) 13
I20260811 16:07:29.839855 12383 raft_consensus.cc:2229] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:29.846326 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 173050us
I20260811 16:07:29.846398 13818 pending_rounds.cc:97] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260811 16:07:29.852203 23414 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.853596 23577 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.855336 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.858531 13818 raft_consensus.cc:2866] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:29.867065 23329 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:29.867944 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:29.869392 23606 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:29.869875 23606 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:29.870190 23606 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:29.874616 14541 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:29.876099 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.880788 12383 raft_consensus.cc:2258] T 02554b9e1cd54e1dbcfb941296b23093 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:29.883512 23583 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:29.871018 13817 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:29.847661 23447 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:29.901165 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68407.8us
W20260811 16:07:29.903982 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.904541 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:29.911471 23425 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:29.912257 23425 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:29.914631 23425 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:29.919222 23607 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:29.894743 23447 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:29.932142 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 73144.8us
I20260811 16:07:29.933166 23414 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260811 16:07:29.931555 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:29.935354 14541 leader_election.cc:334] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:29.937690 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88888e6c2eb344e0b1468ef497832be3" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.939471 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff741363b70845aeab13c5999c9843e4" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.881278 23606 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.120070 23606 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.945070 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:29.946283 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44183.4us
I20260811 16:07:29.942929 12383 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:29.931512 23647 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:29.947961 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:29.949270 13627 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 14, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 14 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:29.952315 23390 consensus_queue.cc:1046] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260811 16:07:29.964673 13622 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 330) took 64462 ms (client timeout 15000 ms). Trace:
I20260811 16:07:29.975559 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.976368 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.977582 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:29.978328 14544 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:29.974977 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.123600 12383 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:30.240021 23609 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.296276 22947 raft_consensus.cc:3032] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:30.296787 22947 raft_consensus.cc:729] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:30.296420 23609 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.297740 22947 consensus_queue.cc:260] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.299098 22947 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:30.300343 23651 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:30.301453 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 323194us
I20260811 16:07:30.303115 23651 consensus_queue.cc:1035] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:30.274461 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 302173us
I20260811 16:07:30.314075 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:30.299585 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 178250us
I20260811 16:07:30.323637 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.324877 23429 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:30.325924 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.326856 13820 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:07:30.334494 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 399191us
I20260811 16:07:30.337281 12383 pending_rounds.cc:62] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 3 pending ops.
I20260811 16:07:30.337559 23441 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260811 16:07:30.338004 12383 pending_rounds.cc:68] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 23 index: 20 } timestamp: 7317358372869898240 op_type: NO_OP noop_request { }
I20260811 16:07:30.338603 12383 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:30.339033 12383 pending_rounds.cc:68] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 21 index: 19 } timestamp: 7317358309818638336 op_type: NO_OP noop_request { }
I20260811 16:07:30.339478 23274 raft_consensus.cc:482] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.339490 12383 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:30.340263 12383 pending_rounds.cc:68] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 20 index: 18 } timestamp: 7317358282840498176 op_type: NO_OP noop_request { }
I20260811 16:07:30.340747 12383 raft_consensus.cc:2866] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:30.341161 12383 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:30.326625 23429 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:30.343308 23429 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.347259 13871 leader_election.cc:398] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26.
I20260811 16:07:30.340287 23274 raft_consensus.cc:504] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.347863 13871 leader_election.cc:401] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:30.349886 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.350731 23274 leader_election.cc:288] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.352998 13707 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.351058 23368 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:30.366556 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 411500us
I20260811 16:07:30.367642 23613 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:30.367903 23402 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for earlier term 25. Current term is 26.
I20260811 16:07:30.374097 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:30.380872 14575 raft_consensus.cc:2379] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 23: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:30.387004 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.389297 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d079a9604d4ed3832dbb48ba12cd16" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.386322 23528 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.387754 13821 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:30.374977 23609 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:30.306746 13622 rpcz_store.cc:269] 0811 16:06:25.502616 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:25.507939 (+  5323us) service_pool.cc:227] Handling call
0811 16:07:29.964331 (+64456392us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:20.615327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:20.616503 (+  1176us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:20.616590 (+    87us) write_op.cc:435] Acquired schema lock
0811 16:07:20.616631 (+    41us) tablet.cc:660] Decoding operations
0811 16:07:20.617185 (+   554us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:20.617303 (+   118us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:20.617361 (+    58us) tablet.cc:683] Acquiring locks for 1 operations
0811 16:07:20.617702 (+   341us) tablet.cc:699] Row locks acquired
0811 16:07:20.617743 (+    41us) write_op.cc:260] PREPARE: finished
0811 16:07:20.618005 (+   262us) write_op.cc:270] Start()
0811 16:07:20.618201 (+   196us) write_op.cc:276] Timestamp: P: 1786464440617906 usec, L: 0
0811 16:07:20.618247 (+    46us) op_driver.cc:331] REPLICATION: starting
0811 16:07:20.675346 (+ 57099us) log.cc:842] Serialized 536 byte log entry
0811 16:07:21.319658 (+644312us) op_driver.cc:444] REPLICATION: finished
0811 16:07:21.952906 (+633248us) write_op.cc:301] APPLY: starting
0811 16:07:22.089708 (+136802us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:22.250883 (+161175us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:22.251011 (+   128us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:22.251870 (+   859us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:22.252188 (+   318us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0811 16:07:22.252269 (+    81us) write_op.cc:312] APPLY: finished
0811 16:07:22.252532 (+   263us) log.cc:842] Serialized 25 byte log entry
0811 16:07:22.418299 (+165767us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:22.422847 (+  4548us) write_op.cc:454] Released schema lock
0811 16:07:22.431532 (+  8685us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:22.431927 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:22.431957 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":933646,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":525025,"apply.run_cpu_time_us":46356,"apply.run_wall_time_us":530642,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8299,"num_ops":1,"prepare.queue_time_us":112656,"prepare.run_cpu_time_us":82520,"prepare.run_wall_time_us":315766,"raft.queue_time_us":248235,"raft.run_cpu_time_us":11996,"raft.run_wall_time_us":456641,"replication_time_us":691204,"thread_start_us":657220,"threads_started":5,"wal-append.queue_time_us":460913,"wal-append.run_cpu_time_us":53879,"wal-append.run_wall_time_us":2174660}]]}
I20260811 16:07:30.400000 23651 consensus_queue.cc:1046] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260811 16:07:30.401357 13622 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60716 (request call id 329) took 18560 ms (client timeout 15000 ms). Trace:
I20260811 16:07:30.401736 23651 raft_consensus.cc:3032] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Stepping down as leader of term 21
I20260811 16:07:30.402346 23651 raft_consensus.cc:729] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:30.402187 13622 rpcz_store.cc:269] 0811 16:07:11.841000 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:30.400923 (+18559923us) service_pool.cc:214] Skipping call since client already timed out
0811 16:07:30.401221 (+   298us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260811 16:07:30.406805 13871 leader_election.cc:302] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.408517 23528 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.410952 23609 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:30.430372 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.432878 23329 raft_consensus.cc:2726] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:30.433100 23402 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:30.433368 23528 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:30.433648 23329 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:07:30.447557 23662 log.cc:924] Time spent T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
W20260811 16:07:30.449584 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84712.8us
I20260811 16:07:30.430048 23606 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:30.420018 23651 consensus_queue.cc:260] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.441865 23441 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:30.457805 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 99329.6us
I20260811 16:07:30.433987 23402 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.446898 23329 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.444726 23609 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.463567 23651 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:30.477653 13825 raft_consensus.cc:1261] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260811 16:07:30.453655 23606 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.470016 23368 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.479619 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 30 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.479430 13822 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260811 16:07:30.462608 23429 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.481484 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:30.476033 23441 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.486485 13817 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.500008 23368 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.504091 13709 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.502559 12383 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:30.491648 23441 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.509778 23647 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:30.512176 13821 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260811 16:07:30.519025 23329 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.502353 23607 consensus_queue.cc:1035] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.012s
I20260811 16:07:30.531586 23536 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
W20260811 16:07:30.533671 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 62784us
I20260811 16:07:30.528620 23429 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.537083 13707 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.536922 23414 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:30.538489 23128 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:30.538542 13707 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.539981 12383 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:30.540783 12383 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:30.544684 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 214698us
I20260811 16:07:30.551887 23402 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.553859 23606 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.563800 23368 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.566637 23609 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.569324 12383 tablet_replica.cc:330] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:30.526028 23441 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.577286 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.576150 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.576735 12383 raft_consensus.cc:2229] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:07:30.575022 23128 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:30.588277 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 49828.2us
I20260811 16:07:30.588261 13709 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:30.592628 13817 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:30.575438 23647 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260811 16:07:30.599782 23128 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:30.607285 13707 leader_election.cc:302] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:30.594483 13627 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:30.625557 23647 raft_consensus.cc:2726] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:30.632002 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.635011 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:30.637285 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 48119us
I20260811 16:07:30.644004 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.646028 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.646713 12383 raft_consensus.cc:2258] T 210dcf7aee994bdaa1e75860a25bdd3a P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:30.648458 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.650651 12383 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:30.652011 12383 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:07:30.655218 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:30.663830 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 162141us
W20260811 16:07:30.664889 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 106888us
W20260811 16:07:30.666555 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:30.673305 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 298063us
I20260811 16:07:30.673424 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.667095 13787 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.675293 23565 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:30.682060 13787 leader_election.cc:334] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.685559 13787 leader_election.cc:302] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.687438 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.689086 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:30.690521 13821 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.690172 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:30.654253 23666 raft_consensus.cc:482] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:30.690168 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.696084 13825 raft_consensus.cc:2454] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:30.699570 13824 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260811 16:07:30.696997 14544 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:30.694787 23609 raft_consensus.cc:2726] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:30.704047 23667 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.712234 13907 raft_consensus.cc:1261] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260811 16:07:30.713585 23274 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.714259 23274 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.708112 23606 raft_consensus.cc:2781] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:30.717058 23274 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.719933 12383 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:30.722506 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.723088 13905 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 16.
W20260811 16:07:30.726351 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.699097 23666 raft_consensus.cc:504] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.726861 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.727739 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.728935 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.729661 13902 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:30.723500 23667 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.728767 23671 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.008s
I20260811 16:07:30.719357 23606 raft_consensus.cc:686] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:30.735846 14575 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260811 16:07:30.729142 23666 leader_election.cc:288] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:30.745118 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.749199 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:30.749466 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.749949 13900 raft_consensus.cc:3037] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.742997 23651 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:30.751606 13909 raft_consensus.cc:1261] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260811 16:07:30.752684 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:30.753140 13909 pending_rounds.cc:76] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting all ops after (but not including) 15
I20260811 16:07:30.753479 13909 pending_rounds.cc:97] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260811 16:07:30.753506 13907 raft_consensus.cc:3037] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:30.753837 13909 raft_consensus.cc:2866] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 16:07:30.755407 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.754274 13906 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:30.756927 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.758989 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.757565 13905 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:30.740375 23402 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.763721 23402 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:30.774188 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.774739 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.775666 23651 consensus_queue.cc:1035] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260811 16:07:30.776268 14542 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:30.777341 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:07:30.779052 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52750.2us
W20260811 16:07:30.779815 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.780165 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.781068 13821 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
W20260811 16:07:30.781934 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 78807.6us
I20260811 16:07:30.784255 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:30.790525 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.787850 23414 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260811 16:07:30.788185 23666 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:30.794629 23668 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260811 16:07:30.794903 23429 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:30.795254 23668 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.797189 23668 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:30.798516 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.791302 13905 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 24.
I20260811 16:07:30.801935 14544 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:30.801270 23429 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:30.804652 23429 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:30.808343 23606 consensus_queue.cc:237] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.803279 23671 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:30.810468 23671 raft_consensus.cc:2781] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:30.817816 13900 raft_consensus.cc:2454] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:30.820609 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962f3dc40b494dc48647abd894784e8d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:30.826121 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46347.4us
I20260811 16:07:30.811035 23671 raft_consensus.cc:686] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:30.826941 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.827391 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:30.831012 13787 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.831650 13787 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:30.836987 13906 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260811 16:07:30.835306 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:30.846487 23329 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.847352 23329 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.848728 13906 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Refusing update from remote peer cec0688f86d54789b9b9ecc924ddecf3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260811 16:07:30.849560 23672 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:30.850019 23329 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:30.850382 13871 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.850138 23672 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.851393 23667 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:30.851706 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a0d32ee74448a6931819ee7d5e0f59" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 30 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.852622 23672 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.860987 13907 raft_consensus.cc:2454] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:30.864732 23329 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.865612 23329 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:30.833530 23609 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260811 16:07:30.880235 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.872190 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:30.892800 14580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.874358 23583 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:30.879432 23402 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:30.901899 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:30.902005 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:30.905933 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55581.8us
I20260811 16:07:30.908013 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:30.917788 14581 raft_consensus.cc:2454] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:07:30.906826 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:30.939687 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:30.948138 23329 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:30.950788 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:30.952466 23402 raft_consensus.cc:2741] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260811 16:07:30.959298 23671 consensus_queue.cc:237] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:30.971618 23681 log.cc:924] Time spent T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260811 16:07:30.972249 23396 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:30.972841 23396 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:30.918834 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
W20260811 16:07:30.979585 13787 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.980160 13787 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:30.993384 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:30.995899 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 89162.5us
W20260811 16:07:30.993511 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 215059us
W20260811 16:07:31.005829 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:30.993497 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 159078us
I20260811 16:07:30.977264 23672 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:07:31.000828 13787 leader_election.cc:334] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:30.993008 23441 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:31.013381 23396 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.028515 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 LEADER]: Raft consensus shutting down.
W20260811 16:07:31.047286 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:31.054057 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:31.051752 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:31.059995 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.060902 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:31.062038 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.022646 23429 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.071874 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
W20260811 16:07:31.057346 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:31.080470 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.082974 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:31.061058 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.089064 13707 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.090181 23688 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:31.090747 23688 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.091171 23688 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:31.091373 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.092119 13901 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:31.094946 23429 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.095481 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.085901 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:31.084070 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.107520 23420 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:31.108718 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "801054abfed346a09c04b7cd13d7c62f" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.109666 23682 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:31.110101 23682 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:31.110562 23682 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:31.100925 23647 raft_consensus.cc:2781] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:31.112991 23647 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:31.113391 23647 raft_consensus.cc:3037] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:31.110744 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f7937a4cf04cef96095a62cb4ef661" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.144280 13707 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.052780 23672 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.169298 23368 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:31.077297 23668 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.178135 14575 raft_consensus.cc:1226] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 16. Current term is 17. Ops: []
I20260811 16:07:31.116899 23447 consensus_queue.cc:1035] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
W20260811 16:07:31.142400 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:31.185662 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 67805.6us
I20260811 16:07:31.110049 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3ac106c3df9431c9323c322b9f8118b" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:31.214794 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 70610.2us
W20260811 16:07:31.226343 13617 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260811 16:07:31.236001 13707 leader_election.cc:302] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.256247 23414 raft_consensus.cc:2726] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260811 16:07:31.299464 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.311968 13905 raft_consensus.cc:2379] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:31.222911 23668 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.224949 23368 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
W20260811 16:07:31.333170 23694 log.cc:924] Time spent T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260811 16:07:31.310706 23565 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
W20260811 16:07:31.341463 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 238767us
W20260811 16:07:31.346935 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 105992us
I20260811 16:07:31.231343 23420 consensus_queue.cc:1046] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260811 16:07:31.345911 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.352234 23672 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.354909 23672 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:31.358441 23688 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.361649 12383 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:31.402498 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.408373 23274 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.412528 23274 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:31.416972 12383 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:31.417845 12383 pending_rounds.cc:62] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 2 pending ops.
I20260811 16:07:31.418128 12383 pending_rounds.cc:68] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 15 index: 12 } timestamp: 7317358359953182720 op_type: NO_OP noop_request { }
W20260811 16:07:31.418278 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 85401.2us
I20260811 16:07:31.418531 12383 raft_consensus.cc:2866] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:31.419180 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.420121 23329 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:31.421684 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:31.418859 12383 pending_rounds.cc:68] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 13 index: 11 } timestamp: 7317358323633618944 op_type: NO_OP noop_request { }
I20260811 16:07:31.422657 23528 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:31.423516 23528 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.423905 23528 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:31.426937 23688 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.353107 23565 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.428937 12383 raft_consensus.cc:2866] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:31.433128 12383 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:31.435650 23565 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.447325 23710 raft_consensus.cc:482] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.448028 23710 raft_consensus.cc:504] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.449743 23274 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.445673 13871 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.461133 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.471845 13900 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260811 16:07:31.473251 13909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.464640 23329 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:31.476543 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.477272 13907 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:31.479583 23447 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:07:31.480324 23447 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.465842 23710 leader_election.cc:288] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.470964 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ade10bd0a2294e86b324757afe52d216" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.482889 23414 raft_consensus.cc:3032] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Stepping down as leader of term 16
I20260811 16:07:31.483407 23414 raft_consensus.cc:729] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:31.483632 23565 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.484870 23447 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.484546 23565 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:31.485616 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:31.486048 14541 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:31.487077 23606 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:31.484542 23414 consensus_queue.cc:260] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.491070 23565 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:31.494181 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:31.495700 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54600.2us
I20260811 16:07:31.496587 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.497612 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.497674 22947 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:31.498715 22947 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:31.501751 23682 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.503115 13907 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:31.503499 13901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.511552 23606 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:31.512212 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.450837 23647 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:31.513783 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.511615 14542 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:31.515307 23647 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.514932 23651 raft_consensus.cc:2781] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:31.516582 23651 raft_consensus.cc:686] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
W20260811 16:07:31.518410 13709 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 51313.6us
I20260811 16:07:31.517930 23651 consensus_queue.cc:237] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.523268 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.504830 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.526345 13871 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.527349 22947 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:31.528002 22947 raft_consensus.cc:2781] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:31.528512 22947 raft_consensus.cc:686] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:31.529707 22947 consensus_queue.cc:237] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.531704 23414 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Advancing to term 17
I20260811 16:07:31.531543 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.539976 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.501753 23528 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:31.548254 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 325513us
W20260811 16:07:31.559533 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:31.560532 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:31.560941 14541 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:31.571619 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98ab517b34b7491eabb89d31d262a45e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:31.562964 14542 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:31.573628 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.579722 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.580088 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:31.589131 13822 raft_consensus.cc:3037] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 22
W20260811 16:07:31.572816 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:31.596345 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:31.600747 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 201985us
I20260811 16:07:31.601866 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.548642 23682 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.629940 13707 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.572309 23606 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:31.637477 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.595712 23607 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260811 16:07:31.651176 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.658349 13707 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:31.661835 14575 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:31.644568 12383 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
W20260811 16:07:31.687132 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 113370us
I20260811 16:07:31.697118 13900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.649202 23703 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:31.688113 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:31.703735 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 45545.9us
I20260811 16:07:31.704586 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:31.712985 13902 raft_consensus.cc:2354] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:31.714022 13789 leader_election.cc:302] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:31.715624 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 120140us
I20260811 16:07:31.716785 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:31.728595 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00255c500904da78a120b3431f1e31d" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:31.724104 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.737552 13900 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260811 16:07:31.718133 23420 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:31.765798 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:31.742765 13706 leader_election.cc:302] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:31.799623 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 82893.2us
W20260811 16:07:31.817401 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 180490us
W20260811 16:07:31.801182 23723 log.cc:924] Time spent T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260811 16:07:31.798748 23565 raft_consensus.cc:2726] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:07:31.836015 23528 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.840219 23718 raft_consensus.cc:482] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.839752 23709 raft_consensus.cc:2726] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260811 16:07:31.799798 23128 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:31.859253 23128 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:31.859594 23718 raft_consensus.cc:504] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:31.862116 23718 leader_election.cc:288] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:31.845309 12383 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:31.845551 23679 log.cc:924] Time spent T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.079s	user 0.000s	sys 0.007s
I20260811 16:07:31.870762 12383 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:31.876750 23565 raft_consensus.cc:3037] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:31.861954 23128 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.884021 12383 tablet_replica.cc:330] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:31.886658 12383 raft_consensus.cc:2229] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:07:31.887796 23565 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:07:31.921530 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 254568us
I20260811 16:07:31.930552 12383 raft_consensus.cc:2258] T 0556c3c022b74f43b43aa6f25d418e58 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:31.898072 14541 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 146 similar messages]
W20260811 16:07:31.938710 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:31.939006 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:31.828665 23720 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.097s
I20260811 16:07:31.943267 14573 raft_consensus.cc:1226] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 22. Current term is 23. Ops: []
W20260811 16:07:31.943104 23719 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.266s	user 0.000s	sys 0.005s
I20260811 16:07:31.949759 13707 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:31.955192 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 78929.7us
W20260811 16:07:31.959133 23727 log.cc:924] Time spent T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.202s	user 0.000s	sys 0.002s
I20260811 16:07:31.958945 23441 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260811 16:07:31.971849 13822 raft_consensus.cc:2454] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:31.951401 23420 raft_consensus.cc:482] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:07:31.985348 23420 raft_consensus.cc:504] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:31.986297 23729 log.cc:924] Time spent T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260811 16:07:31.987766 23420 leader_election.cc:288] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:31.982812 23703 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:31.990012 23441 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:31.990589 23441 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Advancing to term 27
W20260811 16:07:31.998952 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 48412.4us
W20260811 16:07:32.060451 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 84995.2us
W20260811 16:07:32.081606 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 125271us
W20260811 16:07:32.107849 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.099457 13706 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 110970us
I20260811 16:07:31.971128 23682 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:32.096897 23741 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
W20260811 16:07:32.112264 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 371820us
I20260811 16:07:32.112787 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.118620 13707 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.125561 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17293f4853fe4715a4622208f2fbb5a7" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.130992 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47a99d649fa64ed18701c70592b7b534" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.133347 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.136014 14544 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.123616 12383 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.141397 14544 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:07:32.141764 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.142264 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.142894 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c9671b71f644eaf969b8bb56e717beb" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.167538 13909 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:32.177122 13826 raft_consensus.cc:1261] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260811 16:07:32.177273 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.177884 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.154136 23720 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:32.183949 23740 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.116415 23274 consensus_queue.cc:1046] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260811 16:07:32.160437 23672 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.189425 23718 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:32.190565 23718 raft_consensus.cc:3032] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Stepping down as leader of term 17
I20260811 16:07:32.160905 23607 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260811 16:07:32.192492 23274 raft_consensus.cc:3032] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Stepping down as leader of term 22
I20260811 16:07:32.192945 23274 raft_consensus.cc:729] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:32.193956 23274 consensus_queue.cc:260] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.198729 23746 consensus_queue.cc:1046] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:32.199680 12383 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:07:32.201128 12383 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.190902 23718 raft_consensus.cc:729] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:32.218657 13822 raft_consensus.cc:1261] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260811 16:07:32.121708 23682 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.227525 13824 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260811 16:07:32.233223 23682 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.190982 23441 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:32.237187 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 59957.3us
I20260811 16:07:32.228206 23528 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:32.241158 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.241499 13909 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260811 16:07:32.241677 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.241868 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 103542us
I20260811 16:07:32.240135 23738 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:32.244557 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.248723 13824 raft_consensus.cc:1261] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260811 16:07:32.250622 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:32.243422 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:32.274448 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.266178 13709 leader_election.cc:302] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.282059 13709 leader_election.cc:302] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.283435 13709 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.263281 22947 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:32.267879 23746 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.275130 23441 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.252012 23682 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
W20260811 16:07:32.304097 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 55931us
I20260811 16:07:32.254166 23738 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.295089 23703 raft_consensus.cc:2726] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.280329 23720 consensus_queue.cc:1035] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260811 16:07:32.310683 12383 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.277297 23739 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260811 16:07:32.317167 23738 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.317783 13823 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:32.304821 23746 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.319595 13906 raft_consensus.cc:1226] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 17. Current term is 18. Ops: []
I20260811 16:07:32.323361 23685 consensus_queue.cc:1035] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260811 16:07:32.324241 23716 raft_consensus.cc:2726] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.330000 23732 raft_consensus.cc:3032] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Stepping down as leader of term 20
I20260811 16:07:32.312098 23708 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:07:32.295395 23707 consensus_queue.cc:1035] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260811 16:07:32.308032 23420 raft_consensus.cc:482] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.370780 23420 raft_consensus.cc:504] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.373180 23420 leader_election.cc:288] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.374146 23746 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:32.375401 23274 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:32.375986 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:32.376447 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 100178us
W20260811 16:07:32.377101 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:32.377663 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.378331 12383 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:32.378765 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.378981 12383 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P cec0688f86d54789b9b9ecc924ddecf3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.380115 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.382618 12383 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.382994 23703 consensus_queue.cc:1046] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:32.366675 23732 raft_consensus.cc:729] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:32.386051 23732 consensus_queue.cc:260] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.387318 23732 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:32.391501 23709 raft_consensus.cc:482] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.392119 23709 raft_consensus.cc:504] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.393232 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.394207 23739 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.394479 23709 leader_election.cc:288] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:32.395881 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.396409 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.398388 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c98a1b986c4db5bd4c160284e54651" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.398926 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:32.400759 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 129346us
I20260811 16:07:32.416031 13709 leader_election.cc:302] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.297362 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 3.244s	user 0.150s	sys 0.093s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":27564,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":437833,"dirs.run_cpu_time_us":910,"dirs.run_wall_time_us":42702,"lbm_read_time_us":42698,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":23,"lbm_write_time_us":5763,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":10,"reinsert_count":0,"thread_start_us":320580,"threads_started":2,"update_count":241}
I20260811 16:07:32.395242 23718 consensus_queue.cc:260] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.428023 23718 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:32.428844 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:32.429505 13618 maintenance_manager.cc:419] P a33d4003601443f4b810ff8345d6e5a9: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
W20260811 16:07:32.414824 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:32.431701 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.432116 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.433451 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.433956 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.438472 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c0f5b985cc420c9dad45a78187a946" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.443292 13820 raft_consensus.cc:1226] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Rejecting Update request from peer cec0688f86d54789b9b9ecc924ddecf3 for earlier term 26. Current term is 27. Ops: []
I20260811 16:07:32.445240 13617 maintenance_manager.cc:643] P a33d4003601443f4b810ff8345d6e5a9: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260811 16:07:32.446938 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.447644 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.448655 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 150300us
W20260811 16:07:32.432126 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.456741 12383 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:32.453018 23536 consensus_queue.cc:1046] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260811 16:07:32.459771 23536 raft_consensus.cc:3032] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 LEADER]: Stepping down as leader of term 26
I20260811 16:07:32.459793 23744 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.460263 23536 raft_consensus.cc:729] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: cec0688f86d54789b9b9ecc924ddecf3, State: Running, Role: LEADER
I20260811 16:07:32.421005 23734 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:32.458578 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.468518 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.468999 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.470969 23744 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:32.456801 23739 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:32.477155 12383 pending_rounds.cc:62] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:32.477445 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:32.478408 23739 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:32.479089 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.480135 23671 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.480615 23609 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.480671 23671 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.482268 13789 leader_election.cc:398] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:32.482615 13789 leader_election.cc:401] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:32.477550 12383 pending_rounds.cc:68] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 23 index: 17 } timestamp: 7317358331455651840 op_type: NO_OP noop_request { }
I20260811 16:07:32.484050 12383 raft_consensus.cc:2866] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:32.484452 12383 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.449256 23703 raft_consensus.cc:2726] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:32.488306 13707 leader_election.cc:302] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.453702 23714 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:07:32.490542 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 58440.4us
I20260811 16:07:32.496891 14581 raft_consensus.cc:1261] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260811 16:07:32.489112 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
W20260811 16:07:32.504490 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.512642 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:32.517768 13907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.518033 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:32.520509 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.525465 13789 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.527384 23565 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260811 16:07:32.535557 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.515025 23671 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:32.507659 23734 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.539606 23734 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.512512 23703 raft_consensus.cc:2726] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.541977 23734 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.536602 14575 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:32.543915 13908 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 25.
I20260811 16:07:32.545665 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:32.546007 14575 raft_consensus.cc:1226] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Rejecting Update request from peer 5f46150fac70458986206ec7af67a403 for earlier term 20. Current term is 21. Ops: []
I20260811 16:07:32.461280 23536 consensus_queue.cc:260] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:32.549845 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.550357 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.550482 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.554591 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.555064 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.556224 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.556629 13871 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.559679 13821 raft_consensus.cc:2396] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260811 16:07:32.561349 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.561733 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.562310 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.553463 23651 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:32.564539 23402 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:32.549438 23734 consensus_queue.cc:1035] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260811 16:07:32.587535 14544 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.588660 23651 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.594549 23651 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:32.572150 23420 consensus_queue.cc:1159] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" responder_term: 26 status { last_received { term: 26 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 26 index: 15 } }
I20260811 16:07:32.604436 23738 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.605104 23738 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.572683 23714 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.613933 23705 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:32.616256 23685 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:32.616825 23685 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.627391 23536 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:32.577948 23732 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:32.632871 23732 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.633352 23732 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:32.578397 23739 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:32.646610 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 57973.4us
W20260811 16:07:32.662952 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.671275 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 115065us
W20260811 16:07:32.671943 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.672302 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.665133 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:32.673362 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.678056 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.679065 23714 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:32.680058 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:32.655905 23703 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:32.670485 23609 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003) with higher term. Message: Invalid argument: T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 21. Current term is 22.
I20260811 16:07:32.664244 23447 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:07:32.688485 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.708171 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:32.706488 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 142789us
I20260811 16:07:32.697161 12383 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.711814 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.705338 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.709177 14581 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:32.682034 23528 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:32.712677 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:32.727280 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:32.730494 23731 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:32.731029 23731 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:32.731426 23731 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
W20260811 16:07:32.732610 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.693560 23738 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.691286 23703 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.740526 23703 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.741593 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.743441 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:32.744191 14581 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 17.
I20260811 16:07:32.746803 23731 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.700766 23447 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:32.754971 13627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 312) took 53969 ms (client timeout 15000 ms). Trace:
W20260811 16:07:32.755596 13627 rpcz_store.cc:269] 0811 16:06:38.797493 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:38.886808 (+ 89315us) service_pool.cc:227] Handling call
0811 16:07:32.754894 (+53868086us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:30.665738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:30.666566 (+   828us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:30.666633 (+    67us) write_op.cc:435] Acquired schema lock
0811 16:07:30.666659 (+    26us) tablet.cc:660] Decoding operations
0811 16:07:30.691873 (+ 25214us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:30.702179 (+ 10306us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:30.709942 (+  7763us) tablet.cc:683] Acquiring locks for 2 operations
0811 16:07:30.763816 (+ 53874us) tablet.cc:699] Row locks acquired
0811 16:07:30.763854 (+    38us) write_op.cc:260] PREPARE: finished
0811 16:07:30.764141 (+   287us) write_op.cc:270] Start()
0811 16:07:30.764296 (+   155us) write_op.cc:276] Timestamp: P: 1786464450764028 usec, L: 0
0811 16:07:30.764341 (+    45us) op_driver.cc:331] REPLICATION: starting
0811 16:07:30.765171 (+   830us) log.cc:842] Serialized 987 byte log entry
0811 16:07:31.341099 (+575928us) op_driver.cc:444] REPLICATION: finished
0811 16:07:31.715640 (+374541us) write_op.cc:301] APPLY: starting
0811 16:07:31.727017 (+ 11377us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:31.945855 (+218838us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:31.979180 (+ 33325us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:32.363459 (+384279us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b1800362140. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c516d70dc 00007f5c516fba5a 00007f5c516fb347 00007f5c516fb2e0 00007f5c516da7b8 00007f5c5533bf9b 00007f5c55380774 00007f5c5523408a 00007f5c552369db
0811 16:07:32.364378 (+   919us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:32.364713 (+   335us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0811 16:07:32.364778 (+    65us) write_op.cc:312] APPLY: finished
0811 16:07:32.365104 (+   326us) log.cc:842] Serialized 33 byte log entry
0811 16:07:32.559039 (+193935us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:32.570505 (+ 11466us) write_op.cc:454] Released schema lock
0811 16:07:32.584062 (+ 13557us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:32.590000 (+  5938us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:32.590030 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8166,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":260854,"apply.run_cpu_time_us":47730,"apply.run_wall_time_us":895050,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"cfile_init":1,"lbm_read_time_us":46099,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"num_ops":2,"prepare.queue_time_us":16129,"prepare.run_cpu_time_us":97775,"prepare.run_wall_time_us":391705,"raft.queue_time_us":205029,"raft.run_cpu_time_us":15025,"raft.run_wall_time_us":293126,"replication_time_us":572067,"spinlock_wait_cycles":10052864,"thread_start_us":730199,"threads_started":5,"wal-append.queue_time_us":512459,"wal-append.run_cpu_time_us":83635,"wal-append.run_wall_time_us":1145642}]]}
I20260811 16:07:32.724951 23746 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260811 16:07:32.764705 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 76250.7us
W20260811 16:07:32.766269 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.729086 12383 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:32.771811 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:32.777503 13903 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 16.
I20260811 16:07:32.781510 12383 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.787433 23447 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.774192 23685 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.796449 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b76fe83cb6c40d0af784af645b1e956" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.796798 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:32.767725 23672 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260811 16:07:32.801957 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.803550 23607 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:07:32.764212 23746 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.806057 23746 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:32.805449 23732 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.807194 12383 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:32.808212 12383 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 LEADER]: Raft consensus shutting down.
W20260811 16:07:32.809048 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.811235 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.812335 23722 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:07:32.810631 23732 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:32.813054 23651 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:32.815780 23651 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:32.819494 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:32.820355 13823 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 24: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:32.827592 12383 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.886103 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:32.886997 14573 raft_consensus.cc:2379] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 24: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:32.889029 23731 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:32.899541 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.900220 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:32.912233 23775 log.cc:924] Time spent T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260811 16:07:32.915282 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 52899.7us
W20260811 16:07:32.918776 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:32.926198 13787 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:32.926815 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.926729 13787 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.927330 14541 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:32.934803 13707 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:32.931857 23441 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.936354 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bed8270f474c2e80653bbdc5806659" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:32.937008 14573 raft_consensus.cc:3037] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:32.924422 23720 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:07:32.910642 23746 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:32.944578 23709 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260811 16:07:32.937718 23736 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:32.967643 23709 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:32.971282 13626 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 18, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 18 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:32.982081 23711 raft_consensus.cc:2726] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260811 16:07:32.965716 23743 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:33.005209 13787 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:32.992122 23709 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.013273 13626 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.006964 12383 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.027518 12383 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.028209 12383 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:32.993852 23736 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:33.050971 13626 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.064241 12383 tablet_replica.cc:330] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.065464 12383 raft_consensus.cc:2229] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.066223 12383 raft_consensus.cc:2258] T c3ac106c3df9431c9323c322b9f8118b P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.073856 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 122858us
I20260811 16:07:33.088125 14573 raft_consensus.cc:2454] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:33.017565 23743 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:33.098600 13707 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 151502us
I20260811 16:07:33.101783 13626 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 18, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.113713 13626 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.123266 13787 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.133513 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.135514 23746 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.126814 23749 raft_consensus.cc:2781] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:33.147085 23749 raft_consensus.cc:686] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:33.151504 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:33.156728 13905 raft_consensus.cc:3037] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:33.152660 23743 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.153084 23736 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.148126 23749 consensus_queue.cc:237] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.167936 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.168218 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.168735 13904 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 16.
I20260811 16:07:33.182711 13905 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 26.
I20260811 16:07:33.190264 23709 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.131243 13626 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:33.194514 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.195395 13626 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 20 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.198443 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:33.199251 13825 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.199798 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:33.200601 14573 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.199103 23709 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.202889 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.206377 13626 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.208724 12383 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.209888 12383 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.210004 14573 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:33.210825 12383 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.215941 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:33.216759 13905 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Advancing to term 18
I20260811 16:07:33.217108 13789 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:33.218472 23736 raft_consensus.cc:2781] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:33.219094 23736 raft_consensus.cc:686] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:33.220045 23736 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:33.210049 13626 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
W20260811 16:07:33.226564 13787 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.230376 12383 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.226138 13626 catalog_manager.cc:5495] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 16, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 16 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.212472 13825 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:33.241572 13709 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:33.245432 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.244311 13626 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.247285 14573 raft_consensus.cc:2354] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
W20260811 16:07:33.245047 13709 raft_consensus.cc:2670] T 20ad41e4f434442792e36eb47449b101 P cec0688f86d54789b9b9ecc924ddecf3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 16:07:33.249228 13905 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 18.
I20260811 16:07:33.250250 12383 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:33.250960 13787 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:33.252038 13787 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.252480 13787 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.253227 23743 raft_consensus.cc:2726] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:07:33.255406 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:33.264984 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:33.255527 13626 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 20, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.271193 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:33.272739 13626 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 24, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 24 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.274631 13626 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.276086 13626 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.277561 13626 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 17, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:33.279346 13626 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 9, term changed from 13 to 14, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194), NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 14 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:33.281737 13626 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:33.282943 12383 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.285009 13787 leader_election.cc:398] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:33.285378 13787 leader_election.cc:401] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260811 16:07:33.286463 23749 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251) with higher term. Message: Invalid argument: T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 for earlier term 17. Current term is 18.
I20260811 16:07:33.287652 13626 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.289407 13626 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.290146 12383 tablet_replica.cc:330] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.290985 13626 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.301831 12383 raft_consensus.cc:2229] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.303174 12383 raft_consensus.cc:2258] T ffb6122695854eb8a6ab98b508c17b30 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.306555 12383 tablet_replica.cc:330] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.340216 12383 raft_consensus.cc:2229] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.344417 12383 raft_consensus.cc:2258] T d00255c500904da78a120b3431f1e31d P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.360180 23706 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.361053 23706 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.364203 12383 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
W20260811 16:07:33.368278 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:33.371007 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.373490 23706 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.373706 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.375003 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:33.375944 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:33.377008 14542 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.378135 12383 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.379618 12383 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.379846 23706 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:33.383056 12383 tablet_replica.cc:330] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.384274 12383 raft_consensus.cc:2229] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.385174 12383 raft_consensus.cc:2258] T 78a0d32ee74448a6931819ee7d5e0f59 P cec0688f86d54789b9b9ecc924ddecf3 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.388527 12383 tablet_replica.cc:330] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.389927 12383 raft_consensus.cc:2229] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.391337 12383 raft_consensus.cc:2258] T 580037905a064c08b39df9f9843b5448 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.394629 12383 tablet_replica.cc:330] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.395267 23706 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.395578 12383 raft_consensus.cc:2229] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.395889 23706 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.396412 12383 raft_consensus.cc:2258] T 88888e6c2eb344e0b1468ef497832be3 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.400069 12383 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.401114 12383 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.401698 12383 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.403272 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.404804 12383 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.406108 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.407959 13904 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:33.409152 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.409327 12383 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:07:33.410046 23779 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:33.410526 23779 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:33.410887 23779 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:33.410178 23706 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.421710 12383 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.422753 23779 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:33.430635 14541 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.431951 23779 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.432934 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:33.433645 13906 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 24
I20260811 16:07:33.433774 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.435525 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.438443 12383 pending_rounds.cc:62] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.438918 12383 pending_rounds.cc:68] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 23 index: 12 } timestamp: 7317358372857696256 op_type: NO_OP noop_request { }
I20260811 16:07:33.439939 12383 raft_consensus.cc:2866] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.440877 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P cec0688f86d54789b9b9ecc924ddecf3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.449208 13906 raft_consensus.cc:2454] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:33.455051 14542 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.459967 23779 raft_consensus.cc:2781] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:33.467739 23779 raft_consensus.cc:686] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:33.467883 12383 tablet_replica.cc:330] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.469192 12383 raft_consensus.cc:2229] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.468837 23779 consensus_queue.cc:237] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.473444 12383 pending_rounds.cc:62] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.476248 12383 pending_rounds.cc:68] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 20 index: 12 } timestamp: 7317358329102389248 op_type: NO_OP noop_request { }
I20260811 16:07:33.477357 12383 raft_consensus.cc:2866] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.477754 12383 raft_consensus.cc:2258] T 47a99d649fa64ed18701c70592b7b534 P cec0688f86d54789b9b9ecc924ddecf3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.485572 23739 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.488729 23739 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.493208 23739 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.494397 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.495187 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:33.495267 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:33.507920 12383 tablet_replica.cc:330] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.509197 12383 raft_consensus.cc:2229] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.511937 12383 pending_rounds.cc:62] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
W20260811 16:07:33.512748 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:33.512625 12383 pending_rounds.cc:68] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 22 index: 11 } timestamp: 7317358300924674048 op_type: NO_OP noop_request { }
I20260811 16:07:33.516088 12383 raft_consensus.cc:2866] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.516417 12383 raft_consensus.cc:2258] T d9c0f5b985cc420c9dad45a78187a946 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.522094 13871 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.522683 13871 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.523636 23722 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:33.579397 12383 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.581334 12383 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.582074 12383 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.605083 23368 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.605685 23368 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.607990 23368 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.609350 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.610273 13906 raft_consensus.cc:2379] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cec0688f86d54789b9b9ecc924ddecf3 in current term 24: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:33.611528 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.613569 13706 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:33.615398 23368 raft_consensus.cc:3037] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:33.629102 12383 tablet_replica.cc:330] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.642714 12383 raft_consensus.cc:2229] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.647708 13906 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260811 16:07:33.657851 12383 pending_rounds.cc:62] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.658349 12383 pending_rounds.cc:68] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 17 index: 11 } timestamp: 7317358291718115328 op_type: NO_OP noop_request { }
I20260811 16:07:33.659032 12383 raft_consensus.cc:2866] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.659498 12383 raft_consensus.cc:2258] T ff741363b70845aeab13c5999c9843e4 P cec0688f86d54789b9b9ecc924ddecf3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.658303 23709 raft_consensus.cc:482] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.657982 23746 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.662837 23447 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.669152 23709 raft_consensus.cc:504] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:33.670733 23447 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.670974 23746 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.676810 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.659510 23736 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.010s
I20260811 16:07:33.678499 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11dc75ffca384b91994ceec6d295e6e8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:33.679229 23368 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:07:33.682204 14541 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.683641 13709 leader_election.cc:302] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:33.674925 23709 leader_election.cc:288] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:33.685312 13626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 313) took 24601 ms (client timeout 15000 ms). Trace:
I20260811 16:07:33.680397 23447 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:33.698671 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.699486 13906 raft_consensus.cc:2379] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 18: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
W20260811 16:07:33.698930 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:33.703370 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:33.706105 23781 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Advancing to term 18
W20260811 16:07:33.686653 13626 rpcz_store.cc:269] 0811 16:07:09.077019 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:09.077639 (+   620us) service_pool.cc:227] Handling call
0811 16:07:33.678035 (+24600396us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:33.365942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:33.366582 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:33.366632 (+    50us) write_op.cc:435] Acquired schema lock
0811 16:07:33.366654 (+    22us) tablet.cc:660] Decoding operations
0811 16:07:33.387238 (+ 20584us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:33.387333 (+    95us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:33.387360 (+    27us) tablet.cc:683] Acquiring locks for 22 operations
0811 16:07:33.410979 (+ 23619us) tablet.cc:699] Row locks acquired
0811 16:07:33.411001 (+    22us) write_op.cc:260] PREPARE: finished
0811 16:07:33.411191 (+   190us) write_op.cc:270] Start()
0811 16:07:33.411324 (+   133us) write_op.cc:276] Timestamp: P: 1786464453411103 usec, L: 0
0811 16:07:33.411342 (+    18us) op_driver.cc:331] REPLICATION: starting
0811 16:07:33.412077 (+   735us) log.cc:842] Serialized 8752 byte log entry
0811 16:07:33.441081 (+ 29004us) op_driver.cc:444] REPLICATION: finished
0811 16:07:33.456932 (+ 15851us) write_op.cc:301] APPLY: starting
0811 16:07:33.457025 (+    93us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:33.526131 (+ 69106us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:33.528011 (+  1880us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:33.577538 (+ 49527us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:33.577934 (+   396us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0811 16:07:33.577989 (+    55us) write_op.cc:312] APPLY: finished
0811 16:07:33.578415 (+   426us) log.cc:842] Serialized 196 byte log entry
0811 16:07:33.583325 (+  4910us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:33.583575 (+   250us) write_op.cc:454] Released schema lock
0811 16:07:33.583648 (+    73us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:33.639789 (+ 56141us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:33.641528 (+  1739us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19642,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":15541,"apply.run_cpu_time_us":27334,"apply.run_wall_time_us":196643,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95911,"num_ops":22,"prepare.queue_time_us":59092,"prepare.run_cpu_time_us":6380,"prepare.run_wall_time_us":48196,"replication_time_us":29623,"spinlock_wait_cycles":74752,"thread_start_us":66361,"threads_started":2}]]}
I20260811 16:07:33.692135 23709 raft_consensus.cc:2726] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260811 16:07:33.748376 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.749776 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.758100 23746 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:33.750905 12383 pending_rounds.cc:62] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Trying to abort 1 pending ops.
I20260811 16:07:33.760187 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:33.780772 13906 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
I20260811 16:07:33.763367 12383 pending_rounds.cc:68] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3: Aborting op as it isn't in flight: id { term: 25 index: 14 } timestamp: 7317358321825345536 op_type: NO_OP noop_request { }
I20260811 16:07:33.782517 12383 raft_consensus.cc:2866] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:07:33.783206 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P cec0688f86d54789b9b9ecc924ddecf3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:33.776903 13621 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.799098 13621 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:33.825420 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:33.833096 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:33.817379 13621 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:33.848892 23706 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.849650 23706 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.852017 23706 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:33.863040 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:33.845384 13621 catalog_manager.cc:5495] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 10 to 25. New cstate: current_term: 25 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:07:33.865162 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:33.866287 13621 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:33.869242 23781 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:07:33.877965 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43799.9us
W20260811 16:07:33.883378 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 73312.5us
W20260811 16:07:33.883616 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:33.886870 12383 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:33.926074 13621 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 17 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:33.927901 12383 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:33.938535 12383 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:33.913743 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:33.965195 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 167646us
I20260811 16:07:33.953095 23794 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.955772 23781 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:33.973999 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:33.979343 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:33.966452 23743 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:33.990868 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:33.991683 14573 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 20.
W20260811 16:07:33.997298 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:33.978641 23794 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.009830 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:34.012125 13906 raft_consensus.cc:1261] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260811 16:07:34.014382 14575 raft_consensus.cc:1261] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260811 16:07:33.989087 23743 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:33.987350 23781 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.018833 23705 consensus_queue.cc:1035] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260811 16:07:34.024797 23743 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.025679 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.020161 23368 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.027808 23368 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.033655 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.013500 23793 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.034896 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.036543 13825 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 27.
I20260811 16:07:34.039176 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.041285 23739 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:07:34.052570 23794 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.055315 23781 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.056041 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.042929 12383 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.059942 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.065699 12383 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.066956 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.046687 23739 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.070168 23746 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:34.070380 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.070699 23746 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.071228 23746 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.071542 13824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.072403 13824 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 27: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.073066 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.073875 14583 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 21: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:34.074636 23736 consensus_queue.cc:1035] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:34.076573 13621 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 19 to 21, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.078598 13905 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:07:34.082245 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.084296 23798 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:07:34.035846 23793 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.085144 23739 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.085179 13874 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:34.086144 13906 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:34.086997 23739 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.087743 23793 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.088982 14573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.089462 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.089696 14573 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:07:34.090178 14575 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.075256 13820 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:07:34.078444 13621 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 18 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.094414 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.096525 13820 raft_consensus.cc:2379] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 27: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.096339 13707 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
I20260811 16:07:34.095103 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.100123 14544 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:07:34.109097 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.110456 12383 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P cec0688f86d54789b9b9ecc924ddecf3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.102208 23794 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.112848 23794 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.113252 23794 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.113842 13621 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.104195 23368 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.109882 14575 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 26.
I20260811 16:07:34.102782 23709 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260811 16:07:34.120453 23709 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.120859 23709 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.132536 23781 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Advancing to term 27
W20260811 16:07:34.140797 13871 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.141368 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.142028 23781 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:34.142287 23792 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Advancing to term 27
I20260811 16:07:34.148662 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf
I20260811 16:07:34.149569 23743 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.150599 12383 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.150188 23743 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.151553 12383 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.152191 12383 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.152690 23743 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:34.153347 14541 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.155040 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.156399 23796 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.156919 23796 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.157274 23796 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.159602 23731 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.160219 23731 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.166780 23731 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.171641 23746 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.175547 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.176404 14583 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.177332 23746 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.180392 23709 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.184624 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.185369 13820 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.188143 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.188761 13906 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.189996 23739 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:07:34.190917 23792 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:07:34.195591 13820 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 28.
I20260811 16:07:34.187855 23794 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.197574 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.198483 13908 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.198640 13906 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.200421 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:34.201426 23731 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.201951 23731 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.202564 23731 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.201948 23794 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.198566 23796 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.208817 23796 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.216995 23792 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
W20260811 16:07:34.218789 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.222436 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.224229 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.195494 12383 tablet_replica.cc:330] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.227697 13825 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 22: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.228799 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:34.221707 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:34.232074 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:34.231993 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6a000330b3415da4f525eae84f33fb" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.232879 14583 raft_consensus.cc:3037] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.233331 13908 raft_consensus.cc:3037] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.236034 12383 raft_consensus.cc:2229] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.237270 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.238155 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.242909 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
W20260811 16:07:34.250284 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.250885 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.251606 14574 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 27 FOLLOWER]: Advancing to term 28
I20260811 16:07:34.258070 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.244261 23796 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260811 16:07:34.259776 12383 raft_consensus.cc:2258] T 11dc75ffca384b91994ceec6d295e6e8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.260746 14581 raft_consensus.cc:2379] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 22: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:34.265844 13787 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:34.264518 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.264144 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 28.
I20260811 16:07:34.251959 23709 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.219563 23792 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.303942 23746 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260811 16:07:34.307463 23731 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.310461 23731 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.316082 12383 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.318177 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210dcf7aee994bdaa1e75860a25bdd3a" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.321884 13906 raft_consensus.cc:3037] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.324908 23368 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.325523 23368 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.329685 23792 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.330077 13825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.330821 23368 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.332393 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97076df0f82e4818b7f7318f8deff8d8" candidate_uuid: "cec0688f86d54789b9b9ecc924ddecf3" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:07:34.334177 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.335490 12383 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.337978 13706 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cec0688f86d54789b9b9ecc924ddecf3; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:34.262954 23796 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.339386 23796 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Advancing to term 22
W20260811 16:07:34.339802 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.338303 12383 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.340718 23709 raft_consensus.cc:2684] T 97076df0f82e4818b7f7318f8deff8d8 P cec0688f86d54789b9b9ecc924ddecf3 [term 18 FOLLOWER]: Received pre-election callback for term 19 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 16:07:34.340209 13906 raft_consensus.cc:2454] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:34.343993 13789 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:34.344866 23746 raft_consensus.cc:2781] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:34.345784 23746 raft_consensus.cc:686] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.346638 23746 consensus_queue.cc:237] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.354257 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.356356 13908 raft_consensus.cc:2454] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:34.356644 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.360376 14583 raft_consensus.cc:2454] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 21.
I20260811 16:07:34.374064 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.374233 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cec0688f86d54789b9b9ecc924ddecf3 in term 28.
I20260811 16:07:34.376245 13706 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3; no voters: 
W20260811 16:07:34.376906 13706 raft_consensus.cc:2670] T c390fd23cec5435d81b38a50b2988a60 P cec0688f86d54789b9b9ecc924ddecf3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 16:07:34.377615 12383 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.378619 12383 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:34.389665 23796 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.391718 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 125955us
I20260811 16:07:34.394344 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.394423 14542 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:07:34.395030 13821 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 20.
I20260811 16:07:34.397001 13787 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.399201 23705 raft_consensus.cc:2781] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:34.399797 23705 raft_consensus.cc:686] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:34.400667 23705 consensus_queue.cc:237] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.408531 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.413913 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.416690 23736 raft_consensus.cc:2781] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:34.417083 23812 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:07:34.419775 23812 raft_consensus.cc:482] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.420166 23812 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:07:34.422268 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.423918 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.425796 13787 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.430869 12383 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.425192 23736 raft_consensus.cc:686] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.449334 23736 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.443637 13787 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.507932 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:34.513089 23815 log.cc:924] Time spent T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260811 16:07:34.519443 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.529707 23812 raft_consensus.cc:504] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.532455 23812 leader_election.cc:288] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:34.537017 13871 leader_election.cc:334] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.538395 23796 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.539965 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.544466 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.545377 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P cec0688f86d54789b9b9ecc924ddecf3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.549252 12383 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.544442 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0556c3c022b74f43b43aa6f25d418e58" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.551491 13817 raft_consensus.cc:3037] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:07:34.550870 12383 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:07:34.555423 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f5f6467bf4b427f873ea8d2990f2945" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.556144 14574 raft_consensus.cc:3037] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Advancing to term 22
I20260811 16:07:34.558018 12383 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P cec0688f86d54789b9b9ecc924ddecf3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.561352 12383 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.562206 12383 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:07:34.563366 12383 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P cec0688f86d54789b9b9ecc924ddecf3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.566649 12383 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3: stopping tablet replica
I20260811 16:07:34.570583 12383 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:34.571439 12383 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P cec0688f86d54789b9b9ecc924ddecf3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:34.578464 23706 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.579164 23706 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.580806 14574 raft_consensus.cc:2454] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
I20260811 16:07:34.593523 23706 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:34.614670 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:34.617122 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:34.618577 23792 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.619275 23792 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.622015 23792 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.622938 23706 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.623571 23706 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.625680 23706 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.628499 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.598609 13817 raft_consensus.cc:2454] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 21.
I20260811 16:07:34.599489 13787 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:07:34.636154 13787 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.638165 23736 raft_consensus.cc:2781] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader election won for term 22
I20260811 16:07:34.638830 23736 raft_consensus.cc:686] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.639922 23736 consensus_queue.cc:237] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.600205 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:34.603101 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.644659 13821 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:34.646242 23779 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.646939 23779 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.651243 23779 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.654884 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.659790 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.669315 23706 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.669898 23706 raft_consensus.cc:482] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.670248 23706 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.672245 23736 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.672909 23736 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.669380 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:07:34.675565 23736 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.675217 23792 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:34.676971 23792 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.679527 23792 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.679419 23706 raft_consensus.cc:504] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.696877 23706 leader_election.cc:288] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:34.700286 13621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 217) took 25149 ms (client timeout 15000 ms). Trace:
I20260811 16:07:34.691273 23818 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.729429 23818 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.732077 23818 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.673484 13874 leader_election.cc:302] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:34.694769 14541 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.688072 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 50516.1us
I20260811 16:07:34.702394 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af4dc0ff3ced489a86fe70cfbac98798" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
W20260811 16:07:34.708055 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.721434 13620 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 16 to 17, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:34.736968 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:34.737715 14541 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.738052 13817 raft_consensus.cc:3037] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.738657 23706 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:34.738886 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44164us
W20260811 16:07:34.741354 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.733178 13874 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 59793.5us
I20260811 16:07:34.742170 23793 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.742727 23793 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.743643 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.744299 13904 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
I20260811 16:07:34.745838 23793 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.746656 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.747447 23812 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.747848 23812 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.748013 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.747470 13820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:34.749634 13820 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
I20260811 16:07:34.748265 23812 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.750216 23779 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.750658 23779 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.751065 23779 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:34.729305 13621 rpcz_store.cc:269] 0811 16:07:09.550982 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:10.047305 (+496323us) service_pool.cc:227] Handling call
0811 16:07:34.700195 (+24652890us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:34.343979 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:34.344509 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:34.344543 (+    34us) write_op.cc:435] Acquired schema lock
0811 16:07:34.344559 (+    16us) tablet.cc:660] Decoding operations
0811 16:07:34.345506 (+   947us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:34.345596 (+    90us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:34.345634 (+    38us) tablet.cc:683] Acquiring locks for 9 operations
0811 16:07:34.346361 (+   727us) tablet.cc:699] Row locks acquired
0811 16:07:34.346381 (+    20us) write_op.cc:260] PREPARE: finished
0811 16:07:34.346524 (+   143us) write_op.cc:270] Start()
0811 16:07:34.346658 (+   134us) write_op.cc:276] Timestamp: P: 1786464454346476 usec, L: 0
0811 16:07:34.346679 (+    21us) op_driver.cc:331] REPLICATION: starting
0811 16:07:34.371232 (+ 24553us) log.cc:842] Serialized 3664 byte log entry
0811 16:07:34.420043 (+ 48811us) op_driver.cc:444] REPLICATION: finished
0811 16:07:34.445918 (+ 25875us) write_op.cc:301] APPLY: starting
0811 16:07:34.446014 (+    96us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:34.559383 (+113369us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:34.559521 (+   138us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:34.585029 (+ 25508us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:34.595381 (+ 10352us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0811 16:07:34.595450 (+    69us) write_op.cc:312] APPLY: finished
0811 16:07:34.595793 (+   343us) log.cc:842] Serialized 89 byte log entry
0811 16:07:34.599219 (+  3426us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.599405 (+   186us) write_op.cc:454] Released schema lock
0811 16:07:34.599453 (+    48us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:34.622781 (+ 23328us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.622824 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":776,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":25558,"apply.run_cpu_time_us":15078,"apply.run_wall_time_us":177339,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41675,"num_ops":9,"prepare.queue_time_us":148310,"prepare.run_cpu_time_us":3867,"prepare.run_wall_time_us":27636,"replication_time_us":73247,"thread_start_us":144237,"threads_started":2}]]}
W20260811 16:07:34.754482 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:34.733779 23792 raft_consensus.cc:2781] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:07:34.758033 13620 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 21, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.758831 23792 raft_consensus.cc:686] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:34.760457 13817 raft_consensus.cc:2454] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 25.
I20260811 16:07:34.760021 23792 consensus_queue.cc:237] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.760216 13620 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 18 to 22, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.761560 14544 leader_election.cc:302] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.764120 23794 raft_consensus.cc:2781] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:34.764708 23794 raft_consensus.cc:686] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:34.765679 23794 consensus_queue.cc:237] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.770392 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.771126 14575 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:34.771045 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:34.771837 13906 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 22.
W20260811 16:07:34.774397 14541 leader_election.cc:334] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.778630 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: 
I20260811 16:07:34.778926 13620 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.783699 23818 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:34.785454 23812 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.786929 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.801559 23818 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.802184 23818 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:34.802667 23736 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:34.802876 23812 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.803122 23736 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.803649 23736 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:34.810014 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:34.813508 23736 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.782634 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
W20260811 16:07:34.795816 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.802246 13620 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 20, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 20 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:34.817781 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.818109 13620 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.819723 23812 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:34.820206 23812 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:34.820613 23812 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:34.819917 13620 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:34.821820 13620 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:34.826151 23821 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.826779 23821 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.827303 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.828955 23821 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.829173 23796 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.829710 23796 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.831509 23736 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.831841 23796 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.789696 23779 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.834220 23779 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:34.836236 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.841187 13620 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:34.845862 13906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.848132 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.850255 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:34.854763 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.856534 13906 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d98491a0db549d0b671b60b90c9cdea in current term 25: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:34.856913 13904 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
I20260811 16:07:34.857872 13620 catalog_manager.cc:5495] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:34.860719 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.861631 14575 raft_consensus.cc:2379] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 25: Already voted for candidate 8d98491a0db549d0b671b60b90c9cdea in this term.
I20260811 16:07:34.865283 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:34.865965 14575 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
W20260811 16:07:34.866492 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:07:34.869340 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.869783 13871 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.883597 23821 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:07:34.887253 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:34.887953 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.888202 23792 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:34.888675 23792 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.889003 23731 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:34.889108 23792 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:34.889528 23731 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:34.889979 23731 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:34.887454 13908 raft_consensus.cc:1261] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260811 16:07:34.896210 23796 consensus_queue.cc:1035] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:07:34.897083 23818 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.898324 13905 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f46150fac70458986206ec7af67a403 in current term 23: Already voted for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in this term.
I20260811 16:07:34.901571 23731 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.904412 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.908772 23796 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:34.879442 23812 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:34.909374 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.909870 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.910601 23821 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:34.910738 23812 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:34.910980 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.915944 23731 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:34.925823 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580037905a064c08b39df9f9843b5448" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:34.926518 13908 raft_consensus.cc:3037] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:34.930184 23792 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:34.937198 23818 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:07:34.940717 13817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:34.946779 13817 raft_consensus.cc:2379] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5088cdd3f79d4c47ba826dc820b3cfaf in current term 23: Already voted for candidate 5f46150fac70458986206ec7af67a403 in this term.
I20260811 16:07:34.949972 13908 raft_consensus.cc:2454] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:34.950975 13904 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:34.961687 23812 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:07:34.964757 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.966230 14541 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:34.965174 13787 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.967687 13789 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:34.967587 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:34.968770 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:34.972527 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "673bb1bb89d4450ba4dbcb918a9174e0" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:34.973167 14575 raft_consensus.cc:3037] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:34.975469 23731 raft_consensus.cc:2781] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:34.987221 23705 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260811 16:07:34.988672 23736 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:34.996069 23792 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.996196 23731 raft_consensus.cc:686] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:34.997524 23731 consensus_queue.cc:237] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:34.968235 23812 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.005116 23812 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:34.975215 23818 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260811 16:07:35.006814 13820 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:35.007869 13821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403" is_pre_election: true
I20260811 16:07:35.008522 13821 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
I20260811 16:07:35.009688 23706 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:35.012701 13904 raft_consensus.cc:1261] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:35.014536 23706 consensus_queue.cc:1035] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:35.028563 13620 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 332) took 23324 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.029124 13620 rpcz_store.cc:269] 0811 16:07:11.704239 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:20.684758 (+8980519us) service_pool.cc:227] Handling call
0811 16:07:22.287590 (+1602832us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54000311d4. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c51891af0 00007f5c51914f2a 00007f5c57866d6c 00007f5c57960c3e 00007f5c55c72fb4 00007f5c55c72f42 00007f5c55c72e71 00007f5c55c72dec 00007f5c55c720a2 00007f5c4fd3694c 00007f5c4fd35d86
0811 16:07:35.016689 (+12729099us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:34.870851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:34.871405 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:34.871456 (+    51us) write_op.cc:435] Acquired schema lock
0811 16:07:34.871474 (+    18us) tablet.cc:660] Decoding operations
0811 16:07:34.872462 (+   988us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:34.872522 (+    60us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:34.872558 (+    36us) tablet.cc:683] Acquiring locks for 10 operations
0811 16:07:34.873401 (+   843us) tablet.cc:699] Row locks acquired
0811 16:07:34.873416 (+    15us) write_op.cc:260] PREPARE: finished
0811 16:07:34.873573 (+   157us) write_op.cc:270] Start()
0811 16:07:34.873690 (+   117us) write_op.cc:276] Timestamp: P: 1786464454873522 usec, L: 0
0811 16:07:34.873709 (+    19us) op_driver.cc:331] REPLICATION: starting
0811 16:07:34.874406 (+   697us) log.cc:842] Serialized 4004 byte log entry
0811 16:07:34.878364 (+  3958us) op_driver.cc:444] REPLICATION: finished
0811 16:07:34.881173 (+  2809us) write_op.cc:301] APPLY: starting
0811 16:07:34.881280 (+   107us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:34.886585 (+  5305us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:34.886710 (+   125us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:34.910296 (+ 23586us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:34.916466 (+  6170us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0811 16:07:34.916529 (+    63us) write_op.cc:312] APPLY: finished
0811 16:07:34.916862 (+   333us) log.cc:842] Serialized 97 byte log entry
0811 16:07:34.919624 (+  2762us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.934438 (+ 14814us) write_op.cc:454] Released schema lock
0811 16:07:34.934528 (+    90us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:34.934886 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:34.934917 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2913764,"reported_tablets":47,"spinlock_wait_cycles":1024058240,"child_traces":[["op",{"apply.queue_time_us":2509,"apply.run_cpu_time_us":13790,"apply.run_wall_time_us":55400,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41720,"num_ops":10,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":3930,"prepare.run_wall_time_us":18484,"replication_time_us":4528}]]}
I20260811 16:07:35.037155 14574 raft_consensus.cc:1261] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:35.040693 23736 consensus_queue.cc:1035] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260811 16:07:35.054443 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:35.063979 13871 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:07:35.035311 14575 raft_consensus.cc:2454] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
I20260811 16:07:35.079895 14575 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260811 16:07:35.103653 23731 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 16:07:35.140928 14541 connection.cc:698] client connection to 127.12.23.193:40411 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:07:35.116430 13871 connection.cc:698] client connection to 127.12.23.193:40411 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:07:35.143328 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:07:35.144646 13871 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: sendmsg error: Broken pipe (error 32)
I20260811 16:07:35.148342 13821 raft_consensus.cc:1261] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260811 16:07:35.152081 23792 consensus_queue.cc:1035] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260811 16:07:35.186970 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:35.227414 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c952fbefaf4aa7b441b3d2c248f25c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:35.228123 14574 raft_consensus.cc:3037] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
I20260811 16:07:35.233170 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:35.233989 14575 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 18.
W20260811 16:07:35.250581 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:35.267637 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:35.268544 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:35.272745 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.276917 13871 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.278258 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.278273 23821 raft_consensus.cc:2781] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:35.279559 23821 raft_consensus.cc:686] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:35.280568 23821 consensus_queue.cc:237] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.282536 23818 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260811 16:07:35.283008 23818 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:35.283372 23818 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Advancing to term 19
I20260811 16:07:35.285339 14574 raft_consensus.cc:2454] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:07:35.291384 13823 raft_consensus.cc:1261] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260811 16:07:35.293493 23794 consensus_queue.cc:1035] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260811 16:07:35.311049 13871 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.302794 23818 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.314719 23818 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.316336 23812 raft_consensus.cc:2781] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:35.317116 23812 raft_consensus.cc:686] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:35.318171 23792 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.318058 23812 consensus_queue.cc:237] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.318794 23792 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.321053 23792 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.323177 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5f46150fac70458986206ec7af67a403"
I20260811 16:07:35.324100 13823 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:35.333796 13624 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 328) took 121135 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.334383 13624 rpcz_store.cc:269] 0811 16:05:34.198954 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:34.199335 (+   381us) service_pool.cc:227] Handling call
0811 16:07:35.333670 (+121134335us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11101,"reported_tablets":47}
I20260811 16:07:35.338332 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:35.337364 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ad41e4f434442792e36eb47449b101" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:35.344472 14574 raft_consensus.cc:3037] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Advancing to term 19
W20260811 16:07:35.347185 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.348116 13823 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:35.355408 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:35.390391 14574 raft_consensus.cc:2454] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 19.
W20260811 16:07:35.394184 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:35.394975 13871 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:35.403478 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.403955 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.415393 23812 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:35.416397 13871 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:07:35.424240 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:35.428050 13908 raft_consensus.cc:1261] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:35.429855 23731 consensus_queue.cc:1035] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:35.427758 23812 raft_consensus.cc:2781] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader election won for term 19
I20260811 16:07:35.431716 23812 raft_consensus.cc:686] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:35.432780 23812 consensus_queue.cc:237] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:35.449298 13625 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 310) took 103070 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.451076 13625 rpcz_store.cc:269] 0811 16:05:52.378799 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:52.449622 (+ 70823us) service_pool.cc:227] Handling call
0811 16:07:35.448511 (+102998889us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":778958,"reported_tablets":47}
W20260811 16:07:35.518862 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:35.569229 13628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 215) took 83718 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.580166 13628 rpcz_store.cc:269] 0811 16:06:11.850829 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:11.851184 (+   355us) service_pool.cc:227] Handling call
0811 16:07:35.568994 (+83717810us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":40}
I20260811 16:07:35.625312 23706 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.625964 23706 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.630671 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:35.636356 23706 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:35.638796 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.639570 14541 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.641974 23794 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:07:35.703435 13630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 214) took 108195 ms (client timeout 15000 ms). Trace:
W20260811 16:07:35.712811 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:35.704104 13630 rpcz_store.cc:269] 0811 16:05:47.508145 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:05:47.508366 (+   221us) service_pool.cc:227] Handling call
0811 16:07:35.703216 (+108194850us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55270,"reported_tablets":40}
I20260811 16:07:35.720391 23736 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:35.721161 23736 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.717080 13622 catalog_manager.cc:5495] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 14 to 18, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 18 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.732784 13622 catalog_manager.cc:5495] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 17, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.735165 13622 catalog_manager.cc:5495] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 22 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:07:35.738935 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:35.740551 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.743175 23736 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.740077 13622 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 21, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.745374 13622 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.746675 13622 catalog_manager.cc:5495] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.747434 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:35.748160 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 28.
I20260811 16:07:35.743021 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:35.750643 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 28.
I20260811 16:07:35.760733 13622 catalog_manager.cc:5495] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:35.768679 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:35.762678 13622 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.762478 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.770674 13622 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 23, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 23 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.772339 23796 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260811 16:07:35.772851 23796 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:35.773208 23796 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:35.772378 13622 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 19, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.775904 13622 catalog_manager.cc:5495] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 23, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 23 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.780717 23706 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.781384 23706 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.782191 13622 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.783857 13622 catalog_manager.cc:5495] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.787101 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:35.787866 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 22.
I20260811 16:07:35.785405 13622 catalog_manager.cc:5495] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
W20260811 16:07:35.788499 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.790364 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.789714 13622 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.791896 23794 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:35.792317 23794 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:35.791656 13622 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.792687 23794 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:35.793571 13622 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 20, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 20 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.795482 13622 catalog_manager.cc:5495] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.797991 13622 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.798696 23706 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:35.799710 13622 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 25, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 25 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.806314 23794 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.807781 13622 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 20, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 20 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.794327 23796 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.812261 13622 catalog_manager.cc:5495] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.816169 13622 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:35.818320 13622 catalog_manager.cc:5495] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.819752 13622 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.822703 13622 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:35.830758 14541 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:35.836637 13787 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:35.839321 23794 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:35.840436 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:35.840567 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:35.841138 13908 raft_consensus.cc:3037] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:35.841233 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:35.843402 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:35.844048 14574 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Advancing to term 29
I20260811 16:07:35.845496 23796 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:35.849575 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 29.
I20260811 16:07:35.855744 13622 catalog_manager.cc:5495] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.863497 13622 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 9 to 12, term changed from 14 to 16, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.854976 14574 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 29.
I20260811 16:07:35.866393 13787 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.854976 13908 raft_consensus.cc:2454] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 23.
I20260811 16:07:35.867849 13823 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:35.866468 13622 catalog_manager.cc:5495] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 23, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 23 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.867835 14542 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:35.869716 13622 catalog_manager.cc:5495] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:35.871318 13622 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.872026 23812 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:35.867835 23796 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Leader election won for term 29
I20260811 16:07:35.873601 23796 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:35.873386 13622 catalog_manager.cc:5495] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.875391 13622 catalog_manager.cc:5495] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 15 to 17, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 17 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:35.876792 23794 raft_consensus.cc:2781] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election won for term 23
I20260811 16:07:35.874619 23796 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.877473 23794 raft_consensus.cc:686] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:07:35.877419 13622 catalog_manager.cc:5495] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.884939 13622 catalog_manager.cc:5495] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.880174 23794 consensus_queue.cc:237] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:35.886691 13622 catalog_manager.cc:5495] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:35.891754 14574 raft_consensus.cc:1261] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260811 16:07:35.893442 23818 consensus_queue.cc:1035] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260811 16:07:35.938385 14583 raft_consensus.cc:1261] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260811 16:07:35.941493 23812 consensus_queue.cc:1035] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260811 16:07:35.947955 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:36.008455 23829 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.009101 23829 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.012660 23829 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:36.014266 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:07:36.022508 14541 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.023087 14541 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.025408 23829 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:07:36.068600 23812 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.069232 23812 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.075050 23812 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.078173 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:36.078984 14574 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 22.
W20260811 16:07:36.089906 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.094707 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.108013 23818 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.110833 14574 raft_consensus.cc:1261] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260811 16:07:36.115013 23856 consensus_queue.cc:1035] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260811 16:07:36.109015 23818 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.109282 23812 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260811 16:07:36.124426 23812 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.124890 23812 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Advancing to term 23
W20260811 16:07:36.134611 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:36.148514 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:36.149359 14583 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 24.
I20260811 16:07:36.137440 23818 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:36.157212 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:36.159596 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:36.161551 23855 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260811 16:07:36.162003 23855 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting leader election (detected failure of leader cec0688f86d54789b9b9ecc924ddecf3)
I20260811 16:07:36.162411 23855 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:36.176903 12383 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:36.203100 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.210574 23855 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.212836 23855 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:07:36.213583 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:36.220628 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:36.214406 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.232607 23812 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.244925 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa7e1db174a419e955a8806d40e8a14" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:36.245682 14574 raft_consensus.cc:3037] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Advancing to term 25
W20260811 16:07:36.250627 13871 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.258147 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:36.261646 14574 raft_consensus.cc:2454] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
W20260811 16:07:36.244940 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.257571 23812 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.275501 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "111ca2b9029e420191db21651d7c7015" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:36.276196 14583 raft_consensus.cc:3037] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Advancing to term 23
I20260811 16:07:36.278129 13871 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.286931 14583 raft_consensus.cc:2454] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 23.
I20260811 16:07:36.288825 23856 raft_consensus.cc:2781] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader election won for term 25
I20260811 16:07:36.289522 23856 raft_consensus.cc:686] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:36.300773 23856 consensus_queue.cc:237] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.342712 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 60982.6us
W20260811 16:07:36.343556 13871 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.348927 14583 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260811 16:07:36.352156 13871 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.356355 23736 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260811 16:07:36.360376 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.366829 23868 raft_consensus.cc:2781] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader election won for term 23
W20260811 16:07:36.403326 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:36.394953 23868 raft_consensus.cc:686] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:36.405401 23868 consensus_queue.cc:237] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.416744 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.435793 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:36.484275 13904 raft_consensus.cc:1261] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260811 16:07:36.486768 23860 consensus_queue.cc:1035] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:36.528405 13905 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260811 16:07:36.533254 13622 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60732 (request call id 314) took 6473 ms. Trace:
I20260811 16:07:36.533715 13622 rpcz_store.cc:276] 0811 16:07:30.060232 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:30.414345 (+354113us) service_pool.cc:227] Handling call
0811 16:07:36.533158 (+6118813us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:35.964850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:35.965393 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:35.965424 (+    31us) write_op.cc:435] Acquired schema lock
0811 16:07:35.965440 (+    16us) tablet.cc:660] Decoding operations
0811 16:07:35.967789 (+  2349us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:35.967894 (+   105us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:35.967929 (+    35us) tablet.cc:683] Acquiring locks for 36 operations
0811 16:07:35.974833 (+  6904us) tablet.cc:699] Row locks acquired
0811 16:07:35.974853 (+    20us) write_op.cc:260] PREPARE: finished
0811 16:07:35.975008 (+   155us) write_op.cc:270] Start()
0811 16:07:35.975115 (+   107us) write_op.cc:276] Timestamp: P: 1786464455974957 usec, L: 0
0811 16:07:35.975158 (+    43us) op_driver.cc:331] REPLICATION: starting
0811 16:07:35.999597 (+ 24439us) log.cc:842] Serialized 14275 byte log entry
0811 16:07:36.080294 (+ 80697us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b1800318880. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c578838b1 00007f5c57890661 00007f5c4e9c6345 00007f5c577fda39 00007f5c4e9e38bb 00007f5c4e9e1cbf 00007f5c4e9e1155 00007f5c518a1a30 00007f5c5189b44d 00007f5c5189a78b 00007f5c518a5220
0811 16:07:36.113020 (+ 32726us) op_driver.cc:444] REPLICATION: finished
0811 16:07:36.204591 (+ 91571us) write_op.cc:301] APPLY: starting
0811 16:07:36.204676 (+    85us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:36.296133 (+ 91457us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:36.296176 (+    43us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:36.465887 (+169711us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:36.466400 (+   513us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=72,key_file_lookups=72,delta_file_lookups=0,mrs_lookups=0
0811 16:07:36.466456 (+    56us) write_op.cc:312] APPLY: finished
0811 16:07:36.467072 (+   616us) log.cc:842] Serialized 308 byte log entry
0811 16:07:36.467981 (+   909us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.468333 (+   352us) write_op.cc:454] Released schema lock
0811 16:07:36.468420 (+    87us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:36.480456 (+ 12036us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.480490 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22483,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":91261,"apply.run_cpu_time_us":49294,"apply.run_wall_time_us":276580,"cfile_cache_hit":146,"cfile_cache_hit_bytes":154319,"num_ops":36,"prepare.queue_time_us":9341,"prepare.run_cpu_time_us":8148,"prepare.run_wall_time_us":82308,"raft.queue_time_us":68836,"raft.run_cpu_time_us":39353,"raft.run_wall_time_us":65261,"replication_time_us":137755,"spinlock_wait_cycles":3315456,"thread_start_us":127703,"threads_started":4,"wal-append.queue_time_us":7357}]]}
I20260811 16:07:36.536398 23736 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:36.562891 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.576704 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:36.605031 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:36.639568 13626 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.645963 13626 catalog_manager.cc:5495] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 20, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 20 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.648234 13626 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 18 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.651099 13626 catalog_manager.cc:5495] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.652741 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 24, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.662925 13626 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 21 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.665135 13626 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 21, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.666893 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 21 to 24, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 24 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.669198 13626 catalog_manager.cc:5495] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 20 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:36.673019 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.670936 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 19 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 22 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:36.682268 13626 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 15 to 17, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193). New cstate: current_term: 17 leader_uuid: "cec0688f86d54789b9b9ecc924ddecf3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:36.683605 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.696698 13623 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 216) took 60174 ms (client timeout 15000 ms). Trace:
W20260811 16:07:36.697178 13623 rpcz_store.cc:269] 0811 16:06:36.530392 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:06:36.538861 (+  8469us) service_pool.cc:227] Handling call
0811 16:07:36.696477 (+60157616us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":213289,"reported_tablets":40}
W20260811 16:07:36.698197 13686 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.698593 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.711652 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:36.739542 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:36.745867 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.747516 23871 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:36.748214 23871 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:36.750697 23871 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.773084 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:07:36.773871 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:07:36.777618 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:36.778790 23872 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:07:36.779366 23872 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:36.779803 23872 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:36.790130 23872 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.791667 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.794486 23878 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:07:36.795295 23878 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:36.796993 23872 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:07:36.798465 23878 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:36.816720 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.823593 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9315a4a479754517bd121148cf017615" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:07:36.824366 14574 raft_consensus.cc:3037] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
I20260811 16:07:36.832906 14574 raft_consensus.cc:2454] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:07:36.835563 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:07:36.835837 13871 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:07:36.836306 13905 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 23.
W20260811 16:07:36.836840 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:36.837425 23871 raft_consensus.cc:2781] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:07:36.838066 23871 raft_consensus.cc:686] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:07:36.840799 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:36.842334 23878 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260811 16:07:36.842758 23878 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:07:36.843122 23878 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:36.839092 23871 consensus_queue.cc:237] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:36.858372 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:36.868834 13627 catalog_manager.cc:5495] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 15 to 19, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.880820 13626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60742 (request call id 333) took 6107 ms. Trace:
I20260811 16:07:36.893172 14574 raft_consensus.cc:1261] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260811 16:07:36.912333 13626 rpcz_store.cc:276] 0811 16:07:30.773212 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:33.716670 (+2943458us) service_pool.cc:227] Handling call
0811 16:07:36.880708 (+3164038us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:36.717579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:36.727286 (+  9707us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:36.736837 (+  9551us) write_op.cc:435] Acquired schema lock
0811 16:07:36.736856 (+    19us) tablet.cc:660] Decoding operations
0811 16:07:36.737947 (+  1091us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:36.738016 (+    69us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:36.738041 (+    25us) tablet.cc:683] Acquiring locks for 11 operations
0811 16:07:36.751002 (+ 12961us) tablet.cc:699] Row locks acquired
0811 16:07:36.751027 (+    25us) write_op.cc:260] PREPARE: finished
0811 16:07:36.751252 (+   225us) write_op.cc:270] Start()
0811 16:07:36.751381 (+   129us) write_op.cc:276] Timestamp: P: 1786464456751205 usec, L: 0
0811 16:07:36.751403 (+    22us) op_driver.cc:331] REPLICATION: starting
0811 16:07:36.752169 (+   766us) log.cc:842] Serialized 4367 byte log entry
0811 16:07:36.798181 (+ 46012us) op_driver.cc:444] REPLICATION: finished
0811 16:07:36.798525 (+   344us) write_op.cc:301] APPLY: starting
0811 16:07:36.798613 (+    88us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:36.803964 (+  5351us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:36.804089 (+   125us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:36.810717 (+  6628us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:36.810987 (+   270us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0811 16:07:36.811049 (+    62us) write_op.cc:312] APPLY: finished
0811 16:07:36.819364 (+  8315us) log.cc:842] Serialized 105 byte log entry
0811 16:07:36.819583 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.819750 (+   167us) write_op.cc:454] Released schema lock
0811 16:07:36.819810 (+    60us) write_op.cc:341] FINISH: Updating metrics
0811 16:07:36.848177 (+ 28367us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.848220 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9663,"reported_tablets":47,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":14148,"apply.run_wall_time_us":50099,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45892,"num_ops":11,"prepare.queue_time_us":10834,"prepare.run_cpu_time_us":4359,"prepare.run_wall_time_us":48431,"replication_time_us":46671,"thread_start_us":7926,"threads_started":1}]]}
W20260811 16:07:36.898715 13871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 400 similar messages]
I20260811 16:07:36.882037 13627 catalog_manager.cc:5495] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 15 to 18, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 18 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.894724 23878 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:07:36.920949 13871 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:36.926949 13627 catalog_manager.cc:5495] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 24 to 28, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 28 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.947099 13627 catalog_manager.cc:5495] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 20 to 24, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 24 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:36.935379 23878 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Requested vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:36.943727 13787 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:36.932301 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:36.954280 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:36.958171 23872 consensus_queue.cc:1035] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:36.963491 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb6122695854eb8a6ab98b508c17b30" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:07:36.964249 13904 raft_consensus.cc:3037] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Advancing to term 24
I20260811 16:07:36.976708 13904 raft_consensus.cc:2454] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f46150fac70458986206ec7af67a403 in term 24.
I20260811 16:07:37.008000 13789 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403; no voters: cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:07:37.010659 23878 raft_consensus.cc:2781] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Leader election won for term 24
I20260811 16:07:37.011634 23878 raft_consensus.cc:686] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Becoming Leader. State: Replica: 5f46150fac70458986206ec7af67a403, State: Running, Role: LEADER
I20260811 16:07:37.012686 23878 consensus_queue.cc:237] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:07:37.031354 13623 catalog_manager.cc:5495] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 22 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.033735 14575 raft_consensus.cc:1261] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260811 16:07:37.034332 13623 catalog_manager.cc:5495] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 22 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.042025 23871 consensus_queue.cc:1035] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:37.051024 13623 catalog_manager.cc:5495] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.053355 13623 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.062296 13623 catalog_manager.cc:5495] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 16 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.064414 13623 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 26, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.066141 13623 catalog_manager.cc:5495] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 23 to 25, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 25 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.075791 13623 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 29, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 29 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.078226 13627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55174 (request call id 218) took 6652 ms. Trace:
I20260811 16:07:37.078588 13627 rpcz_store.cc:276] 0811 16:07:30.426005 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:07:32.776230 (+2350225us) service_pool.cc:227] Handling call
0811 16:07:37.006682 (+4230452us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:37.006710 (+    28us) write_op.cc:454] Released schema lock
0811 16:07:37.078171 (+ 71461us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 16:07:36.967456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 16:07:36.967931 (+   475us) write_op.cc:432] Acquiring schema lock in shared mode
0811 16:07:36.967960 (+    29us) write_op.cc:435] Acquired schema lock
0811 16:07:36.967971 (+    11us) tablet.cc:660] Decoding operations
0811 16:07:36.968523 (+   552us) write_op.cc:620] Acquiring the partition lock for write op
0811 16:07:36.968615 (+    92us) write_op.cc:641] Partition lock acquired for write op
0811 16:07:36.968647 (+    32us) tablet.cc:683] Acquiring locks for 4 operations
0811 16:07:36.969053 (+   406us) tablet.cc:699] Row locks acquired
0811 16:07:36.969067 (+    14us) write_op.cc:260] PREPARE: finished
0811 16:07:36.969213 (+   146us) write_op.cc:270] Start()
0811 16:07:36.969314 (+   101us) write_op.cc:276] Timestamp: P: 1786464456969161 usec, L: 0
0811 16:07:36.969333 (+    19us) op_driver.cc:331] REPLICATION: starting
0811 16:07:36.970029 (+   696us) log.cc:842] Serialized 1682 byte log entry
0811 16:07:36.972463 (+  2434us) op_driver.cc:444] REPLICATION: finished
0811 16:07:36.972938 (+   475us) write_op.cc:301] APPLY: starting
0811 16:07:36.973021 (+    83us) tablet.cc:1365] starting BulkCheckPresence
0811 16:07:36.975481 (+  2460us) tablet.cc:1368] finished BulkCheckPresence
0811 16:07:36.975607 (+   126us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 16:07:36.978089 (+  2482us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 16:07:36.978292 (+   203us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0811 16:07:36.978347 (+    55us) write_op.cc:312] APPLY: finished
0811 16:07:36.978606 (+   259us) log.cc:842] Serialized 49 byte log entry
0811 16:07:36.979572 (+   966us) write_op.cc:489] Releasing partition, row and schema locks
0811 16:07:36.979701 (+   129us) write_op.cc:454] Released schema lock
0811 16:07:36.979747 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6614,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":6293,"apply.run_wall_time_us":7128,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16688,"num_ops":4,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":2848,"prepare.run_wall_time_us":2849,"replication_time_us":3017}]]}
I20260811 16:07:37.084266 13623 catalog_manager.cc:5495] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 22, leader changed from 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 22 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.086079 13623 catalog_manager.cc:5495] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.087785 13623 catalog_manager.cc:5495] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.089475 13623 catalog_manager.cc:5495] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 22, leader changed from 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.091253 13623 catalog_manager.cc:5495] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 23 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.093627 13623 catalog_manager.cc:5495] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 20 to 21, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 21 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } }
I20260811 16:07:37.095108 13623 catalog_manager.cc:5495] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 21 to 23, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:37.109972 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.177631 12383 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:37.185840 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.216473 13626 catalog_manager.cc:5495] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 24 to 25, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 25 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:37.227625 13626 catalog_manager.cc:5495] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 23 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:37.228523 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.230230 13626 catalog_manager.cc:5495] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 23, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 23 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:37.235584 13626 catalog_manager.cc:5495] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 22 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 24 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:37.237186 13626 catalog_manager.cc:5495] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 17 to 19, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 19 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:37.240199 13626 catalog_manager.cc:5495] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 24 to 26, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:37.242519 13626 catalog_manager.cc:5495] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 24 to 25, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 25 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:07:37.266603 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:37.267307 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:37.267748 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:37.269838 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.283885 13623 catalog_manager.cc:5495] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 reported cstate change: term changed from 22 to 24, leader changed from cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) to 5f46150fac70458986206ec7af67a403 (127.12.23.194). New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:37.307255 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:37.453305 14575 raft_consensus.cc:1261] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260811 16:07:37.455780 23868 consensus_queue.cc:1035] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:37.458985 13904 raft_consensus.cc:1261] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260811 16:07:37.460897 23796 consensus_queue.cc:1035] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:07:37.520205 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.555013 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.555773 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.641175 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:37.666826 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:37.799374 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.847985 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.855852 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:37.966893 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:37.971434 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:37.987767 13904 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.011432 13825 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260811 16:07:38.013415 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 962f3dc40b494dc48647abd894784e8d. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.013906 23868 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260811 16:07:38.015743 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.026306 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:38.031544 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.075817 23871 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Committing config change with OpId 26.15: config changed from index -1 to 15, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.080001 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.087762 13817 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Committing config change with OpId 26.15: config changed from index -1 to 15, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.112210 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:38.129361 13904 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.146236 13626 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 15, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:38.150094 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20f7937a4cf04cef96095a62cb4ef661. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.154515 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.166505 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260811 16:07:38.168220 23866 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:38.178134 12383 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:38.222640 23868 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.224696 13825 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.262897 13825 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.306412 13627 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:38.346493 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.353773 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2c264c500bb4a599103d9117a31012d. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.356592 13904 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260811 16:07:38.359115 23890 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260811 16:07:38.386494 23890 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index -1 to 18, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.398447 13904 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index -1 to 18, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.429278 13825 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:38.439617 13627 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index -1 to 18, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260811 16:07:38.466985 13903 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260811 16:07:38.465262 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251): Couldn't send request to peer 8d98491a0db549d0b671b60b90c9cdea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e92ba91a1eb84cef82a03bb6ed271a72. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:38.468761 23890 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260811 16:07:38.469911 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:38.501344 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.565335 23891 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
I20260811 16:07:38.598857 13904 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.634498 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.680428 23908 ts_tablet_manager.cc:927] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:07:38.725607 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.757709 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.768726 13627 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index -1 to 13, NON_VOTER 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) added. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } } }
W20260811 16:07:38.775758 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.778855 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:38.779697 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 71852us
I20260811 16:07:38.775455 23908 tablet_copy_client.cc:316] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
W20260811 16:07:38.798920 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:38.807183 23914 ts_tablet_manager.cc:927] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:07:38.807415 13923 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 962f3dc40b494dc48647abd894784e8d from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:07:38.808197 13923 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 962f3dc40b494dc48647abd894784e8d from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-962f3dc40b494dc48647abd894784e8d
I20260811 16:07:38.863508 23914 tablet_copy_client.cc:316] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.195:42003
I20260811 16:07:38.865752 13922 tablet_copy_service.cc:140] P 5088cdd3f79d4c47ba826dc820b3cfaf: Received BeginTabletCopySession request for tablet 20f7937a4cf04cef96095a62cb4ef661 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:56292)
I20260811 16:07:38.866365 13922 tablet_copy_service.cc:161] P 5088cdd3f79d4c47ba826dc820b3cfaf: Beginning new tablet copy session on tablet 20f7937a4cf04cef96095a62cb4ef661 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:56292: session id = 8d98491a0db549d0b671b60b90c9cdea-20f7937a4cf04cef96095a62cb4ef661
W20260811 16:07:38.871532 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:38.872128 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.873363 13923 tablet_copy_source_session.cc:205] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
W20260811 16:07:38.879073 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:38.889441 23908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962f3dc40b494dc48647abd894784e8d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:07:38.895466 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:38.911252 13922 tablet_copy_source_session.cc:205] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:07:38.919107 23914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f7937a4cf04cef96095a62cb4ef661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:07:38.936122 23922 ts_tablet_manager.cc:927] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:38.940183 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.945281 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:38.945930 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:38.953338 23922 tablet_copy_client.cc:316] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:07:38.955916 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet b2c264c500bb4a599103d9117a31012d from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:07:38.956477 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet b2c264c500bb4a599103d9117a31012d from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-b2c264c500bb4a599103d9117a31012d
I20260811 16:07:38.970046 13839 tablet_copy_source_session.cc:205] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:07:38.977512 23922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2c264c500bb4a599103d9117a31012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:07:38.980582 23924 ts_tablet_manager.cc:927] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Initiating tablet copy from peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:07:38.987979 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.001250 23924 tablet_copy_client.cc:316] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.23.194:42239
I20260811 16:07:38.976682 23908 tablet_copy_client.cc:791] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.003101 13839 tablet_copy_service.cc:140] P 5f46150fac70458986206ec7af67a403: Received BeginTabletCopySession request for tablet e92ba91a1eb84cef82a03bb6ed271a72 from peer 8d98491a0db549d0b671b60b90c9cdea ({username='slave'} at 127.0.0.1:50506)
I20260811 16:07:39.003647 13839 tablet_copy_service.cc:161] P 5f46150fac70458986206ec7af67a403: Beginning new tablet copy session on tablet e92ba91a1eb84cef82a03bb6ed271a72 from peer 8d98491a0db549d0b671b60b90c9cdea at {username='slave'} at 127.0.0.1:50506: session id = 8d98491a0db549d0b671b60b90c9cdea-e92ba91a1eb84cef82a03bb6ed271a72
I20260811 16:07:39.003130 23908 tablet_copy_client.cc:655] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:07:39.005265 23914 tablet_copy_client.cc:791] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.005959 23914 tablet_copy_client.cc:655] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:07:39.019266 23914 tablet_copy_client.cc:531] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260811 16:07:39.020833 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.022784 23908 tablet_copy_client.cc:531] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:07:39.018963 13839 tablet_copy_source_session.cc:205] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:07:39.030736 23924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92ba91a1eb84cef82a03bb6ed271a72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:07:39.033239 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:39.060472 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:39.064275 23914 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
I20260811 16:07:39.091403 23924 tablet_copy_client.cc:791] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.093055 23924 tablet_copy_client.cc:655] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
W20260811 16:07:39.098986 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.100080 23924 tablet_copy_client.cc:531] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:07:39.119537 23924 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
W20260811 16:07:39.148137 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:39.151590 23908 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
W20260811 16:07:39.178658 12383 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:39.186710 23922 tablet_copy_client.cc:791] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 0 data blocks...
I20260811 16:07:39.199556 23922 tablet_copy_client.cc:655] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Starting download of 1 WAL segments...
I20260811 16:07:39.203593 23922 tablet_copy_client.cc:531] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260811 16:07:39.213420 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:39.232041 23922 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap starting.
W20260811 16:07:39.522950 23924 log.cc:924] Time spent T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.071s	user 0.003s	sys 0.014s
I20260811 16:07:39.524057 23924 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.526571 23924 tablet_bootstrap.cc:492] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.527628 23924 ts_tablet_manager.cc:1397] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.408s	user 0.043s	sys 0.044s
W20260811 16:07:39.537801 23914 log.cc:924] Time spent T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260811 16:07:39.538977 23914 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.540158 23914 tablet_bootstrap.cc:492] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.541107 23914 ts_tablet_manager.cc:1397] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.480s	user 0.039s	sys 0.032s
I20260811 16:07:39.580747 23914 raft_consensus.cc:348] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:07:39.563479 23908 log.cc:924] Time spent T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Append to log took a long time: real 0.070s	user 0.006s	sys 0.002s
I20260811 16:07:39.591931 23914 raft_consensus.cc:729] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.616472 23914 consensus_queue.cc:260] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.619958 23914 ts_tablet_manager.cc:1428] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.001s
I20260811 16:07:39.620820 23908 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.622694 23908 tablet_bootstrap.cc:492] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.623677 23908 ts_tablet_manager.cc:1397] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.472s	user 0.063s	sys 0.017s
I20260811 16:07:39.624817 13922 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20f7937a4cf04cef96095a62cb4ef661 received from {username='slave'} at 127.0.0.1:56292
I20260811 16:07:39.625327 13922 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-20f7937a4cf04cef96095a62cb4ef661 on tablet 20f7937a4cf04cef96095a62cb4ef661 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:39.624867 23924 raft_consensus.cc:348] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.629202 23924 raft_consensus.cc:729] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.630050 23924 consensus_queue.cc:260] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.638212 23924 ts_tablet_manager.cc:1428] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.000s
I20260811 16:07:39.640177 23908 raft_consensus.cc:348] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.641249 23908 raft_consensus.cc:729] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.642081 23908 consensus_queue.cc:260] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.644945 23908 ts_tablet_manager.cc:1428] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260811 16:07:39.646936 23922 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:07:39.697204 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-e92ba91a1eb84cef82a03bb6ed271a72 received from {username='slave'} at 127.0.0.1:50506
I20260811 16:07:39.698453 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-e92ba91a1eb84cef82a03bb6ed271a72 on tablet e92ba91a1eb84cef82a03bb6ed271a72 with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:39.770524 23922 tablet_bootstrap.cc:492] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Bootstrap complete.
I20260811 16:07:39.773216 23922 ts_tablet_manager.cc:1397] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Time spent bootstrapping tablet: real 0.541s	user 0.050s	sys 0.017s
W20260811 16:07:39.791903 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 49612.5us
W20260811 16:07:39.825022 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 65353.9us
W20260811 16:07:39.843520 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.848351 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.864614 14575 raft_consensus.cc:1203] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Deduplicated request from leader. Original: 26.14->[26.15-26.15]   Dedup: 26.15->[]
I20260811 16:07:39.873972 23922 raft_consensus.cc:348] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
I20260811 16:07:39.876117 23922 raft_consensus.cc:729] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Initialized, Role: LEARNER
I20260811 16:07:39.901217 13922 tablet_copy_service.cc:342] P 5088cdd3f79d4c47ba826dc820b3cfaf: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-962f3dc40b494dc48647abd894784e8d received from {username='slave'} at 127.0.0.1:56292
I20260811 16:07:39.901896 13922 tablet_copy_service.cc:433] P 5088cdd3f79d4c47ba826dc820b3cfaf: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-962f3dc40b494dc48647abd894784e8d on tablet 962f3dc40b494dc48647abd894784e8d with peer 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:07:39.877183 23922 consensus_queue.cc:260] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: NON_VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: true } }
W20260811 16:07:39.906343 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.907334 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:39.910387 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:39.938423 23922 ts_tablet_manager.cc:1428] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.007s
W20260811 16:07:39.939308 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.940985 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:39.970268 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:39.996908 14575 raft_consensus.cc:1203] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Deduplicated request from leader. Original: 24.12->[24.13-24.13]   Dedup: 24.13->[]
I20260811 16:07:40.017802 14574 raft_consensus.cc:1203] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Deduplicated request from leader. Original: 26.17->[26.18-26.18]   Dedup: 26.18->[]
W20260811 16:07:40.071684 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.086845 13839 tablet_copy_service.cc:342] P 5f46150fac70458986206ec7af67a403: Request end of tablet copy session 8d98491a0db549d0b671b60b90c9cdea-b2c264c500bb4a599103d9117a31012d received from {username='slave'} at 127.0.0.1:50506
I20260811 16:07:40.087765 13839 tablet_copy_service.cc:433] P 5f46150fac70458986206ec7af67a403: ending tablet copy session 8d98491a0db549d0b671b60b90c9cdea-b2c264c500bb4a599103d9117a31012d on tablet b2c264c500bb4a599103d9117a31012d with peer 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:07:40.089165 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:40.089991 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:40.179471 12383 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:40.239579 14574 raft_consensus.cc:1203] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
W20260811 16:07:40.323936 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.341889 23942 raft_consensus.cc:1050] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:40.345768 23942 consensus_queue.cc:237] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 13, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:40.362511 23913 raft_consensus.cc:1050] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
W20260811 16:07:40.396803 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:40.402810 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:40.408481 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50142.2us
I20260811 16:07:40.415690 13817 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260811 16:07:40.415903 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:40.420591 14581 raft_consensus.cc:1261] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260811 16:07:40.422128 23913 consensus_queue.cc:237] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 11, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:40.427780 23945 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260811 16:07:40.432590 23868 consensus_queue.cc:1035] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:40.432549 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:40.448640 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:40.458034 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.463356 14581 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260811 16:07:40.467244 23913 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:40.496019 13905 raft_consensus.cc:1261] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260811 16:07:40.508150 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.513439 23948 consensus_queue.cc:1035] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:40.575662 23937 raft_consensus.cc:1050] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:40.578949 23937 consensus_queue.cc:237] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 16, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:40.602732 23950 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:40.610857 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.611795 14575 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 LEARNER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260811 16:07:40.610946 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:40.613336 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.613741 23937 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260811 16:07:40.623416 23948 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.626821 14581 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.632529 13908 raft_consensus.cc:1261] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260811 16:07:40.634518 13908 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:40.645905 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:07:40.674440 23939 consensus_queue.cc:1035] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260811 16:07:40.683290 14581 raft_consensus.cc:2932] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.694026 13626 catalog_manager.cc:5495] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:07:40.697866 13627 catalog_manager.cc:5495] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:40.706670 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:40.717500 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:40.719762 13817 raft_consensus.cc:2932] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.740136 23945 raft_consensus.cc:1050] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: attempting to promote NON_VOTER 8d98491a0db549d0b671b60b90c9cdea to VOTER
I20260811 16:07:40.743796 23945 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:40.761998 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:40.777024 14575 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEARNER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:40.779806 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260811 16:07:40.781747 23959 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260811 16:07:40.773401 23948 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.782778 13903 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.828732 14575 raft_consensus.cc:2932] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.796815 23959 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260811 16:07:40.837087 13871 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:40.932273 14581 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:40.928930 23963 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.041539 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:41.046386 13623 catalog_manager.cc:5495] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 18 to 19, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.058955 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:41.059753 13823 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.109198 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:41.115193 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:41.122336 13626 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 13 to 14, 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } attrs { replace: true } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:41.180595 13908 consensus_queue.cc:237] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:07:41.198438 14581 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:41.201906 23963 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:41.204473 13817 raft_consensus.cc:1261] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260811 16:07:41.213354 23963 consensus_queue.cc:1035] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260811 16:07:41.224516 23960 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.245298 12383 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:41.242868 14581 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.252656 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:41.268292 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:41.288594 13626 catalog_manager.cc:5495] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:41.293532 13817 raft_consensus.cc:2932] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:41.308876 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:41.309893 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 20f7937a4cf04cef96095a62cb4ef661 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260811 16:07:41.315626 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:41.406435 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.464524 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:41.472929 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.490064 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:41.491044 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:41.546805 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:41.578445 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.585743 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.653218 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.694406 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:41.758846 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:41.759527 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:41.778884 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:41.903015 13787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260811 16:07:41.903391 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.074748 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.211934 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 103600us
W20260811 16:07:42.230445 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.245898 12383 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:42.296551 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:42.313520 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.439556 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:42.441448 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:42.477284 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.549798 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:42.569664 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.686663 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.701368 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.728611 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:42.750598 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 47563us
W20260811 16:07:42.759246 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:42.799845 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:42.874533 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:42.901602 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:42.931787 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:42.982674 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:42.992069 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:43.031617 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:43.034368 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.078531 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:43.134357 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.187522 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.246520 12383 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:43.375412 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.376579 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:43.502877 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:43.581384 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.629397 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:43.676301 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:43.755370 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 57373.2us
W20260811 16:07:43.799109 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:43.828428 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:43.869083 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:43.880807 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.915107 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:43.926311 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:43.943673 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:43.974444 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:44.008186 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:44.059281 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:44.083981 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.087229 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:44.137233 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:44.229781 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.247766 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.247766 12383 thread.cc:536] Waited for 9000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:44.256589 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.322696 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.449925 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.529135 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:44.835063 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:44.940889 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.001082 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.041466 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.108028 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:45.129288 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.141309 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:45.217397 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.249075 12383 thread.cc:536] Waited for 10000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:45.255385 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.260195 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.325836 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.414760 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:45.446991 13825 consensus_queue.cc:237] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:45.500083 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44214us
W20260811 16:07:45.501142 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:45.511314 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 147022us
W20260811 16:07:45.520905 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.540031 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:45.572935 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:45.573577 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:45.578943 14583 raft_consensus.cc:1261] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260811 16:07:45.656855 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.672456 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 95030us
W20260811 16:07:45.673466 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:45.678498 23948 consensus_queue.cc:1035] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260811 16:07:45.682381 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:45.693668 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.725210 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:07:45.754834 24010 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:45.756949 14583 raft_consensus.cc:2932] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:45.760021 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260811 16:07:45.785285 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7f6a000330b3415da4f525eae84f33fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260811 16:07:45.796428 13626 catalog_manager.cc:5495] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 3 to 14, VOTER 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195) evicted. New cstate: current_term: 21 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:07:45.891640 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:45.967875 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:46.035797 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 84251.5us
W20260811 16:07:46.038934 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:07:46.054059 13894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f6a000330b3415da4f525eae84f33fb with delete_type TABLET_DATA_TOMBSTONED (TS 5088cdd3f79d4c47ba826dc820b3cfaf not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:60510
W20260811 16:07:46.101670 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:46.102489 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.113902 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.119328 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260811 16:07:46.116197 24020 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:07:46.128515 24020 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:46.131028 24020 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:46.164461 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:46.174428 24020 ts_tablet_manager.cc:1905] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:07:46.186349 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:46.230379 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.250047 12383 thread.cc:536] Waited for 11000ms trying to join with diag-logger (tid 13768)
I20260811 16:07:46.289613 24020 ts_tablet_manager.cc:1918] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260811 16:07:46.292790 24020 log.cc:1196] T 7f6a000330b3415da4f525eae84f33fb P 5088cdd3f79d4c47ba826dc820b3cfaf: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/wals/7f6a000330b3415da4f525eae84f33fb
I20260811 16:07:46.301749 13613 catalog_manager.cc:4841] TS 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): tablet 7f6a000330b3415da4f525eae84f33fb (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
W20260811 16:07:46.345305 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:46.363235 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:46.398579 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.490020 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:46.610940 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:46.656837 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.731611 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.741168 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:46.758131 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.766112 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.834872 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.850019 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:46.939421 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260811 16:07:47.071002 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.172217 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.250607 12383 thread.cc:536] Waited for 12000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:47.455849 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.510921 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:47.586663 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.600136 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.721458 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 53495.7us
W20260811 16:07:47.724922 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.769672 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 44794.5us
W20260811 16:07:47.794498 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 83396.7us
W20260811 16:07:47.833823 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:47.866808 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:47.920181 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.961189 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:47.983654 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:47.987458 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:47.972216 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:47.999744 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:48.077756 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 46807.2us
W20260811 16:07:48.173650 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 52745.8us
W20260811 16:07:48.201197 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:48.209494 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:48.251255 12383 thread.cc:536] Waited for 13000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:48.274821 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:48.290705 14583 consensus_queue.cc:237] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:48.341660 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:48.374032 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:48.374972 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:48.375578 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:48.409569 13908 raft_consensus.cc:1261] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260811 16:07:48.416177 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260811 16:07:48.415959 24034 consensus_queue.cc:1035] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260811 16:07:48.418341 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:48.418481 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:48.461654 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:48.469442 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:07:48.506313 24031 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 6 to 14, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:48.508215 13905 raft_consensus.cc:2932] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 6 to 14, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:48.516804 13787 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 16:07:48.530752 13623 catalog_manager.cc:5495] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: config changed from index 6 to 14, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 19 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:48.539551 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:48.555832 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:48.560242 13612 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a48002159c1643c489d152b863d3d839 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260811 16:07:48.585595 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260811 16:07:48.699539 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet a48002159c1643c489d152b863d3d839 with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:52448
I20260811 16:07:48.762454 24043 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:07:48.791086 24043 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260811 16:07:48.794780 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:48.818317 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:48.829860 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260811 16:07:48.854530 24043 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:07:48.871857 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260811 16:07:48.892221 24043 ts_tablet_manager.cc:1905] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:07:48.895676 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260811 16:07:48.959059 24043 ts_tablet_manager.cc:1918] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260811 16:07:48.959641 24043 log.cc:1196] T a48002159c1643c489d152b863d3d839 P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/a48002159c1643c489d152b863d3d839
I20260811 16:07:48.963901 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet a48002159c1643c489d152b863d3d839 (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
W20260811 16:07:49.007802 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.213807 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.251839 12383 thread.cc:536] Waited for 14000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:49.288599 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.327914 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.339895 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.353801 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.436563 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:49.454150 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.466827 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.498075 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:49.685560 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:49.799427 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:49.861639 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.008205 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.034271 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:50.063014 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.092756 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.111404 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:50.133481 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.135200 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:50.238211 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.238381 13612 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 43833us
W20260811 16:07:50.251166 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:50.252942 12383 thread.cc:536] Waited for 15000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:50.309820 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:50.300431 13823 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:50.318893 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:50.347066 13903 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260811 16:07:50.350131 24048 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:07:50.373299 14581 raft_consensus.cc:1261] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Refusing update from remote peer 5f46150fac70458986206ec7af67a403: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260811 16:07:50.380434 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.382877 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260811 16:07:50.382699 24047 consensus_queue.cc:1035] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260811 16:07:50.383458 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:50.406513 23992 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 LEADER]: Committing config change with OpId 29.17: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:50.413466 13906 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
I20260811 16:07:50.442809 13615 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c390fd23cec5435d81b38a50b2988a60 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260811 16:07:50.462807 13626 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 reported cstate change: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New cstate: current_term: 29 leader_uuid: "5f46150fac70458986206ec7af67a403" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260811 16:07:50.498557 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260811 16:07:50.516826 14583 raft_consensus.cc:2932] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index 7 to 17, VOTER cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:50.585867 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:50.597399 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.607440 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:50.663621 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:50.725229 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:50.743656 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:50.889101 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:50.907763 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:51.027381 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.059832 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:51.099548 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 69903.6us
W20260811 16:07:51.127130 14542 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 46577.1us
W20260811 16:07:51.139987 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:51.176687 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.192817 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.202033 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:51.253552 12383 thread.cc:536] Waited for 16000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:51.302948 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:51.350270 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:51.370069 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:51.424310 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:51.445560 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:51.487793 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:51.693811 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.773547 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:51.814227 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:51.850006 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:51.946601 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 448 similar messages]
W20260811 16:07:52.013252 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 50410us
W20260811 16:07:52.041061 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:52.044113 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.093840 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.156278 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.172041 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:52.183281 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.237948 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:52.254122 12383 thread.cc:536] Waited for 17000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:52.359877 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.379495 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.404456 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:52.619664 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:52.624348 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:52.753602 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.761235 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:52.763196 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.768067 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.801285 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:52.814553 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.851274 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:52.904855 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:53.037912 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.073712 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:53.122809 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:53.126941 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:53.146379 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:53.184300 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:53.185178 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.194736 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:53.206487 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:53.254719 12383 thread.cc:536] Waited for 18000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:53.440243 13871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 72993.3us
W20260811 16:07:53.443602 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:53.444728 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 58721.2us
W20260811 16:07:53.467839 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:53.527083 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.605706 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:07:53.606536 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:53.614243 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:54.032311 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:54.035362 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:54.055281 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 215597us
W20260811 16:07:54.075277 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.075937 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:54.079303 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:54.176798 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:54.186290 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.226950 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:54.255224 12383 thread.cc:536] Waited for 19000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:54.281448 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:54.350435 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.399418 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.551694 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.579314 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.587111 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.621234 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.691767 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.782801 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.785709 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:54.891850 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:54.953056 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:54.993727 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.104035 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:55.255812 12383 thread.cc:536] Waited for 20000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:55.316992 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:55.321803 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.330878 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:55.378350 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.392419 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.443527 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.461671 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:55.515794 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.541496 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.557905 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.622619 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.628249 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:55.657182 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.660123 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:55.785909 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:55.834252 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:55.839398 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:55.841493 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:07:55.843492 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:55.872061 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:56.002264 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:56.144318 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:07:56.256510 12383 thread.cc:536] Waited for 21000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:56.282438 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:56.288628 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:56.388540 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:56.453604 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:56.457568 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:56.530926 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:56.538822 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:07:56.609252 13903 consensus_queue.cc:237] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:07:56.655903 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:56.712134 14581 raft_consensus.cc:1261] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260811 16:07:56.758499 24094 consensus_queue.cc:1035] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260811 16:07:56.786044 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:07:56.813050 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:56.824347 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260811 16:07:56.862684 24093 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 4 to 16, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:56.871521 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:07:56.875260 14581 raft_consensus.cc:2932] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 4 to 16, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:56.903010 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260811 16:07:56.914070 13623 catalog_manager.cc:5495] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: config changed from index 4 to 16, VOTER 5f46150fac70458986206ec7af67a403 (127.12.23.194) evicted. New cstate: current_term: 22 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } } }
W20260811 16:07:56.955528 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:56.982414 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260811 16:07:56.986909 13787 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:37251, user_credentials={real_user=slave}} blocked reactor thread for 54401.7us
I20260811 16:07:57.042488 13613 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 801054abfed346a09c04b7cd13d7c62f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
W20260811 16:07:57.054947 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:07:57.073524 13810 tablet_service.cc:1514] Processing DeleteTablet for tablet 801054abfed346a09c04b7cd13d7c62f with delete_type TABLET_DATA_TOMBSTONED (TS 5f46150fac70458986206ec7af67a403 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:52448
I20260811 16:07:57.080444 24107 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:07:57.081866 24107 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:07:57.085958 24107 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:07:57.089922 24107 ts_tablet_manager.cc:1905] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260811 16:07:57.099584 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:07:57.183813 24107 ts_tablet_manager.cc:1918] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.15
I20260811 16:07:57.184438 24107 log.cc:1196] T 801054abfed346a09c04b7cd13d7c62f P 5f46150fac70458986206ec7af67a403: Deleting WAL directory at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/wals/801054abfed346a09c04b7cd13d7c62f
I20260811 16:07:57.187335 13615 catalog_manager.cc:4841] TS 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): tablet 801054abfed346a09c04b7cd13d7c62f (table test-workload [id=a2d76d42d6b4452fb3233af423d45ab2]) successfully deleted
W20260811 16:07:57.197870 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.257074 12383 thread.cc:536] Waited for 22000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:57.293495 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.339154 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.343292 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.372786 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:57.380892 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:57.589358 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:57.609084 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:57.619549 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.741524 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.760550 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:57.877415 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:57.887939 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:57.903164 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:57.934589 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:57.944104 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:57.945667 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.083123 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:58.116292 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.122349 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.123782 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.226907 14544 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:42239, user_credentials={real_user=slave}} blocked reactor thread for 66487.1us
W20260811 16:07:58.236174 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.244833 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:58.257650 12383 thread.cc:536] Waited for 23000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:58.266601 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:58.263563 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:58.349468 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.352680 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:07:58.373441 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:07:58.467801 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:58.508741 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:58.595332 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:58.636962 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:07:58.770342 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 16:07:58.896544 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:07:59.007526 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.080479 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:07:59.145826 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:07:59.231336 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.258210 12383 thread.cc:536] Waited for 24000ms trying to join with diag-logger (tid 13768)
W20260811 16:07:59.274001 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:07:59.311569 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:07:59.348011 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:59.362950 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.406858 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:07:59.433612 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.514138 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:07:59.545814 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.565557 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.593189 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:07:59.743355 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.833478 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:07:59.853299 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:00.005384 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.259006 12383 thread.cc:536] Waited for 25000ms trying to join with diag-logger (tid 13768)
W20260811 16:08:00.357420 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:00.480262 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.482842 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.493359 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.496129 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:00.498823 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.582792 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:00.617775 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:00.709365 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.814466 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:08:00.819746 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.855934 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:00.878732 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:00.911813 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:01.031963 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.058220 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:08:01.078826 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:01.080617 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.141481 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800237040 after lost signal to thread 12388
W20260811 16:08:01.143193 13853 debug-util.cc:398] Leaking SignalData structure 0x7b0800374fc0 after lost signal to thread 13668
W20260811 16:08:01.145401 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3a60 after lost signal to thread 13856
W20260811 16:08:01.146929 13853 debug-util.cc:398] Leaking SignalData structure 0x7b080042a0c0 after lost signal to thread 13941
W20260811 16:08:01.148547 13853 debug-util.cc:398] Leaking SignalData structure 0x7b08003c46a0 after lost signal to thread 14610
W20260811 16:08:01.172439 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.260068 12383 thread.cc:536] Waited for 26000ms trying to join with diag-logger (tid 13768)
W20260811 16:08:01.345613 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 16:08:01.353051 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.357689 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.358678 13787 consensus_peers.cc:487] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:01.438767 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:01.504587 13787 consensus_peers.cc:487] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260811 16:08:01.542961 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:01.583889 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.593231 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.607053 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:01.639400 13787 consensus_peers.cc:487] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 16:08:01.696583 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:01.775121 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:01.880160 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.898253 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:01.908201 13787 consensus_peers.cc:487] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.966185 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:01.978878 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:01.985414 14541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260811 16:08:02.020520 13789 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 68578.6us
W20260811 16:08:02.159391 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:02.204536 13787 consensus_peers.cc:487] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:02.255788 13787 consensus_peers.cc:487] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:02.295588 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.327303 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.421640 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:02.483085 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
W20260811 16:08:02.525390 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.537503 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:02.597172 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:02.651000 13787 consensus_peers.cc:487] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.876947 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:02.988682 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:03.091972 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260811 16:08:03.125705 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.181797 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.210654 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:03.241166 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:08:03.260406 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:03.282166 13874 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.291554 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.292189 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.304330 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.306202 13874 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.308429 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:03.313617 13874 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.349412 13874 consensus_peers.cc:487] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.351100 13874 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.351910 13787 consensus_peers.cc:487] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.360878 14544 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.361858 14544 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.363593 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:03.374272 13874 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.383116 13874 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.386874 13874 consensus_peers.cc:487] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.398520 14544 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.405330 13874 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.412369 14544 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.417098 14544 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.426551 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:03.449359 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:03.454552 14544 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.459688 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.464205 13787 consensus_peers.cc:487] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:03.519227 13787 consensus_peers.cc:487] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260811 16:08:03.524051 13874 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.532155 13787 consensus_peers.cc:487] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:03.555913 14544 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.572327 13874 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.576915 14544 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.579955 13871 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:03.581996 14544 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.586589 14544 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:03.587083 13787 consensus_peers.cc:487] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:03.597491 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:03.623072 13874 consensus_peers.cc:487] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.623409 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:03.627662 12383 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.630511 12383 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.631736 12383 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.633934 14544 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.635316 12383 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.636346 12383 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.637832 12383 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.639554 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:03.642136 12383 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.643250 12383 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.643967 12383 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.647059 12383 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.648001 12383 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.648979 12383 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.651993 12383 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.652866 12383 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.654261 12383 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P 5f46150fac70458986206ec7af67a403 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.657416 12383 tablet_replica.cc:330] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.658452 12383 raft_consensus.cc:2229] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.659384 12383 raft_consensus.cc:2258] T 02554b9e1cd54e1dbcfb941296b23093 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.662878 12383 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.663901 12383 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.664779 12383 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.665690 14544 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.667714 12383 tablet_replica.cc:330] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.668962 12383 raft_consensus.cc:2229] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.670573 12383 raft_consensus.cc:2258] T 94d079a9604d4ed3832dbb48ba12cd16 P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.673897 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.674932 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.676280 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.676491 14544 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.679340 12383 tablet_replica.cc:330] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.680397 12383 raft_consensus.cc:2229] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.681478 12383 raft_consensus.cc:2258] T 210dcf7aee994bdaa1e75860a25bdd3a P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.686964 12383 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.687948 12383 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.689252 12383 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.692698 12383 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.693794 12383 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.694437 12383 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.697341 12383 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.698414 12383 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.699270 12383 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.702800 12383 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.703869 12383 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.705448 12383 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.710443 13874 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.712911 12383 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
W20260811 16:08:03.713459 14544 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.717100 12383 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.718772 12383 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P 5f46150fac70458986206ec7af67a403 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.723956 12383 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.724978 12383 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.725973 12383 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.729666 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.730641 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.737165 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.741879 12383 tablet_replica.cc:330] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.742990 12383 raft_consensus.cc:2229] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.744283 12383 raft_consensus.cc:2258] T c3ac106c3df9431c9323c322b9f8118b P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.748265 12383 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403: stopping tablet replica
W20260811 16:08:03.749118 13787 consensus_peers.cc:487] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:08:03.749173 12383 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.750931 12383 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.753969 12383 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.754966 12383 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:03.754506 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:03.764591 12383 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.788738 12383 tablet_replica.cc:330] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.823036 12383 raft_consensus.cc:2229] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.854763 12383 raft_consensus.cc:2258] T 0556c3c022b74f43b43aa6f25d418e58 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.858086 12383 tablet_replica.cc:330] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.859081 12383 raft_consensus.cc:2229] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.860219 12383 raft_consensus.cc:2258] T 78a0d32ee74448a6931819ee7d5e0f59 P 5f46150fac70458986206ec7af67a403 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.862841 13787 consensus_peers.cc:487] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:03.879923 12383 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
W20260811 16:08:03.893451 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260811 16:08:03.898366 12383 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.899549 12383 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:03.900545 13874 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:03.903697 12383 tablet_replica.cc:330] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.931129 12383 raft_consensus.cc:2229] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.932392 12383 raft_consensus.cc:2258] T 580037905a064c08b39df9f9843b5448 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.937364 12383 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.938215 12383 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.939671 12383 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.953639 12383 tablet_replica.cc:330] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.954564 12383 raft_consensus.cc:2229] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.956044 12383 raft_consensus.cc:2258] T ffb6122695854eb8a6ab98b508c17b30 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.969317 12383 tablet_replica.cc:330] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.970285 12383 raft_consensus.cc:2229] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:03.971179 12383 raft_consensus.cc:2258] T d00255c500904da78a120b3431f1e31d P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.974207 12383 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.974972 12383 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:03.975747 12383 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:03.978437 12383 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:03.999346 12383 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.000052 12383 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P 5f46150fac70458986206ec7af67a403 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.041719 12383 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.042526 12383 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.043095 12383 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.067205 12383 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.086025 12383 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.086679 12383 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.100287 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.101101 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.107715 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.110653 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.111527 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.112604 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P 5f46150fac70458986206ec7af67a403 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:04.116153 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:04.121374 13871 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:04.127401 12383 tablet_replica.cc:330] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.128521 12383 raft_consensus.cc:2229] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.129422 12383 raft_consensus.cc:2258] T ff741363b70845aeab13c5999c9843e4 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.155879 12383 tablet_replica.cc:330] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.156800 12383 raft_consensus.cc:2229] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.157599 12383 raft_consensus.cc:2258] T 47a99d649fa64ed18701c70592b7b534 P 5f46150fac70458986206ec7af67a403 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.160859 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.161736 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:04.180644 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P 5f46150fac70458986206ec7af67a403 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.190161 12383 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.190994 12383 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.204102 12383 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.207055 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.207862 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.209220 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P 5f46150fac70458986206ec7af67a403 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.236159 24120 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:04.237237 12383 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.236886 24120 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.238250 12383 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.239384 12383 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.240753 24120 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:04.242676 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:04.244762 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d7fc8e90884ea59b440daaba753fd7" candidate_uuid: "5f46150fac70458986206ec7af67a403" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:04.248054 13789 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f46150fac70458986206ec7af67a403; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:04.249039 24120 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:04.249722 12383 tablet_replica.cc:330] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.250532 12383 raft_consensus.cc:2229] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.251184 12383 raft_consensus.cc:2258] T d9c0f5b985cc420c9dad45a78187a946 P 5f46150fac70458986206ec7af67a403 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.267880 12383 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.268751 12383 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.269445 12383 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.272378 12383 tablet_replica.cc:330] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.273070 12383 raft_consensus.cc:2229] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:04.273881 12383 raft_consensus.cc:2258] T 11dc75ffca384b91994ceec6d295e6e8 P 5f46150fac70458986206ec7af67a403 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.276522 12383 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.277285 12383 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 LEADER]: Raft consensus shutting down.
I20260811 16:08:04.278642 12383 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P 5f46150fac70458986206ec7af67a403 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:04.288627 12383 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.289415 12383 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:04.291481 13871 consensus_peers.cc:487] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:08:04.298722 12383 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P 5f46150fac70458986206ec7af67a403 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:04.303874 13871 consensus_peers.cc:487] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260811 16:08:04.318714 12383 tablet_replica.cc:330] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403: stopping tablet replica
I20260811 16:08:04.325276 12383 raft_consensus.cc:2229] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:04.326787 12383 raft_consensus.cc:2258] T 88888e6c2eb344e0b1468ef497832be3 P 5f46150fac70458986206ec7af67a403 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:04.340929 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:04.351928 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:04.453079 13871 consensus_peers.cc:487] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 16:08:04.601315 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:04.682248 24111 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.682847 24111 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.685227 24111 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:04.693831 24111 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.694746 24111 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:04.735879 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.748711 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.754962 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.756732 24132 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:04.770808 24111 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:04.775307 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.777803 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.778291 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.782024 24111 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:08:04.787779 24143 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.788661 24143 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.793097 24143 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:04.794523 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:04.799763 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.802904 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.807377 24137 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:04.807880 13874 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:04.808305 24111 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.808869 24111 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.811820 24111 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:04.815868 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:04.819563 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:04.820078 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.820907 24111 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:04.821920 24143 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.822578 24143 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.824990 24143 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:04.827739 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:04.830780 24111 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.831455 24111 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:04.833719 24111 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:04.840118 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
W20260811 16:08:04.842063 14544 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.840389 13874 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:04.848340 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:04.849565 24143 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260811 16:08:04.851387 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:04.852789 24111 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:08:04.879606 13871 consensus_peers.cc:487] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:04.911405 13871 consensus_peers.cc:487] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:04.925249 24135 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:04.925989 24135 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:04.926884 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:04.929435 24135 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:04.938652 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:04.941948 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:04.948782 14541 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:04.949790 24135 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:08:04.977406 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.040092 24137 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.040191 24143 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.040756 24137 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.040834 24143 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:05.046921 13874 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.047536 13874 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.050535 24143 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.051357 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:05.051716 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:05.052068 14575 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 25.
I20260811 16:08:05.053821 13871 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:05.054602 24143 raft_consensus.cc:2726] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260811 16:08:05.055352 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.056180 24143 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260811 16:08:05.056644 24143 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.049672 24137 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.057072 24143 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:08:05.066882 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.077322 24111 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.077894 24111 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.080000 24111 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.083021 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.084357 13905 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 20.
I20260811 16:08:05.077854 24143 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.085518 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
I20260811 16:08:05.086359 24111 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260811 16:08:05.086701 24111 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.086993 24111 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Advancing to term 21
W20260811 16:08:05.090163 14544 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.090883 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b38d6f6713439aad43a191eb42cd45" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea"
I20260811 16:08:05.091588 14575 raft_consensus.cc:3037] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Advancing to term 26
W20260811 16:08:05.095253 13874 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.098719 24143 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.100273 14575 raft_consensus.cc:2454] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:08:05.100443 24111 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.103214 13871 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.103961 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:08:05.104096 24143 raft_consensus.cc:2781] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader election won for term 26
I20260811 16:08:05.104718 13905 raft_consensus.cc:3037] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Advancing to term 21
I20260811 16:08:05.105367 24135 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.105211 24143 raft_consensus.cc:686] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Becoming Leader. State: Replica: 5088cdd3f79d4c47ba826dc820b3cfaf, State: Running, Role: LEADER
I20260811 16:08:05.107558 24143 consensus_queue.cc:237] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.106916 24135 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.111097 24111 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.111997 13902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.113547 24135 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:05.113155 14544 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.116261 14544 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.114022 13902 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 26.
I20260811 16:08:05.119459 24132 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.120105 24132 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.122517 24132 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.125377 13903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.126135 13903 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 29.
I20260811 16:08:05.127130 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 
W20260811 16:08:05.128263 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.129065 24132 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260811 16:08:05.129516 24132 raft_consensus.cc:482] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Starting leader election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.130070 24132 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 29 FOLLOWER]: Advancing to term 30
W20260811 16:08:05.135980 14541 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.139945 14541 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.139294 13627 catalog_manager.cc:5495] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf reported cstate change: term changed from 25 to 26, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195). New cstate: current_term: 26 leader_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:05.141028 24111 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:08:05.145121 13905 raft_consensus.cc:2454] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 21.
I20260811 16:08:05.148250 14542 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.149269 24111 raft_consensus.cc:2781] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader election won for term 21
I20260811 16:08:05.149720 24111 raft_consensus.cc:686] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:08:05.150489 24111 consensus_queue.cc:237] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.155916 24143 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:08:05.177196 14544 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.169325 24143 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.187103 24143 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:05.188702 24141 raft_consensus.cc:482] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.189350 24141 raft_consensus.cc:504] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:08:05.195447 13874 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.196759 24141 leader_election.cc:288] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.209951 13874 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.220614 24132 raft_consensus.cc:504] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.223312 24111 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
W20260811 16:08:05.223696 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.230360 24111 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:05.232434 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:05.232838 24111 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:05.233215 24132 leader_election.cc:288] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 election: Requested vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.230873 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.234233 24137 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:05.234935 14544 leader_election.cc:334] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.234467 13871 leader_election.cc:334] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.236575 13871 leader_election.cc:302] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.235967 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c390fd23cec5435d81b38a50b2988a60" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf"
I20260811 16:08:05.237664 13905 raft_consensus.cc:3037] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Advancing to term 30
I20260811 16:08:05.239531 24141 raft_consensus.cc:2726] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:05.245018 24141 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.245600 24141 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
W20260811 16:08:05.247895 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.248368 24141 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:05.248528 13905 raft_consensus.cc:2454] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 30.
W20260811 16:08:05.248941 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.249823 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.254119 14542 leader_election.cc:302] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403
I20260811 16:08:05.255208 24111 raft_consensus.cc:2781] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 FOLLOWER]: Leader election won for term 30
I20260811 16:08:05.255717 24111 raft_consensus.cc:686] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 LEADER]: Becoming Leader. State: Replica: 8d98491a0db549d0b671b60b90c9cdea, State: Running, Role: LEADER
I20260811 16:08:05.256664 24111 consensus_queue.cc:237] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.261328 24132 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:05.262732 13623 catalog_manager.cc:5495] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 20 to 21, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 21 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260811 16:08:05.263808 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.269250 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
W20260811 16:08:05.276494 13874 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.277345 13874 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.284951 24141 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:05.302611 24141 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.303251 24141 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.305935 24141 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:05.307343 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:05.310981 13871 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.311573 13871 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.315218 24141 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:05.317932 13874 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.406912 13623 catalog_manager.cc:5495] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea reported cstate change: term changed from 29 to 30, leader changed from 5f46150fac70458986206ec7af67a403 (127.12.23.194) to 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196). New cstate: current_term: 30 leader_uuid: "8d98491a0db549d0b671b60b90c9cdea" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260811 16:08:05.450624 24139 raft_consensus.cc:482] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.451221 24139 raft_consensus.cc:504] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.453406 24139 leader_election.cc:288] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.459357 13871 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:05.477247 13874 leader_election.cc:334] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.478410 13874 leader_election.cc:302] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.479269 24139 raft_consensus.cc:2726] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:05.497505 24139 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.498111 24139 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.500464 24139 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.504675 13871 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:05.508883 13874 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.521831 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.522338 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.523175 24139 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:05.531664 24111 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.532286 24111 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.534824 24111 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:05.541834 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92ba91a1eb84cef82a03bb6ed271a72" candidate_uuid: "8d98491a0db549d0b671b60b90c9cdea" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" is_pre_election: true
I20260811 16:08:05.558561 13905 raft_consensus.cc:2454] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d98491a0db549d0b671b60b90c9cdea in term 24.
W20260811 16:08:05.548329 14541 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:05.560122 14544 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.561244 14544 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.567363 24111 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:05.571960 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.572247 13905 raft_consensus.cc:1261] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Refusing update from remote peer 8d98491a0db549d0b671b60b90c9cdea: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260811 16:08:05.572808 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260811 16:08:05.573683 24111 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.574134 24132 consensus_queue.cc:1035] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260811 16:08:05.574213 24111 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:05.581511 24111 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.585772 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:05.586541 14544 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.588274 13871 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:05.600405 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:05.600987 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.602336 24111 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:08:05.615967 14574 raft_consensus.cc:1261] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Refusing update from remote peer 5088cdd3f79d4c47ba826dc820b3cfaf: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260811 16:08:05.618234 24141 consensus_queue.cc:1035] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260811 16:08:05.632687 13871 consensus_peers.cc:487] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260811 16:08:05.661341 13874 consensus_peers.cc:487] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.677150 13871 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260811 16:08:05.685039 13874 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:05.687238 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
W20260811 16:08:05.698097 14542 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:05.713812 24141 raft_consensus.cc:482] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:05.714664 24141 raft_consensus.cc:504] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:05.718077 24141 leader_election.cc:288] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:05.730574 13874 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.735356 13874 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:05.736447 14544 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.744352 13613 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.12.23.195:42003, user_credentials={real_user=slave}} blocked reactor thread for 44665us
W20260811 16:08:05.754855 13871 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:05.758450 14544 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.763289 13874 consensus_peers.cc:487] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.770968 14542 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.773809 13871 leader_election.cc:334] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:05.774508 13871 leader_election.cc:302] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:05.775485 24139 raft_consensus.cc:2726] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:05.781144 13686 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:05.781518 13686 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:05.793148 14542 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.809692 14542 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.816356 14542 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.832808 13871 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:05.836735 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:05.839385 14544 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.893400 14544 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:05.897657 14542 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:05.898490 14542 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:06.326030 13874 consensus_peers.cc:487] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.326783 13874 consensus_peers.cc:487] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.327324 13874 consensus_peers.cc:487] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.428586 13874 consensus_peers.cc:487] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.827329 13874 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.827309 24164 raft_consensus.cc:482] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.828109 24164 raft_consensus.cc:504] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.830479 24164 leader_election.cc:288] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:06.834266 24166 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:06.835323 24166 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.836829 13874 leader_election.cc:334] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:06.839250 24166 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:06.841624 24164 raft_consensus.cc:482] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.842460 24164 raft_consensus.cc:504] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.844967 24164 leader_election.cc:288] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.847604 13874 consensus_peers.cc:487] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.864776 24167 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:06.865397 24167 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.867609 24167 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:06.881342 24174 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:06.883317 24174 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.886026 24174 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:06.888048 24164 raft_consensus.cc:482] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:06.888075 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:06.888918 24164 raft_consensus.cc:504] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.889523 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:06.889976 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:06.891052 24164 leader_election.cc:288] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:06.892300 24164 raft_consensus.cc:482] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.892798 24164 raft_consensus.cc:504] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.893195 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:06.897972 24164 leader_election.cc:288] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.930886 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
I20260811 16:08:06.963734 24178 raft_consensus.cc:482] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.964649 24164 raft_consensus.cc:482] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.966887 24164 raft_consensus.cc:504] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.969735 24164 leader_election.cc:288] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:06.965438 24178 raft_consensus.cc:504] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:06.971797 24139 raft_consensus.cc:482] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:06.972543 24139 raft_consensus.cc:504] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.976929 13874 consensus_peers.cc:487] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.980619 24139 leader_election.cc:288] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.981204 13874 leader_election.cc:334] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:06.982028 13874 consensus_peers.cc:487] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:06.982540 13874 consensus_peers.cc:487] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:06.982904 24169 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:06.983771 24169 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:06.982990 13874 leader_election.cc:334] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:06.985621 13871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 523 similar messages]
I20260811 16:08:06.986291 24169 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:06.987164 24178 leader_election.cc:288] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:06.992043 13871 leader_election.cc:334] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:06.996943 13871 leader_election.cc:334] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:06.997507 13871 leader_election.cc:334] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:06.998430 13871 leader_election.cc:334] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.001871 13871 consensus_peers.cc:487] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260811 16:08:07.002020 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e699b23b5a94bf7b11086e6878e0207" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.002494 13871 consensus_peers.cc:487] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:07.008945 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f329d644e014d3fad21c11a415e907c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.009250 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "993fa0c090be4f83b6e0d60b3aa8dc78" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.011476 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7ec7085e27482fa91e60b9993522de" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.011708 14575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f42299184ed34c10bccc7de82e5dd1bd" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.012836 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20097351f7854d5487483d8e78420c49" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.013540 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5b1c77a3014dd490b50a04ca62cd4c" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.017033 14542 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.017757 14542 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.018350 14542 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.018885 14542 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.019491 14542 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.028245 13874 consensus_peers.cc:487] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.030831 13874 consensus_peers.cc:487] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.031580 24169 raft_consensus.cc:482] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.032161 24169 raft_consensus.cc:504] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.034319 24169 leader_election.cc:288] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.034564 24178 raft_consensus.cc:482] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.035251 24178 raft_consensus.cc:504] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:07.037436 24178 leader_election.cc:288] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:07.040536 13871 consensus_peers.cc:487] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:07.040899 24183 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.041589 24183 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:07.048244 13874 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.048125 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.053812 24178 raft_consensus.cc:482] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.053331 14542 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.054445 24178 raft_consensus.cc:504] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.055397 24177 raft_consensus.cc:482] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.055925 14542 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.055891 24177 raft_consensus.cc:504] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:07.056531 14542 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:08:07.056929 24178 leader_election.cc:288] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.056983 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.057848 24169 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.058044 24177 leader_election.cc:288] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.057863 24181 raft_consensus.cc:482] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.058918 24181 raft_consensus.cc:504] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:07.059907 24183 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.060832 13871 leader_election.cc:302] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.061085 24181 leader_election.cc:288] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.061656 24181 raft_consensus.cc:2726] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:08:07.062124 13871 leader_election.cc:302] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:07.063043 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:07.064081 14541 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.062858 24181 raft_consensus.cc:2726] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:08:07.063181 14542 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.063313 13871 leader_election.cc:302] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.067533 24178 raft_consensus.cc:2726] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:07.065557 14542 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:07.070713 14542 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:07.071388 13871 leader_election.cc:302] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:08:07.074360 13874 leader_election.cc:334] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.076958 13874 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.079309 24182 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.074699 24181 raft_consensus.cc:2726] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.080520 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:07.080119 24182 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.081697 12383 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.081784 13871 leader_election.cc:302] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.082654 24177 raft_consensus.cc:2726] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.082906 12383 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.083112 24182 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.083894 13871 leader_election.cc:302] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.084766 24182 raft_consensus.cc:2726] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260811 16:08:07.085115 12383 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.085872 13871 leader_election.cc:302] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:08:07.085071 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.086640 24182 raft_consensus.cc:2726] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.086601 14544 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.087692 24183 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:08:07.089856 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.090142 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930faff3981346c88c8864a1f3b15158" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.090616 24182 raft_consensus.cc:482] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.091313 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.091173 24182 raft_consensus.cc:504] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.094303 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d60ab9da3d047ca897a698d07779c2e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.095501 24182 leader_election.cc:288] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.093454 24177 raft_consensus.cc:482] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.095615 13871 leader_election.cc:334] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.095616 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2c264c500bb4a599103d9117a31012d" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.096297 13871 leader_election.cc:302] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.096498 14581 raft_consensus.cc:2454] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5088cdd3f79d4c47ba826dc820b3cfaf in term 26.
I20260811 16:08:07.096330 24177 raft_consensus.cc:504] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.097164 24178 raft_consensus.cc:2726] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:08:07.098831 24177 leader_election.cc:288] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.099367 13871 leader_election.cc:302] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.100792 14544 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.100905 24182 raft_consensus.cc:2726] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.102901 24183 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.104239 14581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a48002159c1643c489d152b863d3d839" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.102186 12383 tablet_replica.cc:330] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.105278 14544 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.105542 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e71c22039484c80abd86e7fa5392e68" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.105918 14544 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.106870 12383 raft_consensus.cc:2229] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:07.106627 14544 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.107692 12383 raft_consensus.cc:2258] T 94d079a9604d4ed3832dbb48ba12cd16 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.107582 24182 raft_consensus.cc:482] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
W20260811 16:08:07.107867 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.108295 24182 raft_consensus.cc:504] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.108603 14544 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.109548 24183 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.110386 24182 leader_election.cc:288] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
W20260811 16:08:07.110661 14544 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.106012 13871 leader_election.cc:334] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.111541 13871 leader_election.cc:302] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.112241 24182 raft_consensus.cc:2726] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:07.112458 13871 leader_election.cc:334] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.112692 14544 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.112910 13871 leader_election.cc:302] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:07.114283 14544 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.113258 13874 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.115294 13871 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.115437 24177 raft_consensus.cc:482] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.114352 24182 raft_consensus.cc:2726] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.115762 13871 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.110716 12383 tablet_replica.cc:330] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.116024 24177 raft_consensus.cc:504] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } }
I20260811 16:08:07.117060 12383 raft_consensus.cc:2229] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.118113 24182 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260811 16:08:07.118373 24177 leader_election.cc:288] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:07.120250 13874 leader_election.cc:334] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:07.115204 14544 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.121515 12383 raft_consensus.cc:2258] T 02554b9e1cd54e1dbcfb941296b23093 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.121515 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b1798b103e4d138b728902afcc2b9b" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
W20260811 16:08:07.122419 14544 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.123281 24177 raft_consensus.cc:482] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:07.123852 24177 raft_consensus.cc:504] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.124246 13871 leader_election.cc:302] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
W20260811 16:08:07.125036 13874 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.126212 24177 leader_election.cc:288] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.126688 12383 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.123046 14544 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:07.127460 24182 raft_consensus.cc:2726] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260811 16:08:07.127529 14544 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.128180 13871 leader_election.cc:334] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.128669 12383 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.128670 13871 leader_election.cc:302] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:07.130076 13871 leader_election.cc:334] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.129479 12383 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.135823 24177 raft_consensus.cc:482] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:07.137435 13871 leader_election.cc:302] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.137730 24177 raft_consensus.cc:504] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.138449 24178 raft_consensus.cc:2726] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.129770 24182 raft_consensus.cc:2726] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260811 16:08:07.141032 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8baa39d90a34a09ab0f3b46ed69e00a" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.141392 12383 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.142760 13871 leader_election.cc:334] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.143263 13871 leader_election.cc:302] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.143477 24183 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.144024 24182 raft_consensus.cc:2726] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.143606 12383 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.144177 24183 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.145351 12383 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.145725 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "defa959376494546a5395f8a56cef106" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.148344 12383 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.150987 13871 leader_election.cc:334] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.151615 13871 leader_election.cc:302] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 8d98491a0db549d0b671b60b90c9cdea, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.152467 24182 raft_consensus.cc:2726] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260811 16:08:07.152916 14541 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.153193 13874 leader_election.cc:334] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.153685 13874 leader_election.cc:302] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.153914 24183 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:07.141995 24177 leader_election.cc:288] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.154613 24178 raft_consensus.cc:2726] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260811 16:08:07.155324 24177 raft_consensus.cc:482] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8d98491a0db549d0b671b60b90c9cdea)
I20260811 16:08:07.155850 24177 raft_consensus.cc:504] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.156426 12383 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:07.157099 14542 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:08:07.157480 14542 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.158049 24177 leader_election.cc:288] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 8d98491a0db549d0b671b60b90c9cdea (127.12.23.196:37251)
I20260811 16:08:07.158226 24183 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260811 16:08:07.159665 14583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97fbe9fd7534b9e93a8abec637a8c1e" candidate_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8d98491a0db549d0b671b60b90c9cdea" is_pre_election: true
I20260811 16:08:07.160296 12383 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.163481 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.163379 13874 leader_election.cc:334] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.163978 13874 leader_election.cc:302] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5088cdd3f79d4c47ba826dc820b3cfaf; no voters: 5f46150fac70458986206ec7af67a403, 8d98491a0db549d0b671b60b90c9cdea
I20260811 16:08:07.164261 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 30 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.165165 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 30 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.165237 24177 raft_consensus.cc:2726] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:08:07.129407 14544 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:07.166334 14544 leader_election.cc:334] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.166783 14544 leader_election.cc:302] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.167606 24183 raft_consensus.cc:2726] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260811 16:08:07.167845 12383 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.168645 12383 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.169436 12383 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.170995 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.171586 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.172114 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.172979 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.173775 24183 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260811 16:08:07.174021 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.174882 14544 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.176939 12383 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.177878 12383 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.178462 12383 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.181128 12383 tablet_replica.cc:330] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.181911 12383 raft_consensus.cc:2229] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.183082 12383 raft_consensus.cc:2258] T c3ac106c3df9431c9323c322b9f8118b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.185953 12383 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.186724 12383 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.187750 12383 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.189632 12383 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.190214 12383 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.190713 12383 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.192689 12383 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.193250 12383 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.193825 12383 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.195794 12383 tablet_replica.cc:330] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.196383 12383 raft_consensus.cc:2229] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.197006 12383 raft_consensus.cc:2258] T 88888e6c2eb344e0b1468ef497832be3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.199503 12383 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.200100 12383 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.201151 12383 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.203399 12383 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.203992 12383 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.205222 12383 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.207500 12383 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.208143 12383 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.209105 12383 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.211089 12383 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.211751 12383 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.212239 12383 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.214479 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.215118 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.216566 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.218104 24183 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:07.219051 12383 tablet_replica.cc:330] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.218744 24183 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:07.220180 12383 raft_consensus.cc:2229] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.220821 12383 raft_consensus.cc:2258] T ffb6122695854eb8a6ab98b508c17b30 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.222595 24183 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
I20260811 16:08:07.223855 12383 tablet_replica.cc:330] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.224747 12383 raft_consensus.cc:2229] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.225458 12383 raft_consensus.cc:2258] T d00255c500904da78a120b3431f1e31d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.228783 12383 tablet_replica.cc:330] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
W20260811 16:08:07.228835 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:07.229693 12383 raft_consensus.cc:2229] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 LEADER]: Raft consensus shutting down.
W20260811 16:08:07.230551 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:07.230808 12383 raft_consensus.cc:2258] T ff741363b70845aeab13c5999c9843e4 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.231005 14541 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:07.231923 24183 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260811 16:08:07.233902 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.234648 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.236011 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P 5088cdd3f79d4c47ba826dc820b3cfaf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.238147 12383 tablet_replica.cc:330] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.238881 12383 raft_consensus.cc:2229] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.239840 12383 raft_consensus.cc:2258] T 47a99d649fa64ed18701c70592b7b534 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.241887 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.242529 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.243323 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.245347 12383 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.245949 12383 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.246455 12383 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.248525 12383 tablet_replica.cc:330] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.249138 12383 raft_consensus.cc:2229] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.250293 12383 raft_consensus.cc:2258] T 0556c3c022b74f43b43aa6f25d418e58 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.252460 12383 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.253018 12383 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.254025 12383 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.256522 12383 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.257280 12383 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.257879 12383 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.260975 12383 tablet_replica.cc:330] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.261739 12383 raft_consensus.cc:2229] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.262956 12383 raft_consensus.cc:2258] T 78a0d32ee74448a6931819ee7d5e0f59 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 29 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.266199 12383 tablet_replica.cc:330] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.266942 12383 raft_consensus.cc:2229] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.267570 12383 raft_consensus.cc:2258] T 580037905a064c08b39df9f9843b5448 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.270129 12383 tablet_replica.cc:330] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.270887 12383 raft_consensus.cc:2229] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.272087 12383 raft_consensus.cc:2258] T d9c0f5b985cc420c9dad45a78187a946 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.274672 12383 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.275450 12383 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.276054 12383 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.278168 12383 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.278913 12383 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.280242 12383 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.282907 12383 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.283685 12383 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.284207 12383 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.286206 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.286938 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.288034 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.291294 12383 tablet_replica.cc:330] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.292166 12383 raft_consensus.cc:2229] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.293442 12383 raft_consensus.cc:2258] T 11dc75ffca384b91994ceec6d295e6e8 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.295928 12383 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.296761 12383 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.297492 12383 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.299614 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260811 16:08:07.300036 12383 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.300669 12383 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.301196 12383 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.303068 12383 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.303674 12383 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.304621 12383 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.307090 12383 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.307881 12383 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.309038 12383 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.311126 12383 tablet_replica.cc:330] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.311707 12383 raft_consensus.cc:2229] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.312282 12383 raft_consensus.cc:2258] T 210dcf7aee994bdaa1e75860a25bdd3a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.314383 12383 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.314962 12383 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:07.315560 12383 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P 5088cdd3f79d4c47ba826dc820b3cfaf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.317607 12383 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.318118 12383 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.319469 12383 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P 5088cdd3f79d4c47ba826dc820b3cfaf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:07.321807 12383 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf: stopping tablet replica
I20260811 16:08:07.322371 12383 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 LEADER]: Raft consensus shutting down.
I20260811 16:08:07.323408 12383 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P 5088cdd3f79d4c47ba826dc820b3cfaf [term 16 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:07.373775 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:07.506490 14541 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:40411, user_credentials={real_user=slave}} blocked reactor thread for 104803us
W20260811 16:08:07.538676 14541 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:07.539960 14541 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 16:08:07.547442 14542 connection.cc:698] client connection to 127.12.23.195:42003 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260811 16:08:07.588814 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:07.730979 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:07.878340 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1560 after lost signal to thread 12388
W20260811 16:08:07.879575 14607 debug-util.cc:398] Leaking SignalData structure 0x7b0800327740 after lost signal to thread 13668
W20260811 16:08:07.880295 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe1c0 after lost signal to thread 13941
W20260811 16:08:07.881350 14607 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0100 after lost signal to thread 14610
W20260811 16:08:07.895893 13937 debug-util.cc:398] Leaking SignalData structure 0x7b080014b900 after lost signal to thread 12388
W20260811 16:08:07.897145 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08001751c0 after lost signal to thread 13668
W20260811 16:08:07.897994 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800394ae0 after lost signal to thread 13941
W20260811 16:08:07.899361 13937 debug-util.cc:398] Leaking SignalData structure 0x7b0800367920 after lost signal to thread 14610
W20260811 16:08:07.899641 13937 debug-util.cc:398] Leaking SignalData structure 0x7b08003772c0 after lost signal to thread 14611
W20260811 16:08:07.935242 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
W20260811 16:08:07.958968 14541 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:07.984774 14541 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.033087 14541 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.331408 14541 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.339187 14541 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260811 16:08:08.456653 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08001785a0 after lost signal to thread 12388
W20260811 16:08:08.458007 13665 debug-util.cc:398] Leaking SignalData structure 0x7b08000311c0 after lost signal to thread 13668
W20260811 16:08:08.458690 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080003ea40 after lost signal to thread 13941
W20260811 16:08:08.460269 13665 debug-util.cc:398] Leaking SignalData structure 0x7b080014f860 after lost signal to thread 14610
I20260811 16:08:08.497871 24187 raft_consensus.cc:482] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.498643 24187 raft_consensus.cc:504] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.501546 24190 raft_consensus.cc:482] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.502177 24190 raft_consensus.cc:504] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.503773 24173 raft_consensus.cc:482] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.504360 24173 raft_consensus.cc:504] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.516021 24195 raft_consensus.cc:482] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.516746 24195 raft_consensus.cc:504] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } attrs { replace: true } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.517758 24190 leader_election.cc:288] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.518426 24190 raft_consensus.cc:482] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.519702 24195 leader_election.cc:288] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.524049 24198 raft_consensus.cc:482] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.501024 24187 leader_election.cc:288] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.525770 24187 raft_consensus.cc:482] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.526383 24187 raft_consensus.cc:504] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.528864 24187 leader_election.cc:288] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.529670 24173 leader_election.cc:288] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.524744 24198 raft_consensus.cc:504] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.529662 24195 raft_consensus.cc:482] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.518915 24190 raft_consensus.cc:504] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.534235 24195 raft_consensus.cc:504] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.535950 24198 leader_election.cc:288] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.536304 24190 leader_election.cc:288] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.541654 24195 leader_election.cc:288] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:08.546501 14544 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.547267 14544 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.562752 12383 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 13937)
W20260811 16:08:08.568259 14544 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.576079 14544 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.576875 14544 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:08.578488 24187 raft_consensus.cc:482] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.579264 24187 raft_consensus.cc:504] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.582224 24187 leader_election.cc:288] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.588038 24197 raft_consensus.cc:482] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.589198 24197 raft_consensus.cc:504] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.595995 24197 leader_election.cc:288] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:08.592769 14542 leader_election.cc:334] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.605173 14542 leader_election.cc:302] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
W20260811 16:08:08.601302 14541 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.606634 14541 leader_election.cc:302] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.583585 24194 raft_consensus.cc:482] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.610031 24194 raft_consensus.cc:504] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.612411 24194 leader_election.cc:288] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.608678 24187 raft_consensus.cc:2726] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.614048 14542 leader_election.cc:334] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
W20260811 16:08:08.620995 14544 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:08.621734 24187 raft_consensus.cc:482] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.625929 24187 raft_consensus.cc:504] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.628855 24187 leader_election.cc:288] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.615315 24197 raft_consensus.cc:2726] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:08:08.629581 14544 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.633437 14541 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.639322 14541 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.644411 14541 leader_election.cc:302] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:08.647094 14541 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.652364 14541 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.647353 24187 raft_consensus.cc:2726] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:08.660069 14542 leader_election.cc:334] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.669479 14542 leader_election.cc:302] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.673684 24187 raft_consensus.cc:2726] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:08:08.675470 14542 leader_election.cc:334] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
W20260811 16:08:08.672750 14541 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.676891 14544 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:08.682804 14542 leader_election.cc:334] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.687211 14542 leader_election.cc:302] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:08.690883 14542 leader_election.cc:334] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.691547 24187 raft_consensus.cc:2726] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:08.689807 14541 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.696269 14542 leader_election.cc:302] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.697289 24187 raft_consensus.cc:2726] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:08.698359 14542 leader_election.cc:334] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.698889 14542 leader_election.cc:302] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.699846 24187 raft_consensus.cc:2726] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260811 16:08:08.701102 14542 leader_election.cc:334] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.701838 14542 leader_election.cc:302] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.702637 24187 raft_consensus.cc:2726] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260811 16:08:08.752002 24187 raft_consensus.cc:482] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5088cdd3f79d4c47ba826dc820b3cfaf)
I20260811 16:08:08.752810 24187 raft_consensus.cc:504] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.755209 24187 leader_election.cc:288] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
W20260811 16:08:08.760692 14541 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:08.766229 14542 leader_election.cc:334] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.770898 14542 leader_election.cc:302] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.772132 24187 raft_consensus.cc:2726] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.773540 14542 leader_election.cc:334] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.774111 14542 leader_election.cc:302] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, 5f46150fac70458986206ec7af67a403
I20260811 16:08:08.775199 24187 raft_consensus.cc:2726] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.777345 14542 leader_election.cc:334] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.778203 14542 leader_election.cc:302] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.779162 24187 raft_consensus.cc:2726] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260811 16:08:08.780400 14542 leader_election.cc:334] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.780915 14542 leader_election.cc:302] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.782091 24187 raft_consensus.cc:2726] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260811 16:08:08.795585 14542 leader_election.cc:334] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.796202 14542 leader_election.cc:302] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.797091 24187 raft_consensus.cc:2726] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260811 16:08:08.798132 14542 consensus_peers.cc:487] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:08.845244 24197 raft_consensus.cc:482] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:08.845865 24197 raft_consensus.cc:504] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:08.847082 14544 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:08.848572 24197 leader_election.cc:288] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:08.851567 24197 raft_consensus.cc:482] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:08.852123 24197 raft_consensus.cc:504] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.854305 24197 leader_election.cc:288] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:08.855620 14544 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.857678 14544 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.858366 14541 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.858896 14541 leader_election.cc:302] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
W20260811 16:08:08.859568 14542 leader_election.cc:334] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
I20260811 16:08:08.860041 24197 raft_consensus.cc:2726] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:08.863442 14541 leader_election.cc:334] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.863997 14541 leader_election.cc:302] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.864871 24197 raft_consensus.cc:2726] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:08.872898 14542 consensus_peers.cc:487] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:08.873991 24197 raft_consensus.cc:482] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:08.874591 24197 raft_consensus.cc:504] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:08.878449 24197 leader_election.cc:288] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:08.885902 14544 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:08.887631 14541 leader_election.cc:334] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:08.888240 14541 leader_election.cc:302] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:08.889245 24197 raft_consensus.cc:2726] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:08:08.914294 14541 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.922031 14541 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:08.939049 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
W20260811 16:08:08.972787 14542 consensus_peers.cc:487] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:08.983530 14544 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.001703 14541 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:09.063515 14544 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.070865 14542 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.133152 14544 consensus_peers.cc:487] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.135746 14544 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.142027 14542 consensus_peers.cc:487] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.176574 14542 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:09.202769 24197 raft_consensus.cc:482] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.203542 24197 raft_consensus.cc:504] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:09.205948 24197 leader_election.cc:288] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:09.210677 14541 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:09.211426 14544 leader_election.cc:334] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:09.211858 14544 leader_election.cc:302] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.212664 24197 raft_consensus.cc:2726] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260811 16:08:09.225075 14541 consensus_peers.cc:487] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260811 16:08:09.241976 14542 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.267261 14542 consensus_peers.cc:487] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.278048 14542 consensus_peers.cc:487] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.292071 14542 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.294199 14544 consensus_peers.cc:487] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.312757 14542 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.342576 14544 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.358407 14542 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.373749 14544 consensus_peers.cc:487] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.374965 14542 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.407817 14544 consensus_peers.cc:487] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.427830 14544 consensus_peers.cc:487] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.437764 14544 consensus_peers.cc:487] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.478561 24198 raft_consensus.cc:482] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.479210 24198 raft_consensus.cc:504] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:09.481276 24198 leader_election.cc:288] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:09.486934 14544 consensus_peers.cc:487] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 16:08:09.487598 14544 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:09.489040 14542 consensus_peers.cc:487] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.489611 14541 leader_election.cc:334] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:09.490103 14541 leader_election.cc:302] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.491020 24197 raft_consensus.cc:2726] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260811 16:08:09.495980 14544 consensus_peers.cc:487] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.515878 24197 raft_consensus.cc:482] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.516567 24197 raft_consensus.cc:504] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
I20260811 16:08:09.518985 24197 leader_election.cc:288] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239)
W20260811 16:08:09.525003 14541 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:09.526365 14544 leader_election.cc:334] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
I20260811 16:08:09.526916 14544 leader_election.cc:302] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5f46150fac70458986206ec7af67a403, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.527813 24197 raft_consensus.cc:2726] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260811 16:08:09.544066 14542 consensus_peers.cc:487] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:09.579214 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:08:09.592106 24197 raft_consensus.cc:482] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5f46150fac70458986206ec7af67a403)
I20260811 16:08:09.593228 24197 raft_consensus.cc:504] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "cec0688f86d54789b9b9ecc924ddecf3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 40411 } } peers { permanent_uuid: "5f46150fac70458986206ec7af67a403" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 42239 } } peers { permanent_uuid: "5088cdd3f79d4c47ba826dc820b3cfaf" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 42003 } attrs { replace: true } } peers { permanent_uuid: "8d98491a0db549d0b671b60b90c9cdea" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 37251 } attrs { promote: false } }
W20260811 16:08:09.601473 14542 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111)
W20260811 16:08:09.606169 14541 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:09.606860 14541 leader_election.cc:302] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d98491a0db549d0b671b60b90c9cdea; no voters: 5088cdd3f79d4c47ba826dc820b3cfaf, cec0688f86d54789b9b9ecc924ddecf3
I20260811 16:08:09.606251 24197 leader_election.cc:288] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411), 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239), 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003)
I20260811 16:08:09.608269 24197 raft_consensus.cc:2726] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260811 16:08:09.625449 14541 consensus_peers.cc:487] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260811 16:08:09.626389 14544 leader_election.cc:334] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111)
W20260811 16:08:09.627838 14544 consensus_peers.cc:487] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.676877 12383 tablet_server.cc:178] TabletServer@127.12.23.196:0 shutting down...
W20260811 16:08:09.707120 14541 consensus_peers.cc:487] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260811 16:08:09.723801 14542 consensus_peers.cc:487] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:09.742420 14544 consensus_peers.cc:487] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5f46150fac70458986206ec7af67a403 (127.12.23.194:42239): Couldn't send request to peer 5f46150fac70458986206ec7af67a403. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:42239: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 16:08:09.754740 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:09.755877 12383 tablet_replica.cc:330] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.756966 12383 raft_consensus.cc:2229] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.757799 12383 raft_consensus.cc:2258] T e92ba91a1eb84cef82a03bb6ed271a72 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:09.758262 14542 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer 5088cdd3f79d4c47ba826dc820b3cfaf (127.12.23.195:42003): Couldn't send request to peer 5088cdd3f79d4c47ba826dc820b3cfaf. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:42003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:09.760732 12383 tablet_replica.cc:330] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.761433 12383 raft_consensus.cc:2229] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.761993 12383 raft_consensus.cc:2258] T 962f3dc40b494dc48647abd894784e8d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.764729 12383 tablet_replica.cc:330] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.765601 12383 raft_consensus.cc:2229] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.766276 12383 raft_consensus.cc:2258] T 20ad41e4f434442792e36eb47449b101 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.768646 12383 tablet_replica.cc:330] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.769337 12383 raft_consensus.cc:2229] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.770402 12383 raft_consensus.cc:2258] T a48002159c1643c489d152b863d3d839 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.772521 12383 tablet_replica.cc:330] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.773196 12383 raft_consensus.cc:2229] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.774148 12383 pending_rounds.cc:62] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Trying to abort 1 pending ops.
I20260811 16:08:09.774456 12383 pending_rounds.cc:68] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea: Aborting op as it isn't in flight: id { term: 30 index: 18 } timestamp: 7317358531623370752 op_type: NO_OP noop_request { }
I20260811 16:08:09.774796 12383 raft_consensus.cc:2866] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 16:08:09.775188 12383 raft_consensus.cc:2258] T c390fd23cec5435d81b38a50b2988a60 P 8d98491a0db549d0b671b60b90c9cdea [term 30 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.778013 12383 tablet_replica.cc:330] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.778754 12383 raft_consensus.cc:2229] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.779413 12383 raft_consensus.cc:2258] T b2c264c500bb4a599103d9117a31012d P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.781689 12383 tablet_replica.cc:330] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.782260 12383 raft_consensus.cc:2229] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.783025 12383 raft_consensus.cc:2258] T 20097351f7854d5487483d8e78420c49 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.784955 12383 tablet_replica.cc:330] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.785480 12383 raft_consensus.cc:2229] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.786149 12383 raft_consensus.cc:2258] T 7f6a000330b3415da4f525eae84f33fb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.788445 12383 tablet_replica.cc:330] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.788985 12383 raft_consensus.cc:2229] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.789458 12383 raft_consensus.cc:2258] T 41b38d6f6713439aad43a191eb42cd45 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.791829 12383 tablet_replica.cc:330] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.792412 12383 raft_consensus.cc:2229] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.793305 12383 raft_consensus.cc:2258] T e7c98a1b986c4db5bd4c160284e54651 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.795849 12383 tablet_replica.cc:330] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.796558 12383 raft_consensus.cc:2229] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.797578 12383 raft_consensus.cc:2258] T 7d60ab9da3d047ca897a698d07779c2e P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.800328 12383 tablet_replica.cc:330] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.801199 12383 raft_consensus.cc:2229] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.802295 12383 raft_consensus.cc:2258] T af4dc0ff3ced489a86fe70cfbac98798 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:09.802760 14541 consensus_peers.cc:487] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260811 16:08:09.804759 12383 tablet_replica.cc:330] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.805466 12383 raft_consensus.cc:2229] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.806460 12383 raft_consensus.cc:2258] T 583cc1a296dd4344b3aaf399b8d5b17f P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.808689 12383 tablet_replica.cc:330] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.809307 12383 raft_consensus.cc:2229] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.809813 12383 raft_consensus.cc:2258] T 9315a4a479754517bd121148cf017615 P 8d98491a0db549d0b671b60b90c9cdea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.811800 12383 tablet_replica.cc:330] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.812390 12383 raft_consensus.cc:2229] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.813361 12383 raft_consensus.cc:2258] T 98ab517b34b7491eabb89d31d262a45e P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.816104 12383 tablet_replica.cc:330] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.816851 12383 raft_consensus.cc:2229] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.817384 12383 raft_consensus.cc:2258] T 673bb1bb89d4450ba4dbcb918a9174e0 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.819460 12383 tablet_replica.cc:330] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.820034 12383 raft_consensus.cc:2229] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.820691 12383 raft_consensus.cc:2258] T 20f7937a4cf04cef96095a62cb4ef661 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.823036 12383 tablet_replica.cc:330] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.824033 12383 raft_consensus.cc:2229] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.824867 12383 raft_consensus.cc:2258] T 7aa7e1db174a419e955a8806d40e8a14 P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.828610 12383 tablet_replica.cc:330] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.829612 12383 raft_consensus.cc:2229] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 LEADER]: Raft consensus shutting down.
W20260811 16:08:09.830475 14541 consensus_peers.cc:487] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea -> Peer cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): Couldn't send request to peer cec0688f86d54789b9b9ecc924ddecf3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260811 16:08:09.830798 12383 raft_consensus.cc:2258] T f6b1798b103e4d138b728902afcc2b9b P 8d98491a0db549d0b671b60b90c9cdea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.833940 12383 tablet_replica.cc:330] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.834611 12383 raft_consensus.cc:2229] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.835238 12383 raft_consensus.cc:2258] T 17293f4853fe4715a4622208f2fbb5a7 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.837416 12383 tablet_replica.cc:330] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.838147 12383 raft_consensus.cc:2229] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.838999 12383 raft_consensus.cc:2258] T 18e29247552943ad9bfa10e83e0dc5dd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.841065 12383 tablet_replica.cc:330] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.841706 12383 raft_consensus.cc:2229] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.842231 12383 raft_consensus.cc:2258] T 7b76fe83cb6c40d0af784af645b1e956 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.844835 12383 tablet_replica.cc:330] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.845605 12383 raft_consensus.cc:2229] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.847080 12383 raft_consensus.cc:2258] T 6e71c22039484c80abd86e7fa5392e68 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.849676 12383 tablet_replica.cc:330] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.850310 12383 raft_consensus.cc:2229] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.850880 12383 raft_consensus.cc:2258] T 97076df0f82e4818b7f7318f8deff8d8 P 8d98491a0db549d0b671b60b90c9cdea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.853509 12383 tablet_replica.cc:330] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.854130 12383 raft_consensus.cc:2229] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.854820 12383 raft_consensus.cc:2258] T 85bed8270f474c2e80653bbdc5806659 P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.856966 12383 tablet_replica.cc:330] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.857594 12383 raft_consensus.cc:2229] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.858747 12383 raft_consensus.cc:2258] T 2c5b1c77a3014dd490b50a04ca62cd4c P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.861430 12383 tablet_replica.cc:330] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.862658 12383 raft_consensus.cc:2229] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.863956 12383 raft_consensus.cc:2258] T 993fa0c090be4f83b6e0d60b3aa8dc78 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.866401 12383 tablet_replica.cc:330] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.867234 12383 raft_consensus.cc:2229] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.868120 12383 raft_consensus.cc:2258] T 7f329d644e014d3fad21c11a415e907c P 8d98491a0db549d0b671b60b90c9cdea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.870093 12383 tablet_replica.cc:330] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.870651 12383 raft_consensus.cc:2229] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.871570 12383 raft_consensus.cc:2258] T 6c9671b71f644eaf969b8bb56e717beb P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.874126 12383 tablet_replica.cc:330] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.874878 12383 raft_consensus.cc:2229] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.875741 12383 raft_consensus.cc:2258] T 7f5f6467bf4b427f873ea8d2990f2945 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.877844 12383 tablet_replica.cc:330] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.878417 12383 raft_consensus.cc:2229] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.879385 12383 raft_consensus.cc:2258] T ade10bd0a2294e86b324757afe52d216 P 8d98491a0db549d0b671b60b90c9cdea [term 28 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.881925 12383 tablet_replica.cc:330] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.882746 12383 raft_consensus.cc:2229] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.883787 12383 raft_consensus.cc:2258] T a97fbe9fd7534b9e93a8abec637a8c1e P 8d98491a0db549d0b671b60b90c9cdea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.885878 12383 tablet_replica.cc:330] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.886468 12383 raft_consensus.cc:2229] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.887005 12383 raft_consensus.cc:2258] T 00d7fc8e90884ea59b440daaba753fd7 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.889040 12383 tablet_replica.cc:330] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.889631 12383 raft_consensus.cc:2229] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.890518 12383 raft_consensus.cc:2258] T bc7ec7085e27482fa91e60b9993522de P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.892578 12383 tablet_replica.cc:330] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.893152 12383 raft_consensus.cc:2229] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.894018 12383 raft_consensus.cc:2258] T 93cf6e0832154e35bedbcec9d96701f2 P 8d98491a0db549d0b671b60b90c9cdea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.895960 12383 tablet_replica.cc:330] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.896520 12383 raft_consensus.cc:2229] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.896991 12383 raft_consensus.cc:2258] T 111ca2b9029e420191db21651d7c7015 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.898939 12383 tablet_replica.cc:330] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.899518 12383 raft_consensus.cc:2229] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.900382 12383 raft_consensus.cc:2258] T defa959376494546a5395f8a56cef106 P 8d98491a0db549d0b671b60b90c9cdea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.902511 12383 tablet_replica.cc:330] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.903054 12383 raft_consensus.cc:2229] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.903595 12383 raft_consensus.cc:2258] T 1185ca07eaca4954a71d11cfa2256fd3 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.905651 12383 tablet_replica.cc:330] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.906212 12383 raft_consensus.cc:2229] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.907073 12383 raft_consensus.cc:2258] T 5b62f8d4bd2b496fbdc602cfa4bb2ccc P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.909037 12383 tablet_replica.cc:330] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.909566 12383 raft_consensus.cc:2229] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.910118 12383 raft_consensus.cc:2258] T 801054abfed346a09c04b7cd13d7c62f P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.912053 12383 tablet_replica.cc:330] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.912611 12383 raft_consensus.cc:2229] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.913555 12383 raft_consensus.cc:2258] T 5e699b23b5a94bf7b11086e6878e0207 P 8d98491a0db549d0b671b60b90c9cdea [term 19 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.915750 12383 tablet_replica.cc:330] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.916303 12383 raft_consensus.cc:2229] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.917235 12383 raft_consensus.cc:2258] T 930faff3981346c88c8864a1f3b15158 P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.919292 12383 tablet_replica.cc:330] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.919849 12383 raft_consensus.cc:2229] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.920778 12383 raft_consensus.cc:2258] T f42299184ed34c10bccc7de82e5dd1bd P 8d98491a0db549d0b671b60b90c9cdea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.922791 12383 tablet_replica.cc:330] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.923346 12383 raft_consensus.cc:2229] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:09.923883 12383 raft_consensus.cc:2258] T d7c952fbefaf4aa7b441b3d2c248f25c P 8d98491a0db549d0b671b60b90c9cdea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:09.926097 12383 tablet_replica.cc:330] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea: stopping tablet replica
I20260811 16:08:09.926645 12383 raft_consensus.cc:2229] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 LEADER]: Raft consensus shutting down.
I20260811 16:08:09.927600 12383 raft_consensus.cc:2258] T c8baa39d90a34a09ab0f3b46ed69e00a P 8d98491a0db549d0b671b60b90c9cdea [term 20 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:09.942449 13686 auto_rebalancer.cc:227] Could not retrieve cluster info: Not found: tserver cec0688f86d54789b9b9ecc924ddecf3 not available for placement
I20260811 16:08:10.372454 12383 tablet_server.cc:194] TabletServer@127.12.23.196:0 shutdown complete.
I20260811 16:08:10.491262 12383 master.cc:537] Master@127.12.23.254:34613 shutting down...
W20260811 16:08:14.940867 13612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111) [suppressed 404 similar messages]
W20260811 16:08:14.944577 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20f7937a4cf04cef96095a62cb4ef661: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:24.147418 13612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
W20260811 16:08:24.151243 13612 catalog_manager.cc:4584] TS cec0688f86d54789b9b9ecc924ddecf3 (127.12.23.193:40411): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c390fd23cec5435d81b38a50b2988a60: Network error: Client connection negotiation failed: client connection to 127.12.23.193:40411: connect: Connection refused (error 111)
I20260811 16:08:27.538811 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:27.540109 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:27.540680 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P a33d4003601443f4b810ff8345d6e5a9: stopping tablet replica
I20260811 16:08:27.760612 12383 master.cc:552] Master@127.12.23.254:34613 shutdown complete.
I20260811 16:08:27.821672 12383 test_util.cc:175] -----------------------------------------------
I20260811 16:08:27.821897 12383 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786464125124352-12383-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (319141 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260811 16:08:27.826143 12383 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.23.254:43075
I20260811 16:08:27.827435 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:08:27.834793 24210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:27.835289 24209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:27.835592 24212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:08:27.836220 12383 server_base.cc:1034] running on GCE node
I20260811 16:08:27.842166 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:08:27.842411 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:08:27.842592 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464507842579 us; error 0 us; skew 500 ppm
I20260811 16:08:27.843242 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:08:27.846110 12383 webserver.cc:460] Webserver started at http://127.12.23.254:44515/ using document root <none> and password file <none>
I20260811 16:08:27.846662 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:08:27.846863 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:08:27.847244 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:08:27.848763 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/master-0-root/instance:
uuid: "027aa4a15f9f4982bef60b0108166320"
format_stamp: "Formatted at 2026-08-11 16:08:27 on dist-test-slave-chsk"
I20260811 16:08:27.854235 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260811 16:08:27.858049 24220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:27.859030 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260811 16:08:27.859478 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/master-0-root
uuid: "027aa4a15f9f4982bef60b0108166320"
format_stamp: "Formatted at 2026-08-11 16:08:27 on dist-test-slave-chsk"
I20260811 16:08:27.859894 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:08:27.880563 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:08:27.881910 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:08:27.924271 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.254:43075
I20260811 16:08:27.924381 24276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.254:43075 every 8 connection(s)
I20260811 16:08:27.928684 24277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:27.941461 24277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320: Bootstrap starting.
I20260811 16:08:27.946625 24277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:27.951356 24277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320: No bootstrap required, opened a new log
I20260811 16:08:27.953588 24277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027aa4a15f9f4982bef60b0108166320" member_type: VOTER }
I20260811 16:08:27.954126 24277 raft_consensus.cc:374] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:27.954311 24277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027aa4a15f9f4982bef60b0108166320, State: Initialized, Role: FOLLOWER
I20260811 16:08:27.954834 24277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027aa4a15f9f4982bef60b0108166320" member_type: VOTER }
I20260811 16:08:27.955288 24277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:08:27.955492 24277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:08:27.955730 24277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:27.960613 24277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027aa4a15f9f4982bef60b0108166320" member_type: VOTER }
I20260811 16:08:27.961355 24277 leader_election.cc:302] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 027aa4a15f9f4982bef60b0108166320; no voters: 
I20260811 16:08:27.962677 24277 leader_election.cc:288] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 16:08:27.963192 24280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:27.964706 24280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 1 LEADER]: Becoming Leader. State: Replica: 027aa4a15f9f4982bef60b0108166320, State: Running, Role: LEADER
I20260811 16:08:27.965448 24280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027aa4a15f9f4982bef60b0108166320" member_type: VOTER }
I20260811 16:08:27.965960 24277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:08:27.973851 24282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 027aa4a15f9f4982bef60b0108166320. Latest consensus state: current_term: 1 leader_uuid: "027aa4a15f9f4982bef60b0108166320" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027aa4a15f9f4982bef60b0108166320" member_type: VOTER } }
I20260811 16:08:27.974800 24282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [sys.catalog]: This master's current role is: LEADER
I20260811 16:08:27.974097 24281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "027aa4a15f9f4982bef60b0108166320" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027aa4a15f9f4982bef60b0108166320" member_type: VOTER } }
I20260811 16:08:27.976625 24281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [sys.catalog]: This master's current role is: LEADER
I20260811 16:08:27.977016 24293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:08:27.983407 24293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:08:27.984563 12383 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:08:27.992975 24293 catalog_manager.cc:1347] Generated new cluster ID: 9869c565032241cf93d928e9f568706e
I20260811 16:08:27.993310 24293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:08:28.008427 24293 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:08:28.010245 24293 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:08:28.026317 24293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320: Generated new TSK 0
I20260811 16:08:28.027079 24293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:08:28.051676 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:08:28.058518 24303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.059566 24304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.061373 24307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:08:28.063777 12383 server_base.cc:1034] running on GCE node
I20260811 16:08:28.067437 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:08:28.067695 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:08:28.067914 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464508067891 us; error 0 us; skew 500 ppm
I20260811 16:08:28.068473 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:08:28.071015 12383 webserver.cc:460] Webserver started at http://127.12.23.193:34141/ using document root <none> and password file <none>
I20260811 16:08:28.071610 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:08:28.071827 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:08:28.072091 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:08:28.073441 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/instance:
uuid: "7631002fc97849e6bc5842e364e770e3"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.079113 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260811 16:08:28.082949 24312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.083899 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260811 16:08:28.084894 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "7631002fc97849e6bc5842e364e770e3"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.085265 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:08:28.102495 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:08:28.103900 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:08:28.105460 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:08:28.107990 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:08:28.108211 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.108469 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:08:28.108659 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.156291 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:36221
I20260811 16:08:28.156451 24385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:36221 every 8 connection(s)
I20260811 16:08:28.162211 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:08:28.171346 24390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.172778 24391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.177446 24393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:08:28.178871 12383 server_base.cc:1034] running on GCE node
I20260811 16:08:28.179972 24386 heartbeater.cc:347] Connected to a master server at 127.12.23.254:43075
I20260811 16:08:28.180410 24386 heartbeater.cc:464] Registering TS with master...
I20260811 16:08:28.181180 24386 heartbeater.cc:511] Master 127.12.23.254:43075 requested a full tablet report, sending...
I20260811 16:08:28.183132 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:08:28.183473 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:08:28.183663 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464508183645 us; error 0 us; skew 500 ppm
I20260811 16:08:28.183569 24238 ts_manager.cc:194] Registered new tserver with Master: 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:28.184499 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:08:28.186309 24238 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39070
I20260811 16:08:28.187822 12383 webserver.cc:460] Webserver started at http://127.12.23.194:45191/ using document root <none> and password file <none>
I20260811 16:08:28.188465 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:08:28.188681 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:08:28.188958 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:08:28.190398 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/instance:
uuid: "d44d109b1df0445eba66548c099958e3"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.195485 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260811 16:08:28.199745 24399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.200730 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260811 16:08:28.201088 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-1-root
uuid: "d44d109b1df0445eba66548c099958e3"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.201463 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:08:28.225499 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:08:28.227043 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:08:28.228869 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:08:28.231648 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:08:28.231904 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.232169 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:08:28.232349 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.281421 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.194:38247
I20260811 16:08:28.281548 24470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.194:38247 every 8 connection(s)
I20260811 16:08:28.287366 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:08:28.296414 24474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.296568 24475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.301380 24477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:08:28.301998 12383 server_base.cc:1034] running on GCE node
I20260811 16:08:28.303354 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260811 16:08:28.303366 24471 heartbeater.cc:347] Connected to a master server at 127.12.23.254:43075
W20260811 16:08:28.303804 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:08:28.303972 24471 heartbeater.cc:464] Registering TS with master...
I20260811 16:08:28.304018 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464508304002 us; error 0 us; skew 500 ppm
I20260811 16:08:28.304991 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:08:28.305044 24471 heartbeater.cc:511] Master 127.12.23.254:43075 requested a full tablet report, sending...
I20260811 16:08:28.307632 24238 ts_manager.cc:194] Registered new tserver with Master: d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:28.308281 12383 webserver.cc:460] Webserver started at http://127.12.23.195:45419/ using document root <none> and password file <none>
I20260811 16:08:28.308851 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:08:28.309082 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:08:28.309381 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:08:28.309633 24238 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39084
I20260811 16:08:28.311165 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/instance:
uuid: "6f165e96383a40dc9d724b290a94706d"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.316948 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260811 16:08:28.320931 24483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.321863 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:08:28.322278 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-2-root
uuid: "6f165e96383a40dc9d724b290a94706d"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.322621 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:08:28.344499 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:08:28.345918 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:08:28.347569 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:08:28.350131 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:08:28.350382 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.350634 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:08:28.350811 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.399705 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.195:40337
I20260811 16:08:28.399842 24555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.195:40337 every 8 connection(s)
I20260811 16:08:28.405395 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:08:28.414673 24559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.416152 24560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:28.421358 24562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:08:28.422271 12383 server_base.cc:1034] running on GCE node
I20260811 16:08:28.422763 24556 heartbeater.cc:347] Connected to a master server at 127.12.23.254:43075
I20260811 16:08:28.423245 24556 heartbeater.cc:464] Registering TS with master...
I20260811 16:08:28.423621 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:08:28.424000 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:08:28.424203 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464508424189 us; error 0 us; skew 500 ppm
I20260811 16:08:28.424182 24556 heartbeater.cc:511] Master 127.12.23.254:43075 requested a full tablet report, sending...
I20260811 16:08:28.425262 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:08:28.426968 24238 ts_manager.cc:194] Registered new tserver with Master: 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:28.428428 12383 webserver.cc:460] Webserver started at http://127.12.23.196:35937/ using document root <none> and password file <none>
I20260811 16:08:28.429042 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:08:28.429137 24238 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39100
I20260811 16:08:28.429263 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:08:28.429850 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:08:28.431397 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-3-root/instance:
uuid: "707f02c5118a4d798120ca9c5786ada6"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.436637 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260811 16:08:28.440804 24570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.441746 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:08:28.442147 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-3-root
uuid: "707f02c5118a4d798120ca9c5786ada6"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:28.442483 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:08:28.484238 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:08:28.485707 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:08:28.487756 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:08:28.490443 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:08:28.490679 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.490942 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:08:28.491115 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:28.538167 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.196:32811
I20260811 16:08:28.538317 24637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.196:32811 every 8 connection(s)
I20260811 16:08:28.556483 24638 heartbeater.cc:347] Connected to a master server at 127.12.23.254:43075
I20260811 16:08:28.556946 24638 heartbeater.cc:464] Registering TS with master...
I20260811 16:08:28.557895 24638 heartbeater.cc:511] Master 127.12.23.254:43075 requested a full tablet report, sending...
I20260811 16:08:28.560170 24238 ts_manager.cc:194] Registered new tserver with Master: 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:28.561401 12383 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.019335916s
I20260811 16:08:28.562705 24238 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39104
I20260811 16:08:28.564965 12383 test_util.cc:268] Using random seed: -1368402486
I20260811 16:08:28.595676 24238 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39112:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260811 16:08:28.868798 24599 tablet_service.cc:1467] Processing CreateTablet for tablet 8b6592164b2b415e86bebdce9ce2517a (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260811 16:08:28.870512 24599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b6592164b2b415e86bebdce9ce2517a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.876368 24598 tablet_service.cc:1467] Processing CreateTablet for tablet 06d73d9b96de4eab90e9acf32a1bd105 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260811 16:08:28.878151 24598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06d73d9b96de4eab90e9acf32a1bd105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.887903 24597 tablet_service.cc:1467] Processing CreateTablet for tablet 62fbb0d94a2b49b2bab6a36b517ae048 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260811 16:08:28.889573 24597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62fbb0d94a2b49b2bab6a36b517ae048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.896900 24595 tablet_service.cc:1467] Processing CreateTablet for tablet e75ef18b8865438c83f749eea8f963aa (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260811 16:08:28.898502 24595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75ef18b8865438c83f749eea8f963aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.901212 24596 tablet_service.cc:1467] Processing CreateTablet for tablet c87a65e124704bdfb5ba6c78e7cc79ab (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260811 16:08:28.902482 24430 tablet_service.cc:1467] Processing CreateTablet for tablet 336c47cb9abd43c9b0c55f3234f96b70 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260811 16:08:28.904117 24430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336c47cb9abd43c9b0c55f3234f96b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.904523 24427 tablet_service.cc:1467] Processing CreateTablet for tablet c87a65e124704bdfb5ba6c78e7cc79ab (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260811 16:08:28.906082 24427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c87a65e124704bdfb5ba6c78e7cc79ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.905920 24428 tablet_service.cc:1467] Processing CreateTablet for tablet 3b21df0f0e7b43e7bb8911e772e7d9e2 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260811 16:08:28.906388 24424 tablet_service.cc:1467] Processing CreateTablet for tablet 0849d70159164a57a23b734a02aca623 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260811 16:08:28.907936 24424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0849d70159164a57a23b734a02aca623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.910252 24423 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa4c2dc66334d0d8ae8cc14be6a9df3 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260811 16:08:28.901226 24594 tablet_service.cc:1467] Processing CreateTablet for tablet bc31d8acb4164ff29dd355deb7245651 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260811 16:08:28.914248 24593 tablet_service.cc:1467] Processing CreateTablet for tablet 0849d70159164a57a23b734a02aca623 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260811 16:08:28.916503 24345 tablet_service.cc:1467] Processing CreateTablet for tablet 336c47cb9abd43c9b0c55f3234f96b70 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260811 16:08:28.917831 24590 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa4c2dc66334d0d8ae8cc14be6a9df3 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260811 16:08:28.911890 24428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b21df0f0e7b43e7bb8911e772e7d9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.910410 24426 tablet_service.cc:1467] Processing CreateTablet for tablet bc31d8acb4164ff29dd355deb7245651 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260811 16:08:28.902942 24596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c87a65e124704bdfb5ba6c78e7cc79ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.921345 24337 tablet_service.cc:1467] Processing CreateTablet for tablet 0849d70159164a57a23b734a02aca623 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260811 16:08:28.918381 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336c47cb9abd43c9b0c55f3234f96b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.921213 24341 tablet_service.cc:1467] Processing CreateTablet for tablet 3b21df0f0e7b43e7bb8911e772e7d9e2 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260811 16:08:28.916505 24591 tablet_service.cc:1467] Processing CreateTablet for tablet 20b7cb4615c04cddb553ef8d6e774869 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260811 16:08:28.926313 24429 tablet_service.cc:1467] Processing CreateTablet for tablet 06d73d9b96de4eab90e9acf32a1bd105 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260811 16:08:28.926463 24589 tablet_service.cc:1467] Processing CreateTablet for tablet 5c3effdf4dce4e0cb955d93b6b965802 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260811 16:08:28.921131 24338 tablet_service.cc:1467] Processing CreateTablet for tablet 98f314cba976436a9dfe527ee810d1c5 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260811 16:08:28.927994 24431 tablet_service.cc:1467] Processing CreateTablet for tablet 8b6592164b2b415e86bebdce9ce2517a (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260811 16:08:28.928318 24342 tablet_service.cc:1467] Processing CreateTablet for tablet 62fbb0d94a2b49b2bab6a36b517ae048 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260811 16:08:28.923856 24340 tablet_service.cc:1467] Processing CreateTablet for tablet c87a65e124704bdfb5ba6c78e7cc79ab (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260811 16:08:28.931239 24594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc31d8acb4164ff29dd355deb7245651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.931437 24422 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead62f860954f6ca8149148504e068f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260811 16:08:28.932255 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0849d70159164a57a23b734a02aca623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.933732 24336 tablet_service.cc:1467] Processing CreateTablet for tablet 20b7cb4615c04cddb553ef8d6e774869 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260811 16:08:28.935513 24343 tablet_service.cc:1467] Processing CreateTablet for tablet 06d73d9b96de4eab90e9acf32a1bd105 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260811 16:08:28.922603 24425 tablet_service.cc:1467] Processing CreateTablet for tablet 98f314cba976436a9dfe527ee810d1c5 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260811 16:08:28.938205 24336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20b7cb4615c04cddb553ef8d6e774869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.938267 24599 tablet_service.cc:1467] Processing CreateTablet for tablet f054b2c61c564c9aac4234bf8b363331 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260811 16:08:28.935988 24589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c3effdf4dce4e0cb955d93b6b965802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.939565 24341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b21df0f0e7b43e7bb8911e772e7d9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.941200 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa4c2dc66334d0d8ae8cc14be6a9df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.926420 24339 tablet_service.cc:1467] Processing CreateTablet for tablet e75ef18b8865438c83f749eea8f963aa (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260811 16:08:28.942749 24425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98f314cba976436a9dfe527ee810d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.942924 24340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c87a65e124704bdfb5ba6c78e7cc79ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.947661 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20b7cb4615c04cddb553ef8d6e774869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.948479 24337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0849d70159164a57a23b734a02aca623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.958069 24343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06d73d9b96de4eab90e9acf32a1bd105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.951761 24422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead62f860954f6ca8149148504e068f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.957949 24513 tablet_service.cc:1467] Processing CreateTablet for tablet 8b6592164b2b415e86bebdce9ce2517a (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260811 16:08:28.959894 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b6592164b2b415e86bebdce9ce2517a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.960067 24429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06d73d9b96de4eab90e9acf32a1bd105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.952152 24599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f054b2c61c564c9aac4234bf8b363331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.963582 24431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b6592164b2b415e86bebdce9ce2517a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.963647 24338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98f314cba976436a9dfe527ee810d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.975567 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62fbb0d94a2b49b2bab6a36b517ae048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.969059 24335 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead62f860954f6ca8149148504e068f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260811 16:08:28.964347 24661 tablet_bootstrap.cc:492] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
W20260811 16:08:28.978956 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:28.980571 24335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead62f860954f6ca8149148504e068f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.980772 24590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa4c2dc66334d0d8ae8cc14be6a9df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.983588 24339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75ef18b8865438c83f749eea8f963aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.991360 24512 tablet_service.cc:1467] Processing CreateTablet for tablet 336c47cb9abd43c9b0c55f3234f96b70 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260811 16:08:28.992030 24511 tablet_service.cc:1467] Processing CreateTablet for tablet 62fbb0d94a2b49b2bab6a36b517ae048 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260811 16:08:28.993124 24512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336c47cb9abd43c9b0c55f3234f96b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.994560 24510 tablet_service.cc:1467] Processing CreateTablet for tablet 3b21df0f0e7b43e7bb8911e772e7d9e2 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260811 16:08:28.996284 24503 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead62f860954f6ca8149148504e068f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260811 16:08:28.997113 24509 tablet_service.cc:1467] Processing CreateTablet for tablet e75ef18b8865438c83f749eea8f963aa (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260811 16:08:28.997877 24503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead62f860954f6ca8149148504e068f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.998580 24509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75ef18b8865438c83f749eea8f963aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:28.999465 24426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc31d8acb4164ff29dd355deb7245651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.000530 24508 tablet_service.cc:1467] Processing CreateTablet for tablet bc31d8acb4164ff29dd355deb7245651 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260811 16:08:29.002177 24508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc31d8acb4164ff29dd355deb7245651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.003840 24506 tablet_service.cc:1467] Processing CreateTablet for tablet 98f314cba976436a9dfe527ee810d1c5 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260811 16:08:29.005762 24505 tablet_service.cc:1467] Processing CreateTablet for tablet 20b7cb4615c04cddb553ef8d6e774869 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260811 16:08:29.007603 24504 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa4c2dc66334d0d8ae8cc14be6a9df3 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260811 16:08:29.011624 24510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b21df0f0e7b43e7bb8911e772e7d9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.023336 24511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62fbb0d94a2b49b2bab6a36b517ae048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.027583 24504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa4c2dc66334d0d8ae8cc14be6a9df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.029408 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20b7cb4615c04cddb553ef8d6e774869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.031183 24506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98f314cba976436a9dfe527ee810d1c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.095670 24661 tablet_bootstrap.cc:700] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: Time spent opening tablet: real 0.113s	user 0.003s	sys 0.001s
I20260811 16:08:29.096613 24661 tablet_bootstrap.cc:654] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.102707 24662 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:29.120417 24428 tablet_service.cc:1467] Processing CreateTablet for tablet 5c3effdf4dce4e0cb955d93b6b965802 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260811 16:08:29.168450 24662 tablet_bootstrap.cc:654] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.168835 24423 tablet_service.cc:1467] Processing CreateTablet for tablet 190edee3f615448b912b194695a784e6 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260811 16:08:29.169409 24428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c3effdf4dce4e0cb955d93b6b965802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.146641 24431 tablet_service.cc:1467] Processing CreateTablet for tablet 424cfa023f8d422a8677325b3f8e74dd (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260811 16:08:29.186585 24505 tablet_service.cc:1467] Processing CreateTablet for tablet 30887efe153d45a7838550a656016312 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260811 16:08:29.188077 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30887efe153d45a7838550a656016312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.133872 24590 tablet_service.cc:1467] Processing CreateTablet for tablet 5807918611104b39a416c792b9a4994b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260811 16:08:29.189816 24590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5807918611104b39a416c792b9a4994b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.129977 24427 tablet_service.cc:1467] Processing CreateTablet for tablet 309d4038e85243428daa2e934595bbb4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260811 16:08:29.192034 24386 heartbeater.cc:503] Master 127.12.23.254:43075 was elected leader, sending a full tablet report...
I20260811 16:08:29.196584 24661 tablet_bootstrap.cc:492] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:29.197242 24661 ts_tablet_manager.cc:1397] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.233s	user 0.014s	sys 0.006s
I20260811 16:08:29.115672 24594 tablet_service.cc:1467] Processing CreateTablet for tablet 309d4038e85243428daa2e934595bbb4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260811 16:08:29.155072 24425 tablet_service.cc:1467] Processing CreateTablet for tablet 5807918611104b39a416c792b9a4994b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260811 16:08:29.200690 24661 raft_consensus.cc:348] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.204483 24661 raft_consensus.cc:374] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:29.204850 24661 raft_consensus.cc:729] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:29.207739 24599 tablet_service.cc:1467] Processing CreateTablet for tablet 362cbea48a7e4ff59864d2204065575c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260811 16:08:29.208482 24661 consensus_queue.cc:260] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.211373 24338 tablet_service.cc:1467] Processing CreateTablet for tablet 5c3effdf4dce4e0cb955d93b6b965802 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260811 16:08:29.213680 24424 tablet_service.cc:1467] Processing CreateTablet for tablet 362cbea48a7e4ff59864d2204065575c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260811 16:08:29.229465 24591 tablet_service.cc:1467] Processing CreateTablet for tablet 253403f9eaad4164a0410493e7babb0f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260811 16:08:29.218176 24597 tablet_service.cc:1467] Processing CreateTablet for tablet 62f757f75e81428e95d1831bb753267e (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260811 16:08:29.223616 24594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309d4038e85243428daa2e934595bbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.241638 24598 tablet_service.cc:1467] Processing CreateTablet for tablet 5b058453afc0428fb86d91e3619f3876 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260811 16:08:29.241727 24509 tablet_service.cc:1467] Processing CreateTablet for tablet 309d4038e85243428daa2e934595bbb4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260811 16:08:29.245488 24509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309d4038e85243428daa2e934595bbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.247870 24508 tablet_service.cc:1467] Processing CreateTablet for tablet 424cfa023f8d422a8677325b3f8e74dd (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260811 16:08:29.248165 24506 tablet_service.cc:1467] Processing CreateTablet for tablet f054b2c61c564c9aac4234bf8b363331 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260811 16:08:29.249431 24508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424cfa023f8d422a8677325b3f8e74dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.260275 24506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f054b2c61c564c9aac4234bf8b363331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.264765 24345 tablet_service.cc:1467] Processing CreateTablet for tablet f054b2c61c564c9aac4234bf8b363331 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260811 16:08:29.274267 24336 tablet_service.cc:1467] Processing CreateTablet for tablet 424cfa023f8d422a8677325b3f8e74dd (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260811 16:08:29.292426 24663 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:29.293964 24665 tablet_bootstrap.cc:492] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:29.301635 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f054b2c61c564c9aac4234bf8b363331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.304510 24343 tablet_service.cc:1467] Processing CreateTablet for tablet 5b058453afc0428fb86d91e3619f3876 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260811 16:08:29.306058 24593 tablet_service.cc:1467] Processing CreateTablet for tablet 053f9ea874d649f59f934ea0b1df94ff (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260811 16:08:29.304397 24595 tablet_service.cc:1467] Processing CreateTablet for tablet 29d054ecff344a15bd66eb316fcc28e1 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260811 16:08:29.312147 24335 tablet_service.cc:1467] Processing CreateTablet for tablet 190edee3f615448b912b194695a784e6 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260811 16:08:29.312817 24596 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8deeaaae4d4b2c84759d8accfcdaf4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260811 16:08:29.313788 24471 heartbeater.cc:503] Master 127.12.23.254:43075 was elected leader, sending a full tablet report...
I20260811 16:08:29.301329 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253403f9eaad4164a0410493e7babb0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.314122 24513 tablet_service.cc:1467] Processing CreateTablet for tablet 362cbea48a7e4ff59864d2204065575c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260811 16:08:29.324648 24595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29d054ecff344a15bd66eb316fcc28e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.326370 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 053f9ea874d649f59f934ea0b1df94ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.330027 24589 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2929ec9e5b4864b79c28c24ccb7646 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260811 16:08:29.331943 24505 tablet_service.cc:1467] Processing CreateTablet for tablet 5b058453afc0428fb86d91e3619f3876 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260811 16:08:29.332857 24589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2929ec9e5b4864b79c28c24ccb7646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.333539 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b058453afc0428fb86d91e3619f3876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.336794 24662 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:29.337425 24662 ts_tablet_manager.cc:1397] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.235s	user 0.035s	sys 0.013s
I20260811 16:08:29.343468 24336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424cfa023f8d422a8677325b3f8e74dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.332167 24512 tablet_service.cc:1467] Processing CreateTablet for tablet 190edee3f615448b912b194695a784e6 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260811 16:08:29.348605 24596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8deeaaae4d4b2c84759d8accfcdaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.349870 24597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62f757f75e81428e95d1831bb753267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.355551 24599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362cbea48a7e4ff59864d2204065575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.366353 24510 tablet_service.cc:1467] Processing CreateTablet for tablet 253403f9eaad4164a0410493e7babb0f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260811 16:08:29.378548 24665 tablet_bootstrap.cc:654] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.371451 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362cbea48a7e4ff59864d2204065575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.370820 24598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b058453afc0428fb86d91e3619f3876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.320822 24337 tablet_service.cc:1467] Processing CreateTablet for tablet 5807918611104b39a416c792b9a4994b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260811 16:08:29.387729 24343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b058453afc0428fb86d91e3619f3876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.388427 24342 tablet_service.cc:1467] Processing CreateTablet for tablet 62f757f75e81428e95d1831bb753267e (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260811 16:08:29.389814 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62f757f75e81428e95d1831bb753267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.396191 24338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c3effdf4dce4e0cb955d93b6b965802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.397928 24341 tablet_service.cc:1467] Processing CreateTablet for tablet 253403f9eaad4164a0410493e7babb0f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260811 16:08:29.400689 24339 tablet_service.cc:1467] Processing CreateTablet for tablet 057bc48deb6f442091c76a87d3345c3b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260811 16:08:29.404997 24510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253403f9eaad4164a0410493e7babb0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.413484 24661 ts_tablet_manager.cc:1428] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.216s	user 0.017s	sys 0.008s
I20260811 16:08:29.419351 24638 heartbeater.cc:503] Master 127.12.23.254:43075 was elected leader, sending a full tablet report...
I20260811 16:08:29.420066 24512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 190edee3f615448b912b194695a784e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.424032 24661 tablet_bootstrap.cc:492] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:29.413712 24511 tablet_service.cc:1467] Processing CreateTablet for tablet 29d054ecff344a15bd66eb316fcc28e1 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260811 16:08:29.418324 24339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 057bc48deb6f442091c76a87d3345c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.436357 24594 tablet_service.cc:1467] Processing CreateTablet for tablet cec26b0c5eb044ef9028311f26703757 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260811 16:08:29.437789 24594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec26b0c5eb044ef9028311f26703757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.439093 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 190edee3f615448b912b194695a784e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.439993 24427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309d4038e85243428daa2e934595bbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.422292 24663 tablet_bootstrap.cc:654] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.442282 24665 tablet_bootstrap.cc:492] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:29.442860 24665 ts_tablet_manager.cc:1397] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.017s
I20260811 16:08:29.415271 24503 tablet_service.cc:1467] Processing CreateTablet for tablet 057bc48deb6f442091c76a87d3345c3b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260811 16:08:29.434146 24556 heartbeater.cc:503] Master 127.12.23.254:43075 was elected leader, sending a full tablet report...
I20260811 16:08:29.444777 24428 tablet_service.cc:1467] Processing CreateTablet for tablet 62f757f75e81428e95d1831bb753267e (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260811 16:08:29.446189 24428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62f757f75e81428e95d1831bb753267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.446072 24665 raft_consensus.cc:348] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.449278 24430 tablet_service.cc:1467] Processing CreateTablet for tablet 29d054ecff344a15bd66eb316fcc28e1 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260811 16:08:29.450731 24430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29d054ecff344a15bd66eb316fcc28e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.453150 24426 tablet_service.cc:1467] Processing CreateTablet for tablet 057bc48deb6f442091c76a87d3345c3b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260811 16:08:29.454564 24426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 057bc48deb6f442091c76a87d3345c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.435238 24504 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8deeaaae4d4b2c84759d8accfcdaf4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260811 16:08:29.436757 24511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29d054ecff344a15bd66eb316fcc28e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.457291 24429 tablet_service.cc:1467] Processing CreateTablet for tablet 053f9ea874d649f59f934ea0b1df94ff (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260811 16:08:29.458730 24429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 053f9ea874d649f59f934ea0b1df94ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.461668 24503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 057bc48deb6f442091c76a87d3345c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.461809 24425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5807918611104b39a416c792b9a4994b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.462677 24424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362cbea48a7e4ff59864d2204065575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.463239 24335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 190edee3f615448b912b194695a784e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.464708 24422 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2929ec9e5b4864b79c28c24ccb7646 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260811 16:08:29.466223 24422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2929ec9e5b4864b79c28c24ccb7646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.467993 24431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424cfa023f8d422a8677325b3f8e74dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.402855 24662 raft_consensus.cc:348] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:29.477782 24662 raft_consensus.cc:374] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:29.478178 24662 raft_consensus.cc:729] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:29.481637 24337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5807918611104b39a416c792b9a4994b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.487504 24504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8deeaaae4d4b2c84759d8accfcdaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.446976 24665 raft_consensus.cc:374] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:29.491232 24665 raft_consensus.cc:729] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:29.497452 24341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253403f9eaad4164a0410493e7babb0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.500196 24595 tablet_service.cc:1467] Processing CreateTablet for tablet 30887efe153d45a7838550a656016312 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260811 16:08:29.501612 24595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30887efe153d45a7838550a656016312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.496097 24665 consensus_queue.cc:260] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.421804 24340 tablet_service.cc:1467] Processing CreateTablet for tablet 053f9ea874d649f59f934ea0b1df94ff (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260811 16:08:29.514467 24508 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2929ec9e5b4864b79c28c24ccb7646 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260811 16:08:29.516907 24662 consensus_queue.cc:260] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:29.520696 24591 tablet_service.cc:1467] Processing CreateTablet for tablet 987b5e0c309049a9998fac1cc491a78c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260811 16:08:29.522238 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 987b5e0c309049a9998fac1cc491a78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.536312 24590 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8b101a79cc404dbd7787240d4d827d (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260811 16:08:29.537906 24590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d8b101a79cc404dbd7787240d4d827d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.541513 24589 tablet_service.cc:1467] Processing CreateTablet for tablet 296f5dafb30b436fa348884a38c18320 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260811 16:08:29.543771 24640 tablet.cc:2369] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:08:29.543108 24589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 296f5dafb30b436fa348884a38c18320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.534521 24509 tablet_service.cc:1467] Processing CreateTablet for tablet 987b5e0c309049a9998fac1cc491a78c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260811 16:08:29.568493 24599 tablet_service.cc:1467] Processing CreateTablet for tablet dc328bf3f64c49caa9822ed16b6e0931 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260811 16:08:29.570041 24506 tablet_service.cc:1467] Processing CreateTablet for tablet 9f269dd87fe34c6586deee9aacc68a6f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260811 16:08:29.558087 24598 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3487223f11427fb71f9b2dcb0414f6 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260811 16:08:29.605180 24425 tablet_service.cc:1467] Processing CreateTablet for tablet 9f269dd87fe34c6586deee9aacc68a6f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260811 16:08:29.550410 24596 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1e466e0e3c4e66bfb6943245f80682 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260811 16:08:29.606721 24425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f269dd87fe34c6586deee9aacc68a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.607721 24662 ts_tablet_manager.cc:1428] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.270s	user 0.008s	sys 0.008s
I20260811 16:08:29.608929 24662 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:29.554560 24513 tablet_service.cc:1467] Processing CreateTablet for tablet aef5b136564945f7ba5b1d391c91bb70 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260811 16:08:29.611554 24599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc328bf3f64c49caa9822ed16b6e0931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.613626 24663 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:29.614248 24663 ts_tablet_manager.cc:1397] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.347s	user 0.022s	sys 0.000s
I20260811 16:08:29.617853 24665 ts_tablet_manager.cc:1428] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.175s	user 0.025s	sys 0.016s
I20260811 16:08:29.617673 24663 raft_consensus.cc:348] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.618571 24663 raft_consensus.cc:374] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:29.619107 24665 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:29.622251 24668 raft_consensus.cc:482] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:29.622822 24668 raft_consensus.cc:504] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.621206 24342 tablet_service.cc:1467] Processing CreateTablet for tablet 9f269dd87fe34c6586deee9aacc68a6f (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260811 16:08:29.633883 24668 leader_election.cc:288] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:29.635650 24594 tablet_service.cc:1467] Processing CreateTablet for tablet fe927b7dcce64f2f8f949de1d18044a4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260811 16:08:29.636935 24598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3487223f11427fb71f9b2dcb0414f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.645553 24597 tablet_service.cc:1467] Processing CreateTablet for tablet ae25aabfb52d4b57a9d71bf2e627ed63 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260811 16:08:29.637220 24340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 053f9ea874d649f59f934ea0b1df94ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.649399 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f269dd87fe34c6586deee9aacc68a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.654627 24593 tablet_service.cc:1467] Processing CreateTablet for tablet bf80ef260b444d97bd8f2badb125dd66 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260811 16:08:29.618921 24663 raft_consensus.cc:729] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:29.639183 24673 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:29.657217 24673 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:29.663774 24663 consensus_queue.cc:260] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.640823 24345 tablet_service.cc:1467] Processing CreateTablet for tablet cec26b0c5eb044ef9028311f26703757 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260811 16:08:29.639130 24510 tablet_service.cc:1467] Processing CreateTablet for tablet 296f5dafb30b436fa348884a38c18320 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260811 16:08:29.677742 24508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2929ec9e5b4864b79c28c24ccb7646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.677915 24597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae25aabfb52d4b57a9d71bf2e627ed63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.678584 24661 tablet_bootstrap.cc:654] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.694470 24596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f1e466e0e3c4e66bfb6943245f80682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.695219 24673 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:29.697490 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec26b0c5eb044ef9028311f26703757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.697484 24594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe927b7dcce64f2f8f949de1d18044a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.711814 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf80ef260b444d97bd8f2badb125dd66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:08:29.711591 24222 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 78259us
I20260811 16:08:29.696676 24335 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8deeaaae4d4b2c84759d8accfcdaf4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260811 16:08:29.719715 24335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8deeaaae4d4b2c84759d8accfcdaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.721657 24506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f269dd87fe34c6586deee9aacc68a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.724850 24510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 296f5dafb30b436fa348884a38c18320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.733011 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aef5b136564945f7ba5b1d391c91bb70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.750653 24337 tablet_service.cc:1467] Processing CreateTablet for tablet aef5b136564945f7ba5b1d391c91bb70 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260811 16:08:29.780444 24511 tablet_service.cc:1467] Processing CreateTablet for tablet a6c3f73ad35d4ef8863ea0ac5e2746e8 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260811 16:08:29.762842 24222 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 44924.8us
I20260811 16:08:29.772287 24509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 987b5e0c309049a9998fac1cc491a78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.746838 24336 tablet_service.cc:1467] Processing CreateTablet for tablet 30887efe153d45a7838550a656016312 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260811 16:08:29.818140 24430 tablet_service.cc:1467] Processing CreateTablet for tablet cec26b0c5eb044ef9028311f26703757 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260811 16:08:29.830740 24511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c3f73ad35d4ef8863ea0ac5e2746e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.836174 24337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aef5b136564945f7ba5b1d391c91bb70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.856264 24429 tablet_service.cc:1467] Processing CreateTablet for tablet aef5b136564945f7ba5b1d391c91bb70 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260811 16:08:29.857792 24429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aef5b136564945f7ba5b1d391c91bb70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.857465 24343 tablet_service.cc:1467] Processing CreateTablet for tablet 296f5dafb30b436fa348884a38c18320 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260811 16:08:29.863683 24661 tablet_bootstrap.cc:492] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:29.864296 24661 ts_tablet_manager.cc:1397] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.445s	user 0.029s	sys 0.018s
I20260811 16:08:29.864351 24338 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8b101a79cc404dbd7787240d4d827d (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260811 16:08:29.841210 24505 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1e466e0e3c4e66bfb6943245f80682 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260811 16:08:29.872295 24426 tablet_service.cc:1467] Processing CreateTablet for tablet 987b5e0c309049a9998fac1cc491a78c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260811 16:08:29.872522 24339 tablet_service.cc:1467] Processing CreateTablet for tablet a6c3f73ad35d4ef8863ea0ac5e2746e8 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260811 16:08:29.873878 24339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c3f73ad35d4ef8863ea0ac5e2746e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.875826 24663 ts_tablet_manager.cc:1428] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.261s	user 0.009s	sys 0.019s
I20260811 16:08:29.877128 24663 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:29.877326 24662 tablet_bootstrap.cc:654] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.880540 24427 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1e466e0e3c4e66bfb6943245f80682 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260811 16:08:29.804293 24595 tablet_service.cc:1467] Processing CreateTablet for tablet 08fe7d941ae74b0ab5c504d9f556b073 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260811 16:08:29.873842 24426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 987b5e0c309049a9998fac1cc491a78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.895831 24665 tablet_bootstrap.cc:654] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:29.902581 24336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30887efe153d45a7838550a656016312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.913800 24595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08fe7d941ae74b0ab5c504d9f556b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.918116 24341 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3487223f11427fb71f9b2dcb0414f6 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260811 16:08:29.920261 24504 tablet_service.cc:1467] Processing CreateTablet for tablet fe927b7dcce64f2f8f949de1d18044a4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260811 16:08:29.907547 24503 tablet_service.cc:1467] Processing CreateTablet for tablet dc328bf3f64c49caa9822ed16b6e0931 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260811 16:08:29.928913 24591 tablet_service.cc:1467] Processing CreateTablet for tablet 897e2cd688a14f478986d26de348fc3b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260811 16:08:29.930555 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897e2cd688a14f478986d26de348fc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.934921 24422 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8b101a79cc404dbd7787240d4d827d (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260811 16:08:29.916628 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f1e466e0e3c4e66bfb6943245f80682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:29.944829 24508 tablet_service.cc:1467] Processing CreateTablet for tablet fe620493add749c5a27c9fa537836c4c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260811 16:08:29.959632 24672 raft_consensus.cc:482] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:29.960194 24672 raft_consensus.cc:504] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:29.961179 24512 tablet_service.cc:1467] Processing CreateTablet for tablet bf80ef260b444d97bd8f2badb125dd66 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260811 16:08:29.962900 24672 leader_election.cc:288] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:29.973217 24431 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 12) took 1064 ms. Trace:
I20260811 16:08:29.974795 24424 tablet_service.cc:1467] Processing CreateTablet for tablet a6c3f73ad35d4ef8863ea0ac5e2746e8 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260811 16:08:29.976279 24661 raft_consensus.cc:348] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:29.977475 24661 raft_consensus.cc:374] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:29.991343 24661 raft_consensus.cc:729] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:29.992797 24661 consensus_queue.cc:260] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:29.996513 24661 ts_tablet_manager.cc:1428] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.001s
I20260811 16:08:29.973948 24431 rpcz_store.cc:276] 0811 16:08:28.908789 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.145653 (+236864us) service_pool.cc:227] Handling call
0811 16:08:29.466031 (+320378us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.466146 (+   115us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.752227 (+286081us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:29.972443 (+220216us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:29.973112 (+   669us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:29.942538 24428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 16) took 1030 ms. Trace:
I20260811 16:08:29.978099 24338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d8b101a79cc404dbd7787240d4d827d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.017403 24423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 15) took 1107 ms. Trace:
I20260811 16:08:29.951900 24427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f1e466e0e3c4e66bfb6943245f80682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.015990 24663 tablet_bootstrap.cc:654] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:30.014840 24503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc328bf3f64c49caa9822ed16b6e0931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.017882 24431 tablet_service.cc:1467] Processing CreateTablet for tablet fe927b7dcce64f2f8f949de1d18044a4 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260811 16:08:30.014062 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:30.016402 24341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3487223f11427fb71f9b2dcb0414f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.015479 24428 rpcz_store.cc:276] 0811 16:08:28.910338 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.443830 (+533492us) service_pool.cc:227] Handling call
0811 16:08:29.445677 (+  1847us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.445774 (+    97us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.620234 (+174460us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:29.884070 (+263836us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:29.940879 (+ 56809us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.017904 24423 rpcz_store.cc:276] 0811 16:08:28.909977 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.167797 (+257820us) service_pool.cc:227] Handling call
0811 16:08:29.178271 (+ 10474us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.411561 (+233290us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5800005198. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ad465 00007f5c568979b8 00007f5c5689839d 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2 00007f5c4fe4bb01 00007f5c4fe4ba7c 00007f5c4fe4ad32 00007f5c4fd3694c
0811 16:08:29.438659 (+ 27098us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.678727 (+240068us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.016840 (+338113us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.017334 (+   494us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":87524608}
I20260811 16:08:29.980129 24425 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3487223f11427fb71f9b2dcb0414f6 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260811 16:08:30.029587 24340 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 19) took 1055 ms. Trace:
I20260811 16:08:30.030233 24428 tablet_service.cc:1467] Processing CreateTablet for tablet fe620493add749c5a27c9fa537836c4c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260811 16:08:30.031167 24345 tablet_service.cc:1467] Processing CreateTablet for tablet dc328bf3f64c49caa9822ed16b6e0931 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260811 16:08:30.033624 24510 tablet_service.cc:1467] Processing CreateTablet for tablet 08fe7d941ae74b0ab5c504d9f556b073 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260811 16:08:30.020741 24508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe620493add749c5a27c9fa537836c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.051458 24676 raft_consensus.cc:482] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:30.043520 24340 rpcz_store.cc:276] 0811 16:08:28.973764 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.420846 (+447082us) service_pool.cc:227] Handling call
0811 16:08:29.565265 (+144419us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.580080 (+ 14815us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.860077 (+279997us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.028999 (+168922us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.029525 (+   526us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.052054 24676 raft_consensus.cc:504] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.054055 24340 tablet_service.cc:1467] Processing CreateTablet for tablet fe620493add749c5a27c9fa537836c4c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260811 16:08:30.059316 24422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d8b101a79cc404dbd7787240d4d827d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.055112 24676 leader_election.cc:288] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:30.082098 24423 tablet_service.cc:1467] Processing CreateTablet for tablet ae25aabfb52d4b57a9d71bf2e627ed63 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260811 16:08:30.078400 24661 tablet_bootstrap.cc:492] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:30.094947 24593 tablet_service.cc:1467] Processing CreateTablet for tablet b665c6f1914645fbb497bdc4633cc1af (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260811 16:08:30.096702 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b665c6f1914645fbb497bdc4633cc1af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.095566 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae25aabfb52d4b57a9d71bf2e627ed63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.104383 24513 tablet_service.cc:1467] Processing CreateTablet for tablet e474ad4d29de4c968bbf6811a1ced653 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260811 16:08:30.105212 24428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe620493add749c5a27c9fa537836c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.075958 24512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf80ef260b444d97bd8f2badb125dd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.076109 24343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 296f5dafb30b436fa348884a38c18320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.137127 24335 tablet_service.cc:1467] Processing CreateTablet for tablet ae25aabfb52d4b57a9d71bf2e627ed63 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260811 16:08:30.138439 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:30.140702 24402 leader_election.cc:341] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.147467 24665 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:30.148252 24665 ts_tablet_manager.cc:1397] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.529s	user 0.037s	sys 0.023s
I20260811 16:08:30.169966 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54704 (request call id 21) took 1159 ms. Trace:
I20260811 16:08:30.170758 24506 rpcz_store.cc:276] 0811 16:08:29.010934 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.563734 (+552800us) service_pool.cc:227] Handling call
0811 16:08:29.587623 (+ 23889us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.587792 (+   169us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.937150 (+349358us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.168586 (+231436us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.169898 (+  1312us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.133097 24430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec26b0c5eb044ef9028311f26703757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.181417 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e474ad4d29de4c968bbf6811a1ced653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.183254 24342 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 21) took 1008 ms. Trace:
I20260811 16:08:30.183933 24342 rpcz_store.cc:276] 0811 16:08:29.174834 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.620160 (+445326us) service_pool.cc:227] Handling call
0811 16:08:29.648868 (+ 28708us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.648967 (+    99us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.986586 (+337619us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.070531 (+ 83945us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.134207 (+ 63676us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.184818 24665 raft_consensus.cc:348] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:30.185762 24665 raft_consensus.cc:374] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:30.186055 24665 raft_consensus.cc:729] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:30.186897 24665 consensus_queue.cc:260] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:30.189262 24665 ts_tablet_manager.cc:1428] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260811 16:08:30.207329 24424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c3f73ad35d4ef8863ea0ac5e2746e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.206375 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc328bf3f64c49caa9822ed16b6e0931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.213846 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:30.219652 24524 raft_consensus.cc:2454] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:30.213979 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:30.221980 24429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 24) took 1131 ms. Trace:
I20260811 16:08:30.226492 24431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe927b7dcce64f2f8f949de1d18044a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.187263 24342 tablet_service.cc:1467] Processing CreateTablet for tablet bf80ef260b444d97bd8f2badb125dd66 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260811 16:08:30.209323 24504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe927b7dcce64f2f8f949de1d18044a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.228368 24663 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:30.196339 24339 tablet_service.cc:1467] Processing CreateTablet for tablet e474ad4d29de4c968bbf6811a1ced653 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260811 16:08:30.256748 24663 ts_tablet_manager.cc:1397] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.380s	user 0.012s	sys 0.013s
I20260811 16:08:30.231086 24425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3487223f11427fb71f9b2dcb0414f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.232180 24661 tablet_bootstrap.cc:654] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:30.234004 24335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae25aabfb52d4b57a9d71bf2e627ed63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.266162 24340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe620493add749c5a27c9fa537836c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.236038 24594 tablet_service.cc:1467] Processing CreateTablet for tablet ecaafaa032434ef8bcd23c2ece667e60 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260811 16:08:30.267439 24594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecaafaa032434ef8bcd23c2ece667e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.270030 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:30.236493 24506 tablet_service.cc:1467] Processing CreateTablet for tablet b665c6f1914645fbb497bdc4633cc1af (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260811 16:08:30.271384 24337 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 24) took 1062 ms. Trace:
I20260811 16:08:30.222488 24429 rpcz_store.cc:276] 0811 16:08:29.091093 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.855294 (+764201us) service_pool.cc:227] Handling call
0811 16:08:29.857261 (+  1967us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.857368 (+   107us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.084350 (+226982us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.221346 (+136996us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.221916 (+   570us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:08:30.271836 24402 leader_election.cc:341] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.271814 24337 rpcz_store.cc:276] 0811 16:08:29.209374 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.749563 (+540189us) service_pool.cc:227] Handling call
0811 16:08:29.795794 (+ 46231us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.806495 (+ 10701us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.159636 (+353141us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.208123 (+ 48487us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.252520 (+ 44397us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.272498 24402 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:30.273342 24429 tablet_service.cc:1467] Processing CreateTablet for tablet 08fe7d941ae74b0ab5c504d9f556b073 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260811 16:08:30.240324 24672 raft_consensus.cc:482] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:30.274214 24337 tablet_service.cc:1467] Processing CreateTablet for tablet f2e75587caf14bf3ac0c03288d2dc146 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260811 16:08:30.274883 24672 raft_consensus.cc:504] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:30.277490 24672 leader_election.cc:288] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:30.231130 24509 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54704 (request call id 23) took 1149 ms. Trace:
I20260811 16:08:30.243940 24595 tablet_service.cc:1467] Processing CreateTablet for tablet ce968612a2824f70bea8c2c027892542 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260811 16:08:30.287971 24595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce968612a2824f70bea8c2c027892542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.291501 24509 rpcz_store.cc:276] 0811 16:08:29.081478 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.533552 (+452074us) service_pool.cc:227] Handling call
0811 16:08:29.583663 (+ 50111us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.585671 (+  2008us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.080558 (+494887us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.230552 (+149994us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.231052 (+   500us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.296638 24509 tablet_service.cc:1467] Processing CreateTablet for tablet f2e75587caf14bf3ac0c03288d2dc146 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260811 16:08:30.249266 24662 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:30.311653 24662 ts_tablet_manager.cc:1397] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.703s	user 0.021s	sys 0.015s
I20260811 16:08:30.312100 24426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 23) took 1241 ms. Trace:
I20260811 16:08:30.312569 24426 rpcz_store.cc:276] 0811 16:08:29.070619 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.848979 (+778360us) service_pool.cc:227] Handling call
0811 16:08:29.873299 (+ 24320us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.873452 (+   153us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.238292 (+364840us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.311510 (+ 73218us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.312038 (+   528us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.314519 24426 tablet_service.cc:1467] Processing CreateTablet for tablet 897e2cd688a14f478986d26de348fc3b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260811 16:08:30.271211 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf80ef260b444d97bd8f2badb125dd66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.314826 24662 raft_consensus.cc:348] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.286686 24429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08fe7d941ae74b0ab5c504d9f556b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.316383 24662 raft_consensus.cc:374] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:30.316890 24662 raft_consensus.cc:729] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:30.317708 24662 consensus_queue.cc:260] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.248142 24665 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:30.249120 24505 tablet_service.cc:1467] Processing CreateTablet for tablet ecaafaa032434ef8bcd23c2ece667e60 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260811 16:08:30.250741 24343 tablet_service.cc:1467] Processing CreateTablet for tablet 897e2cd688a14f478986d26de348fc3b (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260811 16:08:30.326848 24343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897e2cd688a14f478986d26de348fc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.327967 24426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897e2cd688a14f478986d26de348fc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.330905 24423 tablet_service.cc:1467] Processing CreateTablet for tablet f2e75587caf14bf3ac0c03288d2dc146 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260811 16:08:30.309301 24572 leader_election.cc:341] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.310284 24428 tablet_service.cc:1467] Processing CreateTablet for tablet e474ad4d29de4c968bbf6811a1ced653 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260811 16:08:30.255980 24510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08fe7d941ae74b0ab5c504d9f556b073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.260259 24663 raft_consensus.cc:348] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.343189 24339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e474ad4d29de4c968bbf6811a1ced653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.424031 24337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2e75587caf14bf3ac0c03288d2dc146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.341336 24341 tablet_service.cc:1467] Processing CreateTablet for tablet b665c6f1914645fbb497bdc4633cc1af (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260811 16:08:30.429025 24341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b665c6f1914645fbb497bdc4633cc1af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.462323 24343 tablet_service.cc:1467] Processing CreateTablet for tablet ce968612a2824f70bea8c2c027892542 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260811 16:08:30.464629 24343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce968612a2824f70bea8c2c027892542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.488191 24422 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 25) took 1295 ms. Trace:
I20260811 16:08:30.489216 24422 rpcz_store.cc:276] 0811 16:08:29.192944 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.866707 (+673763us) service_pool.cc:227] Handling call
0811 16:08:29.936021 (+ 69314us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.936143 (+   122us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.304875 (+368732us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.353570 (+ 48695us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.486784 (+133214us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800005198. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ace82 00007f5c578c58b9 00007f5c567d85d8 00007f5c5689c063 00007f5c56897e2f 00007f5c568985ed 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2
0811 16:08:30.487820 (+  1036us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7902592}
I20260811 16:08:30.492341 24427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 26) took 1201 ms. Trace:
I20260811 16:08:30.498492 24427 rpcz_store.cc:276] 0811 16:08:29.290699 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.879529 (+588830us) service_pool.cc:227] Handling call
0811 16:08:29.881933 (+  2404us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.882210 (+   277us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.181912 (+299702us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.487126 (+305214us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.490559 (+  3433us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.344534 24428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e474ad4d29de4c968bbf6811a1ced653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.511022 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead62f860954f6ca8149148504e068f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:30.511027 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:30.516155 24314 leader_election.cc:341] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.517867 24430 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 22) took 1505 ms. Trace:
I20260811 16:08:30.518508 24430 rpcz_store.cc:276] 0811 16:08:29.012157 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.809941 (+797784us) service_pool.cc:227] Handling call
0811 16:08:29.838571 (+ 28630us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.847057 (+  8486us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.258371 (+411314us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.516559 (+258188us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.517537 (+   978us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:08:30.520742 24485 leader_election.cc:341] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.522944 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2e75587caf14bf3ac0c03288d2dc146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.364001 24511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54704 (request call id 27) took 1024 ms. Trace:
I20260811 16:08:30.347513 24506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b665c6f1914645fbb497bdc4633cc1af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.524298 24511 rpcz_store.cc:276] 0811 16:08:29.339287 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.779456 (+440169us) service_pool.cc:227] Handling call
0811 16:08:29.798598 (+ 19142us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.803510 (+  4912us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.316410 (+512900us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.358325 (+ 41915us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.363928 (+  5603us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.525463 24339 tablet_service.cc:1467] Processing CreateTablet for tablet 1434b986b4784cbdb2ce4d716ecfdb6c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260811 16:08:30.527473 24339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1434b986b4784cbdb2ce4d716ecfdb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.528860 24508 tablet_service.cc:1467] Processing CreateTablet for tablet ff0b07fabee54845918b46e4c673c81d (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260811 16:08:30.530900 24508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0b07fabee54845918b46e4c673c81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.495754 24422 tablet_service.cc:1467] Processing CreateTablet for tablet ecaafaa032434ef8bcd23c2ece667e60 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260811 16:08:30.534888 24513 tablet_service.cc:1467] Processing CreateTablet for tablet b7d8d1f4a7194ed0887d2a71ac016637 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260811 16:08:30.343648 24572 leader_election.cc:302] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:30.540086 24429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 32) took 1061 ms. Trace:
I20260811 16:08:30.541463 24591 tablet_service.cc:1467] Processing CreateTablet for tablet ff0b07fabee54845918b46e4c673c81d (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260811 16:08:30.534071 24345 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 29) took 1180 ms. Trace:
I20260811 16:08:30.370759 24661 tablet_bootstrap.cc:492] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:30.579664 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0b07fabee54845918b46e4c673c81d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:08:30.580824 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 308883us
I20260811 16:08:30.367403 24697 raft_consensus.cc:2726] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:30.557693 24668 raft_consensus.cc:482] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:30.585714 24342 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 32) took 1145 ms. Trace:
I20260811 16:08:30.586642 24342 rpcz_store.cc:276] 0811 16:08:29.439938 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.185860 (+745922us) service_pool.cc:227] Handling call
0811 16:08:30.270701 (+ 84841us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.270798 (+    97us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.326320 (+ 55522us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.584406 (+258086us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.585239 (+   833us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.577929 24345 rpcz_store.cc:276] 0811 16:08:29.353995 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.029931 (+675936us) service_pool.cc:227] Handling call
0811 16:08:30.075701 (+ 45770us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b58002c5598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c568bad21 00007f5c568981e3 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2 00007f5c4fe4bb01
0811 16:08:30.077568 (+  1867us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.079716 (+  2148us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.325505 (+245789us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.533177 (+207672us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.533872 (+   695us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4790656}
I20260811 16:08:30.591820 24509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2e75587caf14bf3ac0c03288d2dc146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.585763 24668 raft_consensus.cc:504] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:30.550066 24511 tablet_service.cc:1467] Processing CreateTablet for tablet e4f248d334c04397adb27e611172a2e8 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260811 16:08:30.546684 24512 tablet_service.cc:1467] Processing CreateTablet for tablet 38d2cd522feb43648ee671400627f17e (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260811 16:08:30.557839 24597 tablet_service.cc:1467] Processing CreateTablet for tablet b630b4a32d1a4cfab0626c4f2715c9c5 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260811 16:08:30.598737 24668 leader_election.cc:288] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:30.598892 24597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b630b4a32d1a4cfab0626c4f2715c9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.599686 24668 raft_consensus.cc:2781] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:30.600131 24668 raft_consensus.cc:482] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:30.600515 24668 raft_consensus.cc:3037] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:30.600787 24345 tablet_service.cc:1467] Processing CreateTablet for tablet b7d8d1f4a7194ed0887d2a71ac016637 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260811 16:08:30.530921 24424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 27) took 1199 ms. Trace:
I20260811 16:08:30.607260 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecaafaa032434ef8bcd23c2ece667e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.546648 24598 tablet_service.cc:1467] Processing CreateTablet for tablet 38d2cd522feb43648ee671400627f17e (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260811 16:08:30.613009 24598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38d2cd522feb43648ee671400627f17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.620710 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d8d1f4a7194ed0887d2a71ac016637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.544837 24596 tablet_service.cc:1467] Processing CreateTablet for tablet e1ed5dfcb9ba47fb84094969135b3697 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260811 16:08:30.621771 24338 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 25) took 1411 ms. Trace:
I20260811 16:08:30.372519 24662 ts_tablet_manager.cc:1428] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.010s
I20260811 16:08:30.614674 24665 tablet_bootstrap.cc:654] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:30.619637 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead62f860954f6ca8149148504e068f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:30.624683 24314 leader_election.cc:341] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.625296 24314 leader_election.cc:302] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:30.626176 24336 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 23) took 1417 ms. Trace:
I20260811 16:08:30.626636 24336 rpcz_store.cc:276] 0811 16:08:29.208952 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.745864 (+536912us) service_pool.cc:227] Handling call
0811 16:08:29.810390 (+ 64526us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.823953 (+ 13563us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.277871 (+453918us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.602264 (+324393us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.625983 (+ 23719us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.629334 24336 tablet_service.cc:1467] Processing CreateTablet for tablet e4f248d334c04397adb27e611172a2e8 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260811 16:08:30.632609 24511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f248d334c04397adb27e611172a2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.543798 24593 tablet_service.cc:1467] Processing CreateTablet for tablet 1434b986b4784cbdb2ce4d716ecfdb6c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260811 16:08:30.548348 24503 tablet_service.cc:1467] Processing CreateTablet for tablet e1ed5dfcb9ba47fb84094969135b3697 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260811 16:08:30.349056 24663 raft_consensus.cc:374] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:30.619922 24422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecaafaa032434ef8bcd23c2ece667e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.577013 24429 rpcz_store.cc:276] 0811 16:08:29.478799 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.272391 (+793592us) service_pool.cc:227] Handling call
0811 16:08:30.274218 (+  1827us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.274344 (+   126us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.358961 (+ 84617us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.529349 (+170388us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.539844 (+ 10495us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.545136 24595 tablet_service.cc:1467] Processing CreateTablet for tablet b7d8d1f4a7194ed0887d2a71ac016637 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260811 16:08:30.622282 24338 rpcz_store.cc:276] 0811 16:08:29.209839 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.863403 (+653564us) service_pool.cc:227] Handling call
0811 16:08:29.926528 (+ 63125us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b58002c5598. stack: 00007f5c4e9b2033 00007f5c4e9b1f30 00007f5c4e310534 00007f5c5801c8b4 00007f5c5801c849 00007f5c4e828f11 00007f5c4e9ac851 00007f5c4e9ac702 00007f5c5789cb09 00007f5c567d8730 00007f5c568bad21 00007f5c568981e3 00007f5c56849869 00007f5c4fe4bc44 00007f5c4fe4bbd2 00007f5c4fe4bb01
0811 16:08:29.926691 (+   163us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.926801 (+   110us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.301480 (+374679us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.620896 (+319416us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.621580 (+   684us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":44404608}
I20260811 16:08:30.644172 24663 raft_consensus.cc:729] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:30.645534 24663 consensus_queue.cc:260] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.646052 24338 tablet_service.cc:1467] Processing CreateTablet for tablet 38d2cd522feb43648ee671400627f17e (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260811 16:08:30.660259 24596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1ed5dfcb9ba47fb84094969135b3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.606302 24424 rpcz_store.cc:276] 0811 16:08:29.331853 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.887532 (+555679us) service_pool.cc:227] Handling call
0811 16:08:29.975817 (+ 88285us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.975920 (+   103us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.328894 (+352974us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.524068 (+195174us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.530710 (+  6642us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.676084 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1434b986b4784cbdb2ce4d716ecfdb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.676301 24335 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 31) took 1283 ms. Trace:
I20260811 16:08:30.676932 24335 rpcz_store.cc:276] 0811 16:08:29.404983 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.136160 (+731177us) service_pool.cc:227] Handling call
0811 16:08:30.138079 (+  1919us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.138215 (+   136us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.458983 (+320768us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.675540 (+216557us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.676116 (+   576us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 16:08:30.635509 24222 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 57892.5us
I20260811 16:08:30.681684 24429 tablet_service.cc:1467] Processing CreateTablet for tablet ff0b07fabee54845918b46e4c673c81d (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260811 16:08:30.682384 24427 tablet_service.cc:1467] Processing CreateTablet for tablet 1434b986b4784cbdb2ce4d716ecfdb6c (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260811 16:08:30.683939 24427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1434b986b4784cbdb2ce4d716ecfdb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.684275 24430 tablet_service.cc:1467] Processing CreateTablet for tablet e4f248d334c04397adb27e611172a2e8 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260811 16:08:30.685786 24430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f248d334c04397adb27e611172a2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.685416 24342 tablet_service.cc:1467] Processing CreateTablet for tablet b630b4a32d1a4cfab0626c4f2715c9c5 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260811 16:08:30.685612 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20b7cb4615c04cddb553ef8d6e774869" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:30.687506 24485 leader_election.cc:341] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.687637 24429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0b07fabee54845918b46e4c673c81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.641403 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d8d1f4a7194ed0887d2a71ac016637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.700326 24662 tablet_bootstrap.cc:492] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:30.703339 24595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d8d1f4a7194ed0887d2a71ac016637. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:08:30.703445 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 78854us
I20260811 16:08:30.707446 24503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1ed5dfcb9ba47fb84094969135b3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.722597 24504 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54704 (request call id 29) took 1347 ms. Trace:
I20260811 16:08:30.724404 24424 tablet_service.cc:1467] Processing CreateTablet for tablet ce968612a2824f70bea8c2c027892542 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260811 16:08:30.763484 24424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce968612a2824f70bea8c2c027892542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.727273 24336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f248d334c04397adb27e611172a2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.735674 24661 ts_tablet_manager.cc:1397] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.667s	user 0.004s	sys 0.033s
I20260811 16:08:30.734272 24431 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 29) took 1378 ms. Trace:
I20260811 16:08:30.726930 24510 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54704 (request call id 32) took 1248 ms. Trace:
W20260811 16:08:30.777515 24222 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 46517.9us
I20260811 16:08:30.777748 24512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38d2cd522feb43648ee671400627f17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.788368 24338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38d2cd522feb43648ee671400627f17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.791831 24697 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:30.792528 24697 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.779501 24431 rpcz_store.cc:276] 0811 16:08:29.355967 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.016883 (+660916us) service_pool.cc:227] Handling call
0811 16:08:30.020164 (+  3281us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.020274 (+   110us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.587386 (+567112us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.733525 (+146139us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.734090 (+   565us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.796350 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b630b4a32d1a4cfab0626c4f2715c9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.797194 24431 tablet_service.cc:1467] Processing CreateTablet for tablet cdded2c7ff674319b9ca73af91948e0a (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260811 16:08:30.798632 24431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdded2c7ff674319b9ca73af91948e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.812918 24426 tablet_service.cc:1467] Processing CreateTablet for tablet e1ed5dfcb9ba47fb84094969135b3697 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260811 16:08:30.814615 24426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1ed5dfcb9ba47fb84094969135b3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.815573 24340 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37354 (request call id 30) took 1437 ms. Trace:
I20260811 16:08:30.816161 24340 rpcz_store.cc:276] 0811 16:08:29.377640 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.053091 (+675451us) service_pool.cc:227] Handling call
0811 16:08:30.054909 (+  1818us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.055015 (+   106us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.618817 (+563802us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.781637 (+162820us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.815369 (+ 33732us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.782222 24510 rpcz_store.cc:276] 0811 16:08:29.478287 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.032745 (+554458us) service_pool.cc:227] Handling call
0811 16:08:30.069455 (+ 36710us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.074957 (+  5502us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.369400 (+294443us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.726134 (+356734us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.726752 (+   618us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.815850 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:30.817811 24702 raft_consensus.cc:2726] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:30.731348 24335 tablet_service.cc:1467] Processing CreateTablet for tablet cdded2c7ff674319b9ca73af91948e0a (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260811 16:08:30.723101 24504 rpcz_store.cc:276] 0811 16:08:29.375204 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.919308 (+544104us) service_pool.cc:227] Handling call
0811 16:08:29.921340 (+  2032us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:29.921448 (+   108us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.649491 (+728043us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.721806 (+ 72315us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.722409 (+   603us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.798744 24697 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:30.844228 24506 tablet_service.cc:1467] Processing CreateTablet for tablet 07f4360b11c44c6fa6327d0a030a1b55 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260811 16:08:30.846426 24506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f4360b11c44c6fa6327d0a030a1b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.787421 24513 tablet_service.cc:1467] Processing CreateTablet for tablet cdded2c7ff674319b9ca73af91948e0a (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260811 16:08:30.807793 24668 raft_consensus.cc:504] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:30.861873 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 518155us
I20260811 16:08:30.863994 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdded2c7ff674319b9ca73af91948e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.864423 24598 tablet_service.cc:1467] Processing CreateTablet for tablet 07f4360b11c44c6fa6327d0a030a1b55 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260811 16:08:30.873919 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:30.875033 24598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f4360b11c44c6fa6327d0a030a1b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.867655 24668 leader_election.cc:288] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:30.877207 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:30.879694 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:30.880399 24524 raft_consensus.cc:3037] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:30.888188 24662 tablet_bootstrap.cc:654] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:30.868913 24661 raft_consensus.cc:348] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:30.891526 24661 raft_consensus.cc:374] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:30.871445 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:30.872288 24665 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:30.893581 24665 ts_tablet_manager.cc:1397] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.665s	user 0.024s	sys 0.026s
I20260811 16:08:30.869696 24340 tablet_service.cc:1467] Processing CreateTablet for tablet 07f4360b11c44c6fa6327d0a030a1b55 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260811 16:08:30.899348 24663 ts_tablet_manager.cc:1428] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.642s	user 0.013s	sys 0.011s
I20260811 16:08:30.894826 24524 raft_consensus.cc:2454] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:30.894758 24661 raft_consensus.cc:729] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:30.912164 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:30.915836 24611 raft_consensus.cc:2379] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:30.915927 24425 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 28) took 1574 ms. Trace:
I20260811 16:08:30.916414 24425 rpcz_store.cc:276] 0811 16:08:29.341631 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:29.952495 (+610864us) service_pool.cc:227] Handling call
0811 16:08:30.057473 (+104978us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.067220 (+  9747us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.704535 (+637315us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.907855 (+203320us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:30.915763 (+  7908us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:30.918499 24425 tablet_service.cc:1467] Processing CreateTablet for tablet b630b4a32d1a4cfab0626c4f2715c9c5 (DEFAULT_TABLE table=test-workload [id=c9ebc58072024245bf271f158adb1edc]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260811 16:08:30.951823 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20b7cb4615c04cddb553ef8d6e774869" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:30.952639 24572 leader_election.cc:341] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.995254 24425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b630b4a32d1a4cfab0626c4f2715c9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:30.995596 24572 leader_election.cc:302] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:30.996564 24668 raft_consensus.cc:2781] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:30.997119 24668 raft_consensus.cc:686] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:30.998080 24668 consensus_queue.cc:237] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:30.999898 24485 leader_election.cc:302] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
W20260811 16:08:30.906951 24663 ts_tablet_manager.cc:1460] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Tablet startup took 649ms
W20260811 16:08:31.003602 24663 ts_tablet_manager.cc:1462] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Trace:
0811 16:08:28.914684 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:28.919258 (+  4574us) service_pool.cc:227] Handling call
0811 16:08:28.928069 (+  8811us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:28.928198 (+   129us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:29.062434 (+134236us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:29.134853 (+ 72419us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:29.151066 (+ 16213us) inbound_call.cc:173] Queueing success response
0811 16:08:29.876773 (+725707us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0811 16:08:30.257200 (+380427us) ts_tablet_manager.cc:1429] Starting tablet replica
0811 16:08:30.257813 (+   613us) tablet_replica.cc:259] Starting instrumentation
0811 16:08:30.258501 (+   688us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":171607,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"tablet-open.queue_time_us":725814,"thread_start_us":90568,"threads_started":1}
W20260811 16:08:30.951887 24402 leader_election.cc:341] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:30.975054 24661 consensus_queue.cc:260] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:31.011232 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 59399.6us
I20260811 16:08:31.013430 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:30.974423 24335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdded2c7ff674319b9ca73af91948e0a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 16:08:31.015244 24402 leader_election.cc:341] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.015736 24402 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:31.017273 24340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f4360b11c44c6fa6327d0a030a1b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:08:31.017611 24697 raft_consensus.cc:2726] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:08:31.009092 24572 leader_election.cc:341] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:31.020390 24572 leader_election.cc:341] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.025275 24572 leader_election.cc:302] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:31.013705 24661 ts_tablet_manager.cc:1428] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.234s	user 0.002s	sys 0.007s
W20260811 16:08:31.024226 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:31.037259 24661 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.038683 24662 tablet_bootstrap.cc:492] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.031812 24665 raft_consensus.cc:348] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.032794 24700 raft_consensus.cc:482] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.039332 24662 ts_tablet_manager.cc:1397] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.340s	user 0.038s	sys 0.045s
I20260811 16:08:31.039702 24700 raft_consensus.cc:504] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.042340 24700 leader_election.cc:288] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.044569 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.045327 24662 raft_consensus.cc:348] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.046522 24662 raft_consensus.cc:374] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.046867 24662 raft_consensus.cc:729] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:31.047228 24314 leader_election.cc:341] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.048257 24665 raft_consensus.cc:374] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.047994 24662 consensus_queue.cc:260] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.048758 24665 raft_consensus.cc:729] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.049973 24665 consensus_queue.cc:260] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.021190 24663 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.055990 24698 raft_consensus.cc:2726] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.032835 24428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32920 (request call id 33) took 1483 ms. Trace:
I20260811 16:08:31.060312 24662 ts_tablet_manager.cc:1428] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260811 16:08:31.067749 24428 rpcz_store.cc:276] 0811 16:08:29.549774 (+     0us) service_pool.cc:170] Inserting onto call queue
0811 16:08:30.303627 (+753853us) service_pool.cc:227] Handling call
0811 16:08:30.344022 (+ 40395us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 16:08:30.344135 (+   113us) ts_tablet_manager.cc:676] Creating new metadata...
0811 16:08:30.669998 (+325863us) tablet_metadata.cc:641] Metadata flushed
0811 16:08:30.994115 (+324117us) tablet_replica.cc:205] Creating consensus instance
0811 16:08:31.032654 (+ 38539us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 16:08:31.068495 24662 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.075722 24663 tablet_bootstrap.cc:654] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.089604 24661 tablet_bootstrap.cc:654] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.113090 24665 ts_tablet_manager.cc:1428] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.219s	user 0.012s	sys 0.007s
I20260811 16:08:31.114292 24706 raft_consensus.cc:2726] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.115077 24662 tablet_bootstrap.cc:654] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.122951 24237 catalog_manager.cc:5495] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
W20260811 16:08:31.124017 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 124257us
I20260811 16:08:31.122861 24665 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:31.135353 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:31.136214 24485 leader_election.cc:341] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.140426 24524 raft_consensus.cc:2454] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:31.141433 24485 leader_election.cc:302] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:31.143723 24708 raft_consensus.cc:2726] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.146268 24314 leader_election.cc:302] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:31.148347 24700 raft_consensus.cc:2781] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.148676 24665 tablet_bootstrap.cc:654] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.148921 24700 raft_consensus.cc:482] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.149482 24700 raft_consensus.cc:3037] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.157924 24663 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.158789 24663 ts_tablet_manager.cc:1397] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.148s	user 0.006s	sys 0.019s
I20260811 16:08:31.162964 24661 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:31.163625 24661 ts_tablet_manager.cc:1397] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.009s
I20260811 16:08:31.163460 24663 raft_consensus.cc:348] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.164326 24663 raft_consensus.cc:374] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.164641 24663 raft_consensus.cc:729] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.164788 24662 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.165434 24662 ts_tablet_manager.cc:1397] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.012s
I20260811 16:08:31.165515 24663 consensus_queue.cc:260] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.167045 24661 raft_consensus.cc:348] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.167971 24661 raft_consensus.cc:374] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.168282 24661 raft_consensus.cc:729] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.168700 24663 ts_tablet_manager.cc:1428] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260811 16:08:31.170270 24661 consensus_queue.cc:260] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.172214 24662 raft_consensus.cc:348] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.172858 24661 ts_tablet_manager.cc:1428] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260811 16:08:31.173085 24662 raft_consensus.cc:374] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.173442 24662 raft_consensus.cc:729] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.174242 24662 consensus_queue.cc:260] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.176842 24662 ts_tablet_manager.cc:1428] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260811 16:08:31.177455 24663 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.177337 24700 raft_consensus.cc:504] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.180975 24665 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:31.181581 24665 ts_tablet_manager.cc:1397] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.003s
I20260811 16:08:31.182264 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:31.182993 24440 raft_consensus.cc:3037] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.184399 24662 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.190722 24663 tablet_bootstrap.cc:654] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.192868 24662 tablet_bootstrap.cc:654] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.193547 24661 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.202256 24665 raft_consensus.cc:348] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.202436 24440 raft_consensus.cc:2454] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:31.206569 24314 leader_election.cc:302] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.203580 24700 leader_election.cc:288] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.207685 24702 raft_consensus.cc:2781] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.208338 24665 raft_consensus.cc:374] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.208544 24702 raft_consensus.cc:686] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:31.212795 24665 raft_consensus.cc:729] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.213697 24702 consensus_queue.cc:237] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.204744 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:31.216622 24524 raft_consensus.cc:3037] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.214730 24665 consensus_queue.cc:260] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.218340 24661 tablet_bootstrap.cc:654] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.210922 24663 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.224597 24663 ts_tablet_manager.cc:1397] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.003s
I20260811 16:08:31.228214 24663 raft_consensus.cc:348] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.229053 24663 raft_consensus.cc:374] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.229377 24663 raft_consensus.cc:729] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.229422 24665 ts_tablet_manager.cc:1428] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.005s
I20260811 16:08:31.230199 24663 consensus_queue.cc:260] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.231779 24662 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.232435 24662 ts_tablet_manager.cc:1397] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.020s
I20260811 16:08:31.236169 24524 raft_consensus.cc:2454] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:31.237249 24662 raft_consensus.cc:348] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.240885 24662 raft_consensus.cc:374] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.241283 24662 raft_consensus.cc:729] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.242347 24662 consensus_queue.cc:260] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.239516 24665 tablet_bootstrap.cc:492] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:31.248839 24663 ts_tablet_manager.cc:1428] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260811 16:08:31.248652 24234 catalog_manager.cc:5495] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:31.250283 24663 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.260710 24662 ts_tablet_manager.cc:1428] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260811 16:08:31.264219 24663 tablet_bootstrap.cc:654] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.264513 24697 raft_consensus.cc:482] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.265204 24661 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:31.265046 24697 raft_consensus.cc:504] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.265936 24661 ts_tablet_manager.cc:1397] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.004s
I20260811 16:08:31.267968 24697 leader_election.cc:288] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.270465 24665 tablet_bootstrap.cc:654] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.270716 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.273157 24524 raft_consensus.cc:2379] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:31.270745 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6592164b2b415e86bebdce9ce2517a" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.271879 24661 raft_consensus.cc:348] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.275979 24661 raft_consensus.cc:374] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.276105 24402 leader_election.cc:302] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:31.276340 24661 raft_consensus.cc:729] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.277164 24697 raft_consensus.cc:3037] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.277433 24661 consensus_queue.cc:260] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.280550 24661 ts_tablet_manager.cc:1428] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260811 16:08:31.281879 24661 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.285907 24663 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.287035 24663 ts_tablet_manager.cc:1397] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260811 16:08:31.292397 24662 tablet_bootstrap.cc:492] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.295070 24665 tablet_bootstrap.cc:492] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:31.295733 24665 ts_tablet_manager.cc:1397] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.004s
I20260811 16:08:31.295365 24663 raft_consensus.cc:348] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.296161 24663 raft_consensus.cc:374] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.296519 24663 raft_consensus.cc:729] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.297322 24663 consensus_queue.cc:260] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.299852 24663 ts_tablet_manager.cc:1428] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:08:31.298926 24665 raft_consensus.cc:348] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.300563 24665 raft_consensus.cc:374] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.300910 24665 raft_consensus.cc:729] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.301173 24663 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.301662 24665 consensus_queue.cc:260] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.305141 24662 tablet_bootstrap.cc:654] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.317428 24661 tablet_bootstrap.cc:654] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.308084 24663 tablet_bootstrap.cc:654] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.308146 24697 raft_consensus.cc:2726] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.320827 24665 ts_tablet_manager.cc:1428] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260811 16:08:31.325735 24668 raft_consensus.cc:482] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.326547 24668 raft_consensus.cc:504] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.330813 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa4c2dc66334d0d8ae8cc14be6a9df3" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.332113 24663 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.332700 24663 ts_tablet_manager.cc:1397] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.003s
W20260811 16:08:31.332778 24572 leader_election.cc:341] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.335312 24668 leader_election.cc:288] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.335901 24663 raft_consensus.cc:348] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.337001 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa4c2dc66334d0d8ae8cc14be6a9df3" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.337599 24663 raft_consensus.cc:374] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.337944 24663 raft_consensus.cc:729] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:31.338850 24572 leader_election.cc:341] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.338804 24663 consensus_queue.cc:260] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.339404 24572 leader_election.cc:302] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:31.340273 24698 raft_consensus.cc:2726] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.341660 24663 ts_tablet_manager.cc:1428] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260811 16:08:31.342305 24665 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:31.344347 24663 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.351763 24663 tablet_bootstrap.cc:654] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.364094 24661 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:31.364689 24661 ts_tablet_manager.cc:1397] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.011s
I20260811 16:08:31.365382 24665 tablet_bootstrap.cc:654] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.366798 24662 tablet_bootstrap.cc:492] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.367442 24662 ts_tablet_manager.cc:1397] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.036s
I20260811 16:08:31.368431 24661 raft_consensus.cc:348] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.369275 24661 raft_consensus.cc:374] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.369583 24661 raft_consensus.cc:729] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.370339 24661 consensus_queue.cc:260] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.370721 24662 raft_consensus.cc:348] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.371560 24662 raft_consensus.cc:374] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.371871 24662 raft_consensus.cc:729] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.372781 24662 consensus_queue.cc:260] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.380522 24665 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:31.381255 24665 ts_tablet_manager.cc:1397] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.019s
I20260811 16:08:31.382256 24662 ts_tablet_manager.cc:1428] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260811 16:08:31.384742 24665 raft_consensus.cc:348] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.386210 24665 raft_consensus.cc:374] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.386790 24665 raft_consensus.cc:729] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.387835 24665 consensus_queue.cc:260] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.389947 24661 ts_tablet_manager.cc:1428] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260811 16:08:31.390470 24663 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.391060 24663 ts_tablet_manager.cc:1397] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.009s
I20260811 16:08:31.391223 24661 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.392299 24702 raft_consensus.cc:482] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.392868 24702 raft_consensus.cc:504] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.394961 24702 leader_election.cc:288] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.397377 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.398456 24662 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.398543 24661 tablet_bootstrap.cc:654] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.399178 24665 ts_tablet_manager.cc:1428] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
W20260811 16:08:31.403921 24314 leader_election.cc:341] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.398722 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:31.406011 24314 leader_election.cc:341] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.406451 24314 leader_election.cc:302] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:31.407466 24665 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:31.407893 24702 raft_consensus.cc:2726] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.406433 24662 tablet_bootstrap.cc:654] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.409034 24663 raft_consensus.cc:348] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.409853 24663 raft_consensus.cc:374] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.410156 24663 raft_consensus.cc:729] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.410954 24663 consensus_queue.cc:260] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.414727 24665 tablet_bootstrap.cc:654] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.417477 24663 ts_tablet_manager.cc:1428] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260811 16:08:31.418751 24663 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.423725 24662 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.424702 24662 ts_tablet_manager.cc:1397] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.003s
I20260811 16:08:31.428686 24662 raft_consensus.cc:348] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.429788 24662 raft_consensus.cc:374] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.430182 24662 raft_consensus.cc:729] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.431272 24662 consensus_queue.cc:260] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.431209 24665 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:31.433275 24665 ts_tablet_manager.cc:1397] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.002s
I20260811 16:08:31.435477 24663 tablet_bootstrap.cc:654] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.437446 24661 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:31.438050 24661 ts_tablet_manager.cc:1397] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.003s
I20260811 16:08:31.441767 24662 ts_tablet_manager.cc:1428] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.000s
I20260811 16:08:31.443194 24662 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.443506 24661 raft_consensus.cc:348] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.444391 24661 raft_consensus.cc:374] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.444767 24661 raft_consensus.cc:729] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.444485 24665 raft_consensus.cc:348] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.445562 24665 raft_consensus.cc:374] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.445960 24665 raft_consensus.cc:729] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.446870 24665 consensus_queue.cc:260] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.445592 24661 consensus_queue.cc:260] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.449803 24665 ts_tablet_manager.cc:1428] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260811 16:08:31.451103 24665 tablet_bootstrap.cc:492] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:31.451462 24662 tablet_bootstrap.cc:654] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.455289 24702 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.455814 24702 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.458266 24702 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.460937 24661 ts_tablet_manager.cc:1428] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260811 16:08:31.462440 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.466110 24668 raft_consensus.cc:482] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.466650 24663 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.466686 24668 raft_consensus.cc:504] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.469197 24668 leader_election.cc:288] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.467327 24663 ts_tablet_manager.cc:1397] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.005s
I20260811 16:08:31.472441 24663 raft_consensus.cc:348] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.473863 24661 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.478329 24663 raft_consensus.cc:374] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.478680 24663 raft_consensus.cc:729] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.480945 24665 tablet_bootstrap.cc:654] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:31.492319 24314 leader_election.cc:341] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.492550 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d73d9b96de4eab90e9acf32a1bd105" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.493340 24663 consensus_queue.cc:260] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.496805 24663 ts_tablet_manager.cc:1428] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260811 16:08:31.499203 24661 tablet_bootstrap.cc:654] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.503783 24663 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.512219 24665 tablet_bootstrap.cc:492] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:31.512566 24663 tablet_bootstrap.cc:654] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:31.509125 24572 leader_election.cc:341] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.513240 24665 ts_tablet_manager.cc:1397] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.006s
I20260811 16:08:31.517954 24665 raft_consensus.cc:348] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.518036 24668 consensus_queue.cc:1035] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:31.518890 24665 raft_consensus.cc:374] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.519264 24665 raft_consensus.cc:729] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.519979 24665 consensus_queue.cc:260] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.527299 24702 raft_consensus.cc:482] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.527889 24702 raft_consensus.cc:504] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.530016 24702 leader_election.cc:288] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.530471 24663 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.531039 24663 ts_tablet_manager.cc:1397] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.008s
I20260811 16:08:31.533979 24663 raft_consensus.cc:348] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.534755 24663 raft_consensus.cc:374] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.535020 24663 raft_consensus.cc:729] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.535988 24663 consensus_queue.cc:260] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.536610 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.526145 24662 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.538304 24662 ts_tablet_manager.cc:1397] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.012s
I20260811 16:08:31.538534 24440 raft_consensus.cc:2454] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:31.540302 24314 leader_election.cc:302] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.540813 24698 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.541616 24702 raft_consensus.cc:2781] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.541487 24698 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.542306 24702 raft_consensus.cc:482] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.542817 24702 raft_consensus.cc:3037] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.542896 24663 ts_tablet_manager.cc:1428] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260811 16:08:31.544299 24663 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.540069 24668 consensus_queue.cc:1035] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 16:08:31.544240 24698 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.548977 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.550570 24662 raft_consensus.cc:348] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.551406 24662 raft_consensus.cc:374] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.551676 24662 raft_consensus.cc:729] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.552366 24662 consensus_queue.cc:260] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.553843 24663 tablet_bootstrap.cc:654] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.554504 24662 ts_tablet_manager.cc:1428] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.002s
I20260811 16:08:31.556257 24665 ts_tablet_manager.cc:1428] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260811 16:08:31.557746 24665 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:31.557888 24668 raft_consensus.cc:482] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.558473 24668 raft_consensus.cc:504] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.559792 24662 tablet_bootstrap.cc:492] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.562623 24668 leader_election.cc:288] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.567934 24610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.570482 24662 tablet_bootstrap.cc:654] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:31.570367 24314 leader_election.cc:341] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.570708 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:31.571348 24572 leader_election.cc:341] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.571439 24611 raft_consensus.cc:2454] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:31.572968 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.573597 24314 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:31.574754 24700 raft_consensus.cc:2781] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.575158 24700 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.575356 24663 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.575507 24700 raft_consensus.cc:3037] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.575897 24663 ts_tablet_manager.cc:1397] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.004s
I20260811 16:08:31.578830 24663 raft_consensus.cc:348] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.579514 24663 raft_consensus.cc:374] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.579778 24663 raft_consensus.cc:729] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.579918 24661 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:31.580657 24661 ts_tablet_manager.cc:1397] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.000s
I20260811 16:08:31.580488 24663 consensus_queue.cc:260] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:31.585965 24572 leader_election.cc:341] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.587857 24697 raft_consensus.cc:482] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.588590 24697 raft_consensus.cc:504] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.592234 24697 leader_election.cc:288] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.592372 24661 raft_consensus.cc:348] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.593182 24661 raft_consensus.cc:374] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.593456 24661 raft_consensus.cc:729] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.594130 24661 consensus_queue.cc:260] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.594233 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.594264 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:31.596227 24402 leader_election.cc:341] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:31.596937 24402 leader_election.cc:341] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.597337 24402 leader_election.cc:302] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:31.598301 24702 raft_consensus.cc:504] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.599355 24697 raft_consensus.cc:2726] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.600458 24702 leader_election.cc:288] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.606170 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
W20260811 16:08:31.611617 24314 leader_election.cc:341] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.613313 24668 raft_consensus.cc:482] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.613940 24668 raft_consensus.cc:504] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.614224 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:31.616115 24441 raft_consensus.cc:3037] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.616377 24668 leader_election.cc:288] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.620000 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20b7cb4615c04cddb553ef8d6e774869" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.620951 24523 raft_consensus.cc:2454] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:31.622922 24572 leader_election.cc:302] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:31.626147 24668 raft_consensus.cc:2781] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.626677 24668 raft_consensus.cc:482] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.627122 24668 raft_consensus.cc:3037] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.629495 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d73d9b96de4eab90e9acf32a1bd105" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.630486 24358 raft_consensus.cc:2454] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:31.631924 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.633642 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.625104 24702 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.635762 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20b7cb4615c04cddb553ef8d6e774869" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.636729 24661 ts_tablet_manager.cc:1428] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260811 16:08:31.636808 24355 raft_consensus.cc:2454] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:31.638111 24661 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.639578 24572 leader_election.cc:302] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:31.639798 24697 raft_consensus.cc:482] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.640419 24697 raft_consensus.cc:504] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.634994 24702 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.642750 24697 leader_election.cc:288] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.645610 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa4c2dc66334d0d8ae8cc14be6a9df3" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.646556 24523 raft_consensus.cc:2454] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:31.647845 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.648620 24439 raft_consensus.cc:2454] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:31.649001 24402 leader_election.cc:302] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.650063 24697 raft_consensus.cc:2781] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.649968 24314 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.650756 24697 raft_consensus.cc:482] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.651309 24697 raft_consensus.cc:3037] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.647480 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa4c2dc66334d0d8ae8cc14be6a9df3" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.656224 24611 raft_consensus.cc:2454] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
W20260811 16:08:31.662915 24572 leader_election.cc:341] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.663000 24700 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.669055 24702 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.672806 24702 raft_consensus.cc:2781] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.673215 24702 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.673310 24700 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.673683 24702 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.671461 24665 tablet_bootstrap.cc:654] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.671495 24357 raft_consensus.cc:2379] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:31.667762 24572 leader_election.cc:302] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:31.675243 24708 raft_consensus.cc:482] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.676129 24708 raft_consensus.cc:504] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.691433 24751 raft_consensus.cc:2781] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.692067 24751 raft_consensus.cc:482] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.692538 24751 raft_consensus.cc:3037] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.704576 24661 tablet_bootstrap.cc:654] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.704767 24663 ts_tablet_manager.cc:1428] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.129s	user 0.028s	sys 0.036s
I20260811 16:08:31.705160 24708 leader_election.cc:288] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.706087 24663 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:31.706674 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.707393 24357 raft_consensus.cc:2454] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:31.709371 24485 leader_election.cc:302] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:31.712517 24662 tablet_bootstrap.cc:492] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:31.713240 24662 ts_tablet_manager.cc:1397] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.044s
I20260811 16:08:31.719326 24708 raft_consensus.cc:2781] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.728473 24662 raft_consensus.cc:348] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.729961 24662 raft_consensus.cc:374] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 16:08:31.719559 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 69689.2us
I20260811 16:08:31.730296 24662 raft_consensus.cc:729] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:31.721570 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 58832.3us
I20260811 16:08:31.727272 24708 raft_consensus.cc:482] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.733835 24662 consensus_queue.cc:260] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.736225 24754 raft_consensus.cc:2726] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.739912 24441 raft_consensus.cc:2454] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:31.740860 24668 raft_consensus.cc:504] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.742347 24697 raft_consensus.cc:504] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.733894 24708 raft_consensus.cc:3037] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.746598 24751 raft_consensus.cc:504] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.746592 24702 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.753554 24661 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:31.754115 24661 ts_tablet_manager.cc:1397] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.116s	user 0.023s	sys 0.032s
I20260811 16:08:31.754290 24751 leader_election.cc:288] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.754801 24702 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.757889 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:31.759524 24663 tablet_bootstrap.cc:654] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.759516 24661 raft_consensus.cc:348] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.760375 24661 raft_consensus.cc:374] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.760731 24661 raft_consensus.cc:729] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.763489 24572 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:31.764438 24751 raft_consensus.cc:3037] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.765758 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d73d9b96de4eab90e9acf32a1bd105" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:31.766443 24357 raft_consensus.cc:3037] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.763197 24661 consensus_queue.cc:260] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.776877 24702 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.777467 24702 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.777952 24661 ts_tablet_manager.cc:1428] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260811 16:08:31.779462 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:31.779901 24702 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.780169 24441 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.781080 24751 raft_consensus.cc:2726] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:31.762739 24668 leader_election.cc:288] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.784763 24661 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:31.788094 24662 ts_tablet_manager.cc:1428] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.016s
I20260811 16:08:31.774981 24357 raft_consensus.cc:2454] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:31.808477 24662 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:31.811393 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa4c2dc66334d0d8ae8cc14be6a9df3" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:31.812333 24523 raft_consensus.cc:3037] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.816830 24697 leader_election.cc:288] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.825085 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20b7cb4615c04cddb553ef8d6e774869" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:31.825511 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20b7cb4615c04cddb553ef8d6e774869" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:31.825865 24524 raft_consensus.cc:3037] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.826009 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d73d9b96de4eab90e9acf32a1bd105" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:31.826239 24357 raft_consensus.cc:3037] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.828838 24758 raft_consensus.cc:482] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.835414 24758 raft_consensus.cc:504] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.824961 24753 consensus_queue.cc:1035] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260811 16:08:31.822899 24314 leader_election.cc:341] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.831852 24757 raft_consensus.cc:482] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.834841 24661 tablet_bootstrap.cc:654] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.837275 24665 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:31.839031 24665 ts_tablet_manager.cc:1397] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.282s	user 0.016s	sys 0.022s
I20260811 16:08:31.839812 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa4c2dc66334d0d8ae8cc14be6a9df3" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:31.840471 24611 raft_consensus.cc:3037] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.842154 24665 raft_consensus.cc:348] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.843032 24665 raft_consensus.cc:374] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.843394 24665 raft_consensus.cc:729] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.844072 24757 raft_consensus.cc:504] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.844264 24665 consensus_queue.cc:260] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.846566 24757 leader_election.cc:288] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.848388 24524 raft_consensus.cc:2454] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:31.848896 24441 raft_consensus.cc:2454] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
W20260811 16:08:31.855949 24572 leader_election.cc:341] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.856932 24523 raft_consensus.cc:2454] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:31.857527 24610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.858258 24610 raft_consensus.cc:2454] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:31.858314 24402 leader_election.cc:302] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.858644 24357 raft_consensus.cc:2454] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:31.859517 24697 raft_consensus.cc:2781] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.859699 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.860091 24697 raft_consensus.cc:686] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:31.860747 24762 raft_consensus.cc:482] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.860973 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.861317 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:31.861133 24697 consensus_queue.cc:237] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.861747 24355 raft_consensus.cc:2454] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:31.861390 24762 raft_consensus.cc:504] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.863469 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:31.859531 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.869992 24314 leader_election.cc:302] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:31.872068 24753 raft_consensus.cc:2781] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.872736 24753 raft_consensus.cc:686] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:31.873845 24753 consensus_queue.cc:237] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.877657 24607 raft_consensus.cc:2454] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:31.880155 24314 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.860208 24572 leader_election.cc:302] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:31.869992 24611 raft_consensus.cc:2454] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:31.881599 24761 raft_consensus.cc:482] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.883890 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.892050 24702 raft_consensus.cc:2781] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.893909 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.894145 24702 raft_consensus.cc:686] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:31.894631 24441 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:31.895080 24702 consensus_queue.cc:237] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.896905 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.899495 24665 ts_tablet_manager.cc:1428] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.060s	user 0.021s	sys 0.011s
I20260811 16:08:31.900635 24665 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
W20260811 16:08:31.902451 24314 leader_election.cc:341] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.903930 24663 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:31.904639 24663 ts_tablet_manager.cc:1397] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.014s
I20260811 16:08:31.912220 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.909005 24757 raft_consensus.cc:2781] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.913260 24607 raft_consensus.cc:2454] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:31.914098 24757 raft_consensus.cc:686] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:31.915076 24757 consensus_queue.cc:237] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.915416 24402 leader_election.cc:302] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.916824 24697 raft_consensus.cc:2781] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.917354 24697 raft_consensus.cc:482] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.917975 24697 raft_consensus.cc:3037] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.917203 24662 tablet_bootstrap.cc:654] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.919812 24665 tablet_bootstrap.cc:654] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:31.920228 24663 raft_consensus.cc:348] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.901880 24236 catalog_manager.cc:5495] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
W20260811 16:08:31.907682 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 47575.4us
I20260811 16:08:31.926645 24572 leader_election.cc:302] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:31.927685 24668 raft_consensus.cc:2781] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.928333 24668 raft_consensus.cc:686] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:31.928599 24572 leader_election.cc:302] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:31.929665 24754 raft_consensus.cc:2781] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.929426 24668 consensus_queue.cc:237] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:31.930052 24754 raft_consensus.cc:482] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.930423 24754 raft_consensus.cc:3037] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.925042 24663 raft_consensus.cc:374] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:31.934015 24663 raft_consensus.cc:729] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:31.910238 24758 leader_election.cc:288] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.906073 24314 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:31.941071 24238 catalog_manager.cc:5495] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:31.942341 24753 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.942741 24753 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.943058 24753 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.943117 24708 raft_consensus.cc:504] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:31.944582 24524 raft_consensus.cc:2379] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:31.937255 24663 consensus_queue.cc:260] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.890614 24761 raft_consensus.cc:504] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.937132 24762 leader_election.cc:288] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:31.948946 24758 raft_consensus.cc:482] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.950196 24748 consensus_queue.cc:1035] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260811 16:08:31.958505 24523 raft_consensus.cc:2454] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:31.959553 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:31.961975 24485 leader_election.cc:341] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.963681 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:31.964478 24663 ts_tablet_manager.cc:1428] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.003s
I20260811 16:08:31.964280 24758 raft_consensus.cc:504] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.966213 24758 leader_election.cc:288] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:31.954059 24314 leader_election.cc:341] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.967767 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:31.968335 24769 raft_consensus.cc:482] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:31.968654 24357 raft_consensus.cc:2454] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
W20260811 16:08:31.971354 24314 leader_election.cc:341] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:31.973325 24314 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:31.974531 24748 raft_consensus.cc:2781] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:31.975030 24748 raft_consensus.cc:686] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:31.976013 24748 consensus_queue.cc:237] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.978055 24761 leader_election.cc:288] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.979802 24402 leader_election.cc:302] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:31.981540 24753 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.982908 24758 raft_consensus.cc:2781] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:31.982784 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:31.983703 24758 raft_consensus.cc:482] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:31.974884 24234 catalog_manager.cc:5495] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:31.969103 24769 raft_consensus.cc:504] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:31.986876 24523 raft_consensus.cc:2454] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:31.988729 24769 leader_election.cc:288] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:31.984169 24758 raft_consensus.cc:3037] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:31.997532 24697 raft_consensus.cc:504] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:31.993327 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:31.999310 24753 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:31.999769 24440 raft_consensus.cc:2379] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:32.001797 24697 leader_election.cc:288] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:31.998929 24754 raft_consensus.cc:504] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.003504 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:32.004205 24607 raft_consensus.cc:3037] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.005393 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:32.006270 24524 raft_consensus.cc:2379] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:32.008472 24708 leader_election.cc:288] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:32.011386 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.011639 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:32.012143 24357 raft_consensus.cc:2454] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:32.012181 24523 raft_consensus.cc:3037] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.012326 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc31d8acb4164ff29dd355deb7245651" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:32.015482 24607 raft_consensus.cc:2454] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:32.016834 24402 leader_election.cc:302] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:32.017508 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.017719 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.018618 24357 raft_consensus.cc:3037] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:32.018931 24485 leader_election.cc:341] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.017904 24697 raft_consensus.cc:2781] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.024008 24485 leader_election.cc:302] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.032733 24357 raft_consensus.cc:2454] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:32.034354 24572 leader_election.cc:302] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:32.035732 24668 raft_consensus.cc:2781] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.024351 24697 raft_consensus.cc:686] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:32.041677 24663 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:32.047428 24708 raft_consensus.cc:2726] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.050453 24661 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:32.051419 24661 ts_tablet_manager.cc:1397] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.007s
I20260811 16:08:32.026697 24754 leader_election.cc:288] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:32.039736 24668 raft_consensus.cc:686] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:32.057197 24662 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:32.047809 24697 consensus_queue.cc:237] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.060060 24662 ts_tablet_manager.cc:1397] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.254s	user 0.022s	sys 0.011s
I20260811 16:08:32.063167 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:32.064002 24439 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.065999 24665 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:32.066720 24665 ts_tablet_manager.cc:1397] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.166s	user 0.026s	sys 0.025s
I20260811 16:08:32.072069 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.072094 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75ef18b8865438c83f749eea8f963aa" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:32.073035 24357 raft_consensus.cc:2379] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:32.073946 24663 tablet_bootstrap.cc:654] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.074829 24485 leader_election.cc:302] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:32.075177 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:32.075551 24668 consensus_queue.cc:237] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.076015 24485 leader_election.cc:302] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.076828 24708 raft_consensus.cc:2781] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:32.077390 24708 raft_consensus.cc:482] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:32.077773 24708 raft_consensus.cc:3037] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.079972 24665 raft_consensus.cc:348] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.081461 24665 raft_consensus.cc:374] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.081832 24665 raft_consensus.cc:729] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.083789 24665 consensus_queue.cc:260] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.084810 24523 raft_consensus.cc:2454] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:32.085467 24769 raft_consensus.cc:2726] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.086970 24665 ts_tablet_manager.cc:1428] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260811 16:08:32.088642 24665 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
W20260811 16:08:32.090843 24314 leader_election.cc:341] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.094978 24665 tablet_bootstrap.cc:654] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.100210 24708 raft_consensus.cc:504] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.102334 24708 leader_election.cc:288] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.099231 24485 leader_election.cc:302] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.104765 24439 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:32.112665 24662 raft_consensus.cc:348] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.113410 24662 raft_consensus.cc:374] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.115778 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.116485 24357 raft_consensus.cc:3037] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.118181 24665 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:32.118880 24665 ts_tablet_manager.cc:1397] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.003s
I20260811 16:08:32.113689 24662 raft_consensus.cc:729] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.094877 24758 raft_consensus.cc:504] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.121202 24662 consensus_queue.cc:260] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.124445 24314 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:32.122426 24661 raft_consensus.cc:348] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.128266 24661 raft_consensus.cc:374] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.128680 24661 raft_consensus.cc:729] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.130838 24661 consensus_queue.cc:260] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.132723 24665 raft_consensus.cc:348] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.133342 24661 ts_tablet_manager.cc:1428] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.082s	user 0.003s	sys 0.004s
I20260811 16:08:32.134867 24661 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:32.135162 24753 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.135954 24753 raft_consensus.cc:686] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:32.136976 24753 consensus_queue.cc:237] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.133868 24665 raft_consensus.cc:374] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.138180 24700 raft_consensus.cc:482] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.138398 24665 raft_consensus.cc:729] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.138785 24700 raft_consensus.cc:504] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.139642 24665 consensus_queue.cc:260] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.141263 24700 leader_election.cc:288] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:32.143445 24661 tablet_bootstrap.cc:654] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.144665 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:32.146250 24314 leader_election.cc:341] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.121543 24708 raft_consensus.cc:2726] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.157452 24662 ts_tablet_manager.cc:1428] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260811 16:08:32.159406 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:32.164314 24665 ts_tablet_manager.cc:1428] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260811 16:08:32.169965 24440 raft_consensus.cc:2379] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:32.171618 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:32.162303 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:32.172780 24665 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:32.174468 24662 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:32.182770 24665 tablet_bootstrap.cc:654] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.178177 24758 leader_election.cc:288] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:32.179888 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.180755 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
W20260811 16:08:32.183730 24314 leader_election.cc:341] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.182910 24236 catalog_manager.cc:5495] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:32.187345 24314 leader_election.cc:302] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.186780 24523 raft_consensus.cc:2379] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:32.188670 24700 raft_consensus.cc:2726] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.190264 24236 catalog_manager.cc:5495] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:32.194949 24661 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:32.194921 24236 catalog_manager.cc:5495] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:32.196148 24661 ts_tablet_manager.cc:1397] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.021s
I20260811 16:08:32.191385 24402 leader_election.cc:302] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.199364 24758 raft_consensus.cc:2726] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.201586 24357 raft_consensus.cc:2454] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:32.202380 24663 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:32.202927 24663 ts_tablet_manager.cc:1397] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.165s	user 0.017s	sys 0.000s
I20260811 16:08:32.203133 24485 leader_election.cc:302] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.204182 24708 raft_consensus.cc:2781] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.204746 24708 raft_consensus.cc:686] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:32.205497 24708 consensus_queue.cc:237] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.209883 24662 tablet_bootstrap.cc:654] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.205601 24663 raft_consensus.cc:348] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.212291 24663 raft_consensus.cc:374] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.213411 24661 raft_consensus.cc:348] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.214311 24661 raft_consensus.cc:374] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.214581 24661 raft_consensus.cc:729] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.215435 24661 consensus_queue.cc:260] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.216681 24237 catalog_manager.cc:5495] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:32.218180 24661 ts_tablet_manager.cc:1428] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260811 16:08:32.219724 24661 tablet_bootstrap.cc:492] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:32.223825 24772 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.224620 24772 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.222231 24238 catalog_manager.cc:5495] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:32.212678 24663 raft_consensus.cc:729] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.231735 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.232229 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:32.233076 24607 raft_consensus.cc:2379] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:32.234414 24668 raft_consensus.cc:482] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.234946 24668 raft_consensus.cc:504] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.237435 24663 consensus_queue.cc:260] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.240892 24663 ts_tablet_manager.cc:1428] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260811 16:08:32.243176 24668 leader_election.cc:288] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.248495 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.245368 24663 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:32.247193 24485 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.247839 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.227087 24772 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:32.250207 24238 catalog_manager.cc:5495] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:32.256279 24772 raft_consensus.cc:3037] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.259873 24440 raft_consensus.cc:2379] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:32.261869 24572 leader_election.cc:302] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.263120 24668 raft_consensus.cc:3037] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.269675 24234 catalog_manager.cc:5495] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:32.271034 24668 raft_consensus.cc:2726] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.276404 24661 tablet_bootstrap.cc:654] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.277530 24772 raft_consensus.cc:2726] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.271515 24708 raft_consensus.cc:482] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.281484 24753 raft_consensus.cc:482] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.282102 24753 raft_consensus.cc:504] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.284385 24753 leader_election.cc:288] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.284957 24665 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:32.285550 24665 ts_tablet_manager.cc:1397] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.113s	user 0.035s	sys 0.006s
I20260811 16:08:32.279279 24708 raft_consensus.cc:504] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.287613 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.288723 24665 raft_consensus.cc:348] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.289155 24708 leader_election.cc:288] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.289455 24665 raft_consensus.cc:374] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.287006 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:32.289871 24665 raft_consensus.cc:729] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.290647 24662 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:32.291239 24662 ts_tablet_manager.cc:1397] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.018s
I20260811 16:08:32.293056 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead62f860954f6ca8149148504e068f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.293803 24357 raft_consensus.cc:2454] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:32.294018 24662 raft_consensus.cc:348] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.294600 24663 tablet_bootstrap.cc:654] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.294790 24662 raft_consensus.cc:374] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 16:08:32.294893 24314 leader_election.cc:341] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.295233 24662 raft_consensus.cc:729] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:32.295693 24314 leader_election.cc:341] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.296108 24314 leader_election.cc:302] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.295938 24662 consensus_queue.cc:260] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.290652 24665 consensus_queue.cc:260] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.298076 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead62f860954f6ca8149148504e068f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.298775 24440 raft_consensus.cc:2454] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:32.299196 24665 ts_tablet_manager.cc:1428] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260811 16:08:32.300268 24665 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:32.300115 24485 leader_election.cc:302] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:32.301860 24772 raft_consensus.cc:2781] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:32.302273 24772 raft_consensus.cc:482] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:32.302593 24772 raft_consensus.cc:3037] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.304916 24662 ts_tablet_manager.cc:1428] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260811 16:08:32.305998 24662 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:32.307582 24753 raft_consensus.cc:2726] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.312477 24772 raft_consensus.cc:504] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.317237 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead62f860954f6ca8149148504e068f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.317963 24357 raft_consensus.cc:3037] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.321053 24758 consensus_queue.cc:1035] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.323112 24665 tablet_bootstrap.cc:654] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.328800 24662 tablet_bootstrap.cc:654] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.330982 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead62f860954f6ca8149148504e068f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:32.332176 24440 raft_consensus.cc:3037] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.345439 24440 raft_consensus.cc:2454] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:32.347069 24485 leader_election.cc:302] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:32.348161 24708 raft_consensus.cc:2781] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.348529 24663 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:32.348699 24708 raft_consensus.cc:686] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:32.349103 24663 ts_tablet_manager.cc:1397] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.019s
I20260811 16:08:32.349647 24708 consensus_queue.cc:237] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.350251 24611 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.331943 24357 raft_consensus.cc:2454] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:32.352952 24772 leader_election.cc:288] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.365645 24662 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:32.366426 24662 ts_tablet_manager.cc:1397] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.009s
I20260811 16:08:32.370258 24662 raft_consensus.cc:348] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.373656 24662 raft_consensus.cc:374] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.373955 24662 raft_consensus.cc:729] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.374357 24663 raft_consensus.cc:348] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.375968 24663 raft_consensus.cc:374] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.376368 24663 raft_consensus.cc:729] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.377350 24663 consensus_queue.cc:260] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.388507 24662 consensus_queue.cc:260] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.390455 24700 consensus_queue.cc:1035] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.391273 24662 ts_tablet_manager.cc:1428] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.004s
I20260811 16:08:32.392361 24662 tablet_bootstrap.cc:492] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:32.392050 24700 consensus_queue.cc:1035] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:32.394322 24665 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:32.394881 24665 ts_tablet_manager.cc:1397] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.021s
I20260811 16:08:32.396373 24663 ts_tablet_manager.cc:1428] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260811 16:08:32.397737 24665 raft_consensus.cc:348] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.411566 24702 consensus_queue.cc:1035] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:32.406241 24236 catalog_manager.cc:5495] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:32.412717 24663 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:32.410017 24700 consensus_queue.cc:1035] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.411264 24748 consensus_queue.cc:1035] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:32.411885 24665 raft_consensus.cc:374] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.399119 24662 tablet_bootstrap.cc:654] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.419510 24758 raft_consensus.cc:482] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.420954 24665 raft_consensus.cc:729] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.411964 24755 consensus_queue.cc:1035] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.421358 24758 raft_consensus.cc:504] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.421802 24665 consensus_queue.cc:260] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.424314 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d73d9b96de4eab90e9acf32a1bd105" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.424968 24668 consensus_queue.cc:1035] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:32.425141 24665 ts_tablet_manager.cc:1428] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260811 16:08:32.425153 24357 raft_consensus.cc:2379] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:32.426517 24665 tablet_bootstrap.cc:492] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:32.427208 24758 leader_election.cc:288] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:32.429035 24610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d73d9b96de4eab90e9acf32a1bd105" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:32.430984 24402 leader_election.cc:302] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.433379 24758 raft_consensus.cc:3037] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.444797 24758 raft_consensus.cc:2726] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.446790 24662 tablet_bootstrap.cc:492] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:32.447804 24662 ts_tablet_manager.cc:1397] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.004s
I20260811 16:08:32.452850 24662 raft_consensus.cc:348] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.453924 24662 raft_consensus.cc:374] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.454236 24662 raft_consensus.cc:729] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.455161 24662 consensus_queue.cc:260] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.454491 24663 tablet_bootstrap.cc:654] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.455678 24668 consensus_queue.cc:1035] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:32.458202 24662 ts_tablet_manager.cc:1428] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260811 16:08:32.458652 24753 consensus_queue.cc:1035] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.459476 24662 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:32.467427 24662 tablet_bootstrap.cc:654] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.479961 24665 tablet_bootstrap.cc:654] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.486778 24662 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:32.487567 24662 ts_tablet_manager.cc:1397] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.017s
I20260811 16:08:32.489392 24668 consensus_queue.cc:1035] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.491079 24662 raft_consensus.cc:348] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.492057 24662 raft_consensus.cc:374] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.492368 24662 raft_consensus.cc:729] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.494364 24662 consensus_queue.cc:260] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.495443 24663 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:32.496057 24663 ts_tablet_manager.cc:1397] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.000s
I20260811 16:08:32.496942 24662 ts_tablet_manager.cc:1428] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260811 16:08:32.498026 24661 tablet_bootstrap.cc:492] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:32.498693 24661 ts_tablet_manager.cc:1397] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.279s	user 0.025s	sys 0.008s
I20260811 16:08:32.506333 24662 tablet_bootstrap.cc:492] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:32.508139 24663 raft_consensus.cc:348] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.508891 24663 raft_consensus.cc:374] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.509197 24663 raft_consensus.cc:729] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.515112 24663 consensus_queue.cc:260] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.517458 24663 ts_tablet_manager.cc:1428] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260811 16:08:32.518620 24663 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:32.521885 24661 raft_consensus.cc:348] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.522701 24661 raft_consensus.cc:374] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.522972 24661 raft_consensus.cc:729] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.523965 24661 consensus_queue.cc:260] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.530371 24661 ts_tablet_manager.cc:1428] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260811 16:08:32.524396 24755 consensus_queue.cc:1035] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260811 16:08:32.531962 24661 tablet_bootstrap.cc:492] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:32.542234 24661 tablet_bootstrap.cc:654] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.545500 24748 raft_consensus.cc:482] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.554376 24748 raft_consensus.cc:504] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.567376 24748 leader_election.cc:288] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:32.599416 24663 tablet_bootstrap.cc:654] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.598850 24772 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.608011 24757 raft_consensus.cc:482] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.609803 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:32.609787 24757 raft_consensus.cc:504] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.610612 24519 raft_consensus.cc:2454] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:32.612035 24757 leader_election.cc:288] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.608716 24772 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.615475 24772 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.621997 24314 leader_election.cc:302] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:32.622488 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.623353 24441 raft_consensus.cc:2379] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:32.621670 24665 tablet_bootstrap.cc:492] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:32.624140 24665 ts_tablet_manager.cc:1397] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.198s	user 0.027s	sys 0.051s
I20260811 16:08:32.629758 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.633735 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:32.634476 24606 raft_consensus.cc:2454] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:32.636417 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.637152 24439 raft_consensus.cc:2454] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:32.627292 24748 raft_consensus.cc:2781] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:32.640599 24748 raft_consensus.cc:482] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:32.640934 24748 raft_consensus.cc:3037] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.625603 24668 consensus_queue.cc:1035] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260811 16:08:32.646127 24665 raft_consensus.cc:348] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.646932 24665 raft_consensus.cc:374] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.647230 24665 raft_consensus.cc:729] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.647921 24665 consensus_queue.cc:260] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.648313 24485 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.649793 24708 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:32.655836 24807 log.cc:924] Time spent T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260811 16:08:32.661067 24755 consensus_queue.cc:1035] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:32.662393 24818 log.cc:924] Time spent T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260811 16:08:32.665755 24665 ts_tablet_manager.cc:1428] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260811 16:08:32.663522 24708 raft_consensus.cc:2726] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.667313 24665 tablet_bootstrap.cc:492] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:32.670332 24572 leader_election.cc:302] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:32.671643 24754 raft_consensus.cc:2781] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:32.672111 24754 raft_consensus.cc:482] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:32.672528 24754 raft_consensus.cc:3037] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.674147 24665 tablet_bootstrap.cc:654] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.678650 24769 consensus_queue.cc:1035] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.657358 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.686597 24702 consensus_queue.cc:1035] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:32.693334 24572 leader_election.cc:341] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.697760 24769 raft_consensus.cc:482] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.698438 24755 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.698532 24769 raft_consensus.cc:504] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.699368 24755 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.703125 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:32.705224 24402 leader_election.cc:341] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.701484 24769 leader_election.cc:288] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.708396 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424cfa023f8d422a8677325b3f8e74dd" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.709144 24356 raft_consensus.cc:2454] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:32.708972 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424cfa023f8d422a8677325b3f8e74dd" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:32.711553 24485 leader_election.cc:341] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.718184 24757 consensus_queue.cc:1035] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 16:08:32.720669 24661 tablet_bootstrap.cc:492] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:32.721393 24661 ts_tablet_manager.cc:1397] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.041s
I20260811 16:08:32.714489 24485 leader_election.cc:302] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.722321 24708 raft_consensus.cc:2781] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:32.722707 24708 raft_consensus.cc:482] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:32.723055 24708 raft_consensus.cc:3037] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.730737 24748 raft_consensus.cc:504] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.760354 24702 consensus_queue.cc:1035] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:32.731051 24708 raft_consensus.cc:504] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.763239 24708 leader_election.cc:288] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.763949 24748 leader_election.cc:288] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
W20260811 16:08:32.732326 24809 log.cc:924] Time spent T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260811 16:08:32.733281 24811 log.cc:924] Time spent T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260811 16:08:32.734380 24755 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:32.736524 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.742584 24662 tablet_bootstrap.cc:654] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.743961 24769 consensus_queue.cc:1035] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:32.748248 24697 raft_consensus.cc:482] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.751413 24661 raft_consensus.cc:348] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.785014 24661 raft_consensus.cc:374] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.785435 24661 raft_consensus.cc:729] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.755403 24757 consensus_queue.cc:1035] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 16:08:32.778822 24668 raft_consensus.cc:482] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:08:32.788234 24402 leader_election.cc:341] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.788812 24402 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.788461 24697 raft_consensus.cc:504] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.790637 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424cfa023f8d422a8677325b3f8e74dd" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.791361 24356 raft_consensus.cc:3037] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.791620 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424cfa023f8d422a8677325b3f8e74dd" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:32.791750 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:32.792686 24523 raft_consensus.cc:3037] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.793008 24661 consensus_queue.cc:260] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.795907 24697 leader_election.cc:288] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:32.796487 24697 raft_consensus.cc:2726] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.788319 24668 raft_consensus.cc:504] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.799775 24668 leader_election.cc:288] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:32.800282 24661 ts_tablet_manager.cc:1428] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
I20260811 16:08:32.801465 24661 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
W20260811 16:08:32.802332 24485 leader_election.cc:341] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.802685 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:32.805166 24754 raft_consensus.cc:504] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.806879 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:32.777818 24708 raft_consensus.cc:482] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.808040 24708 raft_consensus.cc:504] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:32.808759 24402 leader_election.cc:341] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:32.809513 24402 leader_election.cc:341] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.809881 24402 leader_election.cc:302] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.810355 24708 leader_election.cc:288] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:32.810796 24754 leader_election.cc:288] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:32.811354 24697 raft_consensus.cc:2726] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:32.812837 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.832484 24523 raft_consensus.cc:2454] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:32.842298 24663 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:32.842739 24661 tablet_bootstrap.cc:654] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.843032 24663 ts_tablet_manager.cc:1397] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.325s	user 0.024s	sys 0.063s
I20260811 16:08:32.817492 24356 raft_consensus.cc:2454] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:32.863530 24663 raft_consensus.cc:348] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.864470 24663 raft_consensus.cc:374] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.864218 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:32.864825 24663 raft_consensus.cc:729] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.865180 24523 raft_consensus.cc:2454] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:32.866091 24663 consensus_queue.cc:260] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.874240 24663 ts_tablet_manager.cc:1428] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.003s
I20260811 16:08:32.881594 24665 tablet_bootstrap.cc:492] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:32.882268 24665 ts_tablet_manager.cc:1397] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.008s
I20260811 16:08:32.876108 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:32.883885 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:32.884821 24438 raft_consensus.cc:3037] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.858163 24769 consensus_queue.cc:1035] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260811 16:08:32.885027 24665 raft_consensus.cc:348] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.888751 24665 raft_consensus.cc:374] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.889065 24665 raft_consensus.cc:729] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.890132 24665 consensus_queue.cc:260] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.891723 24314 leader_election.cc:302] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:32.892663 24753 raft_consensus.cc:2781] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.893194 24753 raft_consensus.cc:686] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:32.894063 24753 consensus_queue.cc:237] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:32.894691 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:32.910506 24438 raft_consensus.cc:2454] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:32.913998 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:32.917737 24606 raft_consensus.cc:3037] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.917842 24755 raft_consensus.cc:482] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.914784 24665 ts_tablet_manager.cc:1428] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
W20260811 16:08:32.915860 24485 leader_election.cc:341] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:32.914583 24572 leader_election.cc:341] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.918488 24755 raft_consensus.cc:504] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.931293 24755 leader_election.cc:288] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:32.932610 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d054ecff344a15bd66eb316fcc28e1" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:32.933943 24662 tablet_bootstrap.cc:492] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:32.934494 24662 ts_tablet_manager.cc:1397] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.430s	user 0.020s	sys 0.011s
I20260811 16:08:32.934847 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d054ecff344a15bd66eb316fcc28e1" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:32.935642 24607 raft_consensus.cc:2454] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:32.936200 24708 consensus_queue.cc:1035] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:32.936280 24402 leader_election.cc:341] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:32.939543 24572 leader_election.cc:341] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.940546 24708 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:32.938490 24485 leader_election.cc:302] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:32.940860 24662 raft_consensus.cc:348] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.941808 24662 raft_consensus.cc:374] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:32.942133 24662 raft_consensus.cc:729] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:32.943200 24662 consensus_queue.cc:260] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.944489 24663 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:32.942529 24769 raft_consensus.cc:2781] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.941262 24708 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.954336 24662 ts_tablet_manager.cc:1428] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260811 16:08:32.940591 24572 leader_election.cc:302] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:32.956638 24665 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:32.951390 24769 raft_consensus.cc:686] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:32.959844 24769 consensus_queue.cc:237] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:32.962941 24663 tablet_bootstrap.cc:654] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:32.953383 24402 leader_election.cc:302] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:32.964437 24697 raft_consensus.cc:2781] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:32.964828 24697 raft_consensus.cc:482] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:32.965158 24697 raft_consensus.cc:3037] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:32.966827 24754 raft_consensus.cc:2781] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:32.967631 24754 raft_consensus.cc:686] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:32.968730 24661 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:32.968492 24754 consensus_queue.cc:237] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:32.969290 24661 ts_tablet_manager.cc:1397] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.000s
I20260811 16:08:32.976022 24662 tablet_bootstrap.cc:492] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:32.977582 24236 catalog_manager.cc:5495] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:32.987761 24697 raft_consensus.cc:504] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:32.995826 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d054ecff344a15bd66eb316fcc28e1" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:32.996100 24697 leader_election.cc:288] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:32.996987 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d054ecff344a15bd66eb316fcc28e1" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
W20260811 16:08:32.997394 24402 leader_election.cc:341] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:32.997668 24607 raft_consensus.cc:3037] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.000151 24665 tablet_bootstrap.cc:654] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:33.002843 24829 log.cc:924] Time spent T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260811 16:08:33.021590 24831 log.cc:924] Time spent T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260811 16:08:33.030150 24661 raft_consensus.cc:348] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.031003 24661 raft_consensus.cc:374] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.031353 24661 raft_consensus.cc:729] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
W20260811 16:08:32.988394 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 47891.8us
I20260811 16:08:33.035859 24661 consensus_queue.cc:260] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.040860 24661 ts_tablet_manager.cc:1428] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260811 16:08:33.045132 24663 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:33.045733 24663 ts_tablet_manager.cc:1397] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.006s
I20260811 16:08:33.047839 24665 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:33.048390 24665 ts_tablet_manager.cc:1397] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.007s
I20260811 16:08:33.048274 24572 leader_election.cc:302] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:33.051367 24665 raft_consensus.cc:348] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.052136 24665 raft_consensus.cc:374] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.052923 24665 raft_consensus.cc:729] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.053479 24708 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.056421 24607 raft_consensus.cc:2454] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:33.057278 24661 tablet_bootstrap.cc:492] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:33.058097 24606 raft_consensus.cc:2454] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:33.053603 24665 consensus_queue.cc:260] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.055450 24754 raft_consensus.cc:2781] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.059360 24754 raft_consensus.cc:482] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.059716 24754 raft_consensus.cc:3037] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.061043 24662 tablet_bootstrap.cc:654] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.060488 24665 ts_tablet_manager.cc:1428] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260811 16:08:33.075237 24665 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:33.076195 24238 catalog_manager.cc:5495] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
W20260811 16:08:33.077854 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 48927.7us
I20260811 16:08:33.078372 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.082366 24402 leader_election.cc:302] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:33.077196 24754 raft_consensus.cc:504] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.083837 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:33.092080 24755 raft_consensus.cc:2781] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:33.086437 24663 raft_consensus.cc:348] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.093654 24755 raft_consensus.cc:686] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:33.093743 24663 raft_consensus.cc:374] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.094215 24663 raft_consensus.cc:729] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.094515 24754 leader_election.cc:288] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:33.090579 24697 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.095471 24606 raft_consensus.cc:2379] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:33.094939 24663 consensus_queue.cc:260] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.095335 24697 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.096459 24661 tablet_bootstrap.cc:654] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.097553 24697 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.097708 24663 ts_tablet_manager.cc:1428] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260811 16:08:33.098222 24440 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:33.098846 24663 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:33.099320 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:33.102494 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:33.102802 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.102910 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:33.103250 24521 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:33.103672 24520 raft_consensus.cc:3037] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:33.104509 24402 leader_election.cc:341] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.104897 24485 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:33.105358 24663 tablet_bootstrap.cc:654] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.105569 24402 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:33.094624 24755 consensus_queue.cc:237] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.107746 24769 raft_consensus.cc:2781] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.108170 24769 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.108495 24769 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.110095 24755 raft_consensus.cc:2781] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.110656 24755 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.111033 24755 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.101301 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.117504 24769 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.146783 24661 tablet_bootstrap.cc:492] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
W20260811 16:08:33.125921 24572 leader_election.cc:341] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.148649 24755 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.134162 24237 catalog_manager.cc:5495] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:33.152638 24662 tablet_bootstrap.cc:492] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:33.158999 24662 ts_tablet_manager.cc:1397] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.006s
I20260811 16:08:33.120088 24485 leader_election.cc:302] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:33.158331 24661 ts_tablet_manager.cc:1397] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.009s
W20260811 16:08:33.160487 24485 leader_election.cc:341] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.160815 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:33.162286 24661 raft_consensus.cc:348] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.163070 24661 raft_consensus.cc:374] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.163349 24661 raft_consensus.cc:729] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.163995 24661 consensus_queue.cc:260] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.144613 24665 tablet_bootstrap.cc:654] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.169186 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:33.173203 24521 raft_consensus.cc:2379] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:33.174556 24769 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.166960 24662 raft_consensus.cc:348] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.114694 24520 raft_consensus.cc:2454] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:33.175977 24662 raft_consensus.cc:374] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.176265 24843 raft_consensus.cc:2726] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.176373 24662 raft_consensus.cc:729] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:33.176625 24402 leader_election.cc:341] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.177168 24402 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:33.178050 24697 raft_consensus.cc:2726] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.167852 24755 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.179447 24572 leader_election.cc:302] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:33.180728 24754 raft_consensus.cc:2781] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:33.181232 24754 raft_consensus.cc:686] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:33.182129 24754 consensus_queue.cc:237] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.182906 24662 consensus_queue.cc:260] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.168563 24235 catalog_manager.cc:5495] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:33.185073 24662 ts_tablet_manager.cc:1428] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260811 16:08:33.186017 24662 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:33.188316 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:33.189250 24440 raft_consensus.cc:2379] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:33.190393 24661 ts_tablet_manager.cc:1428] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260811 16:08:33.191715 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:33.199656 24661 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
W20260811 16:08:33.200734 24485 leader_election.cc:341] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.203037 24485 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:33.205966 24843 raft_consensus.cc:2726] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.212224 24662 tablet_bootstrap.cc:654] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.209017 24661 tablet_bootstrap.cc:654] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.216192 24234 catalog_manager.cc:5495] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:33.222668 24662 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:33.223470 24662 ts_tablet_manager.cc:1397] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260811 16:08:33.227258 24662 raft_consensus.cc:348] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.228286 24662 raft_consensus.cc:374] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.228634 24662 raft_consensus.cc:729] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.229697 24662 consensus_queue.cc:260] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.230898 24753 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.231485 24753 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.232976 24662 ts_tablet_manager.cc:1428] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260811 16:08:33.233660 24753 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:33.234537 24662 tablet_bootstrap.cc:492] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:33.236858 24663 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:33.237401 24663 ts_tablet_manager.cc:1397] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.010s
I20260811 16:08:33.237843 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.237973 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:33.238731 24440 raft_consensus.cc:2454] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:33.240635 24314 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
W20260811 16:08:33.242234 24314 leader_election.cc:341] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.243353 24753 raft_consensus.cc:2781] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.243801 24753 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.244140 24753 raft_consensus.cc:3037] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.252565 24662 tablet_bootstrap.cc:654] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.255528 24753 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.258829 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
W20260811 16:08:33.260466 24314 leader_election.cc:341] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.262539 24663 raft_consensus.cc:348] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.263701 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:33.264165 24663 raft_consensus.cc:374] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.264384 24440 raft_consensus.cc:3037] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.264515 24663 raft_consensus.cc:729] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.267980 24665 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:33.268529 24665 ts_tablet_manager.cc:1397] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.194s	user 0.022s	sys 0.026s
I20260811 16:08:33.270103 24662 tablet_bootstrap.cc:492] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:33.270648 24662 ts_tablet_manager.cc:1397] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.002s
I20260811 16:08:33.271358 24665 raft_consensus.cc:348] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.272119 24665 raft_consensus.cc:374] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.272401 24665 raft_consensus.cc:729] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
W20260811 16:08:33.273209 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:33.273036 24665 consensus_queue.cc:260] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.265345 24663 consensus_queue.cc:260] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.274690 24440 raft_consensus.cc:2454] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:33.275336 24665 ts_tablet_manager.cc:1428] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260811 16:08:33.276778 24665 tablet_bootstrap.cc:492] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:33.277408 24661 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:33.277925 24661 ts_tablet_manager.cc:1397] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.001s
I20260811 16:08:33.279771 24843 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.280295 24843 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.282543 24843 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.282539 24665 tablet_bootstrap.cc:654] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.284070 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:33.286047 24485 leader_election.cc:341] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.287658 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.273406 24662 raft_consensus.cc:348] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.289418 24314 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:33.289688 24662 raft_consensus.cc:374] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.290163 24662 raft_consensus.cc:729] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.290534 24702 raft_consensus.cc:2781] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:33.291118 24702 raft_consensus.cc:686] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:33.291234 24663 ts_tablet_manager.cc:1428] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260811 16:08:33.292069 24702 consensus_queue.cc:237] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.292761 24663 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:33.296440 24665 tablet_bootstrap.cc:492] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:33.296972 24665 ts_tablet_manager.cc:1397] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
W20260811 16:08:33.297564 24485 leader_election.cc:341] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.298055 24485 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:33.298900 24843 raft_consensus.cc:2726] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.299463 24661 raft_consensus.cc:348] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.300247 24661 raft_consensus.cc:374] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.300527 24661 raft_consensus.cc:729] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.300536 24665 raft_consensus.cc:348] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.301477 24665 raft_consensus.cc:374] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.301908 24665 raft_consensus.cc:729] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.301295 24753 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:33.302219 24661 consensus_queue.cc:260] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.303237 24662 consensus_queue.cc:260] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.304857 24661 ts_tablet_manager.cc:1428] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260811 16:08:33.306133 24661 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:33.303238 24665 consensus_queue.cc:260] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.313850 24665 ts_tablet_manager.cc:1428] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260811 16:08:33.314996 24665 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:33.315296 24755 raft_consensus.cc:482] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.315933 24661 tablet_bootstrap.cc:654] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.315994 24755 raft_consensus.cc:504] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.318353 24755 leader_election.cc:288] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.321020 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:33.322278 24665 tablet_bootstrap.cc:654] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.322547 24520 raft_consensus.cc:2379] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:33.321504 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309d4038e85243428daa2e934595bbb4" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.326175 24402 leader_election.cc:302] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:33.327839 24755 raft_consensus.cc:3037] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.334493 24702 consensus_queue.cc:1035] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.344532 24821 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.345461 24821 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.351243 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.355054 24821 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:33.355334 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:33.356230 24440 raft_consensus.cc:2379] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:33.357800 24572 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:33.362353 24821 raft_consensus.cc:3037] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.358469 24662 ts_tablet_manager.cc:1428] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.004s
I20260811 16:08:33.370313 24662 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:33.390507 24755 raft_consensus.cc:2726] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.391088 24821 raft_consensus.cc:2726] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.394217 24754 raft_consensus.cc:482] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.401443 24702 consensus_queue.cc:1035] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:33.400766 24234 catalog_manager.cc:5495] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:33.401111 24754 raft_consensus.cc:504] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.404457 24663 tablet_bootstrap.cc:654] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.409183 24665 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:33.409724 24665 ts_tablet_manager.cc:1397] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.095s	user 0.039s	sys 0.051s
I20260811 16:08:33.409857 24754 leader_election.cc:288] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:33.412698 24665 raft_consensus.cc:348] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.413491 24665 raft_consensus.cc:374] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.413475 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2929ec9e5b4864b79c28c24ccb7646" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:33.414026 24665 raft_consensus.cc:729] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.414350 24440 raft_consensus.cc:2454] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:33.414927 24665 consensus_queue.cc:260] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.414861 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2929ec9e5b4864b79c28c24ccb7646" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:33.416765 24572 leader_election.cc:302] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:33.417007 24665 ts_tablet_manager.cc:1428] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260811 16:08:33.417862 24572 leader_election.cc:341] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.418205 24665 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:33.419232 24754 raft_consensus.cc:2781] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.420341 24754 raft_consensus.cc:482] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.420944 24754 raft_consensus.cc:3037] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.421829 24662 tablet_bootstrap.cc:654] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.428826 24755 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.429466 24755 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.438388 24755 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.440516 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:33.442361 24402 leader_election.cc:341] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.443610 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.446440 24821 raft_consensus.cc:482] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.447018 24821 raft_consensus.cc:504] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:33.448572 24402 leader_election.cc:341] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.449211 24821 leader_election.cc:288] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.453917 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.454846 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:33.455060 24357 raft_consensus.cc:2454] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:33.460935 24843 consensus_queue.cc:1035] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.449128 24402 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:33.462426 24668 consensus_queue.cc:1035] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.462833 24521 raft_consensus.cc:2454] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:33.463122 24572 leader_election.cc:302] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:33.471431 24668 raft_consensus.cc:2781] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.472617 24668 raft_consensus.cc:482] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.472985 24668 raft_consensus.cc:3037] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.479290 24755 raft_consensus.cc:2726] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.483690 24661 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:33.484262 24661 ts_tablet_manager.cc:1397] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.178s	user 0.032s	sys 0.025s
I20260811 16:08:33.487351 24661 raft_consensus.cc:348] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.488328 24661 raft_consensus.cc:374] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.488677 24661 raft_consensus.cc:729] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.490200 24665 tablet_bootstrap.cc:654] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.490072 24661 consensus_queue.cc:260] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.497712 24754 raft_consensus.cc:504] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.500624 24663 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:33.504263 24663 ts_tablet_manager.cc:1397] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.212s	user 0.020s	sys 0.021s
I20260811 16:08:33.529511 24662 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:33.516450 24661 ts_tablet_manager.cc:1428] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260811 16:08:33.535132 24662 ts_tablet_manager.cc:1397] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.165s	user 0.019s	sys 0.028s
I20260811 16:08:33.536793 24663 raft_consensus.cc:348] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.537504 24663 raft_consensus.cc:374] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.537753 24663 raft_consensus.cc:729] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.529515 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2929ec9e5b4864b79c28c24ccb7646" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:33.528995 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2929ec9e5b4864b79c28c24ccb7646" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:33.539362 24438 raft_consensus.cc:3037] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.527462 24754 leader_election.cc:288] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:33.538373 24663 consensus_queue.cc:260] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.542804 24748 raft_consensus.cc:482] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.547078 24661 tablet_bootstrap.cc:492] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:33.548952 24663 ts_tablet_manager.cc:1428] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260811 16:08:33.548348 24748 raft_consensus.cc:504] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:33.550407 24572 leader_election.cc:341] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.553175 24755 consensus_queue.cc:1035] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.553895 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:33.556198 24662 raft_consensus.cc:348] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.556748 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.557785 24354 raft_consensus.cc:3037] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.558782 24663 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:33.560595 24314 leader_election.cc:302] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
W20260811 16:08:33.564419 24485 consensus_peers.cc:487] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:33.557017 24662 raft_consensus.cc:374] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.567626 24662 raft_consensus.cc:729] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.568501 24662 consensus_queue.cc:260] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.572382 24662 ts_tablet_manager.cc:1428] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260811 16:08:33.574978 24668 raft_consensus.cc:504] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.577828 24668 leader_election.cc:288] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.583436 24663 tablet_bootstrap.cc:654] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.583850 24662 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:33.552668 24748 leader_election.cc:288] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:33.590602 24662 tablet_bootstrap.cc:654] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.604835 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:33.605801 24521 raft_consensus.cc:3037] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.618700 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:33.619813 24357 raft_consensus.cc:3037] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.633948 24754 consensus_queue.cc:1035] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.677820 24438 raft_consensus.cc:2454] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:33.678206 24668 consensus_queue.cc:1035] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.679980 24572 leader_election.cc:302] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:33.682720 24754 raft_consensus.cc:2781] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:33.695269 24357 raft_consensus.cc:2454] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:33.712951 24521 raft_consensus.cc:2454] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:33.719026 24523 raft_consensus.cc:3037] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.720502 24661 tablet_bootstrap.cc:654] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.711809 24702 raft_consensus.cc:2726] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.740099 24700 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.753203 24665 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:33.753777 24665 ts_tablet_manager.cc:1397] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.336s	user 0.024s	sys 0.055s
I20260811 16:08:33.755970 24665 raft_consensus.cc:348] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:33.756647 24665 raft_consensus.cc:374] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.756851 24665 raft_consensus.cc:729] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.726279 24572 leader_election.cc:302] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:33.757395 24665 consensus_queue.cc:260] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:33.760831 24663 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:33.757884 24700 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.761420 24663 ts_tablet_manager.cc:1397] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.022s
I20260811 16:08:33.762820 24700 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.749372 24708 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.764520 24754 raft_consensus.cc:686] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:33.766535 24663 raft_consensus.cc:348] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:33.771119 24663 raft_consensus.cc:374] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.771489 24663 raft_consensus.cc:729] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.765738 24821 raft_consensus.cc:2781] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:33.777340 24663 consensus_queue.cc:260] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:33.779683 24665 ts_tablet_manager.cc:1428] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260811 16:08:33.782112 24662 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:33.784049 24662 ts_tablet_manager.cc:1397] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.200s	user 0.025s	sys 0.040s
I20260811 16:08:33.781569 24821 raft_consensus.cc:686] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:33.791644 24663 ts_tablet_manager.cc:1428] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260811 16:08:33.796208 24665 tablet_bootstrap.cc:492] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:33.770450 24708 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.786567 24754 consensus_queue.cc:237] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.803391 24663 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:33.787941 24668 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.815352 24668 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.817533 24668 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.818123 24668 consensus_queue.cc:1035] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:33.804337 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:33.787714 24821 consensus_queue.cc:237] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.819694 24521 raft_consensus.cc:2454] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:33.808981 24702 consensus_queue.cc:1035] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.824303 24753 consensus_queue.cc:1035] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.810788 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.810842 24708 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.812153 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.813362 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.829800 24606 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:33.829864 24314 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
W20260811 16:08:33.830482 24485 leader_election.cc:341] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.833209 24661 tablet_bootstrap.cc:492] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:33.832594 24662 raft_consensus.cc:348] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:33.833724 24662 raft_consensus.cc:374] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.834117 24662 raft_consensus.cc:729] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.833746 24661 ts_tablet_manager.cc:1397] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.288s	user 0.015s	sys 0.013s
I20260811 16:08:33.838387 24662 consensus_queue.cc:260] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:33.835882 24702 raft_consensus.cc:2781] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.840543 24702 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.841006 24702 raft_consensus.cc:3037] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.842324 24843 raft_consensus.cc:482] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.842893 24843 raft_consensus.cc:504] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.844491 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:33.845312 24520 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:33.847955 24662 ts_tablet_manager.cc:1428] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260811 16:08:33.848618 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d054ecff344a15bd66eb316fcc28e1" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:33.849154 24662 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:33.855314 24843 leader_election.cc:288] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:33.858023 24665 tablet_bootstrap.cc:654] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.863242 24881 consensus_queue.cc:1035] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:33.863966 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.866806 24661 raft_consensus.cc:348] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.868345 24661 raft_consensus.cc:374] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:33.868635 24661 raft_consensus.cc:729] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:33.869361 24661 consensus_queue.cc:260] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:33.874101 24572 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
W20260811 16:08:33.874421 24314 leader_election.cc:341] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.875957 24663 tablet_bootstrap.cc:654] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.883080 24661 ts_tablet_manager.cc:1428] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
W20260811 16:08:33.884691 24572 leader_election.cc:341] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.874104 24485 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:33.876906 24668 raft_consensus.cc:2781] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.890883 24661 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:33.888408 24668 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.902153 24236 catalog_manager.cc:5495] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:33.895043 24843 raft_consensus.cc:2781] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:33.916715 24843 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.917101 24843 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.918586 24708 raft_consensus.cc:482] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.919186 24708 raft_consensus.cc:504] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.903524 24668 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:33.921309 24708 leader_election.cc:288] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.924010 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:33.927789 24485 leader_election.cc:341] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.929975 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d054ecff344a15bd66eb316fcc28e1" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.930560 24755 raft_consensus.cc:482] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:33.931252 24755 raft_consensus.cc:504] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:33.882772 24702 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:33.947045 24662 tablet_bootstrap.cc:654] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.942028 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.954972 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:33.937086 24755 leader_election.cc:288] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:33.957507 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:33.958341 24357 raft_consensus.cc:2454] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:33.960181 24485 leader_election.cc:302] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:33.965229 24661 tablet_bootstrap.cc:654] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:33.966522 24402 leader_election.cc:302] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:33.968767 24755 raft_consensus.cc:2781] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 16:08:33.968858 24402 leader_election.cc:341] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:33.971845 24485 leader_election.cc:341] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:33.972355 24485 leader_election.cc:302] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:33.973095 24772 raft_consensus.cc:2726] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:33.975512 24769 raft_consensus.cc:2726] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:33.969306 24755 raft_consensus.cc:482] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:33.982324 24755 raft_consensus.cc:3037] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.006181 24237 catalog_manager.cc:5495] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:33.998641 24668 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.018566 24665 tablet_bootstrap.cc:492] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.025033 24665 ts_tablet_manager.cc:1397] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.235s	user 0.023s	sys 0.031s
I20260811 16:08:34.027451 24702 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:34.028086 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:34.029536 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:34.030894 24668 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:34.031224 24314 leader_election.cc:341] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.033340 24665 raft_consensus.cc:348] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.034071 24665 raft_consensus.cc:374] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.034371 24665 raft_consensus.cc:729] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.036439 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:34.036868 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:34.037541 24523 raft_consensus.cc:3037] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.037708 24843 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.042248 24661 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:34.042798 24661 ts_tablet_manager.cc:1397] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.153s	user 0.023s	sys 0.023s
I20260811 16:08:34.044076 24520 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:34.044796 24843 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:34.045828 24572 leader_election.cc:341] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.046793 24572 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:34.048633 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:34.049434 24606 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:34.050338 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:34.052136 24755 raft_consensus.cc:504] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.053265 24523 raft_consensus.cc:2454] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
W20260811 16:08:34.053730 24485 leader_election.cc:341] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.053862 24665 consensus_queue.cc:260] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.055873 24700 raft_consensus.cc:482] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.056694 24700 raft_consensus.cc:504] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.057531 24754 raft_consensus.cc:2726] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.059648 24881 raft_consensus.cc:482] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.060222 24881 raft_consensus.cc:504] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.062623 24881 leader_election.cc:288] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.063674 24665 ts_tablet_manager.cc:1428] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260811 16:08:34.064172 24662 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.064689 24662 ts_tablet_manager.cc:1397] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.005s
I20260811 16:08:34.064811 24665 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.067378 24662 raft_consensus.cc:348] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.068135 24662 raft_consensus.cc:374] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.068390 24662 raft_consensus.cc:729] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.068681 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.071215 24663 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:34.071794 24663 ts_tablet_manager.cc:1397] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.269s	user 0.012s	sys 0.005s
I20260811 16:08:34.072275 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.073571 24748 raft_consensus.cc:482] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.074183 24755 leader_election.cc:288] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:34.074111 24748 raft_consensus.cc:504] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.073621 24661 raft_consensus.cc:348] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.075515 24661 raft_consensus.cc:374] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.075781 24661 raft_consensus.cc:729] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.076327 24748 leader_election.cc:288] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.076534 24661 consensus_queue.cc:260] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.078987 24661 ts_tablet_manager.cc:1428] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260811 16:08:34.080040 24661 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
W20260811 16:08:34.080727 24402 leader_election.cc:341] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:34.086220 24402 leader_election.cc:341] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.086668 24402 leader_election.cc:302] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:34.087431 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.081506 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:34.088109 24438 raft_consensus.cc:2454] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:34.088363 24354 raft_consensus.cc:3037] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.058913 24700 leader_election.cc:288] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.055264 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:34.083498 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.085151 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.085005 24662 consensus_queue.cc:260] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.093380 24665 tablet_bootstrap.cc:654] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.092226 24881 raft_consensus.cc:2726] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.100205 24485 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
W20260811 16:08:34.100440 24402 leader_election.cc:341] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.102118 24708 raft_consensus.cc:2726] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.103220 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.103957 24523 raft_consensus.cc:2454] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:34.112222 24661 tablet_bootstrap.cc:654] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.100369 24314 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:34.115545 24314 leader_election.cc:302] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.119540 24663 raft_consensus.cc:348] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.120118 24663 raft_consensus.cc:374] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.120355 24663 raft_consensus.cc:729] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.121233 24662 ts_tablet_manager.cc:1428] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260811 16:08:34.119069 24700 raft_consensus.cc:2781] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.121757 24702 raft_consensus.cc:2781] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.122200 24702 raft_consensus.cc:482] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.122566 24702 raft_consensus.cc:3037] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.122627 24662 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.122628 24700 raft_consensus.cc:686] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:34.127209 24700 consensus_queue.cc:237] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.129024 24662 tablet_bootstrap.cc:654] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.129849 24663 consensus_queue.cc:260] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.140211 24663 ts_tablet_manager.cc:1428] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260811 16:08:34.139791 24702 raft_consensus.cc:504] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.143023 24354 raft_consensus.cc:2454] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
W20260811 16:08:34.145879 24314 leader_election.cc:341] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.149370 24663 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:34.151350 24702 leader_election.cc:288] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.151980 24234 catalog_manager.cc:5495] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:34.156059 24440 raft_consensus.cc:3037] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.157217 24662 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.157745 24662 ts_tablet_manager.cc:1397] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.010s
I20260811 16:08:34.159487 24665 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.160006 24665 ts_tablet_manager.cc:1397] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.003s
I20260811 16:08:34.160499 24662 raft_consensus.cc:348] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.161296 24662 raft_consensus.cc:374] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.161556 24662 raft_consensus.cc:729] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.162452 24662 consensus_queue.cc:260] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.165344 24755 raft_consensus.cc:482] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.166168 24662 ts_tablet_manager.cc:1428] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260811 16:08:34.167307 24662 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.165808 24755 raft_consensus.cc:504] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.171563 24755 leader_election.cc:288] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.173121 24662 tablet_bootstrap.cc:654] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.162802 24665 raft_consensus.cc:348] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.176892 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.177675 24357 raft_consensus.cc:2454] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:34.179563 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.177165 24665 raft_consensus.cc:374] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.180464 24665 raft_consensus.cc:729] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.181282 24402 leader_election.cc:302] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.182305 24881 raft_consensus.cc:2781] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.182693 24881 raft_consensus.cc:482] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.183035 24881 raft_consensus.cc:3037] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.183470 24665 consensus_queue.cc:260] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.184623 24520 raft_consensus.cc:2454] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:34.188345 24402 leader_election.cc:302] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:34.189709 24755 raft_consensus.cc:2781] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.190478 24755 raft_consensus.cc:686] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:34.191566 24755 consensus_queue.cc:237] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.192823 24668 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.193357 24668 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.194403 24881 raft_consensus.cc:504] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.195511 24663 tablet_bootstrap.cc:654] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.196295 24668 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.197799 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:34.198498 24355 raft_consensus.cc:3037] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.201517 24662 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.202471 24662 ts_tablet_manager.cc:1397] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260811 16:08:34.205520 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.206542 24523 raft_consensus.cc:2379] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:34.206470 24662 raft_consensus.cc:348] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.207350 24662 raft_consensus.cc:374] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.207616 24662 raft_consensus.cc:729] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.207779 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.208316 24662 consensus_queue.cc:260] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.208752 24438 raft_consensus.cc:2379] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:34.213259 24572 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:34.214151 24355 raft_consensus.cc:2454] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:34.214493 24668 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.221524 24665 ts_tablet_manager.cc:1428] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.002s
I20260811 16:08:34.222711 24665 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.226734 24402 leader_election.cc:302] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.228075 24754 consensus_queue.cc:1035] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:34.231106 24881 leader_election.cc:288] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:34.232095 24314 leader_election.cc:341] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.232339 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:34.232724 24661 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:34.233354 24661 ts_tablet_manager.cc:1397] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.003s
I20260811 16:08:34.233547 24668 raft_consensus.cc:2726] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.233016 24520 raft_consensus.cc:3037] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.230744 24755 raft_consensus.cc:2781] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.235450 24755 raft_consensus.cc:686] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:34.232596 24314 leader_election.cc:302] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:34.238379 24662 ts_tablet_manager.cc:1428] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260811 16:08:34.239660 24662 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.236346 24755 consensus_queue.cc:237] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.243227 24661 raft_consensus.cc:348] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.243940 24661 raft_consensus.cc:374] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.244201 24661 raft_consensus.cc:729] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.244211 24702 raft_consensus.cc:2726] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.244958 24661 consensus_queue.cc:260] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.247118 24661 ts_tablet_manager.cc:1428] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260811 16:08:34.252583 24754 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.253173 24754 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.255395 24754 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:34.255731 24662 tablet_bootstrap.cc:654] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.257272 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.260481 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.261324 24523 raft_consensus.cc:2379] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:34.264256 24572 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:34.265655 24754 raft_consensus.cc:3037] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.266882 24520 raft_consensus.cc:2454] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:34.269407 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:34.270404 24520 raft_consensus.cc:3037] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.271317 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:34.271971 24440 raft_consensus.cc:3037] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.291002 24661 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:34.276463 24880 consensus_queue.cc:1035] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260811 16:08:34.300642 24440 raft_consensus.cc:2454] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:34.303829 24754 raft_consensus.cc:2726] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.306821 24314 leader_election.cc:302] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.307054 24521 raft_consensus.cc:3037] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.307791 24700 raft_consensus.cc:2781] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.308314 24700 raft_consensus.cc:686] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:34.309173 24700 consensus_queue.cc:237] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.330276 24665 tablet_bootstrap.cc:654] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.332860 24663 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:34.336493 24662 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.342658 24663 ts_tablet_manager.cc:1397] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.194s	user 0.022s	sys 0.006s
I20260811 16:08:34.343554 24662 ts_tablet_manager.cc:1397] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.104s	user 0.022s	sys 0.003s
I20260811 16:08:34.338479 24520 raft_consensus.cc:2454] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:34.358592 24662 raft_consensus.cc:348] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.360036 24662 raft_consensus.cc:374] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.360359 24662 raft_consensus.cc:729] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.363471 24882 consensus_queue.cc:1035] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:34.370958 24663 raft_consensus.cc:348] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.372326 24663 raft_consensus.cc:374] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.372588 24663 raft_consensus.cc:729] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.366879 24662 consensus_queue.cc:260] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.374240 24885 raft_consensus.cc:482] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.374737 24885 raft_consensus.cc:504] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.377077 24885 leader_election.cc:288] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.379295 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe620493add749c5a27c9fa537836c4c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.382189 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe620493add749c5a27c9fa537836c4c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:34.382470 24402 leader_election.cc:341] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:34.383639 24402 leader_election.cc:341] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.384057 24402 leader_election.cc:302] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:34.387328 24881 raft_consensus.cc:2726] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.390027 24880 consensus_queue.cc:1035] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:34.394843 24662 ts_tablet_manager.cc:1428] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260811 16:08:34.373242 24663 consensus_queue.cc:260] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.396062 24661 tablet_bootstrap.cc:654] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.407341 24235 catalog_manager.cc:5495] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:34.409749 24235 catalog_manager.cc:5495] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:34.411305 24662 tablet_bootstrap.cc:492] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.413051 24663 ts_tablet_manager.cc:1428] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260811 16:08:34.414279 24236 catalog_manager.cc:5495] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:34.421146 24663 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:34.422467 24700 raft_consensus.cc:482] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.423049 24700 raft_consensus.cc:504] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.425248 24700 leader_election.cc:288] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.430190 24662 tablet_bootstrap.cc:654] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.438815 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.438536 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:34.456334 24665 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.456955 24665 ts_tablet_manager.cc:1397] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.234s	user 0.038s	sys 0.036s
I20260811 16:08:34.460037 24665 raft_consensus.cc:348] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.461067 24665 raft_consensus.cc:374] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.461400 24665 raft_consensus.cc:729] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
W20260811 16:08:34.463835 24314 leader_election.cc:341] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:34.464629 24314 leader_election.cc:341] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.465018 24314 leader_election.cc:302] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:34.468401 24748 raft_consensus.cc:2726] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.471913 24665 consensus_queue.cc:260] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.483682 24661 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:34.484241 24661 ts_tablet_manager.cc:1397] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.003s
I20260811 16:08:34.489390 24663 tablet_bootstrap.cc:654] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.488438 24661 raft_consensus.cc:348] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.490556 24661 raft_consensus.cc:374] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.490830 24661 raft_consensus.cc:729] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.491530 24661 consensus_queue.cc:260] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.494831 24661 ts_tablet_manager.cc:1428] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260811 16:08:34.497229 24665 ts_tablet_manager.cc:1428] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.001s
W20260811 16:08:34.504802 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:34.506389 24665 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.515172 24665 tablet_bootstrap.cc:654] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.524992 24700 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.525612 24700 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.528029 24661 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:34.537366 24700 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.541091 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.542402 24438 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:34.542649 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:34.543646 24606 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:34.545953 24662 tablet_bootstrap.cc:492] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.546835 24662 ts_tablet_manager.cc:1397] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.137s	user 0.009s	sys 0.026s
I20260811 16:08:34.546074 24314 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:34.552739 24662 raft_consensus.cc:348] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.554050 24662 raft_consensus.cc:374] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.554327 24748 raft_consensus.cc:2781] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.564563 24662 raft_consensus.cc:729] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.564724 24748 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.565131 24748 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.566726 24663 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:34.567276 24663 ts_tablet_manager.cc:1397] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.147s	user 0.022s	sys 0.028s
I20260811 16:08:34.565491 24662 consensus_queue.cc:260] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.570175 24663 raft_consensus.cc:348] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.570766 24662 ts_tablet_manager.cc:1428] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260811 16:08:34.570883 24663 raft_consensus.cc:374] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.560310 24665 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.571637 24665 ts_tablet_manager.cc:1397] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.012s
I20260811 16:08:34.564073 24661 tablet_bootstrap.cc:654] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.574631 24748 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.575419 24663 raft_consensus.cc:729] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.576251 24663 consensus_queue.cc:260] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.574582 24665 raft_consensus.cc:348] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.577085 24748 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.577129 24665 raft_consensus.cc:374] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.558718 24843 raft_consensus.cc:482] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.577917 24665 raft_consensus.cc:729] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.578145 24843 raft_consensus.cc:504] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.578742 24665 consensus_queue.cc:260] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.579943 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:34.580276 24843 leader_election.cc:288] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:34.580595 24440 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.581534 24665 ts_tablet_manager.cc:1428] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260811 16:08:34.581633 24662 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.584877 24663 ts_tablet_manager.cc:1428] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260811 16:08:34.586010 24663 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:34.587298 24665 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.579070 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:34.589722 24606 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.591775 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:34.594514 24485 leader_election.cc:341] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.588478 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:34.598030 24663 tablet_bootstrap.cc:654] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:34.599257 24485 leader_election.cc:341] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.599756 24485 leader_election.cc:302] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:34.600924 24843 raft_consensus.cc:2726] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.604005 24662 tablet_bootstrap.cc:654] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.607788 24665 tablet_bootstrap.cc:654] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.617982 24662 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.618532 24662 ts_tablet_manager.cc:1397] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.001s
I20260811 16:08:34.621289 24662 raft_consensus.cc:348] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.622115 24662 raft_consensus.cc:374] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.622391 24662 raft_consensus.cc:729] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.617998 24665 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.623765 24665 ts_tablet_manager.cc:1397] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260811 16:08:34.625161 24748 consensus_queue.cc:1035] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:34.626577 24665 raft_consensus.cc:348] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.636232 24665 raft_consensus.cc:374] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.636600 24665 raft_consensus.cc:729] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.637349 24665 consensus_queue.cc:260] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.628860 24662 consensus_queue.cc:260] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.640070 24662 ts_tablet_manager.cc:1428] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260811 16:08:34.641779 24662 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.641809 24661 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:34.642395 24663 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:34.642488 24661 ts_tablet_manager.cc:1397] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.115s	user 0.005s	sys 0.028s
I20260811 16:08:34.642972 24663 ts_tablet_manager.cc:1397] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.005s
I20260811 16:08:34.645787 24661 raft_consensus.cc:348] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.646893 24661 raft_consensus.cc:374] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.647709 24665 ts_tablet_manager.cc:1428] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260811 16:08:34.647586 24661 raft_consensus.cc:729] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.648801 24665 tablet_bootstrap.cc:492] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.649243 24661 consensus_queue.cc:260] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.651712 24606 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:34.655540 24665 tablet_bootstrap.cc:654] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.654309 24440 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:34.656623 24314 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:34.662714 24662 tablet_bootstrap.cc:654] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.663256 24748 raft_consensus.cc:2781] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.659580 24661 ts_tablet_manager.cc:1428] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260811 16:08:34.663980 24748 raft_consensus.cc:686] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:34.664760 24661 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:34.665072 24748 consensus_queue.cc:237] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.660104 24663 raft_consensus.cc:348] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.667315 24663 raft_consensus.cc:374] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.667632 24663 raft_consensus.cc:729] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.668318 24663 consensus_queue.cc:260] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.670498 24663 ts_tablet_manager.cc:1428] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.001s
I20260811 16:08:34.675853 24663 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:34.678975 24662 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.679772 24662 ts_tablet_manager.cc:1397] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.000s
I20260811 16:08:34.680831 24661 tablet_bootstrap.cc:654] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.687616 24662 raft_consensus.cc:348] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.688400 24662 raft_consensus.cc:374] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.688655 24662 raft_consensus.cc:729] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.689309 24662 consensus_queue.cc:260] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.691856 24663 tablet_bootstrap.cc:654] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.693333 24668 raft_consensus.cc:482] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.693888 24668 raft_consensus.cc:504] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.695042 24662 ts_tablet_manager.cc:1428] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260811 16:08:34.696013 24668 leader_election.cc:288] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.697001 24665 tablet_bootstrap.cc:492] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.697552 24665 ts_tablet_manager.cc:1397] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.009s
I20260811 16:08:34.699810 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.700739 24356 raft_consensus.cc:2379] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:34.701146 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.702584 24572 leader_election.cc:302] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:34.702819 24662 tablet_bootstrap.cc:492] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.703502 24668 raft_consensus.cc:3037] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.700297 24665 raft_consensus.cc:348] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.707422 24665 raft_consensus.cc:374] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.707772 24665 raft_consensus.cc:729] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.708640 24908 consensus_queue.cc:1035] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:34.708568 24665 consensus_queue.cc:260] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.710925 24665 ts_tablet_manager.cc:1428] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260811 16:08:34.712003 24665 tablet_bootstrap.cc:492] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.713227 24755 raft_consensus.cc:482] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.714051 24755 raft_consensus.cc:504] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.716810 24755 leader_election.cc:288] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.719545 24662 tablet_bootstrap.cc:654] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.720516 24663 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:34.721066 24663 ts_tablet_manager.cc:1397] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.005s
I20260811 16:08:34.721725 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef5b136564945f7ba5b1d391c91bb70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.722534 24521 raft_consensus.cc:2454] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:34.724022 24402 leader_election.cc:302] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.725802 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef5b136564945f7ba5b1d391c91bb70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.728355 24665 tablet_bootstrap.cc:654] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:34.728222 24402 leader_election.cc:341] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.729975 24755 raft_consensus.cc:2781] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.730997 24708 raft_consensus.cc:482] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.731565 24708 raft_consensus.cc:504] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.730847 24755 raft_consensus.cc:482] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.732604 24755 raft_consensus.cc:3037] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.733852 24708 leader_election.cc:288] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.736374 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.737150 24440 raft_consensus.cc:2454] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:34.738524 24485 leader_election.cc:302] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.739661 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.739785 24843 raft_consensus.cc:2781] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.740826 24843 raft_consensus.cc:482] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.741161 24843 raft_consensus.cc:3037] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.744470 24356 raft_consensus.cc:2454] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:34.745936 24700 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.746428 24700 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.740321 24708 raft_consensus.cc:482] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.747959 24708 raft_consensus.cc:504] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.748720 24700 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:34.750689 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:34.751597 24521 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:34.751448 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987b5e0c309049a9998fac1cc491a78c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.752174 24440 raft_consensus.cc:2454] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:34.753571 24485 leader_election.cc:302] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.744167 24237 catalog_manager.cc:5495] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:34.757890 24663 raft_consensus.cc:348] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.758728 24663 raft_consensus.cc:374] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.759001 24663 raft_consensus.cc:729] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.763912 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987b5e0c309049a9998fac1cc491a78c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:34.767086 24668 raft_consensus.cc:2726] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.778843 24885 consensus_queue.cc:1035] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:34.786717 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:34.788183 24609 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:34.750499 24708 leader_election.cc:288] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:34.791109 24708 raft_consensus.cc:2781] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.791622 24708 raft_consensus.cc:482] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.792068 24708 raft_consensus.cc:3037] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.803985 24663 consensus_queue.cc:260] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.802532 24843 raft_consensus.cc:504] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.750195 24755 raft_consensus.cc:504] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:34.807775 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 45605.9us
I20260811 16:08:34.820441 24843 leader_election.cc:288] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.827667 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef5b136564945f7ba5b1d391c91bb70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:34.828454 24521 raft_consensus.cc:3037] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.828794 24661 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:34.829392 24661 ts_tablet_manager.cc:1397] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.008s
I20260811 16:08:34.831929 24755 leader_election.cc:288] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:34.832887 24661 raft_consensus.cc:348] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.835052 24661 raft_consensus.cc:374] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.836136 24661 raft_consensus.cc:729] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.837634 24661 consensus_queue.cc:260] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:34.841599 24661 ts_tablet_manager.cc:1428] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260811 16:08:34.842765 24708 raft_consensus.cc:504] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.856639 24661 tablet_bootstrap.cc:492] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:34.816843 24314 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:34.861100 24663 ts_tablet_manager.cc:1428] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.140s	user 0.010s	sys 0.000s
I20260811 16:08:34.868216 24702 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.873040 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef5b136564945f7ba5b1d391c91bb70" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:34.876312 24663 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:34.884212 24663 tablet_bootstrap.cc:654] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.890017 24665 tablet_bootstrap.cc:492] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:34.890579 24665 ts_tablet_manager.cc:1397] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.179s	user 0.020s	sys 0.041s
W20260811 16:08:34.858058 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 103004us
I20260811 16:08:34.893702 24708 leader_election.cc:288] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:34.894582 24662 tablet_bootstrap.cc:492] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:34.895320 24662 ts_tablet_manager.cc:1397] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.193s	user 0.033s	sys 0.031s
I20260811 16:08:34.896519 24702 raft_consensus.cc:2726] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:34.890903 24521 raft_consensus.cc:2454] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:34.898839 24662 raft_consensus.cc:348] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:34.889431 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 75112us
I20260811 16:08:34.899893 24662 raft_consensus.cc:374] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.901467 24662 raft_consensus.cc:729] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.901645 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:34.902287 24440 raft_consensus.cc:3037] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.902192 24662 consensus_queue.cc:260] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:34.900929 24485 leader_election.cc:341] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.912490 24662 ts_tablet_manager.cc:1428] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260811 16:08:34.913548 24662 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:34.913013 24754 raft_consensus.cc:482] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.916178 24754 raft_consensus.cc:504] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.918242 24754 leader_election.cc:288] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:34.921813 24700 consensus_queue.cc:1035] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:34.922676 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:34.923436 24355 raft_consensus.cc:3037] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.912655 24665 raft_consensus.cc:348] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.925614 24665 raft_consensus.cc:374] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.925918 24665 raft_consensus.cc:729] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.927362 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:34.929102 24665 consensus_queue.cc:260] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:34.934037 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:34.934849 24357 raft_consensus.cc:2454] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
W20260811 16:08:34.936357 24572 leader_election.cc:341] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.940153 24572 leader_election.cc:302] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:34.940716 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987b5e0c309049a9998fac1cc491a78c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:34.945078 24441 raft_consensus.cc:3037] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.945618 24440 raft_consensus.cc:2454] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:34.948482 24485 leader_election.cc:302] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:34.950115 24708 raft_consensus.cc:2781] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.950645 24708 raft_consensus.cc:686] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:34.951524 24708 consensus_queue.cc:237] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.954388 24754 raft_consensus.cc:2781] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:34.954869 24754 raft_consensus.cc:482] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:34.959090 24754 raft_consensus.cc:3037] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:34.959265 24665 ts_tablet_manager.cc:1428] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.003s
I20260811 16:08:34.954833 24941 raft_consensus.cc:482] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:34.957901 24940 consensus_queue.cc:1035] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 16:08:34.961819 24881 consensus_queue.cc:1035] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260811 16:08:34.965416 24665 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:34.961057 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987b5e0c309049a9998fac1cc491a78c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
W20260811 16:08:34.983558 24485 leader_election.cc:341] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.984122 24663 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:34.984802 24663 ts_tablet_manager.cc:1397] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.001s
I20260811 16:08:34.985226 24754 raft_consensus.cc:504] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:34.988416 24663 raft_consensus.cc:348] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:34.989418 24663 raft_consensus.cc:374] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:34.989020 24700 consensus_queue.cc:1035] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:34.989760 24663 raft_consensus.cc:729] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:34.957633 24355 raft_consensus.cc:2454] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:34.974287 24441 raft_consensus.cc:2454] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:34.994167 24485 leader_election.cc:302] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:34.995805 24938 raft_consensus.cc:2781] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:34.996464 24938 raft_consensus.cc:686] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:34.997556 24938 consensus_queue.cc:237] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.000470 24881 raft_consensus.cc:482] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.001194 24881 raft_consensus.cc:504] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.004112 24881 leader_election.cc:288] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
W20260811 16:08:34.969138 24402 leader_election.cc:341] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:34.965085 24941 raft_consensus.cc:504] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.010084 24941 leader_election.cc:288] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:34.981331 24661 tablet_bootstrap.cc:654] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.981457 24662 tablet_bootstrap.cc:654] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:34.990712 24663 consensus_queue.cc:260] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.020583 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:35.021348 24355 raft_consensus.cc:3037] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.029266 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1e466e0e3c4e66bfb6943245f80682" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.029953 24402 leader_election.cc:302] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:35.026485 24754 leader_election.cc:288] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:35.030107 24523 raft_consensus.cc:2454] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:35.036480 24940 raft_consensus.cc:2781] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:35.037042 24940 raft_consensus.cc:686] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:35.037887 24940 consensus_queue.cc:237] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.040227 24941 consensus_queue.cc:1035] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:35.038923 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1e466e0e3c4e66bfb6943245f80682" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.050770 24236 catalog_manager.cc:5495] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:35.070256 24663 ts_tablet_manager.cc:1428] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.000s
I20260811 16:08:35.039557 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:35.080013 24402 leader_election.cc:302] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:35.082321 24355 raft_consensus.cc:2454] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:35.083882 24572 leader_election.cc:302] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:35.085024 24668 raft_consensus.cc:2781] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:35.085544 24668 raft_consensus.cc:686] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:35.086337 24668 consensus_queue.cc:237] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:35.087937 24572 leader_election.cc:341] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.095521 24665 tablet_bootstrap.cc:654] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.100013 24663 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:35.093420 24885 raft_consensus.cc:2781] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:35.106639 24885 raft_consensus.cc:482] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.107069 24885 raft_consensus.cc:3037] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.114711 24663 tablet_bootstrap.cc:654] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.134213 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.138959 24236 catalog_manager.cc:5495] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:35.150605 24661 tablet_bootstrap.cc:492] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:35.151902 24662 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:35.152379 24661 ts_tablet_manager.cc:1397] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.305s	user 0.018s	sys 0.020s
I20260811 16:08:35.152760 24940 raft_consensus.cc:482] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.154455 24700 raft_consensus.cc:482] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.158962 24700 raft_consensus.cc:504] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.161157 24661 raft_consensus.cc:348] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.166342 24661 raft_consensus.cc:374] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.155555 24234 catalog_manager.cc:5495] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:35.169740 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.152426 24662 ts_tablet_manager.cc:1397] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.239s	user 0.032s	sys 0.016s
I20260811 16:08:35.161933 24940 raft_consensus.cc:504] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.161525 24700 leader_election.cc:288] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:35.174888 24402 leader_election.cc:341] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:35.180596 24402 leader_election.cc:341] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.182523 24661 raft_consensus.cc:729] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.188383 24661 consensus_queue.cc:260] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.148181 24237 catalog_manager.cc:5495] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:35.190543 24662 raft_consensus.cc:348] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.192886 24662 raft_consensus.cc:374] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.193295 24661 ts_tablet_manager.cc:1428] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260811 16:08:35.193729 24662 raft_consensus.cc:729] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.194574 24662 consensus_queue.cc:260] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.201057 24755 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.201745 24668 raft_consensus.cc:482] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.201824 24940 leader_election.cc:288] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.201989 24755 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.202317 24668 raft_consensus.cc:504] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.205119 24662 ts_tablet_manager.cc:1428] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260811 16:08:35.205536 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.206233 24523 raft_consensus.cc:2454] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:35.207780 24572 leader_election.cc:302] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
W20260811 16:08:35.207957 24402 leader_election.cc:341] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.206269 24662 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:35.209715 24668 leader_election.cc:288] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.208678 24754 raft_consensus.cc:2781] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:35.214560 24661 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:35.214579 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c3f73ad35d4ef8863ea0ac5e2746e8" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:35.217557 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.216334 24755 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
W20260811 16:08:35.219664 24572 leader_election.cc:341] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.208513 24402 leader_election.cc:302] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:35.223696 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c3f73ad35d4ef8863ea0ac5e2746e8" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.217236 24754 raft_consensus.cc:482] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.225677 24754 raft_consensus.cc:3037] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:35.234948 24314 leader_election.cc:341] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.236969 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.237759 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.240679 24523 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:35.240936 24908 consensus_queue.cc:1035] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:35.238616 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.241775 24665 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:35.241914 24609 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:35.242349 24665 ts_tablet_manager.cc:1397] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.281s	user 0.010s	sys 0.013s
I20260811 16:08:35.218734 24885 raft_consensus.cc:504] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:35.240726 24314 leader_election.cc:341] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.243695 24662 tablet_bootstrap.cc:654] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.243867 24314 leader_election.cc:302] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:35.244655 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.245713 24661 tablet_bootstrap.cc:654] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.246519 24665 raft_consensus.cc:348] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.247272 24665 raft_consensus.cc:374] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.247555 24665 raft_consensus.cc:729] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.248220 24702 raft_consensus.cc:2726] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:08:35.248600 24402 leader_election.cc:341] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.249382 24402 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:35.253371 24941 raft_consensus.cc:2781] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:35.253774 24941 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.254122 24941 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:35.261111 24755 raft_consensus.cc:2726] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:35.278127 24663 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:35.277845 24754 raft_consensus.cc:504] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.278766 24663 ts_tablet_manager.cc:1397] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.002s
I20260811 16:08:35.248246 24665 consensus_queue.cc:260] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.284349 24754 leader_election.cc:288] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.289548 24665 ts_tablet_manager.cc:1428] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260811 16:08:35.282917 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:35.283190 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:35.291290 24523 raft_consensus.cc:3037] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:35.292584 24572 leader_election.cc:341] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.293756 24665 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:35.290316 24663 raft_consensus.cc:348] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.294438 24663 raft_consensus.cc:374] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.294878 24663 raft_consensus.cc:729] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.295989 24663 consensus_queue.cc:260] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.300093 24663 ts_tablet_manager.cc:1428] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260811 16:08:35.300875 24941 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.306306 24941 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:35.301620 24663 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:35.310225 24523 raft_consensus.cc:2454] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
W20260811 16:08:35.303375 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 54099.8us
I20260811 16:08:35.252512 24885 leader_election.cc:288] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:35.318706 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1e466e0e3c4e66bfb6943245f80682" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:35.319661 24521 raft_consensus.cc:3037] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:35.321321 24402 leader_election.cc:341] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.321866 24402 leader_election.cc:302] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:35.323491 24755 raft_consensus.cc:2726] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:35.325210 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:35.302168 24665 tablet_bootstrap.cc:654] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.326073 24520 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:35.329690 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:35.329744 24572 leader_election.cc:302] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:35.330711 24607 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:35.331615 24754 raft_consensus.cc:2781] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:35.332142 24754 raft_consensus.cc:686] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:35.332532 24663 tablet_bootstrap.cc:654] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.333078 24754 consensus_queue.cc:237] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.338430 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1e466e0e3c4e66bfb6943245f80682" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
W20260811 16:08:35.348456 24402 leader_election.cc:341] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.355373 24843 consensus_queue.cc:1035] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:35.360564 24843 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.361287 24843 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.364763 24668 raft_consensus.cc:482] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.365561 24668 raft_consensus.cc:504] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.368317 24668 leader_election.cc:288] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:35.368042 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:35.380950 24485 leader_election.cc:341] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.367291 24843 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.368914 24355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.370162 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987b5e0c309049a9998fac1cc491a78c" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:35.386072 24440 raft_consensus.cc:2379] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:35.370285 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987b5e0c309049a9998fac1cc491a78c" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.388371 24572 leader_election.cc:302] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
W20260811 16:08:35.389287 24485 leader_election.cc:341] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.389861 24668 raft_consensus.cc:3037] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.391382 24485 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:35.399415 24843 raft_consensus.cc:2726] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:35.408603 24668 raft_consensus.cc:2726] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:35.441390 24661 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:35.441716 24607 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:35.442085 24661 ts_tablet_manager.cc:1397] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.228s	user 0.039s	sys 0.063s
I20260811 16:08:35.443432 24402 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:35.444486 24941 raft_consensus.cc:2781] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:35.434165 24708 consensus_queue.cc:1035] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260811 16:08:35.445030 24941 raft_consensus.cc:686] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:35.446278 24941 consensus_queue.cc:237] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.445056 24661 raft_consensus.cc:348] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.448963 24661 raft_consensus.cc:374] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.449236 24661 raft_consensus.cc:729] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.449981 24661 consensus_queue.cc:260] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.451421 24521 raft_consensus.cc:2454] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:35.451749 24661 ts_tablet_manager.cc:1428] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260811 16:08:35.452903 24661 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:35.453039 24402 leader_election.cc:302] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:35.455430 24885 raft_consensus.cc:2781] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:35.456171 24885 raft_consensus.cc:686] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:35.457825 24885 consensus_queue.cc:237] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.468146 24663 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:35.469231 24663 ts_tablet_manager.cc:1397] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.168s	user 0.023s	sys 0.017s
I20260811 16:08:35.467265 24748 consensus_queue.cc:1035] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 16:08:35.484553 24520 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:35.491540 24661 tablet_bootstrap.cc:654] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.492283 24663 raft_consensus.cc:348] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.496338 24940 raft_consensus.cc:482] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.496912 24940 raft_consensus.cc:504] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.498996 24908 raft_consensus.cc:482] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.500913 24662 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:35.501648 24662 ts_tablet_manager.cc:1397] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.296s	user 0.050s	sys 0.069s
I20260811 16:08:35.499594 24908 raft_consensus.cc:504] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.504429 24908 leader_election.cc:288] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:35.506623 24755 consensus_queue.cc:1035] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:35.507383 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.509531 24663 raft_consensus.cc:374] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.510061 24663 raft_consensus.cc:729] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.512399 24663 consensus_queue.cc:260] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.518147 24665 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:35.519047 24665 ts_tablet_manager.cc:1397] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.226s	user 0.020s	sys 0.031s
I20260811 16:08:35.533435 24843 consensus_queue.cc:1035] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 16:08:35.542238 24662 raft_consensus.cc:348] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.551102 24662 raft_consensus.cc:374] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.551558 24662 raft_consensus.cc:729] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.555471 24663 ts_tablet_manager.cc:1428] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260811 16:08:35.559371 24663 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:35.559123 24662 consensus_queue.cc:260] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.549793 24940 leader_election.cc:288] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.588027 24755 raft_consensus.cc:482] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.594942 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.595991 24354 raft_consensus.cc:2379] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:35.596145 24356 raft_consensus.cc:3037] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.594965 24755 raft_consensus.cc:504] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.605867 24755 leader_election.cc:288] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:35.606710 24235 catalog_manager.cc:5495] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:35.608547 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c3f73ad35d4ef8863ea0ac5e2746e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.608597 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c3f73ad35d4ef8863ea0ac5e2746e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.609354 24358 raft_consensus.cc:2454] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
W20260811 16:08:35.610945 24402 leader_election.cc:341] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.600134 24700 raft_consensus.cc:482] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.617022 24700 raft_consensus.cc:504] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.618921 24843 consensus_queue.cc:1035] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:35.582926 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 63541.6us
I20260811 16:08:35.632203 24402 leader_election.cc:302] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:35.634349 24402 leader_election.cc:302] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:35.632391 24700 leader_election.cc:288] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:35.637406 24754 consensus_queue.cc:1035] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:35.643841 24881 raft_consensus.cc:3037] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.641528 24755 raft_consensus.cc:2781] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:35.654203 24661 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:35.654852 24661 ts_tablet_manager.cc:1397] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.202s	user 0.029s	sys 0.021s
I20260811 16:08:35.650909 24755 raft_consensus.cc:482] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.658561 24755 raft_consensus.cc:3037] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.658370 24661 raft_consensus.cc:348] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.660949 24843 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.661641 24661 raft_consensus.cc:374] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.662257 24661 raft_consensus.cc:729] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.663126 24661 consensus_queue.cc:260] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.662343 24843 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.668674 24880 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.670130 24663 tablet_bootstrap.cc:654] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.669780 24880 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.673082 24880 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.677510 24665 raft_consensus.cc:348] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.665488 24661 ts_tablet_manager.cc:1428] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260811 16:08:35.678722 24665 raft_consensus.cc:374] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.679174 24665 raft_consensus.cc:729] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.680100 24665 consensus_queue.cc:260] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.677269 24843 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.692242 24662 ts_tablet_manager.cc:1428] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.190s	user 0.022s	sys 0.042s
I20260811 16:08:35.695816 24662 tablet_bootstrap.cc:492] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:35.697091 24661 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:35.683753 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.698694 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.700132 24665 ts_tablet_manager.cc:1428] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.180s	user 0.011s	sys 0.003s
I20260811 16:08:35.706802 24976 consensus_queue.cc:1035] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:35.693984 24880 raft_consensus.cc:482] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.700788 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.708030 24880 raft_consensus.cc:504] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.698784 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef5b136564945f7ba5b1d391c91bb70" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:35.700315 24607 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:35.710681 24356 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:35.726759 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:35.739519 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:35.739694 24356 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:35.740415 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:35.741508 24662 tablet_bootstrap.cc:654] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.742338 24972 raft_consensus.cc:482] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.743202 24880 leader_election.cc:288] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:35.742873 24972 raft_consensus.cc:504] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.701814 24521 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:35.745402 24972 leader_election.cc:288] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:35.747294 24485 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:35.748291 24938 raft_consensus.cc:2781] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:35.748700 24938 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.749024 24938 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:35.725569 24881 raft_consensus.cc:2726] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:35.774086 24661 tablet_bootstrap.cc:654] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.777838 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:35.778764 24356 raft_consensus.cc:2454] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
W20260811 16:08:35.779445 24973 log.cc:924] Time spent T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260811 16:08:35.783735 24572 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:35.802870 24665 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:35.794553 24754 raft_consensus.cc:2781] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:35.810982 24754 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.811551 24754 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:35.822227 24663 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:35.823582 24663 ts_tablet_manager.cc:1397] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.265s	user 0.032s	sys 0.035s
I20260811 16:08:35.827687 24663 raft_consensus.cc:348] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.828821 24663 raft_consensus.cc:374] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.829180 24663 raft_consensus.cc:729] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.830003 24663 consensus_queue.cc:260] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.838349 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef5b136564945f7ba5b1d391c91bb70" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.839608 24662 tablet_bootstrap.cc:492] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:35.840399 24662 ts_tablet_manager.cc:1397] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.145s	user 0.024s	sys 0.000s
I20260811 16:08:35.841281 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:35.844113 24662 raft_consensus.cc:348] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.845213 24572 leader_election.cc:302] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:35.845597 24662 raft_consensus.cc:374] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:35.846151 24662 raft_consensus.cc:729] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:35.847293 24662 consensus_queue.cc:260] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:35.857776 24663 ts_tablet_manager.cc:1428] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260811 16:08:35.842681 24755 raft_consensus.cc:504] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:35.846815 24520 raft_consensus.cc:2454] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:35.834338 24880 raft_consensus.cc:482] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:35.869736 24662 ts_tablet_manager.cc:1428] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.001s
I20260811 16:08:35.883949 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:35.904057 24235 catalog_manager.cc:5495] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 2, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:35.905966 24235 catalog_manager.cc:5495] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:35.910355 24665 tablet_bootstrap.cc:654] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.911533 24662 tablet_bootstrap.cc:492] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
W20260811 16:08:35.940394 24314 leader_election.cc:341] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:35.943907 24663 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:35.950148 24938 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:35.907655 24984 raft_consensus.cc:2781] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:35.959250 24314 leader_election.cc:302] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:35.876685 24880 raft_consensus.cc:504] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:35.958854 24984 raft_consensus.cc:482] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:35.996095 24662 tablet_bootstrap.cc:654] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:35.985293 24942 raft_consensus.cc:2726] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:08:35.992120 24983 log.cc:924] Time spent T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260811 16:08:35.985996 24984 raft_consensus.cc:3037] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:35.991926 24755 leader_election.cc:288] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:36.019407 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 60312us
W20260811 16:08:36.023697 24314 leader_election.cc:341] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.024364 24314 leader_election.cc:302] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:36.014465 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:36.037560 24519 raft_consensus.cc:1261] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:08:36.041561 24942 raft_consensus.cc:2726] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.042757 24938 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.043645 24610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:36.044320 24938 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.044755 24661 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:36.045303 24661 ts_tablet_manager.cc:1397] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.353s	user 0.016s	sys 0.006s
I20260811 16:08:36.046293 24517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c3f73ad35d4ef8863ea0ac5e2746e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:36.049481 24754 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.044902 24938 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.027872 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6c3f73ad35d4ef8863ea0ac5e2746e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
W20260811 16:08:36.078338 24402 leader_election.cc:341] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.083019 24661 raft_consensus.cc:348] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.083770 24661 raft_consensus.cc:374] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.083938 24661 raft_consensus.cc:729] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.084406 24661 consensus_queue.cc:260] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.074220 24755 consensus_queue.cc:1035] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260811 16:08:36.071604 24356 raft_consensus.cc:3037] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.085539 24663 tablet_bootstrap.cc:654] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.095794 24661 ts_tablet_manager.cc:1428] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.004s
I20260811 16:08:36.097728 24938 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.079646 24610 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 2: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:36.105880 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.106705 24520 raft_consensus.cc:2454] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:36.107564 24665 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:36.108253 24665 ts_tablet_manager.cc:1397] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.310s	user 0.017s	sys 0.018s
I20260811 16:08:36.110368 24314 leader_election.cc:302] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:36.111303 24665 raft_consensus.cc:348] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.116192 24665 raft_consensus.cc:374] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.116524 24665 raft_consensus.cc:729] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.117249 24665 consensus_queue.cc:260] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.073846 24976 consensus_queue.cc:1035] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260811 16:08:36.119431 24992 consensus_queue.cc:1035] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 16:08:36.120244 24665 ts_tablet_manager.cc:1428] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260811 16:08:36.124490 24984 raft_consensus.cc:504] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.125036 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.125773 24880 leader_election.cc:288] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.126541 24607 raft_consensus.cc:2379] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:36.125103 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.127341 24999 raft_consensus.cc:2781] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.127740 24754 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.127869 24999 raft_consensus.cc:482] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.128314 24999 raft_consensus.cc:3037] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.129454 24353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.127801 24357 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:36.131955 24609 raft_consensus.cc:1261] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260811 16:08:36.132676 24485 leader_election.cc:341] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.137748 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:36.145040 24356 raft_consensus.cc:2454] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:36.127324 24984 leader_election.cc:288] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:36.169900 24402 consensus_peers.cc:487] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 -> Peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Couldn't send request to peer 707f02c5118a4d798120ca9c5786ada6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:36.185695 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 78537us
I20260811 16:08:36.183235 24665 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:36.180930 24661 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:36.202883 24977 consensus_queue.cc:1035] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.203935 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:36.196449 24357 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
I20260811 16:08:36.210053 24662 tablet_bootstrap.cc:492] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:36.226191 24662 ts_tablet_manager.cc:1397] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.348s	user 0.033s	sys 0.032s
I20260811 16:08:36.213585 24402 leader_election.cc:302] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:36.217043 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:36.228307 24977 raft_consensus.cc:2781] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.217075 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.229060 24977 raft_consensus.cc:686] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:36.229327 24354 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 2: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:36.217108 24518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:36.230839 24518 raft_consensus.cc:2379] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 2: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:36.230340 24977 consensus_queue.cc:237] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.216640 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.221248 24665 tablet_bootstrap.cc:654] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.228467 24521 raft_consensus.cc:3037] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.240154 24661 tablet_bootstrap.cc:654] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.242748 24908 raft_consensus.cc:482] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.243355 24908 raft_consensus.cc:504] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.247641 24663 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:36.248265 24663 ts_tablet_manager.cc:1397] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.018s
I20260811 16:08:36.249543 24908 leader_election.cc:288] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.250464 24485 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.250747 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897e2cd688a14f478986d26de348fc3b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:36.251523 24663 raft_consensus.cc:348] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.252314 24663 raft_consensus.cc:374] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.252579 24663 raft_consensus.cc:729] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.253284 24663 consensus_queue.cc:260] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:36.254113 24314 leader_election.cc:341] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.255896 24985 raft_consensus.cc:2781] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:36.256683 24662 raft_consensus.cc:348] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.257557 24985 raft_consensus.cc:686] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:36.258706 24985 consensus_queue.cc:237] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.270533 24663 ts_tablet_manager.cc:1428] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260811 16:08:36.224277 24439 raft_consensus.cc:2454] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:36.151057 24999 raft_consensus.cc:504] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.279023 24999 leader_election.cc:288] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:36.282462 24356 raft_consensus.cc:2379] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
W20260811 16:08:36.221957 24572 leader_election.cc:341] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:36.285641 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 63732.5us
W20260811 16:08:36.289505 24572 consensus_peers.cc:487] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:36.257530 24662 raft_consensus.cc:374] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.292732 24662 raft_consensus.cc:729] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.293644 24662 consensus_queue.cc:260] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.287264 24663 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:36.285933 24518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:36.299208 24572 leader_election.cc:302] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.296738 24521 raft_consensus.cc:2454] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:36.312018 25001 raft_consensus.cc:2781] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.312465 25001 raft_consensus.cc:482] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.312808 25001 raft_consensus.cc:3037] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.315801 24662 ts_tablet_manager.cc:1428] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260811 16:08:36.316772 24661 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:36.317330 24661 ts_tablet_manager.cc:1397] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.202s	user 0.037s	sys 0.021s
I20260811 16:08:36.317097 24235 catalog_manager.cc:5495] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:36.320178 24661 raft_consensus.cc:348] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.320899 24661 raft_consensus.cc:374] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.321182 24661 raft_consensus.cc:729] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.321834 24661 consensus_queue.cc:260] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.323743 25002 consensus_queue.cc:1035] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.328857 24663 tablet_bootstrap.cc:654] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.330606 25001 raft_consensus.cc:504] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.331741 24661 ts_tablet_manager.cc:1428] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260811 16:08:36.332816 24661 tablet_bootstrap.cc:492] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:36.333470 25001 leader_election.cc:288] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.316955 24662 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:36.338691 24661 tablet_bootstrap.cc:654] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.340402 24662 tablet_bootstrap.cc:654] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.343508 24572 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.343914 24977 raft_consensus.cc:482] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.344624 24992 raft_consensus.cc:2726] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:08:36.344437 24977 raft_consensus.cc:504] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.345439 24665 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:36.346046 24665 ts_tablet_manager.cc:1397] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.018s
I20260811 16:08:36.346627 24977 leader_election.cc:288] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:36.359251 24661 tablet_bootstrap.cc:492] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:36.360296 24661 ts_tablet_manager.cc:1397] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.012s
I20260811 16:08:36.359217 24236 catalog_manager.cc:5495] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 2, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:36.361421 24662 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:36.361924 24662 ts_tablet_manager.cc:1397] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260811 16:08:36.364428 24662 raft_consensus.cc:348] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.364955 24662 raft_consensus.cc:374] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.365118 24662 raft_consensus.cc:729] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.346710 24572 leader_election.cc:302] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.365649 24662 consensus_queue.cc:260] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.355453 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fe7d941ae74b0ab5c504d9f556b073" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.366921 25002 raft_consensus.cc:2781] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.356987 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fe7d941ae74b0ab5c504d9f556b073" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:36.357333 24663 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:36.349680 24665 raft_consensus.cc:348] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.367851 24665 raft_consensus.cc:374] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.368001 24663 ts_tablet_manager.cc:1397] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.007s
I20260811 16:08:36.368165 24665 raft_consensus.cc:729] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.368747 24999 raft_consensus.cc:482] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.369539 24999 raft_consensus.cc:504] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.370841 24663 raft_consensus.cc:348] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.371595 24663 raft_consensus.cc:374] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.371670 24999 leader_election.cc:288] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:36.371948 24663 raft_consensus.cc:729] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.372594 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897e2cd688a14f478986d26de348fc3b" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:36.372675 24663 consensus_queue.cc:260] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.373634 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "296f5dafb30b436fa348884a38c18320" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:36.375051 24663 ts_tablet_manager.cc:1428] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260811 16:08:36.377871 24662 ts_tablet_manager.cc:1428] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
W20260811 16:08:36.375258 24485 leader_election.cc:341] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.378522 24485 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.378847 24662 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:36.377691 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.382254 24985 raft_consensus.cc:2726] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:08:36.382758 24314 leader_election.cc:341] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.375742 24992 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.367461 24661 raft_consensus.cc:348] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.377025 24663 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:36.383843 24992 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.375690 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:36.387559 24992 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.388947 24662 tablet_bootstrap.cc:654] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:36.388587 24314 leader_election.cc:341] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.389420 24314 leader_election.cc:302] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:36.390605 24972 raft_consensus.cc:2726] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.391849 24665 consensus_queue.cc:260] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.394181 24665 ts_tablet_manager.cc:1428] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260811 16:08:36.395118 24663 tablet_bootstrap.cc:654] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.395254 24665 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:36.383870 24661 raft_consensus.cc:374] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.398171 24661 raft_consensus.cc:729] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.398967 24661 consensus_queue.cc:260] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.367489 25002 raft_consensus.cc:686] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:36.400579 25002 consensus_queue.cc:237] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.401383 24661 ts_tablet_manager.cc:1428] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260811 16:08:36.402514 24661 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
W20260811 16:08:36.406500 24402 leader_election.cc:341] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:36.407367 24402 leader_election.cc:341] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.407791 24402 leader_election.cc:302] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.417100 24661 tablet_bootstrap.cc:654] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.423454 24881 raft_consensus.cc:2726] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.430392 24665 tablet_bootstrap.cc:654] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.431514 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.432317 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:36.432983 24440 raft_consensus.cc:3037] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:36.432998 24314 leader_election.cc:341] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.435623 24314 leader_election.cc:302] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:36.442679 24999 raft_consensus.cc:2726] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.432317 24520 raft_consensus.cc:2454] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:36.443579 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.446441 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.447100 24356 raft_consensus.cc:2454] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:36.449442 24984 raft_consensus.cc:482] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.449990 24984 raft_consensus.cc:504] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.452242 24984 leader_election.cc:288] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:08:36.453683 24572 leader_election.cc:341] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.463335 24572 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:36.467800 24668 raft_consensus.cc:2781] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.468240 24668 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.468622 24668 raft_consensus.cc:3037] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.468053 24440 raft_consensus.cc:2454] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:36.476438 24938 raft_consensus.cc:482] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.490218 24938 raft_consensus.cc:504] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.492275 24938 leader_election.cc:288] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.486752 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.494091 24663 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:36.494665 24663 ts_tablet_manager.cc:1397] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.016s
I20260811 16:08:36.497315 24663 raft_consensus.cc:348] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.498015 24663 raft_consensus.cc:374] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.498268 24663 raft_consensus.cc:729] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.498885 24663 consensus_queue.cc:260] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.500550 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:36.500813 24663 ts_tablet_manager.cc:1428] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260811 16:08:36.501397 24440 raft_consensus.cc:2454] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:36.501855 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe620493add749c5a27c9fa537836c4c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:36.502548 24439 raft_consensus.cc:2454] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:36.507167 24668 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.507658 24663 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:36.507793 24485 leader_election.cc:302] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:36.513865 24662 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:36.514423 24662 ts_tablet_manager.cc:1397] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.013s
I20260811 16:08:36.515503 24237 catalog_manager.cc:5495] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:36.517187 24314 leader_election.cc:302] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.518750 24748 raft_consensus.cc:2726] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.517139 24662 raft_consensus.cc:348] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.520675 24668 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.520684 24662 raft_consensus.cc:374] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.522080 24662 raft_consensus.cc:729] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:36.521890 24572 leader_election.cc:341] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.522868 24662 consensus_queue.cc:260] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.544503 24572 leader_election.cc:302] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.545887 24662 ts_tablet_manager.cc:1428] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260811 16:08:36.547060 24662 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:36.524315 24938 raft_consensus.cc:2781] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.550525 24938 raft_consensus.cc:482] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.552460 24572 leader_election.cc:302] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.553450 24668 raft_consensus.cc:2781] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.554040 24668 raft_consensus.cc:482] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.554451 24668 raft_consensus.cc:3037] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.551093 24754 raft_consensus.cc:2781] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.560058 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe620493add749c5a27c9fa537836c4c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.561122 24521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:36.561789 24521 raft_consensus.cc:3037] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.567193 24754 raft_consensus.cc:686] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:36.568125 24754 consensus_queue.cc:237] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.568712 24665 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:36.569214 24665 ts_tablet_manager.cc:1397] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.174s	user 0.031s	sys 0.019s
I20260811 16:08:36.569278 24663 tablet_bootstrap.cc:654] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.566299 24668 raft_consensus.cc:504] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.573048 24668 leader_election.cc:288] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:08:36.573525 24485 leader_election.cc:341] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.574429 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.576118 24665 raft_consensus.cc:348] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.577010 24665 raft_consensus.cc:374] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.577260 24665 raft_consensus.cc:729] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
W20260811 16:08:36.578183 24572 leader_election.cc:341] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.578620 24665 consensus_queue.cc:260] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.553426 24938 raft_consensus.cc:3037] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.578248 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:36.594846 24661 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:36.585892 24438 raft_consensus.cc:3037] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.595489 24661 ts_tablet_manager.cc:1397] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.193s	user 0.017s	sys 0.010s
I20260811 16:08:36.601857 24665 ts_tablet_manager.cc:1428] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260811 16:08:36.602833 24977 raft_consensus.cc:482] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.602993 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.604043 24356 raft_consensus.cc:3037] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.603781 24977 raft_consensus.cc:504] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.607823 24977 leader_election.cc:288] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.602025 24976 raft_consensus.cc:482] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.611415 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:36.611630 24976 raft_consensus.cc:504] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:36.617226 24402 leader_election.cc:341] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.621649 24976 leader_election.cc:288] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.626758 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.627736 24357 raft_consensus.cc:2454] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:36.628101 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897e2cd688a14f478986d26de348fc3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.629163 24358 raft_consensus.cc:2454] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:36.636888 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897e2cd688a14f478986d26de348fc3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:36.645745 24402 leader_election.cc:341] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.646725 24402 leader_election.cc:302] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.648219 24881 raft_consensus.cc:2781] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.648415 24402 leader_election.cc:302] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.649701 24885 raft_consensus.cc:2781] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.648662 24881 raft_consensus.cc:482] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.650130 24885 raft_consensus.cc:482] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.650393 24881 raft_consensus.cc:3037] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.650557 24885 raft_consensus.cc:3037] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:36.659816 25021 log.cc:924] Time spent T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260811 16:08:36.663268 24662 tablet_bootstrap.cc:654] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.662838 24881 raft_consensus.cc:504] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.665474 24881 leader_election.cc:288] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.667866 24665 tablet_bootstrap.cc:492] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:36.665369 24438 raft_consensus.cc:2454] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:36.676739 24885 raft_consensus.cc:504] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.692901 24572 leader_election.cc:302] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.689930 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
W20260811 16:08:36.697278 24402 leader_election.cc:341] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.698766 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.701530 24938 raft_consensus.cc:504] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.702518 24357 raft_consensus.cc:3037] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.684566 24356 raft_consensus.cc:2454] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:36.701512 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897e2cd688a14f478986d26de348fc3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:36.700850 24885 leader_election.cc:288] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:36.703418 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897e2cd688a14f478986d26de348fc3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.702421 24976 raft_consensus.cc:482] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.688027 24521 raft_consensus.cc:2454] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:36.705792 24572 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:36.706529 24663 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:36.708071 24663 ts_tablet_manager.cc:1397] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.014s
I20260811 16:08:36.708734 24986 raft_consensus.cc:2781] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.709286 24986 raft_consensus.cc:686] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:36.710120 24986 consensus_queue.cc:237] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.707650 24354 raft_consensus.cc:3037] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.712559 24663 raft_consensus.cc:348] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.713356 24663 raft_consensus.cc:374] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.713670 24663 raft_consensus.cc:729] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.714408 24663 consensus_queue.cc:260] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.719836 24665 tablet_bootstrap.cc:654] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.720470 25001 raft_consensus.cc:482] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.720978 25001 raft_consensus.cc:504] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:36.721382 24402 leader_election.cc:341] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.707598 24976 raft_consensus.cc:504] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.724962 25001 leader_election.cc:288] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:36.726046 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1e466e0e3c4e66bfb6943245f80682" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:36.726509 24518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.726970 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:36.728397 24402 leader_election.cc:341] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:36.729130 24402 leader_election.cc:341] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.729803 24402 leader_election.cc:302] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.731314 24881 raft_consensus.cc:2726] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.704120 24754 raft_consensus.cc:2781] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.729116 24663 ts_tablet_manager.cc:1428] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260811 16:08:36.736645 24663 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:36.737385 24234 catalog_manager.cc:5495] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:36.729703 24518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1e466e0e3c4e66bfb6943245f80682" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.741612 24661 raft_consensus.cc:348] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.742755 24661 raft_consensus.cc:374] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.743120 24661 raft_consensus.cc:729] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.745620 24661 consensus_queue.cc:260] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.748749 24754 raft_consensus.cc:686] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:36.749776 24754 consensus_queue.cc:237] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.740103 24976 leader_election.cc:288] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:36.753894 24572 leader_election.cc:302] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:36.760134 25001 raft_consensus.cc:2726] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:36.756729 24518 raft_consensus.cc:3037] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.765332 24665 tablet_bootstrap.cc:492] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:36.769868 24663 tablet_bootstrap.cc:654] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.770093 24665 ts_tablet_manager.cc:1397] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.003s
I20260811 16:08:36.754390 24354 raft_consensus.cc:2454] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:36.780083 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe620493add749c5a27c9fa537836c4c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:36.781385 24402 leader_election.cc:302] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
W20260811 16:08:36.782136 24485 leader_election.cc:341] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.786103 24662 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:36.786682 24662 ts_tablet_manager.cc:1397] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.240s	user 0.012s	sys 0.010s
I20260811 16:08:36.786936 24976 raft_consensus.cc:2781] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.787546 24938 leader_election.cc:288] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.787636 24976 raft_consensus.cc:686] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:36.788676 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe620493add749c5a27c9fa537836c4c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:36.790884 24438 raft_consensus.cc:3037] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.795993 24661 ts_tablet_manager.cc:1428] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.200s	user 0.006s	sys 0.002s
I20260811 16:08:36.788655 24976 consensus_queue.cc:237] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.798870 24885 consensus_queue.cc:1035] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.806397 24661 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:36.808452 25001 consensus_queue.cc:1035] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.811117 24357 raft_consensus.cc:2454] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:36.819418 24662 raft_consensus.cc:348] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.821965 24662 raft_consensus.cc:374] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.822397 24662 raft_consensus.cc:729] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.821372 24438 raft_consensus.cc:2454] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:36.824407 24485 leader_election.cc:302] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:36.825675 24938 raft_consensus.cc:2781] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.826289 24938 raft_consensus.cc:686] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:36.823201 24662 consensus_queue.cc:260] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.827311 24938 consensus_queue.cc:237] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.829267 24662 ts_tablet_manager.cc:1428] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.003s
I20260811 16:08:36.830379 24662 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:36.832620 24665 raft_consensus.cc:348] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.833490 24665 raft_consensus.cc:374] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:36.833788 24665 raft_consensus.cc:729] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:36.835355 24665 consensus_queue.cc:260] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:36.841750 24237 catalog_manager.cc:5495] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:36.845470 24402 leader_election.cc:302] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:36.845434 24237 catalog_manager.cc:5495] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:36.847645 24611 raft_consensus.cc:1261] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:08:36.852643 24234 catalog_manager.cc:5495] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:36.853760 24881 raft_consensus.cc:2781] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:36.854422 24881 raft_consensus.cc:686] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:36.855356 24881 consensus_queue.cc:237] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.858086 24985 consensus_queue.cc:1035] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:36.859133 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:36.864883 24665 ts_tablet_manager.cc:1428] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.001s
I20260811 16:08:36.866379 24665 tablet_bootstrap.cc:492] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:36.873150 24606 raft_consensus.cc:3037] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.878206 24661 tablet_bootstrap.cc:654] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.880062 24985 raft_consensus.cc:482] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.880699 24985 raft_consensus.cc:504] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:36.884824 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:36.886488 24485 leader_election.cc:341] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:36.887380 24748 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.887961 24748 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:36.890106 24748 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:36.896243 24665 tablet_bootstrap.cc:654] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.896615 24518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:36.897423 24518 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:36.900568 24314 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:36.883003 24985 leader_election.cc:288] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.901820 24748 raft_consensus.cc:2781] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.904253 24662 tablet_bootstrap.cc:654] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:36.902259 24748 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.907538 24748 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.912688 24354 raft_consensus.cc:1261] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260811 16:08:36.914319 25028 log.cc:924] Time spent T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260811 16:08:36.914709 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:36.916906 24607 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:36.918087 24985 consensus_queue.cc:1035] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.921996 24885 consensus_queue.cc:1035] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.922333 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:36.923059 24358 raft_consensus.cc:2454] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:36.927636 24485 leader_election.cc:302] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:36.931114 24985 raft_consensus.cc:2781] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:36.939052 24985 raft_consensus.cc:482] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:36.939469 24985 raft_consensus.cc:3037] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:36.948982 24237 catalog_manager.cc:5495] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:36.973903 24908 raft_consensus.cc:482] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:36.974506 24908 raft_consensus.cc:504] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:36.978667 24908 leader_election.cc:288] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:36.979784 24754 consensus_queue.cc:1035] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:36.985098 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:37.005125 24665 tablet_bootstrap.cc:492] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:37.005683 24665 ts_tablet_manager.cc:1397] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.000s
I20260811 16:08:37.013650 24661 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:37.014302 24661 ts_tablet_manager.cc:1397] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.003s
I20260811 16:08:37.002878 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:37.031936 24663 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:37.032516 24663 ts_tablet_manager.cc:1397] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.296s	user 0.016s	sys 0.002s
I20260811 16:08:37.030951 24237 catalog_manager.cc:5495] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:37.043339 24663 raft_consensus.cc:348] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.044287 24663 raft_consensus.cc:374] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.044559 24663 raft_consensus.cc:729] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.045495 24663 consensus_queue.cc:260] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.049507 24439 raft_consensus.cc:2379] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:37.062848 24665 raft_consensus.cc:348] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.063628 24665 raft_consensus.cc:374] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.063871 24665 raft_consensus.cc:729] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.064464 24665 consensus_queue.cc:260] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.066385 24663 ts_tablet_manager.cc:1428] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260811 16:08:37.067523 24663 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:37.077509 24314 leader_election.cc:302] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:37.079883 24665 ts_tablet_manager.cc:1428] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260811 16:08:37.080881 24661 raft_consensus.cc:348] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.091905 24661 raft_consensus.cc:374] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.092526 24661 raft_consensus.cc:729] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.094302 24661 consensus_queue.cc:260] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.097507 24661 ts_tablet_manager.cc:1428] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.002s
I20260811 16:08:37.097929 24748 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.098675 24661 tablet_bootstrap.cc:492] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:37.091876 24908 raft_consensus.cc:3037] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:37.101267 24665 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:37.101840 24754 raft_consensus.cc:482] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:37.104526 24754 raft_consensus.cc:504] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.106437 24754 leader_election.cc:288] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:37.113698 24748 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:37.114672 24665 tablet_bootstrap.cc:654] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.131909 24661 tablet_bootstrap.cc:654] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.133432 24662 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:37.134016 24662 ts_tablet_manager.cc:1397] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.304s	user 0.013s	sys 0.000s
I20260811 16:08:37.131558 24754 consensus_queue.cc:1035] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 16:08:37.141251 24662 raft_consensus.cc:348] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:37.142226 24662 raft_consensus.cc:374] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.142575 24662 raft_consensus.cc:729] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.143496 24662 consensus_queue.cc:260] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:37.113718 24985 raft_consensus.cc:504] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:37.151391 24662 ts_tablet_manager.cc:1428] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260811 16:08:37.142732 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:37.154008 24662 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:37.160027 24353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3487223f11427fb71f9b2dcb0414f6" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:37.161121 24353 raft_consensus.cc:2379] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:37.162410 24661 tablet_bootstrap.cc:492] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:37.162957 24661 ts_tablet_manager.cc:1397] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.004s
I20260811 16:08:37.157220 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:37.171833 24523 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:37.155624 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:37.175607 24611 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:37.178725 25051 raft_consensus.cc:482] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:37.180006 24668 consensus_queue.cc:1035] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:37.182669 25001 consensus_queue.cc:1035] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:37.183789 24523 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:37.186805 24314 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:37.197407 24572 leader_election.cc:302] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:37.205878 24661 raft_consensus.cc:348] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.179353 25051 raft_consensus.cc:504] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.196167 24748 raft_consensus.cc:2781] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:37.206791 24661 raft_consensus.cc:374] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.212144 24661 raft_consensus.cc:729] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.212893 24661 consensus_queue.cc:260] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.215193 24661 ts_tablet_manager.cc:1428] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260811 16:08:37.216177 24661 tablet_bootstrap.cc:492] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:37.211802 24997 raft_consensus.cc:482] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:37.220191 24997 raft_consensus.cc:504] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.221328 24908 raft_consensus.cc:2726] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:37.222433 24997 leader_election.cc:288] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:37.201489 25001 raft_consensus.cc:3037] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:37.224573 25051 leader_election.cc:288] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:37.225630 24748 raft_consensus.cc:686] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:37.226701 24748 consensus_queue.cc:237] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.233532 24977 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:37.234200 24977 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:37.235878 24661 tablet_bootstrap.cc:654] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.240361 24977 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:37.253422 24665 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:37.254099 24665 ts_tablet_manager.cc:1397] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.162s	user 0.036s	sys 0.007s
I20260811 16:08:37.257572 24610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fe7d941ae74b0ab5c504d9f556b073" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:37.258774 24610 raft_consensus.cc:2454] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:37.259405 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:37.268011 24611 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:37.271888 24662 tablet_bootstrap.cc:654] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.275345 24985 leader_election.cc:288] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:37.278728 24663 tablet_bootstrap.cc:654] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.293504 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:37.294304 24440 raft_consensus.cc:2454] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:37.293339 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fe7d941ae74b0ab5c504d9f556b073" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:37.295909 24439 raft_consensus.cc:2454] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:37.296228 24986 consensus_queue.cc:1035] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:37.303375 24518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:37.305954 24353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:37.315605 24754 consensus_queue.cc:1035] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:37.316617 24402 leader_election.cc:341] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.317970 24665 raft_consensus.cc:348] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.318806 24665 raft_consensus.cc:374] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.319098 24665 raft_consensus.cc:729] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.321678 24358 raft_consensus.cc:3037] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:37.320425 24665 consensus_queue.cc:260] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:37.341723 24402 leader_election.cc:341] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.359879 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:37.356184 25001 raft_consensus.cc:2726] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:37.361151 24485 leader_election.cc:302] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:37.363368 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:37.363533 25062 raft_consensus.cc:2781] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:37.364162 25062 raft_consensus.cc:482] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:37.364939 25062 raft_consensus.cc:3037] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:37.364138 24354 raft_consensus.cc:3037] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:37.372231 24485 leader_election.cc:341] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.356331 24402 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
W20260811 16:08:37.432524 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 47506.1us
I20260811 16:08:37.461532 24485 leader_election.cc:302] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
W20260811 16:08:37.477057 24485 leader_election.cc:341] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.463986 24997 raft_consensus.cc:482] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:37.475046 24665 ts_tablet_manager.cc:1428] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.221s	user 0.010s	sys 0.000s
I20260811 16:08:37.461087 24977 raft_consensus.cc:2726] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:37.497341 24665 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:37.479189 24985 raft_consensus.cc:2781] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 16:08:37.527465 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 66808.8us
W20260811 16:08:37.537802 25067 log.cc:924] Time spent T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260811 16:08:37.530689 24985 raft_consensus.cc:482] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:37.495534 24997 raft_consensus.cc:504] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.559518 24985 raft_consensus.cc:3037] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:37.592083 25065 log.cc:924] Time spent T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260811 16:08:37.610646 24662 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:37.611318 24661 tablet_bootstrap.cc:492] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:37.611528 24662 ts_tablet_manager.cc:1397] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.459s	user 0.061s	sys 0.077s
I20260811 16:08:37.612102 24661 ts_tablet_manager.cc:1397] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.396s	user 0.007s	sys 0.007s
I20260811 16:08:37.598171 25076 consensus_queue.cc:1035] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260811 16:08:37.651968 24997 leader_election.cc:288] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:37.655637 24661 raft_consensus.cc:348] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.656548 24661 raft_consensus.cc:374] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.647008 24976 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:37.656839 24661 raft_consensus.cc:729] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.662338 24661 consensus_queue.cc:260] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:37.666435 24402 consensus_peers.cc:487] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 -> Peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Couldn't send request to peer 707f02c5118a4d798120ca9c5786ada6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:37.660218 25073 log.cc:924] Time spent T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260811 16:08:37.658051 25070 log.cc:924] Time spent T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260811 16:08:37.677143 24663 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:37.677747 24663 ts_tablet_manager.cc:1397] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.610s	user 0.030s	sys 0.046s
I20260811 16:08:37.678745 24665 tablet_bootstrap.cc:654] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.658124 24976 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:37.684785 24976 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:37.685407 24610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:37.686463 24662 raft_consensus.cc:348] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.687314 24662 raft_consensus.cc:374] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.687616 24662 raft_consensus.cc:729] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.688299 24662 consensus_queue.cc:260] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.693986 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:37.694682 24662 ts_tablet_manager.cc:1428] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260811 16:08:37.695850 24662 tablet_bootstrap.cc:492] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:37.700723 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:37.706933 24485 consensus_peers.cc:487] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:37.713188 24485 leader_election.cc:341] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:37.723497 24402 leader_election.cc:341] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.728750 24662 tablet_bootstrap.cc:654] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.741283 24661 ts_tablet_manager.cc:1428] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.129s	user 0.003s	sys 0.018s
W20260811 16:08:37.748843 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 81689.9us
W20260811 16:08:37.775545 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 49133.9us
W20260811 16:08:37.778007 24485 leader_election.cc:341] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.781915 24661 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:37.778602 24485 leader_election.cc:302] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:37.796424 24663 raft_consensus.cc:348] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.797065 24663 raft_consensus.cc:374] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.797308 24663 raft_consensus.cc:729] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.800537 24663 consensus_queue.cc:260] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.814429 24235 catalog_manager.cc:5495] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
W20260811 16:08:37.820760 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 45118.4us
I20260811 16:08:37.825955 24663 ts_tablet_manager.cc:1428] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.148s	user 0.007s	sys 0.005s
I20260811 16:08:37.831737 24663 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:37.801345 24938 raft_consensus.cc:2726] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:37.778228 25084 consensus_queue.cc:1035] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
I20260811 16:08:37.799945 25062 raft_consensus.cc:504] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.812160 24354 raft_consensus.cc:2454] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
W20260811 16:08:37.872871 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 95989.8us
I20260811 16:08:37.850848 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:37.888039 25062 leader_election.cc:288] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:37.898523 24485 leader_election.cc:302] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:37.877373 25090 raft_consensus.cc:482] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:08:37.897825 24402 leader_election.cc:341] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:37.904836 24663 tablet_bootstrap.cc:654] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.904258 24402 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:37.905622 24938 raft_consensus.cc:2781] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:37.911589 24938 raft_consensus.cc:686] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:37.913414 24662 tablet_bootstrap.cc:492] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:37.913950 24662 ts_tablet_manager.cc:1397] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.218s	user 0.020s	sys 0.015s
I20260811 16:08:37.915067 25101 raft_consensus.cc:2726] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:37.904201 25090 raft_consensus.cc:504] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:37.918140 24661 tablet_bootstrap.cc:654] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:37.912482 24938 consensus_queue.cc:237] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:37.920279 25090 leader_election.cc:288] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:37.924319 24662 raft_consensus.cc:348] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.925359 24662 raft_consensus.cc:374] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.925704 24662 raft_consensus.cc:729] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.929993 24662 consensus_queue.cc:260] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.902339 24885 consensus_queue.cc:1035] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260811 16:08:37.945030 24665 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:37.945922 24665 ts_tablet_manager.cc:1397] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.449s	user 0.021s	sys 0.002s
I20260811 16:08:37.951172 24665 raft_consensus.cc:348] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.952270 24665 raft_consensus.cc:374] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:37.952597 24665 raft_consensus.cc:729] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:37.953557 24665 consensus_queue.cc:260] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:37.967530 24663 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:37.969596 24663 ts_tablet_manager.cc:1397] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.005s
I20260811 16:08:37.925374 24985 raft_consensus.cc:504] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:37.976143 24353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:37.979385 24665 ts_tablet_manager.cc:1428] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260811 16:08:37.981063 24662 ts_tablet_manager.cc:1428] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.002s
I20260811 16:08:37.981709 24665 tablet_bootstrap.cc:492] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:37.985421 24662 tablet_bootstrap.cc:492] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:37.946967 24976 consensus_queue.cc:1035] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260811 16:08:37.996850 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:38.005350 24985 leader_election.cc:288] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:37.998835 24438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fe7d941ae74b0ab5c504d9f556b073" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:38.009737 24438 raft_consensus.cc:3037] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:38.026696 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 65716.3us
W20260811 16:08:38.031507 24402 leader_election.cc:341] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:38.037964 24402 leader_election.cc:341] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.038535 24402 leader_election.cc:302] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:38.039566 25075 raft_consensus.cc:2726] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.039961 24908 consensus_queue.cc:1035] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:08:38.061792 24663 raft_consensus.cc:348] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.062950 24663 raft_consensus.cc:374] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.063271 24663 raft_consensus.cc:729] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.035125 25079 raft_consensus.cc:482] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.067271 24663 consensus_queue.cc:260] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.074179 24436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:38.075040 24436 raft_consensus.cc:3037] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.115370 24662 tablet_bootstrap.cc:654] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:38.136262 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 336687us
I20260811 16:08:38.071285 25079 raft_consensus.cc:504] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.159341 25079 leader_election.cc:288] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:38.161121 24661 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:38.161713 24661 ts_tablet_manager.cc:1397] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.383s	user 0.019s	sys 0.046s
I20260811 16:08:38.166988 24663 ts_tablet_manager.cc:1428] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.197s	user 0.010s	sys 0.000s
I20260811 16:08:38.168174 24663 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:38.189966 24661 raft_consensus.cc:348] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.195783 24661 raft_consensus.cc:374] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.196271 24661 raft_consensus.cc:729] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.197219 24661 consensus_queue.cc:260] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.218931 24665 tablet_bootstrap.cc:654] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.220279 24661 ts_tablet_manager.cc:1428] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260811 16:08:38.229187 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:38.244971 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fe7d941ae74b0ab5c504d9f556b073" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:38.245862 24602 raft_consensus.cc:3037] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.233968 24438 raft_consensus.cc:2454] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
W20260811 16:08:38.256177 24572 consensus_peers.cc:487] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:38.248440 25099 raft_consensus.cc:482] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.253670 24938 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.301937 24485 leader_election.cc:302] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:38.274725 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae25aabfb52d4b57a9d71bf2e627ed63" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:38.323820 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:38.331964 24661 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:38.325218 24985 raft_consensus.cc:2781] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:38.309864 24436 raft_consensus.cc:2454] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:38.272149 25099 raft_consensus.cc:504] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.334924 25101 raft_consensus.cc:482] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:08:38.357008 25117 log.cc:924] Time spent T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260811 16:08:38.301513 24938 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.361635 24938 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:38.362062 24602 raft_consensus.cc:2454] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:38.362756 25101 raft_consensus.cc:504] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.363358 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:38.364162 25056 consensus_queue.cc:1035] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.094s
I20260811 16:08:38.365093 25101 leader_election.cc:288] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:38.353404 24985 raft_consensus.cc:686] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
W20260811 16:08:38.367939 25116 log.cc:924] Time spent T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260811 16:08:38.368692 24985 consensus_queue.cc:237] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.375648 25099 leader_election.cc:288] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:38.377987 24314 leader_election.cc:302] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:38.379650 25096 raft_consensus.cc:2726] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.382980 24663 tablet_bootstrap.cc:654] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.382817 24485 leader_election.cc:302] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:38.384687 24601 raft_consensus.cc:3037] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.387480 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0b07fabee54845918b46e4c673c81d" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:38.391949 24997 raft_consensus.cc:2781] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:38.396781 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0b07fabee54845918b46e4c673c81d" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:38.416795 25077 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.417430 25077 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.419989 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:38.411079 24997 raft_consensus.cc:686] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
W20260811 16:08:38.439237 24402 leader_election.cc:341] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:38.454490 24402 leader_election.cc:341] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.454880 24402 leader_election.cc:302] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
W20260811 16:08:38.456276 25124 log.cc:924] Time spent T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260811 16:08:38.456766 24517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:38.457543 24517 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:38.458880 25056 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.459465 25056 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.462528 25056 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:38.463053 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:38.464542 24441 raft_consensus.cc:2454] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:38.468426 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:38.470141 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe927b7dcce64f2f8f949de1d18044a4" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:38.471050 24439 raft_consensus.cc:2379] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:38.456328 24607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:38.471849 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:38.472846 24607 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:38.464983 25077 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:38.479020 24314 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:38.483280 24662 tablet_bootstrap.cc:492] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:38.483930 24662 ts_tablet_manager.cc:1397] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.502s	user 0.027s	sys 0.015s
W20260811 16:08:38.488125 24314 leader_election.cc:341] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:38.489673 24485 leader_election.cc:341] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.483330 25056 raft_consensus.cc:2781] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 16:08:38.500463 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 45999.4us
I20260811 16:08:38.513042 24601 raft_consensus.cc:2454] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:38.514870 24572 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
W20260811 16:08:38.516773 25127 log.cc:924] Time spent T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260811 16:08:38.516783 24997 consensus_queue.cc:237] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.521147 24661 tablet_bootstrap.cc:654] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.505750 25056 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:38.525830 25056 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.526237 25128 consensus_queue.cc:1035] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260811 16:08:38.524688 24662 raft_consensus.cc:348] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.530128 24662 raft_consensus.cc:374] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.503818 25076 raft_consensus.cc:2726] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.530469 24662 raft_consensus.cc:729] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.541738 24662 consensus_queue.cc:260] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.554157 24351 raft_consensus.cc:3037] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:38.558427 24485 consensus_peers.cc:487] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:38.560135 25095 raft_consensus.cc:2781] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:38.560671 25095 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:38.561013 25095 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:38.559554 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 60053.9us
I20260811 16:08:38.569384 24485 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:38.570314 24985 raft_consensus.cc:2781] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:38.570717 24985 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:38.571031 24985 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.534533 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:38.581525 24572 leader_election.cc:341] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.584316 24665 tablet_bootstrap.cc:492] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:38.584933 24665 ts_tablet_manager.cc:1397] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.604s	user 0.015s	sys 0.013s
I20260811 16:08:38.589738 24665 raft_consensus.cc:348] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.590799 24665 raft_consensus.cc:374] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.591279 24665 raft_consensus.cc:729] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.593358 24665 consensus_queue.cc:260] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.601222 24663 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:38.601812 24663 ts_tablet_manager.cc:1397] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.434s	user 0.008s	sys 0.009s
I20260811 16:08:38.604882 24663 raft_consensus.cc:348] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.605605 24663 raft_consensus.cc:374] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.605870 24663 raft_consensus.cc:729] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.606570 24663 consensus_queue.cc:260] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.609205 24663 ts_tablet_manager.cc:1428] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260811 16:08:38.610287 24663 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:38.617146 24662 ts_tablet_manager.cc:1428] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.002s
I20260811 16:08:38.619792 24665 ts_tablet_manager.cc:1428] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260811 16:08:38.620775 24662 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:38.622529 24665 tablet_bootstrap.cc:492] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:38.629077 24985 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.643594 25079 raft_consensus.cc:482] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.644273 25079 raft_consensus.cc:504] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.646536 25079 leader_election.cc:288] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:38.648640 25056 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.649904 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:38.651638 24314 leader_election.cc:341] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.653201 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:38.656070 24572 leader_election.cc:302] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
W20260811 16:08:38.659940 24485 leader_election.cc:341] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.658334 25077 raft_consensus.cc:2726] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.664249 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:38.668705 24235 catalog_manager.cc:5495] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:38.672966 24235 catalog_manager.cc:5495] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:38.661865 25095 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:38.678910 24314 leader_election.cc:341] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.679528 24314 leader_election.cc:302] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:38.680670 25079 raft_consensus.cc:2726] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.681371 24235 catalog_manager.cc:5495] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:38.658452 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:38.685869 24601 raft_consensus.cc:2379] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:38.706630 24662 tablet_bootstrap.cc:654] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.657792 24985 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:38.715476 24485 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:38.722675 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:38.723980 24439 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.719632 24997 raft_consensus.cc:2726] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.730393 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:38.731371 25056 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:38.732467 24314 leader_election.cc:341] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.750435 25095 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:38.755966 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:38.757097 24520 raft_consensus.cc:2379] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:38.760664 24661 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:38.761332 24661 ts_tablet_manager.cc:1397] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.430s	user 0.031s	sys 0.026s
I20260811 16:08:38.761371 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:38.765961 24665 tablet_bootstrap.cc:654] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.771476 24663 tablet_bootstrap.cc:654] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.775071 24661 raft_consensus.cc:348] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.776192 24661 raft_consensus.cc:374] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.776525 24661 raft_consensus.cc:729] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.777369 24661 consensus_queue.cc:260] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:38.773368 24572 leader_election.cc:341] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.779315 24572 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:38.781224 24986 raft_consensus.cc:2726] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:38.761269 24439 raft_consensus.cc:2454] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:38.789026 24661 ts_tablet_manager.cc:1428] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260811 16:08:38.788796 24314 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:38.799300 25056 raft_consensus.cc:2781] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:38.799875 25056 raft_consensus.cc:686] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:38.800745 25056 consensus_queue.cc:237] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.808915 24661 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:38.818646 24662 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:38.819376 24662 ts_tablet_manager.cc:1397] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.201s	user 0.029s	sys 0.007s
I20260811 16:08:38.830641 24662 raft_consensus.cc:348] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.831558 24662 raft_consensus.cc:374] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.831859 24662 raft_consensus.cc:729] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.832868 24662 consensus_queue.cc:260] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.833442 24663 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:38.834160 24663 ts_tablet_manager.cc:1397] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.224s	user 0.009s	sys 0.012s
I20260811 16:08:38.835625 24665 tablet_bootstrap.cc:492] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:38.836409 24665 ts_tablet_manager.cc:1397] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.005s
I20260811 16:08:38.837307 24662 ts_tablet_manager.cc:1428] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260811 16:08:38.837210 24663 raft_consensus.cc:348] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.838254 24663 raft_consensus.cc:374] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.838443 24662 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:38.838617 24663 raft_consensus.cc:729] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.840478 24665 raft_consensus.cc:348] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.841277 24665 raft_consensus.cc:374] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.841590 24665 raft_consensus.cc:729] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.842568 24665 consensus_queue.cc:260] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.846108 24665 ts_tablet_manager.cc:1428] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260811 16:08:38.847929 24665 tablet_bootstrap.cc:492] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:38.853765 24661 tablet_bootstrap.cc:654] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.854517 24602 raft_consensus.cc:3037] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.856101 24665 tablet_bootstrap.cc:654] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.859283 24663 consensus_queue.cc:260] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:38.862799 24663 ts_tablet_manager.cc:1428] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260811 16:08:38.865638 24662 tablet_bootstrap.cc:654] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.878819 24663 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:38.878952 24439 raft_consensus.cc:3037] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:38.885366 24663 tablet_bootstrap.cc:654] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.894083 24985 consensus_queue.cc:1035] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:38.905580 24662 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:38.906208 24665 tablet_bootstrap.cc:492] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:38.906381 24662 ts_tablet_manager.cc:1397] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.012s
I20260811 16:08:38.906775 24665 ts_tablet_manager.cc:1397] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.000s
I20260811 16:08:38.909778 24665 raft_consensus.cc:348] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.917728 24665 raft_consensus.cc:374] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.918095 24665 raft_consensus.cc:729] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.919669 24662 raft_consensus.cc:348] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.923190 24662 raft_consensus.cc:374] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.923625 24662 raft_consensus.cc:729] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.918889 24237 catalog_manager.cc:5495] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:38.922454 24665 consensus_queue.cc:260] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.872449 24661 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:38.925864 24661 ts_tablet_manager.cc:1397] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.005s
I20260811 16:08:38.925051 24662 consensus_queue.cc:260] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:38.932898 24661 raft_consensus.cc:348] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.933948 24661 raft_consensus.cc:374] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:38.934237 24661 raft_consensus.cc:729] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:38.935923 24665 ts_tablet_manager.cc:1428] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260811 16:08:38.937071 24665 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:38.941808 24662 ts_tablet_manager.cc:1428] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.007s
I20260811 16:08:38.941419 24661 consensus_queue.cc:260] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:38.944058 24661 ts_tablet_manager.cc:1428] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260811 16:08:38.945052 24661 tablet_bootstrap.cc:492] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:38.955363 24662 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:38.952488 24881 raft_consensus.cc:482] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:38.964488 24881 raft_consensus.cc:504] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:38.966526 24881 leader_election.cc:288] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:38.966600 24661 tablet_bootstrap.cc:654] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:38.974494 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:38.975423 24516 raft_consensus.cc:2454] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:38.976761 24402 leader_election.cc:302] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:38.977782 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:38.978961 24881 raft_consensus.cc:2781] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:38.979434 24881 raft_consensus.cc:482] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:38.979809 24881 raft_consensus.cc:3037] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:38.984829 24402 leader_election.cc:341] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:38.999779 24665 tablet_bootstrap.cc:654] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.004403 24663 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:39.005136 24663 ts_tablet_manager.cc:1397] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.127s	user 0.008s	sys 0.014s
I20260811 16:08:39.006364 25080 consensus_queue.cc:1035] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260811 16:08:39.024545 24662 tablet_bootstrap.cc:654] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.024937 25080 consensus_queue.cc:1035] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 16:08:39.032971 25128 raft_consensus.cc:482] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.033416 24985 consensus_queue.cc:1035] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:39.033663 25128 raft_consensus.cc:504] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.038166 25075 raft_consensus.cc:482] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.038708 25075 raft_consensus.cc:504] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.040729 25128 leader_election.cc:288] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:39.041852 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.042279 24435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:39.041000 25075 leader_election.cc:288] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:39.032397 24663 raft_consensus.cc:348] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.046271 24663 raft_consensus.cc:374] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.046639 24663 raft_consensus.cc:729] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:39.044435 24485 leader_election.cc:341] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.047390 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:39.047948 24485 leader_election.cc:341] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.048434 24485 leader_election.cc:302] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:39.048565 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:39.049232 25080 raft_consensus.cc:2726] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.054389 24663 consensus_queue.cc:260] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.062994 24661 tablet_bootstrap.cc:492] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:39.063733 24661 ts_tablet_manager.cc:1397] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.000s
I20260811 16:08:39.069188 24881 raft_consensus.cc:504] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.084975 24881 leader_election.cc:288] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:39.070446 24661 raft_consensus.cc:348] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
W20260811 16:08:39.071473 24402 leader_election.cc:341] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.072870 25101 raft_consensus.cc:482] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f165e96383a40dc9d724b290a94706d)
I20260811 16:08:39.086148 25101 raft_consensus.cc:504] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.089900 25101 leader_election.cc:288] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:39.095217 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:39.094964 24402 leader_election.cc:341] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.097780 24402 leader_election.cc:302] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.097834 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e474ad4d29de4c968bbf6811a1ced653" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.098640 25101 raft_consensus.cc:2726] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.098582 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:39.074031 24663 ts_tablet_manager.cc:1428] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.001s
I20260811 16:08:39.100656 24661 raft_consensus.cc:374] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.100960 24661 raft_consensus.cc:729] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.101742 24661 consensus_queue.cc:260] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.103905 24604 raft_consensus.cc:3037] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.104837 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:39.105623 24516 raft_consensus.cc:3037] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.109025 24402 leader_election.cc:302] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.109949 25101 raft_consensus.cc:2726] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:39.118613 24604 raft_consensus.cc:2454] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:39.121032 24661 ts_tablet_manager.cc:1428] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.001s
I20260811 16:08:39.122203 24661 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:39.130947 24663 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:39.168953 24663 tablet_bootstrap.cc:654] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.164405 24665 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:39.191025 24665 ts_tablet_manager.cc:1397] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.254s	user 0.012s	sys 0.008s
I20260811 16:08:39.176287 24402 leader_election.cc:302] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:39.192128 25076 raft_consensus.cc:2781] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:39.192641 25076 raft_consensus.cc:686] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:39.193490 25076 consensus_queue.cc:237] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.157810 24662 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:39.194968 24662 ts_tablet_manager.cc:1397] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.006s
I20260811 16:08:39.198307 24662 raft_consensus.cc:348] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.194188 24665 raft_consensus.cc:348] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.202888 24665 raft_consensus.cc:374] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.146912 24516 raft_consensus.cc:2454] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:39.181270 24661 tablet_bootstrap.cc:654] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.199110 24662 raft_consensus.cc:374] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.209653 24662 raft_consensus.cc:729] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.210390 24665 raft_consensus.cc:729] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.211185 24665 consensus_queue.cc:260] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.213707 24665 ts_tablet_manager.cc:1428] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260811 16:08:39.214033 24356 raft_consensus.cc:3037] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.214496 24662 consensus_queue.cc:260] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.218209 24748 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.219298 24748 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.224179 24665 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:39.228067 25077 raft_consensus.cc:482] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.228756 25077 raft_consensus.cc:504] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.231195 25077 leader_election.cc:288] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:39.234923 24662 ts_tablet_manager.cc:1428] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260811 16:08:39.235428 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:39.236945 24662 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:39.236752 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.237723 24347 raft_consensus.cc:2454] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:39.241768 24572 leader_election.cc:302] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
W20260811 16:08:39.242767 24572 leader_election.cc:341] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.243357 25077 raft_consensus.cc:2781] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.243850 25077 raft_consensus.cc:482] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.244205 25077 raft_consensus.cc:3037] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.246487 24748 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:39.248380 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:39.249979 24516 raft_consensus.cc:2379] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:39.251827 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.252830 24602 raft_consensus.cc:2379] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:39.256183 24663 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:39.256800 24663 ts_tablet_manager.cc:1397] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.010s
I20260811 16:08:39.253377 24234 catalog_manager.cc:5495] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:39.261037 24314 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:39.263092 24748 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.281821 25077 raft_consensus.cc:504] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.291654 24997 raft_consensus.cc:482] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.292694 24997 raft_consensus.cc:504] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.293876 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:39.294847 24351 raft_consensus.cc:3037] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.296202 24997 leader_election.cc:288] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:39.297796 25077 leader_election.cc:288] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:39.282765 24661 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:39.298849 24661 ts_tablet_manager.cc:1397] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.001s
I20260811 16:08:39.300138 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
W20260811 16:08:39.304467 24572 leader_election.cc:341] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.307633 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0b07fabee54845918b46e4c673c81d" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:39.308528 24665 tablet_bootstrap.cc:654] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.308735 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0b07fabee54845918b46e4c673c81d" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.308542 24440 raft_consensus.cc:2454] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
W20260811 16:08:39.310317 24485 leader_election.cc:341] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.312947 24485 leader_election.cc:302] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:39.315038 24662 tablet_bootstrap.cc:654] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.259670 24663 raft_consensus.cc:348] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.316195 24663 raft_consensus.cc:374] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.316706 24663 raft_consensus.cc:729] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.316056 24661 raft_consensus.cc:348] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.317492 24661 raft_consensus.cc:374] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.317875 24661 raft_consensus.cc:729] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.318645 24661 consensus_queue.cc:260] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.320901 24663 consensus_queue.cc:260] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.315862 25128 raft_consensus.cc:2781] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.322461 25128 raft_consensus.cc:482] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.322827 25128 raft_consensus.cc:3037] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.323683 24661 ts_tablet_manager.cc:1428] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260811 16:08:39.323830 24748 raft_consensus.cc:2726] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.337030 24663 ts_tablet_manager.cc:1428] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.001s
I20260811 16:08:39.340375 24661 tablet_bootstrap.cc:492] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:39.343020 24663 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:39.336726 25094 consensus_queue.cc:1035] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260811 16:08:39.366953 24314 consensus_peers.cc:487] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:39.377636 24661 tablet_bootstrap.cc:654] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.406502 25076 raft_consensus.cc:482] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.415681 25076 raft_consensus.cc:504] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.418010 25076 leader_election.cc:288] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.419663 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:39.420737 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:39.421561 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:39.422796 24402 leader_election.cc:341] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:39.423902 24402 leader_election.cc:341] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.424373 24402 leader_election.cc:302] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.425176 25075 raft_consensus.cc:2726] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.410346 24351 raft_consensus.cc:2454] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:39.433377 24665 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:39.434056 24665 ts_tablet_manager.cc:1397] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.015s
I20260811 16:08:39.435927 24572 leader_election.cc:302] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: d44d109b1df0445eba66548c099958e3
I20260811 16:08:39.437176 25077 raft_consensus.cc:2781] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:39.438153 24665 raft_consensus.cc:348] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.438539 25077 raft_consensus.cc:686] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:39.439015 24665 raft_consensus.cc:374] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.439385 24665 raft_consensus.cc:729] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.440079 24665 consensus_queue.cc:260] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.442893 24665 ts_tablet_manager.cc:1428] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260811 16:08:39.443982 24665 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:39.440142 25077 consensus_queue.cc:237] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.462003 25080 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.463858 24986 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.464067 25080 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.464504 24986 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.466413 25080 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.469800 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.471500 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.472290 24604 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
W20260811 16:08:39.473825 24485 leader_election.cc:341] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.475432 24485 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.466754 24986 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.472366 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:39.481566 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.482769 24661 tablet_bootstrap.cc:492] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:39.483413 24661 ts_tablet_manager.cc:1397] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.004s
I20260811 16:08:39.482360 25080 raft_consensus.cc:2781] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.485049 24520 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:39.485667 25080 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.486128 25080 raft_consensus.cc:3037] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.461750 25128 raft_consensus.cc:504] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.492024 24572 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:39.493440 25095 raft_consensus.cc:2781] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.493863 25095 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.494172 25095 raft_consensus.cc:3037] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.494829 24665 tablet_bootstrap.cc:654] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:39.495517 24572 leader_election.cc:341] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.496096 25128 leader_election.cc:288] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:39.500612 25080 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.501034 24661 raft_consensus.cc:348] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.501739 24661 raft_consensus.cc:374] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.502060 24661 raft_consensus.cc:729] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.503311 25080 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.504621 24662 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:39.505185 24662 ts_tablet_manager.cc:1397] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.269s	user 0.019s	sys 0.017s
I20260811 16:08:39.506330 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0b07fabee54845918b46e4c673c81d" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:39.506428 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:39.509122 24662 raft_consensus.cc:348] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.509894 24662 raft_consensus.cc:374] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.510134 24662 raft_consensus.cc:729] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.510272 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:39.511720 24662 consensus_queue.cc:260] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.513326 24663 tablet_bootstrap.cc:654] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
W20260811 16:08:39.513907 24485 leader_election.cc:341] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.515439 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0b07fabee54845918b46e4c673c81d" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:39.516048 24440 raft_consensus.cc:3037] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.514050 24661 consensus_queue.cc:260] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.520503 24602 raft_consensus.cc:3037] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.522514 24661 ts_tablet_manager.cc:1428] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260811 16:08:39.508455 25095 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.523677 24661 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:39.524493 24605 raft_consensus.cc:2379] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:39.529114 24662 ts_tablet_manager.cc:1428] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260811 16:08:39.530633 24440 raft_consensus.cc:2454] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:39.533829 25095 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.539819 24662 tablet_bootstrap.cc:492] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3: Bootstrap starting.
I20260811 16:08:39.549223 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:39.549834 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:39.550024 24485 leader_election.cc:302] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:39.550839 24516 raft_consensus.cc:2379] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:39.556638 25080 raft_consensus.cc:2781] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:39.557478 25080 raft_consensus.cc:686] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:39.558354 24602 raft_consensus.cc:2454] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:39.559368 24485 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
W20260811 16:08:39.559932 24572 leader_election.cc:341] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.549176 24661 tablet_bootstrap.cc:654] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.565805 24572 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.562402 24997 raft_consensus.cc:2726] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.558941 25080 consensus_queue.cc:237] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.573228 25077 raft_consensus.cc:2726] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.608222 24662 tablet_bootstrap.cc:654] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.602368 24237 catalog_manager.cc:5495] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:39.652839 24977 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.657464 24977 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.660984 24977 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:39.661955 25094 raft_consensus.cc:482] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.664927 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:39.669073 24402 leader_election.cc:341] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.666754 25094 raft_consensus.cc:504] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.674590 25094 leader_election.cc:288] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:39.678129 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:39.684033 24665 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:39.743104 24665 ts_tablet_manager.cc:1397] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.299s	user 0.011s	sys 0.013s
I20260811 16:08:39.744714 24997 raft_consensus.cc:482] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.745460 24997 raft_consensus.cc:504] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.745954 24665 raft_consensus.cc:348] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.746711 24665 raft_consensus.cc:374] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.746973 24665 raft_consensus.cc:729] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.747867 24665 consensus_queue.cc:260] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.748204 24997 leader_election.cc:288] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.752727 24665 ts_tablet_manager.cc:1428] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260811 16:08:39.755604 24665 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:39.761237 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f4360b11c44c6fa6327d0a030a1b55" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
W20260811 16:08:39.761667 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 196004us
W20260811 16:08:39.763635 24485 leader_election.cc:341] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.766882 24663 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:39.767570 24663 ts_tablet_manager.cc:1397] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.425s	user 0.058s	sys 0.096s
I20260811 16:08:39.773453 24661 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:39.698786 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:39.774068 24661 ts_tablet_manager.cc:1397] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.251s	user 0.014s	sys 0.000s
I20260811 16:08:39.700884 24977 raft_consensus.cc:482] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.774923 24663 raft_consensus.cc:348] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.775774 24663 raft_consensus.cc:374] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.776095 24663 raft_consensus.cc:729] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.775761 24977 raft_consensus.cc:504] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.777024 24661 raft_consensus.cc:348] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.777889 24661 raft_consensus.cc:374] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.778213 24661 raft_consensus.cc:729] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.778692 24236 catalog_manager.cc:5495] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:39.782675 24439 raft_consensus.cc:2454] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:39.777972 24663 consensus_queue.cc:260] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.778875 24661 consensus_queue.cc:260] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.789395 24661 ts_tablet_manager.cc:1428] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260811 16:08:39.790370 24663 ts_tablet_manager.cc:1428] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260811 16:08:39.791469 24663 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:39.798379 24663 tablet_bootstrap.cc:654] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.790408 24661 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:39.803570 25076 raft_consensus.cc:482] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.803951 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f4360b11c44c6fa6327d0a030a1b55" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.782847 24977 leader_election.cc:288] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:39.804199 24402 leader_election.cc:341] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.804986 24602 raft_consensus.cc:2454] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:39.804176 25076 raft_consensus.cc:504] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.805764 24977 consensus_queue.cc:1035] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:39.807178 25076 leader_election.cc:288] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.808907 24665 tablet_bootstrap.cc:654] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.805253 24402 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.815654 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.816565 25076 raft_consensus.cc:2726] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:39.819113 24661 tablet_bootstrap.cc:654] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.820441 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.821228 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.822098 24347 raft_consensus.cc:2454] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:39.825397 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.832042 24662 tablet_bootstrap.cc:492] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3: No bootstrap required, opened a new log
I20260811 16:08:39.832706 24662 ts_tablet_manager.cc:1397] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3: Time spent bootstrapping tablet: real 0.302s	user 0.013s	sys 0.001s
I20260811 16:08:39.833093 24661 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:39.833658 24661 ts_tablet_manager.cc:1397] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.006s
I20260811 16:08:39.836880 24661 raft_consensus.cc:348] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.837648 24661 raft_consensus.cc:374] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.837939 24661 raft_consensus.cc:729] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.841322 24663 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:39.841905 24663 ts_tablet_manager.cc:1397] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.007s
I20260811 16:08:39.841987 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.842949 24347 raft_consensus.cc:2379] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:39.844844 24663 raft_consensus.cc:348] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.845700 24663 raft_consensus.cc:374] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.846011 24663 raft_consensus.cc:729] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.847095 24485 leader_election.cc:302] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.846714 24663 consensus_queue.cc:260] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.848419 24997 raft_consensus.cc:2781] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.849042 24997 raft_consensus.cc:482] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.849495 24997 raft_consensus.cc:3037] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.849992 25076 consensus_queue.cc:1035] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:39.850669 24663 ts_tablet_manager.cc:1428] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260811 16:08:39.838812 24661 consensus_queue.cc:260] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.853627 24661 ts_tablet_manager.cc:1428] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
W20260811 16:08:39.854588 24402 leader_election.cc:341] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.854947 24663 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:39.859640 24661 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:39.867998 24402 leader_election.cc:302] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:39.875852 25076 raft_consensus.cc:2781] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.876245 25076 raft_consensus.cc:482] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.876636 25076 raft_consensus.cc:3037] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.874080 24665 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:39.883760 24665 ts_tablet_manager.cc:1397] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.128s	user 0.006s	sys 0.007s
I20260811 16:08:39.890702 24985 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.891368 24985 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.892340 24997 raft_consensus.cc:504] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.893462 24985 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:39.894261 24997 leader_election.cc:288] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.895386 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:39.909605 24997 raft_consensus.cc:482] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:39.909777 25076 raft_consensus.cc:504] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.910174 24997 raft_consensus.cc:504] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:39.912333 25076 leader_election.cc:288] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.915342 24661 tablet_bootstrap.cc:654] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.915999 24997 leader_election.cc:288] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:39.916641 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.917423 24356 raft_consensus.cc:2454] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:39.918851 24485 leader_election.cc:302] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:39.919704 24997 raft_consensus.cc:2781] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.920100 24997 raft_consensus.cc:482] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.920642 24997 raft_consensus.cc:3037] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.921171 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:39.895768 24663 tablet_bootstrap.cc:654] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:39.895383 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f4360b11c44c6fa6327d0a030a1b55" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:39.898079 24314 leader_election.cc:302] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:39.924393 24748 raft_consensus.cc:2781] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:39.924759 24748 raft_consensus.cc:482] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:39.925055 24748 raft_consensus.cc:3037] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.896023 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:39.900377 24402 leader_election.cc:302] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:39.927444 24661 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:39.928018 24661 ts_tablet_manager.cc:1397] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.001s
I20260811 16:08:39.905071 24665 raft_consensus.cc:348] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.905773 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f4360b11c44c6fa6327d0a030a1b55" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:39.929929 24665 raft_consensus.cc:374] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.859984 24662 raft_consensus.cc:348] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.930265 24665 raft_consensus.cc:729] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.930483 24662 raft_consensus.cc:374] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.930758 24662 raft_consensus.cc:729] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:39.931078 24665 consensus_queue.cc:260] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:39.931432 24662 consensus_queue.cc:260] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:39.932536 24881 raft_consensus.cc:3037] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.933800 24662 ts_tablet_manager.cc:1428] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.000s
W20260811 16:08:39.922881 24485 leader_election.cc:341] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:08:39.936141 24485 leader_election.cc:341] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.931581 24661 raft_consensus.cc:348] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.940265 24661 raft_consensus.cc:374] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:39.940666 24661 raft_consensus.cc:729] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
W20260811 16:08:39.942830 24314 leader_election.cc:341] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:39.943224 24661 consensus_queue.cc:260] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.948009 24520 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.948887 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:39.930150 24605 raft_consensus.cc:3037] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.951344 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:39.952310 24748 raft_consensus.cc:504] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:39.958310 24665 ts_tablet_manager.cc:1428] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.004s
I20260811 16:08:39.959852 24665 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d: Bootstrap starting.
I20260811 16:08:39.962667 24661 ts_tablet_manager.cc:1428] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260811 16:08:39.955027 24611 raft_consensus.cc:3037] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:39.966128 24748 leader_election.cc:288] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:39.972955 24661 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:39.970127 24351 raft_consensus.cc:2379] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:39.992410 24881 raft_consensus.cc:2726] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:40.020301 24605 raft_consensus.cc:2454] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:40.050824 24665 tablet_bootstrap.cc:654] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:40.025740 25100 raft_consensus.cc:482] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:08:40.062441 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 108969us
I20260811 16:08:40.080639 24611 raft_consensus.cc:2454] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:40.081193 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:40.082130 24439 raft_consensus.cc:2379] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:40.098605 24402 leader_election.cc:302] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:40.100028 24485 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:40.101830 24485 leader_election.cc:302] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:40.101433 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1434b986b4784cbdb2ce4d716ecfdb6c" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:40.104424 24602 raft_consensus.cc:2379] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:40.105026 24663 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:40.105661 24663 ts_tablet_manager.cc:1397] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.251s	user 0.013s	sys 0.007s
I20260811 16:08:40.060187 25100 raft_consensus.cc:504] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.128077 24661 tablet_bootstrap.cc:654] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:40.120412 25188 raft_consensus.cc:2781] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:40.122695 24985 raft_consensus.cc:2781] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:40.130666 24985 raft_consensus.cc:686] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:40.131831 25100 leader_election.cc:288] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.132629 24985 consensus_queue.cc:237] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.138789 24314 leader_election.cc:302] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:40.146356 24663 raft_consensus.cc:348] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.148190 24663 raft_consensus.cc:374] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:40.148520 24663 raft_consensus.cc:729] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:40.151096 24663 consensus_queue.cc:260] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.153507 25191 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:40.154137 25191 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.156478 25191 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.142930 25188 raft_consensus.cc:686] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:40.145429 25185 raft_consensus.cc:2726] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:40.183698 24663 ts_tablet_manager.cc:1428] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260811 16:08:40.198318 24748 raft_consensus.cc:482] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:40.198963 24748 raft_consensus.cc:504] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.217831 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:40.218722 24440 raft_consensus.cc:2454] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:40.224601 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:40.225005 24348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:40.225478 24358 raft_consensus.cc:2454] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 0.
I20260811 16:08:40.226836 24572 leader_election.cc:302] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:40.228780 25095 raft_consensus.cc:2781] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:40.229185 25095 raft_consensus.cc:482] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:40.229504 25095 raft_consensus.cc:3037] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.239873 24748 leader_election.cc:288] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.214359 25096 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:40.266363 24665 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d: No bootstrap required, opened a new log
I20260811 16:08:40.267272 24665 ts_tablet_manager.cc:1397] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d: Time spent bootstrapping tablet: real 0.308s	user 0.020s	sys 0.004s
I20260811 16:08:40.237066 24997 raft_consensus.cc:504] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.184752 25188 consensus_queue.cc:237] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.236454 25174 consensus_queue.cc:1035] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260811 16:08:40.263098 25199 raft_consensus.cc:482] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:40.280807 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:40.281528 24440 raft_consensus.cc:2454] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:40.250283 25096 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.287874 24663 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:40.280236 25199 raft_consensus.cc:504] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:40.325464 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:40.307489 24348 raft_consensus.cc:2454] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
I20260811 16:08:40.350965 24663 tablet_bootstrap.cc:654] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:40.354519 24661 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:40.362305 24661 ts_tablet_manager.cc:1397] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.390s	user 0.016s	sys 0.022s
I20260811 16:08:40.355731 24997 leader_election.cc:288] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:40.363883 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 130380us
I20260811 16:08:40.314909 25198 consensus_queue.cc:1035] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
W20260811 16:08:40.381130 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 100780us
I20260811 16:08:40.344053 24439 raft_consensus.cc:2454] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:40.396600 25096 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:40.399283 25199 leader_election.cc:288] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:40.407282 24665 raft_consensus.cc:348] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.408303 24665 raft_consensus.cc:374] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:40.408638 24665 raft_consensus.cc:729] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Initialized, Role: FOLLOWER
I20260811 16:08:40.409386 24665 consensus_queue.cc:260] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.421128 24435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:40.421983 24435 raft_consensus.cc:2454] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 0.
I20260811 16:08:40.423220 24661 raft_consensus.cc:348] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.424050 24661 raft_consensus.cc:374] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:40.424314 24661 raft_consensus.cc:729] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:40.424998 24661 consensus_queue.cc:260] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.413555 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:40.435930 24314 leader_election.cc:302] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:40.437793 24661 ts_tablet_manager.cc:1428] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260811 16:08:40.439292 24661 tablet_bootstrap.cc:492] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6: Bootstrap starting.
I20260811 16:08:40.441802 25192 raft_consensus.cc:2781] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:40.442322 25192 raft_consensus.cc:482] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:40.442662 25192 raft_consensus.cc:3037] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.447116 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:40.447999 24357 raft_consensus.cc:3037] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.448264 24314 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:40.450695 25094 raft_consensus.cc:2781] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:40.451288 25094 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:40.451630 25094 raft_consensus.cc:3037] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:08:40.456243 24402 leader_election.cc:341] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:40.460475 24485 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:40.460610 25095 raft_consensus.cc:504] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.463366 24997 raft_consensus.cc:2781] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:40.463824 24997 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:40.464315 24997 raft_consensus.cc:3037] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.464227 25198 consensus_queue.cc:1035] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:40.470374 24665 ts_tablet_manager.cc:1428] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d: Time spent starting tablet: real 0.201s	user 0.006s	sys 0.001s
I20260811 16:08:40.471577 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:40.478886 24357 raft_consensus.cc:2454] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:40.483686 24997 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.490628 24517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:40.491361 24516 raft_consensus.cc:2379] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:40.491504 24517 raft_consensus.cc:2454] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 0.
I20260811 16:08:40.484963 25174 consensus_queue.cc:1035] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:40.463800 25095 leader_election.cc:288] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.491266 25094 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.497166 24661 tablet_bootstrap.cc:654] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:40.497434 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:40.497756 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:40.498528 25094 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:40.503384 25128 raft_consensus.cc:2726] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:40.507041 24440 raft_consensus.cc:3037] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.510396 24602 raft_consensus.cc:2379] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:40.514058 24435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
W20260811 16:08:40.517900 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:40.519241 24485 leader_election.cc:302] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:40.520117 25208 raft_consensus.cc:2781] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:40.521080 25192 raft_consensus.cc:504] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.525331 25192 leader_election.cc:288] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.525986 25208 raft_consensus.cc:686] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:40.526947 25208 consensus_queue.cc:237] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.531069 24440 raft_consensus.cc:2454] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 1.
I20260811 16:08:40.537442 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:40.538636 24358 raft_consensus.cc:2379] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate 7631002fc97849e6bc5842e364e770e3 in this term.
I20260811 16:08:40.537365 24314 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:40.541522 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:40.542488 24516 raft_consensus.cc:2379] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:40.543486 25185 raft_consensus.cc:2781] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:40.544366 25185 raft_consensus.cc:686] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:40.545327 25185 consensus_queue.cc:237] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.555497 24357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:40.558866 24402 leader_election.cc:302] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:40.560923 24485 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:40.561053 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:40.504138 24663 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:40.561919 24441 raft_consensus.cc:3037] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.562101 24663 ts_tablet_manager.cc:1397] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.274s	user 0.015s	sys 0.005s
I20260811 16:08:40.561080 25188 raft_consensus.cc:2781] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:40.563238 25188 raft_consensus.cc:482] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:40.563763 25188 raft_consensus.cc:3037] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.565620 24663 raft_consensus.cc:348] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.566556 24663 raft_consensus.cc:374] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:40.566977 24663 raft_consensus.cc:729] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:40.506394 24997 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.568956 24663 consensus_queue.cc:260] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.548792 24237 catalog_manager.cc:5495] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:40.575217 24440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:40.575685 24663 ts_tablet_manager.cc:1428] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260811 16:08:40.576853 25197 raft_consensus.cc:2726] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:40.588300 24663 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:40.591262 25192 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:40.592243 25192 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:40.598279 25192 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:40.598598 24238 catalog_manager.cc:5495] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:40.605706 24663 tablet_bootstrap.cc:654] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:40.605268 25188 raft_consensus.cc:504] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:40.607702 25188 leader_election.cc:288] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:40.607972 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:40.609000 24520 raft_consensus.cc:2379] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:40.610427 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:40.602905 24238 catalog_manager.cc:5495] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:40.606979 24441 raft_consensus.cc:2454] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:40.615479 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:40.612913 25197 raft_consensus.cc:482] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:08:40.618275 24402 leader_election.cc:341] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:40.619980 25197 raft_consensus.cc:504] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:40.618166 24605 raft_consensus.cc:3037] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.633400 24661 tablet_bootstrap.cc:492] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6: No bootstrap required, opened a new log
I20260811 16:08:40.634045 24661 ts_tablet_manager.cc:1397] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6: Time spent bootstrapping tablet: real 0.195s	user 0.010s	sys 0.003s
I20260811 16:08:40.637436 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:40.638024 25197 leader_election.cc:288] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:40.638278 24516 raft_consensus.cc:3037] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:40.644611 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:40.652880 25197 consensus_queue.cc:1035] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:40.653996 24485 leader_election.cc:341] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:40.661931 24661 raft_consensus.cc:348] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:40.663101 24661 raft_consensus.cc:374] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:40.663462 24661 raft_consensus.cc:729] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Initialized, Role: FOLLOWER
I20260811 16:08:40.671702 24661 consensus_queue.cc:260] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:40.672402 24572 leader_election.cc:302] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:40.678645 24516 raft_consensus.cc:2454] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:40.726037 24663 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:40.956171 24663 ts_tablet_manager.cc:1397] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.368s	user 0.043s	sys 0.025s
I20260811 16:08:40.714758 24237 catalog_manager.cc:5495] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 1 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:40.767649 24402 leader_election.cc:302] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:40.687419 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:40.736299 24485 consensus_peers.cc:487] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:40.754724 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:40.964507 24441 raft_consensus.cc:2454] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 0.
W20260811 16:08:40.964668 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 228341us
I20260811 16:08:40.965620 24601 raft_consensus.cc:2379] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:40.716223 24605 raft_consensus.cc:2454] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:40.735791 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b630b4a32d1a4cfab0626c4f2715c9c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:40.947032 25238 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:40.716996 24661 ts_tablet_manager.cc:1428] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.004s
I20260811 16:08:40.691728 25174 raft_consensus.cc:482] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:41.001116 25174 raft_consensus.cc:504] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:40.679364 25212 raft_consensus.cc:2781] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:41.004115 25212 raft_consensus.cc:686] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:41.006011 25212 consensus_queue.cc:237] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:40.997285 25080 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:41.008121 25080 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.013358 25174 leader_election.cc:288] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:41.029487 25075 raft_consensus.cc:2781] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:41.030471 25075 raft_consensus.cc:686] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:41.031467 24663 raft_consensus.cc:348] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.034653 25075 consensus_queue.cc:237] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:41.037663 24663 raft_consensus.cc:374] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:41.039470 24663 raft_consensus.cc:729] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:41.039986 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 95433.5us
I20260811 16:08:41.022085 25238 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.064997 25238 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:41.041604 24663 consensus_queue.cc:260] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.074251 25080 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:41.087167 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 319426us
I20260811 16:08:41.096329 24748 consensus_queue.cc:1035] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:41.112237 24314 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:41.113569 25184 raft_consensus.cc:3037] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:41.119803 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:41.121237 24520 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:41.122526 24663 ts_tablet_manager.cc:1428] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.166s	user 0.012s	sys 0.000s
W20260811 16:08:41.124950 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 108388us
I20260811 16:08:41.140589 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:41.204964 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:41.206427 24358 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:41.223376 25184 raft_consensus.cc:2726] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:41.234504 25246 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:41.245522 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:41.246832 24605 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:41.252758 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ed5dfcb9ba47fb84094969135b3697" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:41.254076 24516 raft_consensus.cc:2379] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 1: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:41.235806 25246 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.270474 25244 consensus_queue.cc:1035] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:41.267067 24572 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:41.255664 24485 leader_election.cc:302] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:41.295723 24663 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:41.302407 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:41.303399 24356 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:41.305967 25246 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:41.331833 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 130175us
I20260811 16:08:41.334013 25246 raft_consensus.cc:2781] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:08:41.334548 25246 raft_consensus.cc:482] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:41.334960 25246 raft_consensus.cc:3037] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:41.332983 24235 catalog_manager.cc:5495] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:41.355549 24238 catalog_manager.cc:5495] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 1 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
W20260811 16:08:41.375994 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 109532us
I20260811 16:08:41.377061 25100 raft_consensus.cc:2781] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:41.385627 25100 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:41.386152 25100 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:41.409699 24314 leader_election.cc:302] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:41.412955 25184 raft_consensus.cc:2726] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:08:41.425935 24572 leader_election.cc:302] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:41.440713 25242 raft_consensus.cc:3037] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:41.457561 25242 raft_consensus.cc:2726] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:08:41.464243 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 52353.6us
I20260811 16:08:41.468869 24997 consensus_queue.cc:1035] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:41.471439 24485 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:41.472594 24997 raft_consensus.cc:2781] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:41.473095 24997 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:41.477494 24997 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:41.490124 25100 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.441915 25246 raft_consensus.cc:504] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:41.503232 24314 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 50416.2us
I20260811 16:08:41.528777 25192 consensus_queue.cc:1035] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260811 16:08:41.524807 25100 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:41.532194 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:41.544869 25243 consensus_queue.cc:1035] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260811 16:08:41.548421 24347 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:41.559731 24748 raft_consensus.cc:482] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:41.560691 24748 raft_consensus.cc:504] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.572193 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:41.546378 25212 consensus_queue.cc:1035] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260811 16:08:41.609421 25246 leader_election.cc:288] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:41.623620 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:41.634923 24347 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:41.651520 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:41.649262 25237 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:41.663997 25237 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.666646 24611 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
W20260811 16:08:41.682176 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 54210.5us
I20260811 16:08:41.668545 24748 leader_election.cc:288] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:41.668787 24663 tablet_bootstrap.cc:654] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Neither blocks nor log segments found. Creating new log.
I20260811 16:08:41.670450 24997 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.695048 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:41.701437 24523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:41.702325 24523 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:41.703605 24524 raft_consensus.cc:2379] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 2: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:41.706986 25212 consensus_queue.cc:1035] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260811 16:08:41.713320 24611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f4360b11c44c6fa6327d0a030a1b55" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:41.668678 25237 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:41.704324 24356 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:41.717839 25243 consensus_queue.cc:1035] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260811 16:08:41.744622 24572 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:41.722549 24347 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 2.
I20260811 16:08:41.779992 25238 raft_consensus.cc:2781] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:41.818424 25238 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:41.839569 25238 raft_consensus.cc:3037] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:41.841037 24997 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:08:41.859212 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 149340us
I20260811 16:08:41.880558 24485 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:41.881728 24997 consensus_queue.cc:1035] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 16:08:41.881728 24572 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:38247, user_credentials={real_user=slave}} blocked reactor thread for 57912.6us
I20260811 16:08:41.881910 25247 raft_consensus.cc:2781] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:41.884274 25247 raft_consensus.cc:482] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:41.884702 24572 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:41.884789 25247 raft_consensus.cc:3037] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:41.897095 25100 raft_consensus.cc:2781] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:41.920619 25100 raft_consensus.cc:686] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:41.921757 25100 consensus_queue.cc:237] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.941147 24881 consensus_queue.cc:1035] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260811 16:08:41.983253 24356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:42.007259 24356 raft_consensus.cc:2379] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 2: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:42.007566 25247 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:41.982383 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:42.008896 24441 raft_consensus.cc:3037] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:42.010269 25247 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:41.981356 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:42.039659 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:41.935045 25238 raft_consensus.cc:504] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:42.054956 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 114812us
I20260811 16:08:42.050715 25238 leader_election.cc:288] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:42.069439 24354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:42.070344 24524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:42.076526 24663 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: No bootstrap required, opened a new log
I20260811 16:08:42.077544 24663 ts_tablet_manager.cc:1397] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.876s	user 0.038s	sys 0.022s
I20260811 16:08:42.081965 24663 raft_consensus.cc:348] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:42.082876 24663 raft_consensus.cc:374] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:08:42.083305 24663 raft_consensus.cc:729] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:42.072623 24354 raft_consensus.cc:3037] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:42.084239 24663 consensus_queue.cc:260] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:42.087702 24663 ts_tablet_manager.cc:1428] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260811 16:08:42.089341 24524 raft_consensus.cc:2379] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 2: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:42.094877 24441 raft_consensus.cc:2454] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:42.118230 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f4360b11c44c6fa6327d0a030a1b55" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:42.162554 24485 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:42.164973 24314 leader_election.cc:302] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:42.166947 24748 raft_consensus.cc:2726] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:42.170704 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:42.173741 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d2cd522feb43648ee671400627f17e" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:42.174780 24601 raft_consensus.cc:2379] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 2: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
W20260811 16:08:42.178309 24485 leader_election.cc:341] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:08:42.179845 25277 raft_consensus.cc:2726] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:08:42.189090 24354 raft_consensus.cc:2454] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 2.
I20260811 16:08:42.193495 24238 catalog_manager.cc:5495] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 2 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:42.198406 24357 raft_consensus.cc:3037] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:42.199034 24572 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:42.204456 25077 raft_consensus.cc:2781] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:42.205127 25077 raft_consensus.cc:686] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:42.206117 25077 consensus_queue.cc:237] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:42.204604 24485 leader_election.cc:302] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:42.213485 25277 raft_consensus.cc:2781] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:08:42.214061 25277 raft_consensus.cc:686] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:42.215049 25277 consensus_queue.cc:237] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:42.219759 24292 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:08:42.269116 24485 leader_election.cc:302] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:42.270339 25207 raft_consensus.cc:2726] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:08:42.311558 25094 raft_consensus.cc:482] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:42.312134 25094 raft_consensus.cc:504] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:42.314393 25094 leader_election.cc:288] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:42.316525 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:42.317474 24441 raft_consensus.cc:2379] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7631002fc97849e6bc5842e364e770e3 in current term 1: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:42.319962 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:42.323591 24314 leader_election.cc:302] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:42.322978 24238 catalog_manager.cc:5495] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 2 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:42.325073 25260 raft_consensus.cc:3037] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:08:42.337009 25260 raft_consensus.cc:2726] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:08:42.339934 24235 catalog_manager.cc:5495] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:42.429647 24519 raft_consensus.cc:1261] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:08:42.431039 25239 consensus_queue.cc:1035] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:42.448942 24347 raft_consensus.cc:1261] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:08:42.451361 25100 consensus_queue.cc:1035] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:42.752305 24347 raft_consensus.cc:1261] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:08:42.753713 25100 consensus_queue.cc:1035] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:42.755519 25282 consensus_queue.cc:1035] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:42.756450 24519 raft_consensus.cc:1261] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 16:08:42.757925 25077 consensus_queue.cc:1035] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:08:42.764976 25282 consensus_queue.cc:1035] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:08:43.041097 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
W20260811 16:08:43.072913 24402 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:08:43.096303 24402 consensus_peers.cc:487] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.097182 24402 consensus_peers.cc:487] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.106339 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:43.112978 12383 tablet_replica.cc:330] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.113960 12383 raft_consensus.cc:2229] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.114718 12383 raft_consensus.cc:2258] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.119190 12383 tablet_replica.cc:330] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.120151 12383 raft_consensus.cc:2229] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.120594 12383 raft_consensus.cc:2258] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.122931 12383 tablet_replica.cc:330] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
W20260811 16:08:43.119057 24572 consensus_peers.cc:487] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.123718 12383 raft_consensus.cc:2229] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.124296 12383 raft_consensus.cc:2258] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.127357 12383 tablet_replica.cc:330] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.128065 12383 raft_consensus.cc:2229] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.128477 12383 raft_consensus.cc:2258] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.130930 12383 tablet_replica.cc:330] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.131851 12383 raft_consensus.cc:2229] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.132727 12383 raft_consensus.cc:2258] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.136535 12383 tablet_replica.cc:330] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.137367 12383 raft_consensus.cc:2229] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.138415 12383 raft_consensus.cc:2258] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.139796 24572 consensus_peers.cc:487] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.141161 12383 tablet_replica.cc:330] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.141898 12383 raft_consensus.cc:2229] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.142419 12383 raft_consensus.cc:2258] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.145102 12383 tablet_replica.cc:330] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.145812 12383 raft_consensus.cc:2229] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.146447 12383 raft_consensus.cc:2258] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.147751 24572 consensus_peers.cc:487] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.149179 12383 tablet_replica.cc:330] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.149996 12383 raft_consensus.cc:2229] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.150527 12383 raft_consensus.cc:2258] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.153163 12383 tablet_replica.cc:330] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.153779 12383 raft_consensus.cc:2229] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.154783 12383 raft_consensus.cc:2258] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.155747 24572 consensus_peers.cc:487] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.157109 12383 tablet_replica.cc:330] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.157856 12383 raft_consensus.cc:2229] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.158310 12383 raft_consensus.cc:2258] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.160813 12383 tablet_replica.cc:330] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.161484 12383 raft_consensus.cc:2229] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.162089 12383 raft_consensus.cc:2258] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.164646 12383 tablet_replica.cc:330] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.165365 12383 raft_consensus.cc:2229] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.165887 12383 raft_consensus.cc:2258] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.168761 12383 tablet_replica.cc:330] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.169478 12383 raft_consensus.cc:2229] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.169857 12383 raft_consensus.cc:2258] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.172238 12383 tablet_replica.cc:330] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.172856 12383 raft_consensus.cc:2229] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.173429 12383 raft_consensus.cc:2258] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.176445 12383 tablet_replica.cc:330] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.177139 12383 raft_consensus.cc:2229] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.177663 12383 raft_consensus.cc:2258] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.179926 12383 tablet_replica.cc:330] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.180588 12383 raft_consensus.cc:2229] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.181147 12383 raft_consensus.cc:2258] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.184163 12383 tablet_replica.cc:330] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.184859 12383 raft_consensus.cc:2229] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.185321 12383 raft_consensus.cc:2258] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.187378 12383 tablet_replica.cc:330] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.188055 12383 raft_consensus.cc:2229] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.188516 12383 raft_consensus.cc:2258] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.190985 12383 tablet_replica.cc:330] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.191654 12383 raft_consensus.cc:2229] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.192541 12383 raft_consensus.cc:2258] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.194810 12383 tablet_replica.cc:330] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.195425 12383 raft_consensus.cc:2229] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.195902 12383 raft_consensus.cc:2258] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.198448 12383 tablet_replica.cc:330] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.199134 12383 raft_consensus.cc:2229] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.199777 12383 raft_consensus.cc:2258] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.201922 12383 tablet_replica.cc:330] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.202579 12383 raft_consensus.cc:2229] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.202993 12383 raft_consensus.cc:2258] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.206264 12383 tablet_replica.cc:330] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.206961 12383 raft_consensus.cc:2229] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.207962 12383 raft_consensus.cc:2258] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.210244 12383 tablet_replica.cc:330] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.210913 12383 raft_consensus.cc:2229] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.211469 12383 raft_consensus.cc:2258] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.214236 12383 tablet_replica.cc:330] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.215000 12383 raft_consensus.cc:2229] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.215606 12383 raft_consensus.cc:2258] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.215843 24485 consensus_peers.cc:487] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.218633 12383 tablet_replica.cc:330] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.219666 12383 raft_consensus.cc:2229] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.220266 12383 raft_consensus.cc:2258] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.227483 12383 tablet_replica.cc:330] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.229631 12383 raft_consensus.cc:2229] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.230311 12383 raft_consensus.cc:2258] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.234037 12383 tablet_replica.cc:330] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.234980 12383 raft_consensus.cc:2229] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.236363 12383 raft_consensus.cc:2258] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.237860 24402 consensus_peers.cc:487] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.239658 12383 tablet_replica.cc:330] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.240851 12383 raft_consensus.cc:2229] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.241593 12383 raft_consensus.cc:2258] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.245468 12383 tablet_replica.cc:330] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.246472 12383 raft_consensus.cc:2229] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.247290 12383 raft_consensus.cc:2258] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.250677 12383 tablet_replica.cc:330] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.251680 12383 raft_consensus.cc:2229] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.252992 12383 raft_consensus.cc:2258] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.254796 24572 consensus_peers.cc:487] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.256345 12383 tablet_replica.cc:330] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.257346 12383 raft_consensus.cc:2229] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.257944 12383 raft_consensus.cc:2258] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.258488 24572 consensus_peers.cc:487] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.261411 12383 tablet_replica.cc:330] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.262557 12383 raft_consensus.cc:2229] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.263098 12383 raft_consensus.cc:2258] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.266042 12383 tablet_replica.cc:330] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.266758 12383 raft_consensus.cc:2229] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.267896 12383 raft_consensus.cc:2258] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.270521 12383 tablet_replica.cc:330] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.271211 12383 raft_consensus.cc:2229] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.271711 12383 raft_consensus.cc:2258] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.274000 12383 tablet_replica.cc:330] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.274700 12383 raft_consensus.cc:2229] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.276166 12383 raft_consensus.cc:2258] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.279603 12383 tablet_replica.cc:330] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.280658 12383 raft_consensus.cc:2229] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.281288 12383 raft_consensus.cc:2258] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.284932 24485 consensus_peers.cc:487] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.285768 24485 consensus_peers.cc:487] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.284987 12383 tablet_replica.cc:330] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.289650 12383 raft_consensus.cc:2229] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
W20260811 16:08:43.290292 24572 consensus_peers.cc:487] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.291115 12383 raft_consensus.cc:2258] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.294229 12383 tablet_replica.cc:330] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.295186 12383 raft_consensus.cc:2229] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.296319 12383 raft_consensus.cc:2258] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.299449 12383 tablet_replica.cc:330] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.300490 12383 raft_consensus.cc:2229] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
W20260811 16:08:43.301744 24485 consensus_peers.cc:487] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.301771 12383 raft_consensus.cc:2258] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.303123 24572 consensus_peers.cc:487] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.305433 12383 tablet_replica.cc:330] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
W20260811 16:08:43.305969 24485 consensus_peers.cc:487] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.306363 12383 raft_consensus.cc:2229] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.306944 12383 raft_consensus.cc:2258] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.308492 24402 consensus_peers.cc:487] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.310109 12383 tablet_replica.cc:330] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.310838 12383 raft_consensus.cc:2229] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:43.311318 12383 raft_consensus.cc:2258] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.313738 12383 tablet_replica.cc:330] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.314428 12383 raft_consensus.cc:2229] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.315513 12383 raft_consensus.cc:2258] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:43.318580 12383 tablet_replica.cc:330] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: stopping tablet replica
I20260811 16:08:43.319356 12383 raft_consensus.cc:2229] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:08:43.320572 12383 raft_consensus.cc:2258] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:43.327791 24572 consensus_peers.cc:487] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.343470 24572 consensus_peers.cc:487] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.376556 24402 consensus_peers.cc:487] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.377161 24485 consensus_peers.cc:487] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.383827 24572 consensus_peers.cc:487] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.384716 24572 consensus_peers.cc:487] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.386350 24485 consensus_peers.cc:487] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.406198 24485 consensus_peers.cc:487] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.410840 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
W20260811 16:08:43.426169 24572 consensus_peers.cc:487] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.432025 24402 consensus_peers.cc:487] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.434957 24485 consensus_peers.cc:487] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.454012 24572 consensus_peers.cc:487] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.509702 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:08:43.516772 24572 consensus_peers.cc:487] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.519636 25314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:43.519603 25315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:08:43.522254 25317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:08:43.524768 12383 server_base.cc:1034] running on GCE node
I20260811 16:08:43.530875 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:08:43.531278 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:08:43.531508 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464523531490 us; error 0 us; skew 500 ppm
I20260811 16:08:43.532337 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:08:43.540637 12383 webserver.cc:460] Webserver started at http://127.12.23.193:34141/ using document root <none> and password file <none>
I20260811 16:08:43.541579 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:08:43.541878 12383 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260811 16:08:43.550086 12383 fs_manager.cc:709] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
W20260811 16:08:43.560057 24402 consensus_peers.cc:487] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:43.565726 24485 consensus_peers.cc:487] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:43.566283 25324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:08:43.567485 12383 fs_manager.cc:725] Time spent opening block manager: real 0.008s	user 0.003s	sys 0.000s
I20260811 16:08:43.567917 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "7631002fc97849e6bc5842e364e770e3"
format_stamp: "Formatted at 2026-08-11 16:08:28 on dist-test-slave-chsk"
I20260811 16:08:43.568482 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:08:43.585228 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:08:43.586679 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:08:43.588310 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:08:43.593894 25331 ts_tablet_manager.cc:542] Loading tablet metadata (0/45 complete)
I20260811 16:08:43.987222 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260811 16:08:43.987617 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.395s	user 0.010s	sys 0.000s
I20260811 16:08:43.987973 12383 ts_tablet_manager.cc:594] Registering tablets (0/45 complete)
I20260811 16:08:43.996248 25331 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.030184 25331 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.031190 25331 tablet_bootstrap.cc:492] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.031917 25331 ts_tablet_manager.cc:1397] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.012s
I20260811 16:08:44.034402 25331 raft_consensus.cc:348] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.035182 25331 raft_consensus.cc:729] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.035956 25331 consensus_queue.cc:260] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.038300 25331 ts_tablet_manager.cc:1428] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260811 16:08:44.039091 25331 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.077724 25331 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.078738 25331 tablet_bootstrap.cc:492] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.079493 25331 ts_tablet_manager.cc:1397] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.016s
I20260811 16:08:44.081938 25331 raft_consensus.cc:348] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.082723 25331 raft_consensus.cc:729] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.083444 25331 consensus_queue.cc:260] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.086589 25331 ts_tablet_manager.cc:1428] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260811 16:08:44.087349 25331 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.099449 25331 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.100231 25331 tablet_bootstrap.cc:492] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.100862 25331 ts_tablet_manager.cc:1397] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260811 16:08:44.102783 25331 raft_consensus.cc:348] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.103430 25331 raft_consensus.cc:729] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.104060 25331 consensus_queue.cc:260] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.105566 25331 ts_tablet_manager.cc:1428] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260811 16:08:44.106215 25331 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.119786 25331 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.124048 25331 tablet_bootstrap.cc:492] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.126355 25331 ts_tablet_manager.cc:1397] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260811 16:08:44.128723 25331 raft_consensus.cc:348] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.129422 25331 raft_consensus.cc:729] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.129964 25331 consensus_queue.cc:260] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.131520 25331 ts_tablet_manager.cc:1428] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260811 16:08:44.132200 25331 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.146190 25331 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.147204 25331 tablet_bootstrap.cc:492] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.147821 25331 ts_tablet_manager.cc:1397] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260811 16:08:44.149994 25331 raft_consensus.cc:348] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.150599 25331 raft_consensus.cc:729] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.151206 25331 consensus_queue.cc:260] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.152724 25331 ts_tablet_manager.cc:1428] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260811 16:08:44.153501 25331 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.170439 25331 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.171795 25331 tablet_bootstrap.cc:492] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.172538 25331 ts_tablet_manager.cc:1397] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260811 16:08:44.175129 25331 raft_consensus.cc:348] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.176322 25331 raft_consensus.cc:729] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.178320 25331 consensus_queue.cc:260] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.180459 25331 ts_tablet_manager.cc:1428] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260811 16:08:44.181293 25331 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.197121 25331 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.198196 25331 tablet_bootstrap.cc:492] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.198899 25331 ts_tablet_manager.cc:1397] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260811 16:08:44.201902 25331 raft_consensus.cc:348] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.202664 25331 raft_consensus.cc:729] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.202986 25239 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.203421 25331 consensus_queue.cc:260] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.203699 25239 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:44.205651 25331 ts_tablet_manager.cc:1428] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260811 16:08:44.205878 25239 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:44.206529 25331 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.208528 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:44.213274 24572 leader_election.cc:334] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.214363 24572 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.215071 25239 raft_consensus.cc:2726] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.219125 25334 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.219827 25334 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.222200 25334 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.223870 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:44.226436 24485 leader_election.cc:334] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.226836 24485 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:44.227496 25334 raft_consensus.cc:2726] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.227970 25331 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.229051 25331 tablet_bootstrap.cc:492] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.229761 25331 ts_tablet_manager.cc:1397] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260811 16:08:44.232272 25331 raft_consensus.cc:348] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.233006 25331 raft_consensus.cc:729] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.233654 25331 consensus_queue.cc:260] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.235957 25331 ts_tablet_manager.cc:1428] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260811 16:08:44.236796 25331 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.253413 25331 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.254489 25331 tablet_bootstrap.cc:492] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.255232 25331 ts_tablet_manager.cc:1397] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260811 16:08:44.257613 25331 raft_consensus.cc:348] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.258378 25331 raft_consensus.cc:729] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.259052 25331 consensus_queue.cc:260] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.261925 25331 ts_tablet_manager.cc:1428] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260811 16:08:44.262935 25331 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.273455 25334 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.274092 25334 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:44.276501 25334 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:44.280264 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.281045 24605 raft_consensus.cc:2454] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:44.287277 25235 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.287945 25235 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.290066 25235 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.296911 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.308264 25332 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.308972 25332 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.319875 25334 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.320622 25334 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.322806 25334 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.323385 25334 raft_consensus.cc:482] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.324687 25276 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.323935 25334 raft_consensus.cc:504] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.325275 25276 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.328892 25276 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.329903 25334 leader_election.cc:288] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:08:44.331490 24402 leader_election.cc:334] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.332955 25332 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:44.335111 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.335000 24402 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.340116 25332 raft_consensus.cc:2726] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:08:44.352001 24572 leader_election.cc:334] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.354031 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.355116 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.355888 24485 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:44.358747 25309 raft_consensus.cc:2781] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.362862 25309 raft_consensus.cc:482] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.363462 25309 raft_consensus.cc:3037] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.364204 25332 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.364899 25332 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.368060 25332 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:44.371359 24485 leader_election.cc:334] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.353602 24402 leader_election.cc:334] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.352818 24572 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.376467 25239 raft_consensus.cc:2726] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.379835 24402 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.380690 25332 raft_consensus.cc:2726] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.378960 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.381620 24515 raft_consensus.cc:2454] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:44.387176 25331 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.388312 25331 tablet_bootstrap.cc:492] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.388532 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.389077 25331 ts_tablet_manager.cc:1397] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.126s	user 0.044s	sys 0.048s
I20260811 16:08:44.395977 24402 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.396297 25331 raft_consensus.cc:348] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.396880 25332 raft_consensus.cc:2781] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260811 16:08:44.396966 24485 leader_election.cc:334] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.397055 25331 raft_consensus.cc:729] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.397392 25332 raft_consensus.cc:482] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
W20260811 16:08:44.397943 24402 leader_election.cc:334] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.399881 25332 raft_consensus.cc:3037] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.399974 25331 consensus_queue.cc:260] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:44.400421 24485 leader_election.cc:334] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.402235 24485 leader_election.cc:302] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:44.402992 25334 raft_consensus.cc:2726] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.403047 25331 ts_tablet_manager.cc:1428] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260811 16:08:44.404598 25331 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.407802 12383 ts_tablet_manager.cc:610] Registered 45 tablets
I20260811 16:08:44.408226 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.420s	user 0.331s	sys 0.002s
I20260811 16:08:44.409200 25332 raft_consensus.cc:504] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.410979 25309 raft_consensus.cc:504] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:44.413256 24485 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.416327 25309 leader_election.cc:288] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
W20260811 16:08:44.417743 24402 leader_election.cc:334] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.418834 25334 raft_consensus.cc:2726] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.425552 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f248d334c04397adb27e611172a2e8" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:44.426308 24516 raft_consensus.cc:3037] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.427901 25276 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.428587 25276 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.431288 25276 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.439023 25332 leader_election.cc:288] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:44.446791 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.449443 25332 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.450089 25332 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.450889 25075 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.451483 25075 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.452464 25332 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.453567 25075 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.447765 24516 raft_consensus.cc:2454] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:44.457108 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.457445 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62fbb0d94a2b49b2bab6a36b517ae048" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:44.458063 24602 raft_consensus.cc:3037] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.459164 25276 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.458796 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.457993 24601 raft_consensus.cc:2454] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:44.459760 25276 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.461009 24605 raft_consensus.cc:2454] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:44.461900 25332 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.462069 25276 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.462605 25332 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:44.464520 24572 leader_election.cc:334] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.465162 25332 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:44.465580 24572 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:44.465926 24402 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.466871 25276 raft_consensus.cc:2726] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.466882 24402 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.468051 24602 raft_consensus.cc:2454] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
I20260811 16:08:44.469573 25235 raft_consensus.cc:482] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.469465 24402 leader_election.cc:302] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.470059 25075 raft_consensus.cc:2781] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.471122 25075 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.471167 25235 raft_consensus.cc:504] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.473759 25235 leader_election.cc:288] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:44.474543 25235 raft_consensus.cc:2781] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.471807 25075 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.470194 25332 raft_consensus.cc:2781] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.475777 25332 raft_consensus.cc:482] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.476392 25332 raft_consensus.cc:3037] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.475101 25235 raft_consensus.cc:686] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:44.480690 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.481714 25309 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.482828 25309 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.489225 25100 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.489887 25100 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.494238 25331 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.494704 25332 raft_consensus.cc:504] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.496196 25100 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.497634 25332 leader_election.cc:288] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.498960 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.499963 24515 raft_consensus.cc:2454] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:44.503029 25331 tablet_bootstrap.cc:492] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.504267 25331 ts_tablet_manager.cc:1397] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.012s
W20260811 16:08:44.504980 24572 leader_election.cc:334] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.508076 25331 raft_consensus.cc:348] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.480033 25235 consensus_queue.cc:237] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.509588 25331 raft_consensus.cc:729] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.510704 25331 consensus_queue.cc:260] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.513692 25331 ts_tablet_manager.cc:1428] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260811 16:08:44.514990 25331 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
W20260811 16:08:44.525527 24572 leader_election.cc:334] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.531680 25309 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.532218 24572 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.534488 24485 leader_election.cc:302] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:44.536196 25334 raft_consensus.cc:2781] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.536569 25100 raft_consensus.cc:2781] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.537073 25100 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.537554 25100 raft_consensus.cc:3037] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.538183 25239 raft_consensus.cc:482] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.538800 25239 raft_consensus.cc:504] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.541292 25239 leader_election.cc:288] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.537052 25334 raft_consensus.cc:686] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:44.548187 24985 raft_consensus.cc:482] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.553061 24985 raft_consensus.cc:504] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.555055 24985 leader_election.cc:288] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.546892 25100 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.557746 25100 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.548554 25334 consensus_queue.cc:237] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:44.565761 25239 raft_consensus.cc:482] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.566776 25239 raft_consensus.cc:504] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.569873 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:44.570050 25239 leader_election.cc:288] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.570822 24515 raft_consensus.cc:3037] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.580476 24515 raft_consensus.cc:2454] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 2.
I20260811 16:08:44.582067 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.583096 24516 raft_consensus.cc:2454] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
W20260811 16:08:44.586239 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 51919.5us
I20260811 16:08:44.589620 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.590446 24441 raft_consensus.cc:2454] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:44.593238 24572 leader_election.cc:302] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.594421 25239 raft_consensus.cc:2781] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.594954 25239 raft_consensus.cc:482] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.595475 25239 raft_consensus.cc:3037] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:08:44.598101 24572 leader_election.cc:334] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.598721 24572 leader_election.cc:334] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.603061 24572 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
W20260811 16:08:44.603960 24485 leader_election.cc:334] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.605362 25100 raft_consensus.cc:2781] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.605938 25100 raft_consensus.cc:686] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:44.606873 25100 consensus_queue.cc:237] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.606652 25239 raft_consensus.cc:504] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.610643 24985 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.611387 24985 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.614135 24985 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.620009 24572 leader_election.cc:302] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.624187 25276 raft_consensus.cc:2781] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.624661 25276 raft_consensus.cc:482] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.625034 25276 raft_consensus.cc:3037] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.628636 24234 catalog_manager.cc:5495] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:44.628674 25239 leader_election.cc:288] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.636153 25235 raft_consensus.cc:482] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.637737 24238 catalog_manager.cc:5495] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:44.639384 25239 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.633575 25276 raft_consensus.cc:504] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.589447 25075 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.644029 24437 raft_consensus.cc:2379] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 707f02c5118a4d798120ca9c5786ada6 in current term 2: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:44.640373 25239 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.646754 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0849d70159164a57a23b734a02aca623" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:44.647429 24441 raft_consensus.cc:3037] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.638896 25235 raft_consensus.cc:504] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.649128 25239 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.651039 25235 leader_election.cc:288] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:44.651881 25334 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
W20260811 16:08:44.653913 24402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:40337, user_credentials={real_user=slave}} blocked reactor thread for 184526us
I20260811 16:08:44.658519 24441 raft_consensus.cc:2454] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 2.
I20260811 16:08:44.663297 25276 leader_election.cc:288] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.664888 25075 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.670267 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.671414 24437 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
W20260811 16:08:44.673527 25355 log.cc:924] Time spent T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260811 16:08:44.676119 24235 catalog_manager.cc:5495] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 2 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:44.660597 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.683805 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.684456 24515 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:44.685302 24602 raft_consensus.cc:2379] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 2: Already voted for candidate 707f02c5118a4d798120ca9c5786ada6 in this term.
I20260811 16:08:44.652650 25334 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.691725 24572 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:44.694799 24572 leader_election.cc:302] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.699787 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:44.700277 25100 raft_consensus.cc:2781] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.700912 25100 raft_consensus.cc:686] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:44.701361 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.702354 24602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5807918611104b39a416c792b9a4994b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:44.702034 25100 consensus_queue.cc:237] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.703015 24602 raft_consensus.cc:3037] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.703649 24520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:44.704506 24520 raft_consensus.cc:2454] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:44.705956 25331 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.708354 25276 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:08:44.710999 24402 leader_election.cc:334] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.711956 24402 leader_election.cc:334] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.713847 25331 tablet_bootstrap.cc:492] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.720791 25331 ts_tablet_manager.cc:1397] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.206s	user 0.049s	sys 0.071s
I20260811 16:08:44.721994 24402 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
W20260811 16:08:44.698146 24572 leader_election.cc:334] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.724041 24402 leader_election.cc:302] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.725291 25351 raft_consensus.cc:2781] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.725705 25351 raft_consensus.cc:482] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.726089 25351 raft_consensus.cc:3037] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:08:44.727779 24402 leader_election.cc:334] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.728556 24402 leader_election.cc:334] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.728937 24402 leader_election.cc:302] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.729450 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.730154 24437 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 1.
I20260811 16:08:44.732041 24985 raft_consensus.cc:482] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.732579 24985 raft_consensus.cc:504] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.735370 25352 raft_consensus.cc:2726] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.737315 25331 raft_consensus.cc:348] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.738078 25331 raft_consensus.cc:729] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:44.735456 24402 leader_election.cc:334] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.738438 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
W20260811 16:08:44.738961 24402 leader_election.cc:334] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.739212 24439 raft_consensus.cc:2454] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
W20260811 16:08:44.740013 24402 leader_election.cc:334] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.742687 24485 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.691049 25334 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.742514 25331 consensus_queue.cc:260] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.749930 24985 leader_election.cc:288] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.749760 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f054b2c61c564c9aac4234bf8b363331" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:44.760568 24519 raft_consensus.cc:3037] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.724131 25350 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.761834 25350 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.762290 25350 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.762984 24485 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.763600 25331 ts_tablet_manager.cc:1428] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260811 16:08:44.767752 25331 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.733997 24602 raft_consensus.cc:2454] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:44.768877 25366 raft_consensus.cc:2781] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.769469 25366 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.760557 25334 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.769944 25366 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.780583 24402 leader_election.cc:302] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.782912 25235 raft_consensus.cc:2781] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.783504 25235 raft_consensus.cc:686] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:44.780191 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:44.772969 25334 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.774113 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:44.796257 24605 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:44.797258 24437 raft_consensus.cc:2454] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 1.
I20260811 16:08:44.793466 25334 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.784469 25235 consensus_queue.cc:237] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.806891 25276 raft_consensus.cc:2726] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.812773 24519 raft_consensus.cc:2454] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 2.
I20260811 16:08:44.829545 24606 raft_consensus.cc:2454] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:44.831923 25351 raft_consensus.cc:504] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.840538 25351 leader_election.cc:288] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:44.835862 24572 leader_election.cc:334] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.818526 25350 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.846930 25350 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:44.846911 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.196:32811, user_credentials={real_user=slave}} blocked reactor thread for 71410.2us
I20260811 16:08:44.847710 25334 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:44.851080 24485 leader_election.cc:334] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.851874 24485 leader_election.cc:302] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.854257 25360 raft_consensus.cc:2726] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.857190 25334 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.862068 24485 leader_election.cc:302] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.864001 25360 raft_consensus.cc:2781] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.864609 25360 raft_consensus.cc:482] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.864979 25360 raft_consensus.cc:3037] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.863822 25366 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.870659 25366 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.872268 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:44.873605 24519 raft_consensus.cc:2379] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d44d109b1df0445eba66548c099958e3 in current term 2: Already voted for candidate 6f165e96383a40dc9d724b290a94706d in this term.
I20260811 16:08:44.875325 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057bc48deb6f442091c76a87d3345c3b" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:44.876282 24515 raft_consensus.cc:3037] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.877478 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:44.877928 24402 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.878393 24437 raft_consensus.cc:2379] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f165e96383a40dc9d724b290a94706d in current term 2: Already voted for candidate d44d109b1df0445eba66548c099958e3 in this term.
I20260811 16:08:44.879411 25350 raft_consensus.cc:2781] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.879459 24572 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 
W20260811 16:08:44.880642 24485 leader_election.cc:334] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.881389 25371 raft_consensus.cc:2781] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.882058 25371 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.880151 25350 raft_consensus.cc:686] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:44.885063 25371 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.885846 25350 consensus_queue.cc:237] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:44.898129 24485 leader_election.cc:334] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.886991 25360 raft_consensus.cc:504] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:44.889537 24572 leader_election.cc:334] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.899742 24572 leader_election.cc:334] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.902171 24515 raft_consensus.cc:2454] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:44.905519 25331 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.906592 25331 tablet_bootstrap.cc:492] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.908841 24572 leader_election.cc:302] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.910328 25276 raft_consensus.cc:2781] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.910842 25276 raft_consensus.cc:686] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:44.911777 25276 consensus_queue.cc:237] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:44.913873 24485 leader_election.cc:334] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.916997 24485 leader_election.cc:334] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.917583 24402 leader_election.cc:302] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:44.916061 25360 leader_election.cc:288] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:08:44.918722 24402 leader_election.cc:334] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:44.919575 24402 leader_election.cc:334] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:44.920455 25331 ts_tablet_manager.cc:1397] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.011s
I20260811 16:08:44.921527 25235 raft_consensus.cc:2781] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:44.922228 25235 raft_consensus.cc:686] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:44.923228 25235 consensus_queue.cc:237] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.925562 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:44.926290 24437 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.927155 25331 raft_consensus.cc:348] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.927963 25331 raft_consensus.cc:729] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.928680 25331 consensus_queue.cc:260] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:44.919947 25371 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.935443 25371 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:44.938069 25331 ts_tablet_manager.cc:1428] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260811 16:08:44.939065 25331 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:44.919999 24402 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44d109b1df0445eba66548c099958e3; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.945806 25350 raft_consensus.cc:2726] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:08:44.952414 24238 catalog_manager.cc:5495] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 2 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:44.954504 24238 catalog_manager.cc:5495] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 2 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:44.955235 24235 catalog_manager.cc:5495] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:44.956939 24235 catalog_manager.cc:5495] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:44.960100 24485 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:44.965157 25366 raft_consensus.cc:2781] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:08:44.965554 25366 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:08:44.965946 25366 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.964257 24437 raft_consensus.cc:2454] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
I20260811 16:08:44.977480 25366 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:44.979885 25366 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:44.982416 25331 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:44.984810 25331 tablet_bootstrap.cc:492] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:44.985811 25331 ts_tablet_manager.cc:1397] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.000s
I20260811 16:08:44.987686 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:44.988425 24439 raft_consensus.cc:3037] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.989243 25331 raft_consensus.cc:348] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.988993 24235 catalog_manager.cc:5495] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:44.990083 25331 raft_consensus.cc:729] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:44.991071 25331 consensus_queue.cc:260] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:44.996297 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "707f02c5118a4d798120ca9c5786ada6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:44.996982 24441 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:44.994320 25331 ts_tablet_manager.cc:1428] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260811 16:08:45.002533 25331 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:45.010100 24515 raft_consensus.cc:1261] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.014672 25276 consensus_queue.cc:1035] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260811 16:08:45.016909 24572 leader_election.cc:334] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:45.018505 24441 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 707f02c5118a4d798120ca9c5786ada6 in term 2.
I20260811 16:08:45.025365 24439 raft_consensus.cc:2454] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
W20260811 16:08:45.022753 24485 leader_election.cc:334] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:45.037478 24572 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3; no voters: 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:45.038338 25276 raft_consensus.cc:2781] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:45.042869 25276 raft_consensus.cc:686] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Leader. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:45.043828 25276 consensus_queue.cc:237] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.049134 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:45.049883 24601 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:45.055426 25331 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.056933 25331 tablet_bootstrap.cc:492] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.057968 25331 ts_tablet_manager.cc:1397] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.004s
W20260811 16:08:45.058575 24402 consensus_peers.cc:487] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.067255 25331 raft_consensus.cc:348] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.068114 25331 raft_consensus.cc:729] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:45.068835 25331 consensus_queue.cc:260] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.069933 24485 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.071357 25331 ts_tablet_manager.cc:1428] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260811 16:08:45.072556 25331 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:45.073259 25366 raft_consensus.cc:2726] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.075093 24485 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:45.072392 24601 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
I20260811 16:08:45.077018 25366 raft_consensus.cc:2781] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:45.077693 25366 raft_consensus.cc:686] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
W20260811 16:08:45.079049 24572 consensus_peers.cc:487] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.078802 25366 consensus_queue.cc:237] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:45.085727 24519 raft_consensus.cc:1261] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.087522 25350 consensus_queue.cc:1035] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:45.089427 24485 leader_election.cc:302] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:45.096463 25334 raft_consensus.cc:2781] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:45.097186 25334 raft_consensus.cc:686] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:45.098345 25334 consensus_queue.cc:237] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:45.102327 24485 leader_election.cc:334] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:08:45.105809 24485 leader_election.cc:334] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:45.108232 24235 catalog_manager.cc:5495] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196). New cstate: current_term: 2 leader_uuid: "707f02c5118a4d798120ca9c5786ada6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:45.149706 24485 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:45.153110 25334 raft_consensus.cc:2781] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:45.153904 25334 raft_consensus.cc:686] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:45.155354 25334 consensus_queue.cc:237] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:45.155375 24485 leader_election.cc:334] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:08:45.177541 24441 raft_consensus.cc:1261] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.173288 24235 catalog_manager.cc:5495] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
W20260811 16:08:45.197252 24485 consensus_peers.cc:487] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.205521 25276 consensus_queue.cc:1035] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:45.206012 24601 raft_consensus.cc:1261] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.248296 25331 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.249373 25331 tablet_bootstrap.cc:492] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.250070 25331 ts_tablet_manager.cc:1397] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.178s	user 0.033s	sys 0.024s
W20260811 16:08:45.251950 24402 consensus_peers.cc:487] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.252614 25331 raft_consensus.cc:348] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.253422 25331 raft_consensus.cc:729] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:45.254240 25331 consensus_queue.cc:260] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.256481 25336 raft_consensus.cc:482] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.257007 25336 raft_consensus.cc:504] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:45.262579 25336 leader_election.cc:288] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:45.264891 24572 consensus_peers.cc:487] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.280381 25331 ts_tablet_manager.cc:1428] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260811 16:08:45.284678 25331 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:45.292536 24238 catalog_manager.cc:5495] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:45.293013 25334 consensus_queue.cc:1035] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:45.294435 24238 catalog_manager.cc:5495] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 1 to 2, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:45.332679 25336 raft_consensus.cc:482] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.333354 25336 raft_consensus.cc:504] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.339723 25336 leader_election.cc:288] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:08:45.363432 24402 consensus_peers.cc:487] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.369271 24601 raft_consensus.cc:1261] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.379447 24605 raft_consensus.cc:1261] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260811 16:08:45.386788 24402 consensus_peers.cc:487] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.389544 25351 consensus_queue.cc:1035] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260811 16:08:45.410599 24572 consensus_peers.cc:487] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.395653 25351 consensus_queue.cc:1035] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260811 16:08:45.425163 24572 consensus_peers.cc:487] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.437443 25331 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.438751 25331 tablet_bootstrap.cc:492] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.439512 25331 ts_tablet_manager.cc:1397] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.022s
I20260811 16:08:45.442083 25331 raft_consensus.cc:348] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.442862 25331 raft_consensus.cc:729] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:45.443706 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:45.443719 25331 consensus_queue.cc:260] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.446311 25331 ts_tablet_manager.cc:1428] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260811 16:08:45.447181 25331 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:45.448586 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:45.462893 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336c47cb9abd43c9b0c55f3234f96b70" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:45.468345 24515 raft_consensus.cc:1261] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.472536 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f757f75e81428e95d1831bb753267e" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:45.472867 24441 raft_consensus.cc:1261] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 707f02c5118a4d798120ca9c5786ada6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.475317 25326 leader_election.cc:302] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.476769 25336 raft_consensus.cc:2726] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.481946 25326 leader_election.cc:302] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.483377 25336 raft_consensus.cc:2726] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.489355 25100 consensus_queue.cc:1035] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:45.497696 25331 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.498761 25331 tablet_bootstrap.cc:492] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.498818 25358 consensus_queue.cc:1035] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:45.504329 25331 ts_tablet_manager.cc:1397] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.004s
I20260811 16:08:45.509059 24515 raft_consensus.cc:1261] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.510110 25331 raft_consensus.cc:348] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.510958 25331 raft_consensus.cc:729] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:45.514380 24572 consensus_peers.cc:487] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.515877 25331 consensus_queue.cc:260] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.516777 25369 consensus_queue.cc:1035] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:45.520124 25336 raft_consensus.cc:482] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.520695 25336 raft_consensus.cc:504] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:45.522987 25336 leader_election.cc:288] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:45.525125 24516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:45.529364 25331 ts_tablet_manager.cc:1428] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260811 16:08:45.530175 25336 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.530326 25331 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:45.530768 25336 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.534200 24439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "190edee3f615448b912b194695a784e6" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:45.543048 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:45.543215 25336 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:45.544737 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:45.547626 25336 raft_consensus.cc:482] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.548239 25336 raft_consensus.cc:504] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:45.551021 25336 leader_election.cc:288] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:45.551676 25336 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.552322 25336 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.554975 25336 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
W20260811 16:08:45.566416 24572 consensus_peers.cc:487] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.587406 24572 consensus_peers.cc:487] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.611738 24441 raft_consensus.cc:1261] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.614826 25326 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:45.615255 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:45.616417 25326 leader_election.cc:302] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.617941 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:45.622074 25336 raft_consensus.cc:2726] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:08:45.622922 25336 raft_consensus.cc:2726] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.623814 25459 raft_consensus.cc:482] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.624306 25459 raft_consensus.cc:504] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.626144 25459 leader_election.cc:288] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:45.628064 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:45.628908 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce968612a2824f70bea8c2c027892542" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:45.630532 25326 leader_election.cc:302] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.631554 25459 raft_consensus.cc:2726] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.640390 25368 consensus_queue.cc:1035] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:45.647697 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdded2c7ff674319b9ca73af91948e0a" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:45.648131 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
W20260811 16:08:45.650167 24572 consensus_peers.cc:487] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.650362 24485 consensus_peers.cc:487] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.680095 25331 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.681290 25331 tablet_bootstrap.cc:492] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.682063 25331 ts_tablet_manager.cc:1397] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.152s	user 0.033s	sys 0.028s
I20260811 16:08:45.697939 25331 raft_consensus.cc:348] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.698758 25331 raft_consensus.cc:729] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:45.699503 25331 consensus_queue.cc:260] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.701779 25331 ts_tablet_manager.cc:1428] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260811 16:08:45.702971 25331 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:45.715809 25326 leader_election.cc:302] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.718791 25326 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:45.720752 24439 raft_consensus.cc:1261] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260811 16:08:45.720994 24485 consensus_peers.cc:487] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.724756 25336 raft_consensus.cc:2726] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.725591 25336 raft_consensus.cc:2726] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:45.736666 25331 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.737814 25331 tablet_bootstrap.cc:492] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.738579 25331 ts_tablet_manager.cc:1397] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.019s
W20260811 16:08:45.739518 24485 consensus_peers.cc:487] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.744123 25331 raft_consensus.cc:348] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:45.745096 25331 raft_consensus.cc:729] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
W20260811 16:08:45.745893 24572 consensus_peers.cc:487] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.745872 25331 consensus_queue.cc:260] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:45.749948 25331 ts_tablet_manager.cc:1428] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260811 16:08:45.750840 25331 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
W20260811 16:08:45.753145 24485 consensus_peers.cc:487] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.753878 24485 consensus_peers.cc:487] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:45.755519 25334 consensus_queue.cc:1035] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260811 16:08:45.764007 24485 consensus_peers.cc:487] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.769613 24485 consensus_peers.cc:487] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:45.782147 24572 consensus_peers.cc:487] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.797650 24601 raft_consensus.cc:1261] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:45.798676 25459 raft_consensus.cc:482] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 16:08:45.799099 24572 consensus_peers.cc:487] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.799317 25459 raft_consensus.cc:504] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:08:45.801000 24402 consensus_peers.cc:487] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.801191 25360 consensus_queue.cc:1035] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:45.801666 25459 leader_election.cc:288] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:45.804339 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:45.811429 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:45.813421 25326 leader_election.cc:302] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:45.815367 25459 raft_consensus.cc:2726] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:08:45.820760 24572 consensus_peers.cc:487] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.821776 24485 consensus_peers.cc:487] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.822451 24402 consensus_peers.cc:487] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.828754 25331 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:45.829926 25331 tablet_bootstrap.cc:492] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:45.830731 25331 ts_tablet_manager.cc:1397] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.019s
I20260811 16:08:45.835752 25459 raft_consensus.cc:482] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.836419 25459 raft_consensus.cc:504] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
W20260811 16:08:45.838721 24402 consensus_peers.cc:487] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.839416 24402 consensus_peers.cc:487] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.853639 25459 leader_election.cc:288] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:45.853084 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:45.856925 25331 raft_consensus.cc:348] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.860652 25331 raft_consensus.cc:729] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:45.861390 25331 consensus_queue.cc:260] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:45.862932 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98f314cba976436a9dfe527ee810d1c5" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:45.863932 25331 ts_tablet_manager.cc:1428] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.000s
I20260811 16:08:45.864892 25331 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
W20260811 16:08:45.873364 24572 consensus_peers.cc:487] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:45.873811 25326 leader_election.cc:302] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:45.875579 25459 raft_consensus.cc:2726] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:08:45.912822 24402 consensus_peers.cc:487] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:45.987036 25473 log.cc:924] Time spent T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260811 16:08:45.989413 25459 raft_consensus.cc:482] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:45.990121 25459 raft_consensus.cc:504] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:45.992470 25459 leader_election.cc:288] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
W20260811 16:08:45.989382 24485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:36221, user_credentials={real_user=slave}} blocked reactor thread for 54778.7us
I20260811 16:08:46.018853 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
W20260811 16:08:46.022248 24402 consensus_peers.cc:487] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:46.022989 24402 consensus_peers.cc:487] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.026883 25331 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.027568 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b058453afc0428fb86d91e3619f3876" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:46.028585 25331 tablet_bootstrap.cc:492] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.029428 25331 ts_tablet_manager.cc:1397] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.165s	user 0.026s	sys 0.022s
W20260811 16:08:46.035207 24485 consensus_peers.cc:487] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.041239 25326 leader_election.cc:302] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6
I20260811 16:08:46.043345 25459 raft_consensus.cc:2726] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:08:46.043589 24572 consensus_peers.cc:487] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.052026 25459 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:46.052862 25459 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.052244 25331 raft_consensus.cc:348] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.063208 25331 raft_consensus.cc:729] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.064641 25459 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
W20260811 16:08:46.065649 24485 consensus_peers.cc:487] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 16:08:46.067014 24485 consensus_peers.cc:487] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.064558 25331 consensus_queue.cc:260] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.072744 25331 ts_tablet_manager.cc:1428] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260811 16:08:46.061441 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:46.074365 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:46.085706 25331 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.087832 25326 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:08:46.089684 25459 raft_consensus.cc:2726] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 16:08:46.093928 24485 consensus_peers.cc:487] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.099089 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:36221
I20260811 16:08:46.099381 25484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:36221 every 8 connection(s)
W20260811 16:08:46.099881 24572 consensus_peers.cc:487] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.136776 25331 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.138005 25331 tablet_bootstrap.cc:492] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.138710 25331 ts_tablet_manager.cc:1397] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.004s
I20260811 16:08:46.141288 25331 raft_consensus.cc:348] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.142014 25331 raft_consensus.cc:729] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.142668 25331 consensus_queue.cc:260] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.144872 25331 ts_tablet_manager.cc:1428] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260811 16:08:46.145795 25331 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.150411 25459 raft_consensus.cc:482] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:46.151043 25459 raft_consensus.cc:504] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
W20260811 16:08:46.152444 24572 consensus_peers.cc:487] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.153517 25459 leader_election.cc:288] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:46.154230 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:08:46.155014 24436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8b101a79cc404dbd7787240d4d827d" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44d109b1df0445eba66548c099958e3" is_pre_election: true
I20260811 16:08:46.157292 25326 leader_election.cc:302] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3; no voters: 707f02c5118a4d798120ca9c5786ada6, d44d109b1df0445eba66548c099958e3
I20260811 16:08:46.158413 25427 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.158615 25336 raft_consensus.cc:2726] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:08:46.168366 25331 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.169647 25331 tablet_bootstrap.cc:492] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.170507 25331 ts_tablet_manager.cc:1397] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260811 16:08:46.174306 25331 raft_consensus.cc:348] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.175205 25331 raft_consensus.cc:729] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.175747 25485 heartbeater.cc:347] Connected to a master server at 127.12.23.254:43075
I20260811 16:08:46.176380 25485 heartbeater.cc:464] Registering TS with master...
I20260811 16:08:46.177312 25485 heartbeater.cc:511] Master 127.12.23.254:43075 requested a full tablet report, sending...
I20260811 16:08:46.175928 25331 consensus_queue.cc:260] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.180758 25331 ts_tablet_manager.cc:1428] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260811 16:08:46.181768 25331 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.197038 25331 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.198103 25331 tablet_bootstrap.cc:492] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.197983 24234 ts_manager.cc:194] Re-registered known tserver with Master: 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:08:46.199028 25331 ts_tablet_manager.cc:1397] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260811 16:08:46.201638 25331 raft_consensus.cc:348] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.202412 25331 raft_consensus.cc:729] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.203104 25331 consensus_queue.cc:260] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.205372 25331 ts_tablet_manager.cc:1428] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260811 16:08:46.206260 25331 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
W20260811 16:08:46.223284 24572 consensus_peers.cc:487] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.225960 25331 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.227101 25331 tablet_bootstrap.cc:492] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.227830 25331 ts_tablet_manager.cc:1397] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260811 16:08:46.230512 25331 raft_consensus.cc:348] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.231312 25331 raft_consensus.cc:729] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.231980 25331 consensus_queue.cc:260] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.233748 25331 ts_tablet_manager.cc:1428] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260811 16:08:46.234563 25331 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.247537 24234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41266
I20260811 16:08:46.249365 25331 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.250336 25331 tablet_bootstrap.cc:492] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.250913 25331 ts_tablet_manager.cc:1397] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260811 16:08:46.253319 25331 raft_consensus.cc:348] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.253996 25331 raft_consensus.cc:729] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.254005 25485 heartbeater.cc:503] Master 127.12.23.254:43075 was elected leader, sending a full tablet report...
I20260811 16:08:46.254881 25331 consensus_queue.cc:260] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.257014 25331 ts_tablet_manager.cc:1428] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260811 16:08:46.257870 25331 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.273609 25331 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.274705 25331 tablet_bootstrap.cc:492] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.275520 25331 ts_tablet_manager.cc:1397] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260811 16:08:46.278083 25331 raft_consensus.cc:348] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.278667 25331 raft_consensus.cc:729] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.279405 25331 consensus_queue.cc:260] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.281090 25331 ts_tablet_manager.cc:1428] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260811 16:08:46.281903 25331 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
W20260811 16:08:46.296005 24485 consensus_peers.cc:487] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.305464 25428 raft_consensus.cc:3037] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.316454 25427 raft_consensus.cc:3037] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.321491 25331 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.322693 25331 tablet_bootstrap.cc:492] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.323463 25331 ts_tablet_manager.cc:1397] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.019s
W20260811 16:08:46.325937 24572 consensus_peers.cc:487] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260811 16:08:46.326395 25331 raft_consensus.cc:348] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.327270 25331 raft_consensus.cc:729] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.327920 25331 consensus_queue.cc:260] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.330391 25331 ts_tablet_manager.cc:1428] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260811 16:08:46.331228 25331 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.359638 25331 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.360445 25424 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.360723 25331 tablet_bootstrap.cc:492] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.364230 25331 ts_tablet_manager.cc:1397] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.008s
I20260811 16:08:46.366963 25331 raft_consensus.cc:348] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.367756 25331 raft_consensus.cc:729] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.368453 25331 consensus_queue.cc:260] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.371841 25331 ts_tablet_manager.cc:1428] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260811 16:08:46.372759 25331 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.381081 25425 raft_consensus.cc:3037] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.391795 25331 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.393399 25331 tablet_bootstrap.cc:492] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.401444 25331 ts_tablet_manager.cc:1397] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.008s
I20260811 16:08:46.412531 25331 raft_consensus.cc:348] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.414600 25331 raft_consensus.cc:729] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.415306 25331 consensus_queue.cc:260] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.416915 25331 ts_tablet_manager.cc:1428] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260811 16:08:46.418128 25331 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.422318 25425 raft_consensus.cc:3037] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.445089 25425 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.466701 25331 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.468096 25331 tablet_bootstrap.cc:492] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.473810 25331 ts_tablet_manager.cc:1397] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.024s
I20260811 16:08:46.476563 25331 raft_consensus.cc:348] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.477362 25331 raft_consensus.cc:729] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.478041 25331 consensus_queue.cc:260] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.480190 25331 ts_tablet_manager.cc:1428] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260811 16:08:46.481027 25331 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.499884 25331 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.500948 25331 tablet_bootstrap.cc:492] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.501701 25331 ts_tablet_manager.cc:1397] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260811 16:08:46.504029 25331 raft_consensus.cc:348] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.504601 25331 raft_consensus.cc:729] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.505164 25331 consensus_queue.cc:260] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.507242 25331 ts_tablet_manager.cc:1428] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260811 16:08:46.507757 25425 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.508116 25331 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.526386 25331 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.527431 25331 tablet_bootstrap.cc:492] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.528158 25331 ts_tablet_manager.cc:1397] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260811 16:08:46.530767 25331 raft_consensus.cc:348] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.531515 25331 raft_consensus.cc:729] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.532192 25331 consensus_queue.cc:260] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.533682 25331 ts_tablet_manager.cc:1428] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260811 16:08:46.534318 25331 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.549678 25331 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.550736 25331 tablet_bootstrap.cc:492] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.551541 25331 ts_tablet_manager.cc:1397] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260811 16:08:46.554100 25331 raft_consensus.cc:348] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.554787 25331 raft_consensus.cc:729] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.555575 25331 consensus_queue.cc:260] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.557866 25331 ts_tablet_manager.cc:1428] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260811 16:08:46.558607 25331 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.593650 25331 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.594653 25331 tablet_bootstrap.cc:492] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.595538 25331 ts_tablet_manager.cc:1397] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.000s
I20260811 16:08:46.598109 25481 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:08:46.597813 25331 raft_consensus.cc:348] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.598740 25331 raft_consensus.cc:729] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.598760 25481 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.599795 25331 consensus_queue.cc:260] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.602450 25331 ts_tablet_manager.cc:1428] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260811 16:08:46.602777 25424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3" is_pre_election: true
I20260811 16:08:46.603602 25424 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 1.
I20260811 16:08:46.604393 25331 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.606094 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d" is_pre_election: true
I20260811 16:08:46.606853 24519 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 2.
I20260811 16:08:46.608024 25481 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:46.608292 25425 raft_consensus.cc:3037] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.608484 24402 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:46.609439 25481 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:08:46.609897 25481 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:08:46.610343 25481 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:46.621517 25331 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.622798 25331 tablet_bootstrap.cc:492] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.623624 25331 ts_tablet_manager.cc:1397] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260811 16:08:46.624533 25481 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.626396 25331 raft_consensus.cc:348] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:46.627218 25331 raft_consensus.cc:729] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.627930 25331 consensus_queue.cc:260] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:46.628803 25424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7631002fc97849e6bc5842e364e770e3"
I20260811 16:08:46.629482 25424 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 3
I20260811 16:08:46.630246 25331 ts_tablet_manager.cc:1428] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260811 16:08:46.631213 25331 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.639199 25424 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 3.
I20260811 16:08:46.641350 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "d44d109b1df0445eba66548c099958e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:46.642019 24519 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:46.647825 24402 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:46.648870 25482 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:46.649413 25482 raft_consensus.cc:686] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 LEADER]: Becoming Leader. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:46.650315 25482 consensus_queue.cc:237] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.656934 25331 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.640292 25481 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:46.663795 24519 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44d109b1df0445eba66548c099958e3 in term 3.
I20260811 16:08:46.665808 25331 tablet_bootstrap.cc:492] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.666687 25331 ts_tablet_manager.cc:1397] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.004s
I20260811 16:08:46.669188 25331 raft_consensus.cc:348] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.670040 25331 raft_consensus.cc:729] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.670919 25331 consensus_queue.cc:260] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.672745 24234 catalog_manager.cc:5495] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 reported cstate change: term changed from 1 to 3, leader changed from 7631002fc97849e6bc5842e364e770e3 (127.12.23.193) to d44d109b1df0445eba66548c099958e3 (127.12.23.194). New cstate: current_term: 3 leader_uuid: "d44d109b1df0445eba66548c099958e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:46.677837 25331 ts_tablet_manager.cc:1428] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260811 16:08:46.680275 25331 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.704741 25331 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.705814 25331 tablet_bootstrap.cc:492] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.706573 25331 ts_tablet_manager.cc:1397] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260811 16:08:46.709431 25331 raft_consensus.cc:348] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.710182 25331 raft_consensus.cc:729] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.712091 25331 consensus_queue.cc:260] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.714412 25331 ts_tablet_manager.cc:1428] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:08:46.715397 25331 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.733871 25331 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.734923 25331 tablet_bootstrap.cc:492] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.735963 25331 ts_tablet_manager.cc:1397] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260811 16:08:46.739493 25331 raft_consensus.cc:348] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.740254 25331 raft_consensus.cc:729] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.740923 25331 consensus_queue.cc:260] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.743211 25331 ts_tablet_manager.cc:1428] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260811 16:08:46.744236 25331 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.767747 25331 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.768805 25331 tablet_bootstrap.cc:492] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.769603 25331 ts_tablet_manager.cc:1397] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260811 16:08:46.789139 25331 raft_consensus.cc:348] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.790290 25331 raft_consensus.cc:729] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.792766 25331 consensus_queue.cc:260] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.795289 25331 ts_tablet_manager.cc:1428] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.025s	user 0.021s	sys 0.000s
I20260811 16:08:46.796587 25331 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.835213 25331 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.836323 25331 tablet_bootstrap.cc:492] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.837090 25331 ts_tablet_manager.cc:1397] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.008s
I20260811 16:08:46.839771 25331 raft_consensus.cc:348] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.840546 25331 raft_consensus.cc:729] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.841398 25331 consensus_queue.cc:260] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.846668 25331 ts_tablet_manager.cc:1428] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260811 16:08:46.847604 25331 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.864598 25424 raft_consensus.cc:3037] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.875839 25331 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.877008 25331 tablet_bootstrap.cc:492] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.877820 25331 ts_tablet_manager.cc:1397] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.001s
I20260811 16:08:46.880494 25331 raft_consensus.cc:348] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.881304 25331 raft_consensus.cc:729] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.882416 25331 consensus_queue.cc:260] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:46.884621 25331 ts_tablet_manager.cc:1428] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260811 16:08:46.885434 25331 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.918473 25331 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.919536 25331 tablet_bootstrap.cc:492] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.920220 25331 ts_tablet_manager.cc:1397] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.011s
I20260811 16:08:46.922904 25331 raft_consensus.cc:348] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.923678 25331 raft_consensus.cc:729] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.924506 25331 consensus_queue.cc:260] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:46.926908 25331 ts_tablet_manager.cc:1428] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260811 16:08:46.927816 25331 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Bootstrap starting.
I20260811 16:08:46.944633 25427 raft_consensus.cc:3037] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:46.945542 25331 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:08:46.946640 25331 tablet_bootstrap.cc:492] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Bootstrap complete.
I20260811 16:08:46.947388 25331 ts_tablet_manager.cc:1397] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260811 16:08:46.949925 25331 raft_consensus.cc:348] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.950644 25331 raft_consensus.cc:729] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Initialized, Role: FOLLOWER
I20260811 16:08:46.951361 25331 consensus_queue.cc:260] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:46.953866 25331 ts_tablet_manager.cc:1428] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260811 16:08:47.079969 25424 raft_consensus.cc:1261] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:47.081543 25530 consensus_queue.cc:1035] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:47.101490 24519 raft_consensus.cc:1261] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Refusing update from remote peer d44d109b1df0445eba66548c099958e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:47.103909 25369 consensus_queue.cc:1035] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:47.108280 25427 raft_consensus.cc:3037] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.116648 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:56.196650 24601 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:56.197638 24601 raft_consensus.cc:595] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:56.217026 24441 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c"
dest_uuid: "d44d109b1df0445eba66548c099958e3"
mode: GRACEFUL
new_leader_uuid: "6f165e96383a40dc9d724b290a94706d"
 from {username='slave'} at 127.0.0.1:46142
I20260811 16:08:56.217736 24441 raft_consensus.cc:595] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Received request to transfer leadership to TS 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:56.220408 24601 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:56.220985 24601 raft_consensus.cc:595] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:56.236307 25556 raft_consensus.cc:979] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.236830 25556 raft_consensus.cc:1067] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.238487 25425 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:56.239032 25425 raft_consensus.cc:482] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:56.239441 25425 raft_consensus.cc:3037] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.240453 24515 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:51496
I20260811 16:08:56.241057 24515 raft_consensus.cc:595] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:56.243613 24515 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:51496
I20260811 16:08:56.244141 24515 raft_consensus.cc:595] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:56.246667 24515 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:51496
I20260811 16:08:56.247283 24515 raft_consensus.cc:595] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:56.248391 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260811 16:08:56.248844 25425 raft_consensus.cc:504] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.249871 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:08:56.250746 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:56.251103 25425 leader_election.cc:288] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:56.252887 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:56.253743 24601 raft_consensus.cc:3032] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:56.254000 24601 raft_consensus.cc:729] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:56.254747 24601 consensus_queue.cc:260] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.255810 24601 raft_consensus.cc:3037] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.260932 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253403f9eaad4164a0410493e7babb0f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:56.261808 24515 raft_consensus.cc:3037] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.264660 24601 raft_consensus.cc:2454] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:56.266178 25326 leader_election.cc:302] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:56.268879 25577 raft_consensus.cc:2781] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:56.269261 24515 raft_consensus.cc:2454] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:56.270592 25577 raft_consensus.cc:686] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:56.271836 25577 consensus_queue.cc:237] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.284873 24234 catalog_manager.cc:5495] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:56.322844 25553 raft_consensus.cc:979] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.323383 25553 raft_consensus.cc:1067] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.327347 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57812
I20260811 16:08:56.327935 25427 raft_consensus.cc:482] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:56.328233 25427 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.333582 25567 raft_consensus.cc:979] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: : Instructing follower 6f165e96383a40dc9d724b290a94706d to start an election
I20260811 16:08:56.334306 25565 raft_consensus.cc:1067] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Signalling peer 6f165e96383a40dc9d724b290a94706d to start an election
I20260811 16:08:56.335983 24515 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
 from {username='slave'} at 127.0.0.1:54722
I20260811 16:08:56.336561 24515 raft_consensus.cc:482] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:56.336982 24515 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.337355 25427 raft_consensus.cc:504] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:56.339056 25427 leader_election.cc:288] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:56.339803 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:56.340480 24441 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.340322 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e75587caf14bf3ac0c03288d2dc146" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:56.341042 24519 raft_consensus.cc:3032] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:56.341356 24519 raft_consensus.cc:729] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:56.342244 24519 consensus_queue.cc:260] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:56.346298 24515 raft_consensus.cc:504] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:56.348497 24519 raft_consensus.cc:3037] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.352270 24436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:56.352994 24436 raft_consensus.cc:3032] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:56.353241 24436 raft_consensus.cc:729] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:56.353968 24436 consensus_queue.cc:260] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:56.354929 24436 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.356366 24515 leader_election.cc:288] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 3 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:56.358593 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362cbea48a7e4ff59864d2204065575c" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:56.359221 24601 raft_consensus.cc:3037] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.359596 24441 raft_consensus.cc:2454] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:56.360904 25326 leader_election.cc:302] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:56.361927 25577 raft_consensus.cc:2781] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:56.362452 25577 raft_consensus.cc:686] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:56.362566 24519 raft_consensus.cc:2454] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:56.363628 25577 consensus_queue.cc:237] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:56.365343 24436 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 3.
I20260811 16:08:56.369666 24485 leader_election.cc:302] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:56.370792 25559 raft_consensus.cc:2781] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:56.371320 25559 raft_consensus.cc:686] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 3 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:56.372179 25559 consensus_queue.cc:237] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:56.375059 24601 raft_consensus.cc:2454] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 3.
I20260811 16:08:56.389120 24234 catalog_manager.cc:5495] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 2 to 3, leader changed from d44d109b1df0445eba66548c099958e3 (127.12.23.194) to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 3 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:56.392472 24235 catalog_manager.cc:5495] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 2 to 3, leader changed from 6f165e96383a40dc9d724b290a94706d (127.12.23.195) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:56.480316 25559 raft_consensus.cc:979] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.481057 25585 raft_consensus.cc:1067] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.482561 25425 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57812
I20260811 16:08:56.483053 25425 raft_consensus.cc:482] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:56.483345 25425 raft_consensus.cc:3037] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.489140 25425 raft_consensus.cc:504] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.490792 25425 leader_election.cc:288] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:56.491829 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:56.492343 24601 raft_consensus.cc:3037] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.494448 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d8d1f4a7194ed0887d2a71ac016637" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:56.495105 24519 raft_consensus.cc:3032] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:56.495529 24519 raft_consensus.cc:729] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:56.496317 24519 consensus_queue.cc:260] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.497577 24519 raft_consensus.cc:3037] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:56.498148 24601 raft_consensus.cc:2454] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:56.499425 25326 leader_election.cc:302] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:56.500136 25577 raft_consensus.cc:2781] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:56.500641 25577 raft_consensus.cc:686] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:56.501438 25577 consensus_queue.cc:237] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.506043 24519 raft_consensus.cc:2454] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:56.517858 24235 catalog_manager.cc:5495] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 6f165e96383a40dc9d724b290a94706d (127.12.23.195) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:56.648617 25585 raft_consensus.cc:979] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.649186 25559 raft_consensus.cc:1067] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.650816 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57812
I20260811 16:08:56.651396 25427 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:56.651696 25427 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.657370 25427 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.658910 25427 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:56.659915 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:56.660211 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf80ef260b444d97bd8f2badb125dd66" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:56.660560 24519 raft_consensus.cc:3032] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:56.660912 24519 raft_consensus.cc:729] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:56.660913 24601 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.661779 24519 consensus_queue.cc:260] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.662938 24519 raft_consensus.cc:3037] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.666662 24601 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:56.667809 25326 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:56.668674 25577 raft_consensus.cc:2781] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:56.668959 24519 raft_consensus.cc:2454] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:56.669190 25577 raft_consensus.cc:686] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:56.670265 25577 consensus_queue.cc:237] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.683427 24601 raft_consensus.cc:1261] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:56.685184 25577 consensus_queue.cc:1035] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:56.693325 24235 catalog_manager.cc:5495] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 2 to 3, leader changed from 6f165e96383a40dc9d724b290a94706d (127.12.23.195) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:56.711169 25556 raft_consensus.cc:979] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.711692 25556 raft_consensus.cc:1067] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:56.716614 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:56.717209 25427 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:56.717537 25427 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.724321 25427 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.725837 25427 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:56.726990 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:56.727699 24606 raft_consensus.cc:3032] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:56.728201 24606 raft_consensus.cc:729] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:56.729031 24606 consensus_queue.cc:260] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.727705 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b665c6f1914645fbb497bdc4633cc1af" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:56.730072 24519 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.730387 24606 raft_consensus.cc:3037] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:56.731894 24515 raft_consensus.cc:1261] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:56.733358 25577 consensus_queue.cc:1035] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:56.742795 24519 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:56.744115 25326 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:56.745389 25577 raft_consensus.cc:2781] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:56.746048 25577 raft_consensus.cc:686] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:56.747248 25577 consensus_queue.cc:237] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:56.748834 24606 raft_consensus.cc:2454] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:56.768821 24235 catalog_manager.cc:5495] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 2 to 3, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:56.805871 24606 raft_consensus.cc:1261] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:56.807228 25585 consensus_queue.cc:1035] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:56.825059 24519 raft_consensus.cc:1261] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:56.827477 25577 consensus_queue.cc:1035] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:56.828459 24441 raft_consensus.cc:1261] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:56.832705 25585 consensus_queue.cc:1035] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:56.840457 24436 raft_consensus.cc:1261] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:56.842746 25578 consensus_queue.cc:1035] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:08:56.949478 24515 raft_consensus.cc:1261] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:56.950819 25577 consensus_queue.cc:1035] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:56.965205 24606 raft_consensus.cc:1261] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:56.967561 25577 consensus_queue.cc:1035] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:57.149362 24519 raft_consensus.cc:1261] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:57.150750 25613 consensus_queue.cc:1035] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:57.160828 24606 raft_consensus.cc:1261] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:57.162709 25577 consensus_queue.cc:1035] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:57.233284 24519 raft_consensus.cc:1261] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:57.234910 25577 consensus_queue.cc:1035] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:57.245981 24601 raft_consensus.cc:1261] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:57.249089 25613 consensus_queue.cc:1035] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:57.326561 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:57.369279 24606 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "30887efe153d45a7838550a656016312"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:57.369895 24606 raft_consensus.cc:595] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:57.372618 24606 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:57.373107 24606 raft_consensus.cc:595] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:57.375571 24519 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:51496
I20260811 16:08:57.376025 24519 raft_consensus.cc:595] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:57.378317 24606 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:57.378721 24606 raft_consensus.cc:595] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:57.380764 24606 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:57.381170 24606 raft_consensus.cc:595] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:57.383450 24441 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60"
dest_uuid: "d44d109b1df0445eba66548c099958e3"
mode: GRACEFUL
new_leader_uuid: "6f165e96383a40dc9d724b290a94706d"
 from {username='slave'} at 127.0.0.1:46142
I20260811 16:08:57.384019 24441 raft_consensus.cc:595] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Received request to transfer leadership to TS 6f165e96383a40dc9d724b290a94706d
I20260811 16:08:57.385157 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260811 16:08:57.386726 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:08:57.387392 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:57.413622 25566 raft_consensus.cc:979] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.414227 25566 raft_consensus.cc:1067] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.415870 25424 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:57.417466 25424 raft_consensus.cc:482] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:57.417786 25424 raft_consensus.cc:3037] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.426558 25424 raft_consensus.cc:504] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:57.428530 25424 leader_election.cc:288] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:57.429874 24436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:57.430557 24436 raft_consensus.cc:3037] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.431941 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c3effdf4dce4e0cb955d93b6b965802" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:57.432547 24606 raft_consensus.cc:3032] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:57.432816 24606 raft_consensus.cc:729] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:57.433599 24606 consensus_queue.cc:260] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:57.434691 24606 raft_consensus.cc:3037] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.438977 24436 raft_consensus.cc:2454] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.440749 25326 leader_election.cc:302] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:57.441615 25613 raft_consensus.cc:2781] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:57.442096 25613 raft_consensus.cc:686] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:57.443234 24606 raft_consensus.cc:2454] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.442975 25613 consensus_queue.cc:237] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:57.456619 24238 catalog_manager.cc:5495] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:57.624768 25556 raft_consensus.cc:979] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.625311 25566 raft_consensus.cc:1067] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.626753 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:57.627283 25427 raft_consensus.cc:482] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:57.627553 25427 raft_consensus.cc:3037] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.633978 25427 raft_consensus.cc:504] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:57.635748 25427 leader_election.cc:288] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:57.636584 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:57.637027 24436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec26b0c5eb044ef9028311f26703757" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:57.637276 24606 raft_consensus.cc:3032] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:57.637632 24436 raft_consensus.cc:3037] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.637697 24606 raft_consensus.cc:729] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:57.638865 24606 consensus_queue.cc:260] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:57.639791 24606 raft_consensus.cc:3037] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.644850 24436 raft_consensus.cc:2454] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.646699 24441 raft_consensus.cc:1226] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Rejecting Update request from peer 707f02c5118a4d798120ca9c5786ada6 for earlier term 1. Current term is 2. Ops: []
I20260811 16:08:57.648422 25556 raft_consensus.cc:979] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.648861 25326 leader_election.cc:302] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:57.650271 25556 raft_consensus.cc:1067] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.650324 24606 raft_consensus.cc:2454] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.652787 25613 raft_consensus.cc:2781] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:57.653216 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "30887efe153d45a7838550a656016312"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:57.653546 25613 raft_consensus.cc:686] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:57.653827 25427 raft_consensus.cc:482] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:57.654223 25427 raft_consensus.cc:3037] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.654307 25613 consensus_queue.cc:237] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:57.661746 25427 raft_consensus.cc:504] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:57.663797 25427 leader_election.cc:288] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:57.665776 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:57.666399 24606 raft_consensus.cc:3032] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:57.666685 24606 raft_consensus.cc:729] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:57.667459 24606 consensus_queue.cc:260] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:57.668000 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30887efe153d45a7838550a656016312" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:57.668766 24519 raft_consensus.cc:3037] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.668998 24606 raft_consensus.cc:3037] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.668999 24238 catalog_manager.cc:5495] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:57.676697 24606 raft_consensus.cc:2454] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.677446 24519 raft_consensus.cc:2454] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.680176 25326 leader_election.cc:302] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:57.681303 25613 raft_consensus.cc:2781] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:57.681820 25613 raft_consensus.cc:686] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:57.682705 25613 consensus_queue.cc:237] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:57.691978 24238 catalog_manager.cc:5495] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:57.737572 25559 raft_consensus.cc:979] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.738145 25559 raft_consensus.cc:1067] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.739701 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57812
I20260811 16:08:57.740319 25427 raft_consensus.cc:482] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:57.740655 25427 raft_consensus.cc:3037] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.747892 25427 raft_consensus.cc:504] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:57.752096 25427 leader_election.cc:288] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:57.752859 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:57.753574 24441 raft_consensus.cc:3037] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.759438 24441 raft_consensus.cc:2454] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.760356 25326 leader_election.cc:302] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:57.760845 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f269dd87fe34c6586deee9aacc68a6f" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:57.761437 25613 raft_consensus.cc:2781] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:57.761538 24515 raft_consensus.cc:3032] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:57.762120 24515 raft_consensus.cc:729] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:57.762200 25613 raft_consensus.cc:686] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:57.763046 24515 consensus_queue.cc:260] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:57.763332 25613 consensus_queue.cc:237] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:57.764313 24515 raft_consensus.cc:3037] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.772576 24515 raft_consensus.cc:2454] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.773837 24238 catalog_manager.cc:5495] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 6f165e96383a40dc9d724b290a94706d (127.12.23.195) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:57.817106 25607 raft_consensus.cc:979] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: : Instructing follower 6f165e96383a40dc9d724b290a94706d to start an election
I20260811 16:08:57.817595 25567 raft_consensus.cc:1067] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Signalling peer 6f165e96383a40dc9d724b290a94706d to start an election
I20260811 16:08:57.819095 24519 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
 from {username='slave'} at 127.0.0.1:54722
I20260811 16:08:57.819681 24519 raft_consensus.cc:482] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:57.819986 24519 raft_consensus.cc:3037] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.830443 24519 raft_consensus.cc:504] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:57.832854 24441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:57.833479 24441 raft_consensus.cc:3032] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:57.833701 24441 raft_consensus.cc:729] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:57.834627 24519 leader_election.cc:288] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:57.835306 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecaafaa032434ef8bcd23c2ece667e60" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:57.835947 24601 raft_consensus.cc:3037] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.834455 24441 consensus_queue.cc:260] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:57.840157 24441 raft_consensus.cc:3037] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.842252 24601 raft_consensus.cc:2454] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
I20260811 16:08:57.843559 24485 leader_election.cc:302] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 707f02c5118a4d798120ca9c5786ada6; no voters: 
I20260811 16:08:57.844449 25559 raft_consensus.cc:2781] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:57.844867 25559 raft_consensus.cc:686] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Leader. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:57.845562 25559 consensus_queue.cc:237] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:08:57.846210 24441 raft_consensus.cc:2454] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f165e96383a40dc9d724b290a94706d in term 2.
I20260811 16:08:57.857391 24441 raft_consensus.cc:1261] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:57.857872 24238 catalog_manager.cc:5495] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d reported cstate change: term changed from 1 to 2, leader changed from d44d109b1df0445eba66548c099958e3 (127.12.23.194) to 6f165e96383a40dc9d724b290a94706d (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6f165e96383a40dc9d724b290a94706d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:57.859632 25577 consensus_queue.cc:1035] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:57.863266 25556 raft_consensus.cc:979] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.863842 25556 raft_consensus.cc:1067] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:57.872702 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:57.873311 25427 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:57.873669 25427 raft_consensus.cc:3037] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.883889 24601 raft_consensus.cc:1261] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:57.885381 25578 consensus_queue.cc:1035] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:57.888286 25427 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:57.892454 25427 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:57.897388 24519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:57.898204 24519 raft_consensus.cc:3037] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.904763 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:57.905514 24606 raft_consensus.cc:3032] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:08:57.905791 24606 raft_consensus.cc:729] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:57.907572 24606 consensus_queue.cc:260] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:57.915889 24606 raft_consensus.cc:3037] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:08:57.916955 24519 raft_consensus.cc:2454] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.918241 25326 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:57.919751 25578 raft_consensus.cc:2781] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:08:57.920300 25578 raft_consensus.cc:686] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:57.923831 25578 consensus_queue.cc:237] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:57.926797 24606 raft_consensus.cc:2454] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 2.
I20260811 16:08:57.938304 24235 catalog_manager.cc:5495] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 1 to 2, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 2 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:58.046365 24606 raft_consensus.cc:1261] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.047883 25578 consensus_queue.cc:1035] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.061200 24436 raft_consensus.cc:1261] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.065615 25577 consensus_queue.cc:1035] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:58.070168 24601 raft_consensus.cc:1261] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.072299 25577 consensus_queue.cc:1035] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.077764 24519 raft_consensus.cc:1261] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.083025 25577 consensus_queue.cc:1035] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.231132 24436 raft_consensus.cc:1261] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.232510 25559 consensus_queue.cc:1035] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.254050 24606 raft_consensus.cc:1261] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 6f165e96383a40dc9d724b290a94706d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.259131 25601 consensus_queue.cc:1035] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:08:58.316404 24519 raft_consensus.cc:1261] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.317739 25578 consensus_queue.cc:1035] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.331683 24437 raft_consensus.cc:1261] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.333578 25578 consensus_queue.cc:1035] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.388226 24519 raft_consensus.cc:1261] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.389555 25578 consensus_queue.cc:1035] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.403394 24601 raft_consensus.cc:1261] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:08:58.404628 25578 consensus_queue.cc:1035] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:58.432904 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:58.500525 24601 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff"
dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:45466
I20260811 16:08:58.501220 24601 raft_consensus.cc:595] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:58.504326 24437 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2"
dest_uuid: "d44d109b1df0445eba66548c099958e3"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:46142
I20260811 16:08:58.504995 24437 raft_consensus.cc:595] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:58.508113 24515 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4"
dest_uuid: "6f165e96383a40dc9d724b290a94706d"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:51496
I20260811 16:08:58.508749 24515 raft_consensus.cc:595] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:58.514521 24437 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab"
dest_uuid: "d44d109b1df0445eba66548c099958e3"
mode: GRACEFUL
new_leader_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:46142
I20260811 16:08:58.515271 24437 raft_consensus.cc:595] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Received request to transfer leadership to TS 7631002fc97849e6bc5842e364e770e3
I20260811 16:08:58.516674 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260811 16:08:58.518162 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:08:58.518761 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:58.574365 25601 raft_consensus.cc:979] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.574965 25645 raft_consensus.cc:1067] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.576526 25424 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57812
I20260811 16:08:58.577054 25424 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:58.577337 25424 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.584231 25424 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:58.585943 25424 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811)
I20260811 16:08:58.586649 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:58.587175 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8deeaaae4d4b2c84759d8accfcdaf4" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:58.587806 24601 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.587365 24515 raft_consensus.cc:3032] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:58.588646 24515 raft_consensus.cc:729] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f165e96383a40dc9d724b290a94706d, State: Running, Role: LEADER
I20260811 16:08:58.589440 24515 consensus_queue.cc:260] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:58.590742 24515 raft_consensus.cc:3037] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.593499 25607 raft_consensus.cc:979] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.593950 25607 raft_consensus.cc:1067] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.594904 24601 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:58.595543 25424 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57828
I20260811 16:08:58.596084 25424 raft_consensus.cc:482] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:58.596052 25326 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:58.596665 25424 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:08:58.597460 25613 raft_consensus.cc:2781] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:58.598026 25613 raft_consensus.cc:686] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:58.598814 25613 consensus_queue.cc:237] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:08:58.602124 25424 raft_consensus.cc:504] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:58.604987 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:58.605360 25424 leader_election.cc:288] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 4 election: Requested vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:08:58.605616 24437 raft_consensus.cc:3032] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:08:58.606050 24437 raft_consensus.cc:729] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:58.606379 24515 raft_consensus.cc:2454] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:58.606858 24437 consensus_queue.cc:260] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:58.608140 24437 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:08:58.609269 24515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b21df0f0e7b43e7bb8911e772e7d9e2" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6f165e96383a40dc9d724b290a94706d"
I20260811 16:08:58.609892 24515 raft_consensus.cc:3037] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:08:58.610838 24238 catalog_manager.cc:5495] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 2 to 3, leader changed from 6f165e96383a40dc9d724b290a94706d (127.12.23.195) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } }
I20260811 16:08:58.615063 24437 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 4.
I20260811 16:08:58.616530 25326 leader_election.cc:302] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:58.617443 25613 raft_consensus.cc:2781] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:08:58.618556 25613 raft_consensus.cc:686] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 4 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:58.619725 25613 consensus_queue.cc:237] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } }
I20260811 16:08:58.617406 24515 raft_consensus.cc:2454] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 4.
I20260811 16:08:58.638207 24238 catalog_manager.cc:5495] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 3 to 4, leader changed from d44d109b1df0445eba66548c099958e3 (127.12.23.194) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 4 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:58.718657 25623 raft_consensus.cc:979] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.719246 25556 raft_consensus.cc:1067] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.720645 25424 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57808
I20260811 16:08:58.721186 25424 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:58.721463 25424 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.726868 25424 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:58.728503 25424 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:58.729741 24437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:58.730022 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053f9ea874d649f59f934ea0b1df94ff" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:58.730454 24437 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.730700 24601 raft_consensus.cc:3032] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:58.731084 24601 raft_consensus.cc:729] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 707f02c5118a4d798120ca9c5786ada6, State: Running, Role: LEADER
I20260811 16:08:58.731839 24601 consensus_queue.cc:260] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:58.732954 24601 raft_consensus.cc:3037] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.737706 24437 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:58.739136 25326 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3; no voters: 
I20260811 16:08:58.739566 24601 raft_consensus.cc:2454] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:58.740121 25613 raft_consensus.cc:2781] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:58.740880 25613 raft_consensus.cc:686] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:58.741714 25613 consensus_queue.cc:237] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:58.752584 24238 catalog_manager.cc:5495] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 2 to 3, leader changed from 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:58.887555 25607 raft_consensus.cc:979] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: : Instructing follower 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.888155 25607 raft_consensus.cc:1067] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Signalling peer 7631002fc97849e6bc5842e364e770e3 to start an election
I20260811 16:08:58.890179 25427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab"
dest_uuid: "7631002fc97849e6bc5842e364e770e3"
 from {username='slave'} at 127.0.0.1:57828
I20260811 16:08:58.890755 25427 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:08:58.891114 25427 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.898083 25427 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:58.900700 24606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "707f02c5118a4d798120ca9c5786ada6"
I20260811 16:08:58.901369 24606 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.901646 25427 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Requested vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:08:58.904855 24436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c87a65e124704bdfb5ba6c78e7cc79ab" candidate_uuid: "7631002fc97849e6bc5842e364e770e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d44d109b1df0445eba66548c099958e3"
I20260811 16:08:58.905457 24436 raft_consensus.cc:3032] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:08:58.905802 24436 raft_consensus.cc:729] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d44d109b1df0445eba66548c099958e3, State: Running, Role: LEADER
I20260811 16:08:58.906440 24436 consensus_queue.cc:260] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:58.907653 24436 raft_consensus.cc:3037] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:08:58.908226 24606 raft_consensus.cc:2454] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:58.909623 25326 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3; no voters: 
I20260811 16:08:58.910600 25613 raft_consensus.cc:2781] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:08:58.912382 25613 raft_consensus.cc:686] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7631002fc97849e6bc5842e364e770e3, State: Running, Role: LEADER
I20260811 16:08:58.913484 25613 consensus_queue.cc:237] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:08:58.915184 24436 raft_consensus.cc:2454] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7631002fc97849e6bc5842e364e770e3 in term 3.
I20260811 16:08:58.925781 24238 catalog_manager.cc:5495] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 reported cstate change: term changed from 2 to 3, leader changed from d44d109b1df0445eba66548c099958e3 (127.12.23.194) to 7631002fc97849e6bc5842e364e770e3 (127.12.23.193). New cstate: current_term: 3 leader_uuid: "7631002fc97849e6bc5842e364e770e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } health_report { overall_health: UNKNOWN } } }
I20260811 16:08:58.992282 24519 raft_consensus.cc:1261] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:58.993708 25578 consensus_queue.cc:1035] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:59.006419 24606 raft_consensus.cc:1261] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260811 16:08:59.009052 25641 consensus_queue.cc:1035] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:08:59.032308 24515 raft_consensus.cc:1261] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 4 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:08:59.033846 25641 consensus_queue.cc:1035] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:59.045028 24437 raft_consensus.cc:1261] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 4 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260811 16:08:59.048879 25613 consensus_queue.cc:1035] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:08:59.165823 24437 raft_consensus.cc:1261] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:59.167987 25641 consensus_queue.cc:1035] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:59.170719 24601 raft_consensus.cc:1261] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:59.173483 25613 consensus_queue.cc:1035] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:08:59.306143 24606 raft_consensus.cc:1261] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:59.307454 25641 consensus_queue.cc:1035] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:59.317203 24437 raft_consensus.cc:1261] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Refusing update from remote peer 7631002fc97849e6bc5842e364e770e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:08:59.319819 25613 consensus_queue.cc:1035] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:08:59.563974 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:59.604628 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:08:59.605716 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:08:59.606179 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:59.648164 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:08:59.682420 12383 tablet_server.cc:178] TabletServer@127.12.23.193:36221 shutting down...
W20260811 16:08:59.687351 24572 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 256 similar messages]
W20260811 16:08:59.696105 24485 consensus_peers.cc:487] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.701936 24485 consensus_peers.cc:487] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.707161 24572 consensus_peers.cc:487] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.727597 24485 consensus_peers.cc:487] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.734223 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:08:59.735532 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.739071 12383 raft_consensus.cc:2229] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.739737 12383 raft_consensus.cc:2258] T 424cfa023f8d422a8677325b3f8e74dd P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.742790 24485 consensus_peers.cc:487] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.743511 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.744619 12383 raft_consensus.cc:2229] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.745168 12383 raft_consensus.cc:2258] T ae25aabfb52d4b57a9d71bf2e627ed63 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.748281 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.749315 12383 raft_consensus.cc:2229] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.749861 12383 raft_consensus.cc:2258] T 296f5dafb30b436fa348884a38c18320 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.752946 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.753968 12383 raft_consensus.cc:2229] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.754619 12383 raft_consensus.cc:2258] T 0849d70159164a57a23b734a02aca623 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.757625 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.758548 12383 raft_consensus.cc:2229] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.759104 12383 raft_consensus.cc:2258] T fe620493add749c5a27c9fa537836c4c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.762404 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.763427 12383 raft_consensus.cc:2229] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
W20260811 16:08:59.766909 24402 consensus_peers.cc:487] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.773723 24485 consensus_peers.cc:487] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.776103 24572 consensus_peers.cc:487] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.776597 12383 raft_consensus.cc:2258] T 5c3effdf4dce4e0cb955d93b6b965802 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.778342 24402 consensus_peers.cc:487] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.779721 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.780710 12383 raft_consensus.cc:2229] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.781297 12383 raft_consensus.cc:2258] T f054b2c61c564c9aac4234bf8b363331 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.784353 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.784998 12383 raft_consensus.cc:2229] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.785437 12383 raft_consensus.cc:2258] T aef5b136564945f7ba5b1d391c91bb70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.787918 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.788813 12383 raft_consensus.cc:2229] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.789723 12383 raft_consensus.cc:2258] T b7d8d1f4a7194ed0887d2a71ac016637 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.792660 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.793589 12383 raft_consensus.cc:2229] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.794189 12383 raft_consensus.cc:2258] T b630b4a32d1a4cfab0626c4f2715c9c5 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.795387 24572 consensus_peers.cc:487] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.797327 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.798069 12383 raft_consensus.cc:2229] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.798600 12383 raft_consensus.cc:2258] T e75ef18b8865438c83f749eea8f963aa P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.801193 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.801975 12383 raft_consensus.cc:2229] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.802876 12383 raft_consensus.cc:2258] T cec26b0c5eb044ef9028311f26703757 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.804133 24485 consensus_peers.cc:487] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.805410 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.806340 12383 raft_consensus.cc:2229] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.806849 12383 raft_consensus.cc:2258] T 38d2cd522feb43648ee671400627f17e P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.809120 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.809873 12383 raft_consensus.cc:2229] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.810784 12383 raft_consensus.cc:2258] T 30887efe153d45a7838550a656016312 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.813632 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.814487 12383 raft_consensus.cc:2229] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.815068 12383 raft_consensus.cc:2258] T 20b7cb4615c04cddb553ef8d6e774869 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.818472 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.819422 12383 raft_consensus.cc:2229] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.820011 12383 raft_consensus.cc:2258] T 5807918611104b39a416c792b9a4994b P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.823007 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.824293 12383 raft_consensus.cc:2229] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.825032 12383 raft_consensus.cc:2258] T 07f4360b11c44c6fa6327d0a030a1b55 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.822929 24572 consensus_peers.cc:487] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.828289 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.829276 12383 raft_consensus.cc:2229] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.830415 12383 raft_consensus.cc:2258] T 9f269dd87fe34c6586deee9aacc68a6f P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.832902 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.833604 12383 raft_consensus.cc:2229] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.834554 12383 raft_consensus.cc:2258] T bf80ef260b444d97bd8f2badb125dd66 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.836905 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.837530 12383 raft_consensus.cc:2229] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.838387 12383 raft_consensus.cc:2258] T b665c6f1914645fbb497bdc4633cc1af P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.840502 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.841095 12383 raft_consensus.cc:2229] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.841529 12383 raft_consensus.cc:2258] T e474ad4d29de4c968bbf6811a1ced653 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.843827 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.844480 12383 raft_consensus.cc:2229] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.844962 12383 raft_consensus.cc:2258] T 8d8b101a79cc404dbd7787240d4d827d P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.847899 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.848773 12383 raft_consensus.cc:2229] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.849265 12383 raft_consensus.cc:2258] T cdded2c7ff674319b9ca73af91948e0a P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.851440 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.851964 12383 raft_consensus.cc:2229] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.852337 12383 raft_consensus.cc:2258] T 057bc48deb6f442091c76a87d3345c3b P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.854395 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.854934 12383 raft_consensus.cc:2229] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 4 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.855791 12383 raft_consensus.cc:2258] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 7631002fc97849e6bc5842e364e770e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.858356 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.859035 12383 raft_consensus.cc:2229] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.859525 12383 raft_consensus.cc:2258] T 2e3487223f11427fb71f9b2dcb0414f6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.861819 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.862519 12383 raft_consensus.cc:2229] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.863019 12383 raft_consensus.cc:2258] T 62fbb0d94a2b49b2bab6a36b517ae048 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.865798 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.866690 12383 raft_consensus.cc:2229] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.867260 12383 raft_consensus.cc:2258] T 1434b986b4784cbdb2ce4d716ecfdb6c P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.869629 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.870432 12383 raft_consensus.cc:2229] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.871443 12383 raft_consensus.cc:2258] T f2e75587caf14bf3ac0c03288d2dc146 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.873883 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.874464 12383 raft_consensus.cc:2229] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.875280 12383 raft_consensus.cc:2258] T 053f9ea874d649f59f934ea0b1df94ff P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.878278 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.878928 12383 raft_consensus.cc:2229] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.879374 12383 raft_consensus.cc:2258] T ce968612a2824f70bea8c2c027892542 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.881386 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.881934 12383 raft_consensus.cc:2229] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.882431 12383 raft_consensus.cc:2258] T e4f248d334c04397adb27e611172a2e8 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.885015 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.885708 12383 raft_consensus.cc:2229] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260811 16:08:59.886086 24402 consensus_peers.cc:487] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.886196 12383 raft_consensus.cc:2258] T 98f314cba976436a9dfe527ee810d1c5 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.890064 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.890856 12383 raft_consensus.cc:2229] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.891397 12383 raft_consensus.cc:2258] T 4ead62f860954f6ca8149148504e068f P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.894354 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.895166 12383 raft_consensus.cc:2229] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.896193 12383 raft_consensus.cc:2258] T 253403f9eaad4164a0410493e7babb0f P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.899066 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.899961 12383 raft_consensus.cc:2229] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.900522 12383 raft_consensus.cc:2258] T 5b058453afc0428fb86d91e3619f3876 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.903645 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.904417 12383 raft_consensus.cc:2229] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.905506 12383 raft_consensus.cc:2258] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.908491 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.909268 12383 raft_consensus.cc:2229] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.909755 12383 raft_consensus.cc:2258] T 62f757f75e81428e95d1831bb753267e P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.911470 24485 consensus_peers.cc:487] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.912906 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.913821 12383 raft_consensus.cc:2229] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.914288 12383 raft_consensus.cc:2258] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.917299 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.918089 12383 raft_consensus.cc:2229] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.918987 12383 raft_consensus.cc:2258] T dc328bf3f64c49caa9822ed16b6e0931 P 7631002fc97849e6bc5842e364e770e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.920812 24485 consensus_peers.cc:487] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:08:59.921731 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.922443 12383 raft_consensus.cc:2229] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.922870 12383 raft_consensus.cc:2258] T 06d73d9b96de4eab90e9acf32a1bd105 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.925122 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.925850 12383 raft_consensus.cc:2229] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.926316 12383 raft_consensus.cc:2258] T 190edee3f615448b912b194695a784e6 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.929150 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.929733 12383 raft_consensus.cc:2229] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.930160 12383 raft_consensus.cc:2258] T 897e2cd688a14f478986d26de348fc3b P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.932430 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.932953 12383 raft_consensus.cc:2229] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:08:59.933887 12383 raft_consensus.cc:2258] T c87a65e124704bdfb5ba6c78e7cc79ab P 7631002fc97849e6bc5842e364e770e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:08:59.936455 12383 tablet_replica.cc:330] stopping tablet replica
I20260811 16:08:59.937103 12383 raft_consensus.cc:2229] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:08:59.937486 12383 raft_consensus.cc:2258] T 336c47cb9abd43c9b0c55f3234f96b70 P 7631002fc97849e6bc5842e364e770e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:08:59.963989 24572 consensus_peers.cc:487] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.965591 24402 consensus_peers.cc:487] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.969313 24402 consensus_peers.cc:487] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:08:59.970127 24485 consensus_peers.cc:487] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.003274 24572 consensus_peers.cc:487] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.020471 12383 tablet_server.cc:194] TabletServer@127.12.23.193:36221 shutdown complete.
W20260811 16:09:00.041996 24402 consensus_peers.cc:487] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.055765 24402 consensus_peers.cc:487] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.064839 24572 consensus_peers.cc:487] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.065443 24572 consensus_peers.cc:487] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.069387 24402 consensus_peers.cc:487] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.114033 24572 consensus_peers.cc:487] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.128005 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:09:00.137547 24572 consensus_peers.cc:487] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.138237 24572 consensus_peers.cc:487] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.157755 24572 consensus_peers.cc:487] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.160926 24485 consensus_peers.cc:487] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.162542 24402 consensus_peers.cc:487] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.185806 24402 consensus_peers.cc:487] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.192148 24485 consensus_peers.cc:487] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.202303 24572 consensus_peers.cc:487] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.204221 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:00.205330 12383 tablet_replica.cc:330] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.206491 12383 raft_consensus.cc:2229] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.207170 12383 raft_consensus.cc:2258] T b630b4a32d1a4cfab0626c4f2715c9c5 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.209636 12383 tablet_replica.cc:330] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.210364 12383 raft_consensus.cc:2229] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.211301 12383 raft_consensus.cc:2258] T e1ed5dfcb9ba47fb84094969135b3697 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.213236 12383 tablet_replica.cc:330] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.213841 12383 raft_consensus.cc:2229] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.214251 12383 raft_consensus.cc:2258] T ecaafaa032434ef8bcd23c2ece667e60 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.216275 12383 tablet_replica.cc:330] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.216885 12383 raft_consensus.cc:2229] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.217895 12383 raft_consensus.cc:2258] T 2e3487223f11427fb71f9b2dcb0414f6 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.221479 12383 tablet_replica.cc:330] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.222394 12383 raft_consensus.cc:2229] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.223531 12383 raft_consensus.cc:2258] T 897e2cd688a14f478986d26de348fc3b P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.226657 12383 tablet_replica.cc:330] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.227545 12383 raft_consensus.cc:2229] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.228088 12383 raft_consensus.cc:2258] T fe927b7dcce64f2f8f949de1d18044a4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.230926 12383 tablet_replica.cc:330] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.231967 12383 raft_consensus.cc:2229] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.232975 12383 raft_consensus.cc:2258] T 1434b986b4784cbdb2ce4d716ecfdb6c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.235633 12383 tablet_replica.cc:330] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.236362 12383 raft_consensus.cc:2229] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.236884 12383 raft_consensus.cc:2258] T 08fe7d941ae74b0ab5c504d9f556b073 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:00.238139 24572 consensus_peers.cc:487] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 -> Peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Couldn't send request to peer 7631002fc97849e6bc5842e364e770e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.239396 12383 tablet_replica.cc:330] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.240116 12383 raft_consensus.cc:2229] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.241056 12383 raft_consensus.cc:2258] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.243399 12383 tablet_replica.cc:330] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.244192 12383 raft_consensus.cc:2229] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.244649 12383 raft_consensus.cc:2258] T cec26b0c5eb044ef9028311f26703757 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.246656 12383 tablet_replica.cc:330] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.247364 12383 raft_consensus.cc:2229] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.247802 12383 raft_consensus.cc:2258] T e474ad4d29de4c968bbf6811a1ced653 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.250043 12383 tablet_replica.cc:330] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.250643 12383 raft_consensus.cc:2229] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.251102 12383 raft_consensus.cc:2258] T 8d8b101a79cc404dbd7787240d4d827d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.253718 12383 tablet_replica.cc:330] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.254571 12383 raft_consensus.cc:2229] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.255012 12383 raft_consensus.cc:2258] T ae25aabfb52d4b57a9d71bf2e627ed63 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.257516 12383 tablet_replica.cc:330] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.258158 12383 raft_consensus.cc:2229] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.258672 12383 raft_consensus.cc:2258] T 987b5e0c309049a9998fac1cc491a78c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.260836 12383 tablet_replica.cc:330] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.261435 12383 raft_consensus.cc:2229] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.262353 12383 raft_consensus.cc:2258] T aef5b136564945f7ba5b1d391c91bb70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.264365 12383 tablet_replica.cc:330] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.264925 12383 raft_consensus.cc:2229] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.265370 12383 raft_consensus.cc:2258] T 06d73d9b96de4eab90e9acf32a1bd105 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.267635 12383 tablet_replica.cc:330] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.268195 12383 raft_consensus.cc:2229] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.269143 12383 raft_consensus.cc:2258] T 190edee3f615448b912b194695a784e6 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.271365 12383 tablet_replica.cc:330] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.272017 12383 raft_consensus.cc:2229] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.272511 12383 raft_consensus.cc:2258] T 424cfa023f8d422a8677325b3f8e74dd P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.275393 12383 tablet_replica.cc:330] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.276253 12383 raft_consensus.cc:2229] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.277467 12383 raft_consensus.cc:2258] T 62f757f75e81428e95d1831bb753267e P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.280216 12383 tablet_replica.cc:330] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.280853 12383 raft_consensus.cc:2229] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.281265 12383 raft_consensus.cc:2258] T fe620493add749c5a27c9fa537836c4c P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.283674 12383 tablet_replica.cc:330] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.284279 12383 raft_consensus.cc:2229] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.284718 12383 raft_consensus.cc:2258] T ff0b07fabee54845918b46e4c673c81d P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.287609 12383 tablet_replica.cc:330] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.288483 12383 raft_consensus.cc:2229] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 16:09:00.289031 24485 consensus_peers.cc:487] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.289043 12383 raft_consensus.cc:2258] T 309d4038e85243428daa2e934595bbb4 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.291877 12383 tablet_replica.cc:330] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.292507 12383 raft_consensus.cc:2229] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.293395 12383 raft_consensus.cc:2258] T 5807918611104b39a416c792b9a4994b P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.295496 12383 tablet_replica.cc:330] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.296166 12383 raft_consensus.cc:2229] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.296628 12383 raft_consensus.cc:2258] T 2b2929ec9e5b4864b79c28c24ccb7646 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.298516 12383 tablet_replica.cc:330] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.299093 12383 raft_consensus.cc:2229] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.299579 12383 raft_consensus.cc:2258] T 9f269dd87fe34c6586deee9aacc68a6f P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.301331 12383 tablet_replica.cc:330] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.301930 12383 raft_consensus.cc:2229] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.302805 12383 raft_consensus.cc:2258] T bc31d8acb4164ff29dd355deb7245651 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.304780 12383 tablet_replica.cc:330] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.305363 12383 raft_consensus.cc:2229] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.305807 12383 raft_consensus.cc:2258] T cdded2c7ff674319b9ca73af91948e0a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.307839 12383 tablet_replica.cc:330] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.308463 12383 raft_consensus.cc:2229] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.309432 12383 raft_consensus.cc:2258] T 057bc48deb6f442091c76a87d3345c3b P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.312561 12383 tablet_replica.cc:330] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.313378 12383 raft_consensus.cc:2229] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.313939 12383 raft_consensus.cc:2258] T 5c3effdf4dce4e0cb955d93b6b965802 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:00.314612 24485 consensus_peers.cc:487] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.316550 12383 tablet_replica.cc:330] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.317485 12383 raft_consensus.cc:2229] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.318670 12383 raft_consensus.cc:2258] T 9f1e466e0e3c4e66bfb6943245f80682 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.321935 12383 tablet_replica.cc:330] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.322878 12383 raft_consensus.cc:2229] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.324103 12383 raft_consensus.cc:2258] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.326648 12383 tablet_replica.cc:330] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.327380 12383 raft_consensus.cc:2229] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.328055 12383 raft_consensus.cc:2258] T 98f314cba976436a9dfe527ee810d1c5 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.330917 12383 tablet_replica.cc:330] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.331743 12383 raft_consensus.cc:2229] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.332350 12383 raft_consensus.cc:2258] T ce968612a2824f70bea8c2c027892542 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.334859 12383 tablet_replica.cc:330] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.335493 12383 raft_consensus.cc:2229] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.336566 12383 raft_consensus.cc:2258] T e4f248d334c04397adb27e611172a2e8 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.339007 12383 tablet_replica.cc:330] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.339926 12383 raft_consensus.cc:2229] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.340798 12383 raft_consensus.cc:2258] T 29d054ecff344a15bd66eb316fcc28e1 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.343950 12383 tablet_replica.cc:330] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.344751 12383 raft_consensus.cc:2229] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.345314 12383 raft_consensus.cc:2258] T 4ead62f860954f6ca8149148504e068f P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.348140 12383 tablet_replica.cc:330] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.348793 12383 raft_consensus.cc:2229] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.349232 12383 raft_consensus.cc:2258] T 0849d70159164a57a23b734a02aca623 P d44d109b1df0445eba66548c099958e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.352268 12383 tablet_replica.cc:330] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.353045 12383 raft_consensus.cc:2229] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.353551 12383 raft_consensus.cc:2258] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P d44d109b1df0445eba66548c099958e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.356369 12383 tablet_replica.cc:330] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.357128 12383 raft_consensus.cc:2229] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.357740 12383 raft_consensus.cc:2258] T 8b6592164b2b415e86bebdce9ce2517a P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.360575 12383 tablet_replica.cc:330] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.361318 12383 raft_consensus.cc:2229] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.361848 12383 raft_consensus.cc:2258] T 362cbea48a7e4ff59864d2204065575c P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.364719 12383 tablet_replica.cc:330] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3: stopping tablet replica
W20260811 16:09:00.364688 24572 consensus_peers.cc:487] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.365993 12383 raft_consensus.cc:2229] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.366554 12383 raft_consensus.cc:2258] T c87a65e124704bdfb5ba6c78e7cc79ab P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.369370 12383 tablet_replica.cc:330] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.370055 12383 raft_consensus.cc:2229] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.370568 12383 raft_consensus.cc:2258] T 336c47cb9abd43c9b0c55f3234f96b70 P d44d109b1df0445eba66548c099958e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.372735 12383 tablet_replica.cc:330] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.373289 12383 raft_consensus.cc:2229] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.373766 12383 raft_consensus.cc:2258] T f2e75587caf14bf3ac0c03288d2dc146 P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.376222 12383 tablet_replica.cc:330] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3: stopping tablet replica
I20260811 16:09:00.376797 12383 raft_consensus.cc:2229] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.377391 12383 raft_consensus.cc:2258] T 053f9ea874d649f59f934ea0b1df94ff P d44d109b1df0445eba66548c099958e3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:00.389575 24572 consensus_peers.cc:487] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.568627 24572 consensus_peers.cc:487] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.570940 24572 consensus_peers.cc:487] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.574536 24485 consensus_peers.cc:487] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.579224 24485 consensus_peers.cc:487] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.579916 24485 consensus_peers.cc:487] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.588934 24485 consensus_peers.cc:487] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.590647 24485 consensus_peers.cc:487] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.593144 24485 consensus_peers.cc:487] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.611099 24485 consensus_peers.cc:487] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.611867 24485 consensus_peers.cc:487] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.612531 24485 consensus_peers.cc:487] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.618381 24572 consensus_peers.cc:487] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.619288 24572 consensus_peers.cc:487] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.660408 24572 consensus_peers.cc:487] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 -> Peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Couldn't send request to peer d44d109b1df0445eba66548c099958e3. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.664539 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
I20260811 16:09:00.759043 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
W20260811 16:09:00.781723 24572 consensus_peers.cc:487] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.831708 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:00.833148 12383 tablet_replica.cc:330] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.834462 12383 raft_consensus.cc:2229] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.835106 12383 raft_consensus.cc:2258] T f2e75587caf14bf3ac0c03288d2dc146 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.843442 12383 tablet_replica.cc:330] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.843442 25684 raft_consensus.cc:482] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:00.844233 25684 raft_consensus.cc:504] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:09:00.846462 25684 leader_election.cc:288] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
I20260811 16:09:00.847847 12383 raft_consensus.cc:2229] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.849113 12383 raft_consensus.cc:2258] T 07f4360b11c44c6fa6327d0a030a1b55 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.854346 12383 tablet_replica.cc:330] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.855590 12383 raft_consensus.cc:2229] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.856164 12383 raft_consensus.cc:2258] T 38d2cd522feb43648ee671400627f17e P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:00.858006 24572 leader_election.cc:334] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:00.859436 12383 tablet_replica.cc:330] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
W20260811 16:09:00.862228 24572 leader_election.cc:334] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
I20260811 16:09:00.862774 24572 leader_election.cc:302] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:09:00.863032 12383 raft_consensus.cc:2229] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.863699 25684 raft_consensus.cc:2726] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:00.865694 12383 raft_consensus.cc:2258] T ecaafaa032434ef8bcd23c2ece667e60 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.868068 25683 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:00.868584 25683 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:00.869858 12383 tablet_replica.cc:330] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
W20260811 16:09:00.869709 24572 consensus_peers.cc:487] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:00.870548 24572 consensus_peers.cc:487] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.870971 12383 raft_consensus.cc:2229] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.871714 12383 raft_consensus.cc:2258] T e1ed5dfcb9ba47fb84094969135b3697 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.872545 24601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc328bf3f64c49caa9822ed16b6e0931" candidate_uuid: "6f165e96383a40dc9d724b290a94706d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "707f02c5118a4d798120ca9c5786ada6" is_pre_election: true
I20260811 16:09:00.873396 25683 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 707f02c5118a4d798120ca9c5786ada6 (127.12.23.196:32811), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:09:00.875175 12383 tablet_replica.cc:330] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
W20260811 16:09:00.875773 24485 leader_election.cc:334] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:00.876224 12383 raft_consensus.cc:2229] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.876266 24485 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f165e96383a40dc9d724b290a94706d; no voters: 707f02c5118a4d798120ca9c5786ada6, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:00.876979 12383 raft_consensus.cc:2258] T b665c6f1914645fbb497bdc4633cc1af P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.877179 25683 raft_consensus.cc:2726] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:00.879669 12383 tablet_replica.cc:330] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.880436 12383 raft_consensus.cc:2229] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.880942 12383 raft_consensus.cc:2258] T b7d8d1f4a7194ed0887d2a71ac016637 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.883344 12383 tablet_replica.cc:330] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.884025 12383 raft_consensus.cc:2229] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.884940 12383 raft_consensus.cc:2258] T e474ad4d29de4c968bbf6811a1ced653 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.887486 12383 tablet_replica.cc:330] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.888329 12383 raft_consensus.cc:2229] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.889213 12383 raft_consensus.cc:2258] T fe620493add749c5a27c9fa537836c4c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.892845 12383 tablet_replica.cc:330] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.893671 12383 raft_consensus.cc:2229] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.894147 12383 raft_consensus.cc:2258] T bf80ef260b444d97bd8f2badb125dd66 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.896358 12383 tablet_replica.cc:330] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.897075 12383 raft_consensus.cc:2229] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.897620 12383 raft_consensus.cc:2258] T a6c3f73ad35d4ef8863ea0ac5e2746e8 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.900156 12383 tablet_replica.cc:330] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.900810 12383 raft_consensus.cc:2229] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.901295 12383 raft_consensus.cc:2258] T dc328bf3f64c49caa9822ed16b6e0931 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.903542 12383 tablet_replica.cc:330] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.904188 12383 raft_consensus.cc:2229] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.905166 12383 raft_consensus.cc:2258] T 987b5e0c309049a9998fac1cc491a78c P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.907442 12383 tablet_replica.cc:330] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.908074 12383 raft_consensus.cc:2229] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.908522 12383 raft_consensus.cc:2258] T 9f269dd87fe34c6586deee9aacc68a6f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.911046 12383 tablet_replica.cc:330] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.911777 12383 raft_consensus.cc:2229] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.912336 12383 raft_consensus.cc:2258] T aef5b136564945f7ba5b1d391c91bb70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.915418 12383 tablet_replica.cc:330] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.916263 12383 raft_consensus.cc:2229] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.917210 12383 raft_consensus.cc:2258] T fe927b7dcce64f2f8f949de1d18044a4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.919629 12383 tablet_replica.cc:330] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.920252 12383 raft_consensus.cc:2229] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.920699 12383 raft_consensus.cc:2258] T 296f5dafb30b436fa348884a38c18320 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.922814 12383 tablet_replica.cc:330] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.923539 12383 raft_consensus.cc:2229] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.924048 12383 raft_consensus.cc:2258] T 190edee3f615448b912b194695a784e6 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.926409 12383 tablet_replica.cc:330] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.926636 25688 raft_consensus.cc:482] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:00.927318 12383 raft_consensus.cc:2229] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.927246 25688 raft_consensus.cc:504] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:00.928112 12383 raft_consensus.cc:2258] T 2b2929ec9e5b4864b79c28c24ccb7646 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.929809 25688 leader_election.cc:288] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:09:00.931425 12383 tablet_replica.cc:330] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
W20260811 16:09:00.931432 24572 consensus_peers.cc:487] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:00.932269 12383 raft_consensus.cc:2229] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.933239 12383 raft_consensus.cc:2258] T cdded2c7ff674319b9ca73af91948e0a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:00.933656 24572 leader_election.cc:334] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:09:00.934222 24572 leader_election.cc:334] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:00.934559 24572 leader_election.cc:302] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:00.935240 25688 raft_consensus.cc:2726] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:00.936149 12383 tablet_replica.cc:330] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.936825 12383 raft_consensus.cc:2229] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.937247 12383 raft_consensus.cc:2258] T 057bc48deb6f442091c76a87d3345c3b P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.939510 12383 tablet_replica.cc:330] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.940234 12383 raft_consensus.cc:2229] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.940637 12383 raft_consensus.cc:2258] T 253403f9eaad4164a0410493e7babb0f P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.942562 12383 tablet_replica.cc:330] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.943111 12383 raft_consensus.cc:2229] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.943570 12383 raft_consensus.cc:2258] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.945485 12383 tablet_replica.cc:330] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.946053 12383 raft_consensus.cc:2229] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.946501 12383 raft_consensus.cc:2258] T 5b058453afc0428fb86d91e3619f3876 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.948701 12383 tablet_replica.cc:330] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.949282 12383 raft_consensus.cc:2229] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.950142 12383 raft_consensus.cc:2258] T 424cfa023f8d422a8677325b3f8e74dd P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.952404 12383 tablet_replica.cc:330] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.952957 12383 raft_consensus.cc:2229] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.953372 12383 raft_consensus.cc:2258] T e4f248d334c04397adb27e611172a2e8 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.955511 12383 tablet_replica.cc:330] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.956033 12383 raft_consensus.cc:2229] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.956513 12383 raft_consensus.cc:2258] T 29d054ecff344a15bd66eb316fcc28e1 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.958663 12383 tablet_replica.cc:330] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.959511 12383 raft_consensus.cc:2229] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.959959 12383 raft_consensus.cc:2258] T 9f1e466e0e3c4e66bfb6943245f80682 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.962920 12383 tablet_replica.cc:330] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.963546 12383 raft_consensus.cc:2229] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.963954 12383 raft_consensus.cc:2258] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.966185 12383 tablet_replica.cc:330] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.966778 12383 raft_consensus.cc:2229] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.967444 12383 raft_consensus.cc:2258] T f054b2c61c564c9aac4234bf8b363331 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.969636 12383 tablet_replica.cc:330] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.970176 12383 raft_consensus.cc:2229] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.970981 12383 raft_consensus.cc:2258] T 4ead62f860954f6ca8149148504e068f P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.973102 12383 tablet_replica.cc:330] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.973618 12383 raft_consensus.cc:2229] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.974399 12383 raft_consensus.cc:2258] T 362cbea48a7e4ff59864d2204065575c P 6f165e96383a40dc9d724b290a94706d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.976507 12383 tablet_replica.cc:330] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.977065 12383 raft_consensus.cc:2229] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.977536 12383 raft_consensus.cc:2258] T e75ef18b8865438c83f749eea8f963aa P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.979566 12383 tablet_replica.cc:330] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.980073 12383 raft_consensus.cc:2229] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.981395 12383 raft_consensus.cc:2258] T 08fe7d941ae74b0ab5c504d9f556b073 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.984215 12383 tablet_replica.cc:330] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.985030 12383 raft_consensus.cc:2229] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:00.986203 12383 raft_consensus.cc:2258] T 62fbb0d94a2b49b2bab6a36b517ae048 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.988901 12383 tablet_replica.cc:330] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.989697 12383 raft_consensus.cc:2229] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.990316 12383 raft_consensus.cc:2258] T 8b6592164b2b415e86bebdce9ce2517a P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.993570 12383 tablet_replica.cc:330] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.994391 12383 raft_consensus.cc:2229] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:00.994983 12383 raft_consensus.cc:2258] T 3b21df0f0e7b43e7bb8911e772e7d9e2 P 6f165e96383a40dc9d724b290a94706d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:00.998158 12383 tablet_replica.cc:330] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:00.999056 12383 raft_consensus.cc:2229] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.000068 12383 raft_consensus.cc:2258] T 336c47cb9abd43c9b0c55f3234f96b70 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.003347 12383 tablet_replica.cc:330] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:01.004019 12383 raft_consensus.cc:2229] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.004567 12383 raft_consensus.cc:2258] T 30887efe153d45a7838550a656016312 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.007351 12383 tablet_replica.cc:330] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:01.008143 12383 raft_consensus.cc:2229] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.009104 12383 raft_consensus.cc:2258] T 98f314cba976436a9dfe527ee810d1c5 P 6f165e96383a40dc9d724b290a94706d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.012498 12383 tablet_replica.cc:330] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:01.013221 12383 raft_consensus.cc:2229] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.013764 12383 raft_consensus.cc:2258] T bc31d8acb4164ff29dd355deb7245651 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.016170 12383 tablet_replica.cc:330] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:01.016773 12383 raft_consensus.cc:2229] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.017987 12383 raft_consensus.cc:2258] T ff0b07fabee54845918b46e4c673c81d P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.021405 12383 tablet_replica.cc:330] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:01.022198 12383 raft_consensus.cc:2229] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.022825 12383 raft_consensus.cc:2258] T 309d4038e85243428daa2e934595bbb4 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.026852 12383 tablet_replica.cc:330] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d: stopping tablet replica
I20260811 16:09:01.027643 12383 raft_consensus.cc:2229] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.028232 12383 raft_consensus.cc:2258] T 20b7cb4615c04cddb553ef8d6e774869 P 6f165e96383a40dc9d724b290a94706d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.050482 25688 raft_consensus.cc:482] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.051537 25688 raft_consensus.cc:504] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:01.053897 25688 leader_election.cc:288] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:09:01.057400 24572 leader_election.cc:334] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:09:01.058048 24572 leader_election.cc:334] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:01.058373 24572 leader_election.cc:302] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:01.059033 25688 raft_consensus.cc:2726] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:01.087530 25688 raft_consensus.cc:482] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.088222 25688 raft_consensus.cc:504] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:09:01.090617 25688 leader_election.cc:288] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:09:01.094224 24572 leader_election.cc:334] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:09:01.095049 24572 leader_election.cc:334] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
I20260811 16:09:01.095495 24572 leader_election.cc:302] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.096377 25688 raft_consensus.cc:2726] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:01.103184 25671 raft_consensus.cc:482] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.103842 25671 raft_consensus.cc:504] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:01.105948 25671 leader_election.cc:288] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:09:01.109241 24572 leader_election.cc:334] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
W20260811 16:09:01.110222 24572 leader_election.cc:334] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:01.110560 24572 leader_election.cc:302] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:01.111263 25671 raft_consensus.cc:2726] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:09:01.115466 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:09:01.116637 25688 raft_consensus.cc:482] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.117280 25688 raft_consensus.cc:504] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:01.119372 25688 leader_election.cc:288] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:09:01.124573 24572 leader_election.cc:334] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:09:01.125573 24572 leader_election.cc:334] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
I20260811 16:09:01.125996 24572 leader_election.cc:302] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:01.126688 25688 raft_consensus.cc:2726] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:01.131867 25688 raft_consensus.cc:482] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.132472 25688 raft_consensus.cc:504] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:01.134758 25688 leader_election.cc:288] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
W20260811 16:09:01.140424 24572 leader_election.cc:334] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
W20260811 16:09:01.141112 24572 consensus_peers.cc:487] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:01.144097 24572 leader_election.cc:334] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:01.144644 24572 leader_election.cc:302] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:01.145334 25688 raft_consensus.cc:2726] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:09:01.205101 24572 consensus_peers.cc:487] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:01.211421 24572 consensus_peers.cc:487] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:01.212080 24572 consensus_peers.cc:487] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:01.219903 25671 raft_consensus.cc:482] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.221158 25671 raft_consensus.cc:504] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:09:01.225044 25671 leader_election.cc:288] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:09:01.236441 24572 leader_election.cc:334] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:09:01.237609 24572 leader_election.cc:334] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
I20260811 16:09:01.238270 24572 leader_election.cc:302] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.239651 25671 raft_consensus.cc:2726] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:09:01.242705 24572 consensus_peers.cc:487] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 -> Peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Couldn't send request to peer 6f165e96383a40dc9d724b290a94706d. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:01.247887 25671 raft_consensus.cc:482] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.249135 25671 raft_consensus.cc:504] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:09:01.252509 25671 leader_election.cc:288] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:09:01.258852 24572 leader_election.cc:334] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:09:01.259584 24572 leader_election.cc:334] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
I20260811 16:09:01.259999 24572 leader_election.cc:302] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.260903 25671 raft_consensus.cc:2726] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:09:01.292672 25671 raft_consensus.cc:482] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.293495 25671 raft_consensus.cc:504] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
I20260811 16:09:01.296021 25671 leader_election.cc:288] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:09:01.299350 25671 raft_consensus.cc:482] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7631002fc97849e6bc5842e364e770e3)
I20260811 16:09:01.300207 25671 raft_consensus.cc:504] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } }
W20260811 16:09:01.301452 24572 leader_election.cc:334] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
W20260811 16:09:01.302533 24572 leader_election.cc:334] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:01.302883 24572 leader_election.cc:302] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:01.302978 25671 leader_election.cc:288] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337), 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221)
I20260811 16:09:01.303807 25688 raft_consensus.cc:2726] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:01.304076 25671 raft_consensus.cc:482] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44d109b1df0445eba66548c099958e3)
I20260811 16:09:01.305038 25671 raft_consensus.cc:504] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:09:01.307905 25671 leader_election.cc:288] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:09:01.310531 24572 leader_election.cc:334] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
W20260811 16:09:01.311669 24572 leader_election.cc:334] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
I20260811 16:09:01.312073 24572 leader_election.cc:302] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, 7631002fc97849e6bc5842e364e770e3
I20260811 16:09:01.312855 25688 raft_consensus.cc:2726] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260811 16:09:01.315994 24572 leader_election.cc:334] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:09:01.317389 24572 leader_election.cc:334] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
I20260811 16:09:01.317920 24572 leader_election.cc:302] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.318714 25688 raft_consensus.cc:2726] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:01.319347 25671 raft_consensus.cc:482] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44d109b1df0445eba66548c099958e3)
I20260811 16:09:01.320331 25671 raft_consensus.cc:504] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:09:01.323091 25671 leader_election.cc:288] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:09:01.324136 12383 tablet_server.cc:178] TabletServer@127.12.23.196:0 shutting down...
W20260811 16:09:01.329260 24572 leader_election.cc:334] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
W20260811 16:09:01.331655 24572 leader_election.cc:334] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
I20260811 16:09:01.332017 24572 leader_election.cc:302] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.332857 25671 raft_consensus.cc:2726] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:01.367365 25671 raft_consensus.cc:482] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44d109b1df0445eba66548c099958e3)
I20260811 16:09:01.368060 25671 raft_consensus.cc:504] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } } peers { permanent_uuid: "7631002fc97849e6bc5842e364e770e3" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 36221 } } peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } }
I20260811 16:09:01.369679 25671 leader_election.cc:288] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221), d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247)
W20260811 16:09:01.376771 24572 leader_election.cc:334] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7631002fc97849e6bc5842e364e770e3 (127.12.23.193:36221): Network error: Client connection negotiation failed: client connection to 127.12.23.193:36221: connect: Connection refused (error 111)
W20260811 16:09:01.378082 24572 leader_election.cc:334] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
I20260811 16:09:01.378530 24572 leader_election.cc:302] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 7631002fc97849e6bc5842e364e770e3, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.379438 25686 raft_consensus.cc:2726] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:01.385838 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:01.387106 12383 tablet_replica.cc:330] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.388911 12383 raft_consensus.cc:2229] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.389854 12383 raft_consensus.cc:2258] T b7d8d1f4a7194ed0887d2a71ac016637 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.392973 12383 tablet_replica.cc:330] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.393769 12383 raft_consensus.cc:2229] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.395258 12383 raft_consensus.cc:2258] T b630b4a32d1a4cfab0626c4f2715c9c5 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.397939 12383 tablet_replica.cc:330] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.398785 12383 raft_consensus.cc:2229] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.399442 12383 raft_consensus.cc:2258] T 07f4360b11c44c6fa6327d0a030a1b55 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.402127 12383 tablet_replica.cc:330] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.402909 12383 raft_consensus.cc:2229] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.403533 12383 raft_consensus.cc:2258] T e1ed5dfcb9ba47fb84094969135b3697 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.405982 12383 tablet_replica.cc:330] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.406764 12383 raft_consensus.cc:2229] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.407454 12383 raft_consensus.cc:2258] T ecaafaa032434ef8bcd23c2ece667e60 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.410017 12383 tablet_replica.cc:330] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.410769 12383 raft_consensus.cc:2229] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.411425 12383 raft_consensus.cc:2258] T 897e2cd688a14f478986d26de348fc3b P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.414075 12383 tablet_replica.cc:330] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.414719 12383 raft_consensus.cc:2229] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.415360 25671 raft_consensus.cc:482] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44d109b1df0445eba66548c099958e3)
I20260811 16:09:01.415683 12383 raft_consensus.cc:2258] T b665c6f1914645fbb497bdc4633cc1af P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.416117 25671 raft_consensus.cc:504] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44d109b1df0445eba66548c099958e3" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 38247 } } peers { permanent_uuid: "6f165e96383a40dc9d724b290a94706d" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 40337 } } peers { permanent_uuid: "707f02c5118a4d798120ca9c5786ada6" member_type: VOTER last_known_addr { host: "127.12.23.196" port: 32811 } }
I20260811 16:09:01.418694 25671 leader_election.cc:288] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247), 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337)
I20260811 16:09:01.420001 12383 tablet_replica.cc:330] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.421197 12383 raft_consensus.cc:2229] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.421891 12383 raft_consensus.cc:2258] T 2e3487223f11427fb71f9b2dcb0414f6 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:01.422665 24572 leader_election.cc:334] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44d109b1df0445eba66548c099958e3 (127.12.23.194:38247): Network error: Client connection negotiation failed: client connection to 127.12.23.194:38247: connect: Connection refused (error 111)
W20260811 16:09:01.423552 24572 leader_election.cc:334] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f165e96383a40dc9d724b290a94706d (127.12.23.195:40337): Network error: Client connection negotiation failed: client connection to 127.12.23.195:40337: connect: Connection refused (error 111)
I20260811 16:09:01.423844 24572 leader_election.cc:302] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 707f02c5118a4d798120ca9c5786ada6; no voters: 6f165e96383a40dc9d724b290a94706d, d44d109b1df0445eba66548c099958e3
I20260811 16:09:01.424574 25671 raft_consensus.cc:2726] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:01.426071 12383 tablet_replica.cc:330] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.426812 12383 raft_consensus.cc:2229] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.427482 12383 raft_consensus.cc:2258] T bf80ef260b444d97bd8f2badb125dd66 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.430085 12383 tablet_replica.cc:330] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.430727 12383 raft_consensus.cc:2229] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.432355 12383 raft_consensus.cc:2258] T ae25aabfb52d4b57a9d71bf2e627ed63 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.436317 12383 tablet_replica.cc:330] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.437011 12383 raft_consensus.cc:2229] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.437562 12383 raft_consensus.cc:2258] T dc328bf3f64c49caa9822ed16b6e0931 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.440569 12383 tablet_replica.cc:330] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.441330 12383 raft_consensus.cc:2229] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.442150 12383 raft_consensus.cc:2258] T fe927b7dcce64f2f8f949de1d18044a4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.445163 12383 tablet_replica.cc:330] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.445924 12383 raft_consensus.cc:2229] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.447458 12383 raft_consensus.cc:2258] T 296f5dafb30b436fa348884a38c18320 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.450074 12383 tablet_replica.cc:330] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.450803 12383 raft_consensus.cc:2229] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.452163 12383 raft_consensus.cc:2258] T 8d8b101a79cc404dbd7787240d4d827d P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.454777 12383 tablet_replica.cc:330] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.455511 12383 raft_consensus.cc:2229] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.456115 12383 raft_consensus.cc:2258] T 987b5e0c309049a9998fac1cc491a78c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.458554 12383 tablet_replica.cc:330] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.459287 12383 raft_consensus.cc:2229] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.459800 12383 raft_consensus.cc:2258] T 62f757f75e81428e95d1831bb753267e P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.462497 12383 tablet_replica.cc:330] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.463335 12383 raft_consensus.cc:2229] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.464535 12383 raft_consensus.cc:2258] T 38d2cd522feb43648ee671400627f17e P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.467532 12383 tablet_replica.cc:330] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.468209 12383 raft_consensus.cc:2229] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.468812 12383 raft_consensus.cc:2258] T cec26b0c5eb044ef9028311f26703757 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.471565 12383 tablet_replica.cc:330] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.472373 12383 raft_consensus.cc:2229] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.472900 12383 raft_consensus.cc:2258] T 053f9ea874d649f59f934ea0b1df94ff P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.475580 12383 tablet_replica.cc:330] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.476577 12383 raft_consensus.cc:2229] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.477291 12383 raft_consensus.cc:2258] T 253403f9eaad4164a0410493e7babb0f P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.480104 12383 tablet_replica.cc:330] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.480813 12383 raft_consensus.cc:2229] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.481923 12383 raft_consensus.cc:2258] T 5b058453afc0428fb86d91e3619f3876 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.484340 12383 tablet_replica.cc:330] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.484961 12383 raft_consensus.cc:2229] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.485590 12383 raft_consensus.cc:2258] T 8a8deeaaae4d4b2c84759d8accfcdaf4 P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.488068 12383 tablet_replica.cc:330] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.488705 12383 raft_consensus.cc:2229] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.489791 12383 raft_consensus.cc:2258] T 0849d70159164a57a23b734a02aca623 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.492478 12383 tablet_replica.cc:330] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.493072 12383 raft_consensus.cc:2229] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.493678 12383 raft_consensus.cc:2258] T 5c3effdf4dce4e0cb955d93b6b965802 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.496503 12383 tablet_replica.cc:330] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.497145 12383 raft_consensus.cc:2229] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.497720 12383 raft_consensus.cc:2258] T 5807918611104b39a416c792b9a4994b P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.499850 12383 tablet_replica.cc:330] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.500432 12383 raft_consensus.cc:2229] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.500926 12383 raft_consensus.cc:2258] T ff0b07fabee54845918b46e4c673c81d P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.503345 12383 tablet_replica.cc:330] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.503961 12383 raft_consensus.cc:2229] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.505528 12383 raft_consensus.cc:2258] T 309d4038e85243428daa2e934595bbb4 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.508433 12383 tablet_replica.cc:330] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.509172 12383 raft_consensus.cc:2229] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.510361 12383 raft_consensus.cc:2258] T 20b7cb4615c04cddb553ef8d6e774869 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.512844 12383 tablet_replica.cc:330] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.513435 12383 raft_consensus.cc:2229] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.514628 12383 raft_consensus.cc:2258] T ce968612a2824f70bea8c2c027892542 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.516968 12383 tablet_replica.cc:330] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.517632 12383 raft_consensus.cc:2229] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.518180 12383 raft_consensus.cc:2258] T 29d054ecff344a15bd66eb316fcc28e1 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.520501 12383 tablet_replica.cc:330] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.521072 12383 raft_consensus.cc:2229] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.521608 12383 raft_consensus.cc:2258] T 9f1e466e0e3c4e66bfb6943245f80682 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.524065 12383 tablet_replica.cc:330] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.524724 12383 raft_consensus.cc:2229] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.525296 12383 raft_consensus.cc:2258] T 8aa4c2dc66334d0d8ae8cc14be6a9df3 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.527731 12383 tablet_replica.cc:330] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.528311 12383 raft_consensus.cc:2229] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.529524 12383 raft_consensus.cc:2258] T f054b2c61c564c9aac4234bf8b363331 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.532136 12383 tablet_replica.cc:330] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.532836 12383 raft_consensus.cc:2229] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.533321 12383 raft_consensus.cc:2258] T 30887efe153d45a7838550a656016312 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.535914 12383 tablet_replica.cc:330] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.536753 12383 raft_consensus.cc:2229] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.538275 12383 raft_consensus.cc:2258] T e75ef18b8865438c83f749eea8f963aa P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.541198 12383 tablet_replica.cc:330] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
W20260811 16:09:01.541504 24634 debug-util.cc:398] Leaking SignalData structure 0x7b080026b120 after lost signal to thread 12388
I20260811 16:09:01.541975 12383 raft_consensus.cc:2229] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.542932 12383 raft_consensus.cc:2258] T 362cbea48a7e4ff59864d2204065575c P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:01.543316 24634 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6dc0 after lost signal to thread 24276
I20260811 16:09:01.546505 12383 tablet_replica.cc:330] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
W20260811 16:09:01.546654 24634 debug-util.cc:398] Leaking SignalData structure 0x7b08001eb980 after lost signal to thread 24637
I20260811 16:09:01.547767 12383 raft_consensus.cc:2229] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.548699 12383 raft_consensus.cc:2258] T c87a65e124704bdfb5ba6c78e7cc79ab P 707f02c5118a4d798120ca9c5786ada6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.552135 12383 tablet_replica.cc:330] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.552874 12383 raft_consensus.cc:2229] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.553544 12383 raft_consensus.cc:2258] T 1434b986b4784cbdb2ce4d716ecfdb6c P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.556525 12383 tablet_replica.cc:330] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.557304 12383 raft_consensus.cc:2229] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.557992 12383 raft_consensus.cc:2258] T 08fe7d941ae74b0ab5c504d9f556b073 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.561005 12383 tablet_replica.cc:330] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.561673 12383 raft_consensus.cc:2229] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.562498 12383 raft_consensus.cc:2258] T 62fbb0d94a2b49b2bab6a36b517ae048 P 707f02c5118a4d798120ca9c5786ada6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.565413 12383 tablet_replica.cc:330] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.566058 12383 raft_consensus.cc:2229] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.567615 12383 raft_consensus.cc:2258] T 2b2929ec9e5b4864b79c28c24ccb7646 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.570030 12383 tablet_replica.cc:330] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.570708 12383 raft_consensus.cc:2229] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.571915 12383 raft_consensus.cc:2258] T 06d73d9b96de4eab90e9acf32a1bd105 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.574503 12383 tablet_replica.cc:330] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.575096 12383 raft_consensus.cc:2229] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:01.575764 12383 raft_consensus.cc:2258] T bc31d8acb4164ff29dd355deb7245651 P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:01.578524 12383 tablet_replica.cc:330] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6: stopping tablet replica
I20260811 16:09:01.578995 12383 raft_consensus.cc:2229] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:01.580153 12383 raft_consensus.cc:2258] T 8b6592164b2b415e86bebdce9ce2517a P 707f02c5118a4d798120ca9c5786ada6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:02.672752 12383 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 24634)
W20260811 16:09:03.673312 12383 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 24634)
W20260811 16:09:04.673812 12383 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 24634)
I20260811 16:09:05.163807 12383 tablet_server.cc:194] TabletServer@127.12.23.196:0 shutdown complete.
I20260811 16:09:05.249086 12383 master.cc:537] Master@127.12.23.254:43075 shutting down...
I20260811 16:09:05.287792 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:05.288512 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:05.288893 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P 027aa4a15f9f4982bef60b0108166320: stopping tablet replica
I20260811 16:09:05.314090 12383 master.cc:552] Master@127.12.23.254:43075 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37592 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:471: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (7 ms)
[----------] 5 tests from LeaderRebalancerTest (420069 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260811 16:09:05.426019 12383 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.23.254:33065
I20260811 16:09:05.427627 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:05.434243 25692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.434916 25693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:05.435707 12383 server_base.cc:1034] running on GCE node
W20260811 16:09:05.435662 25696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:05.437491 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:05.437713 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:05.437893 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464545437879 us; error 0 us; skew 500 ppm
I20260811 16:09:05.438485 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:05.441418 12383 webserver.cc:460] Webserver started at http://127.12.23.254:38865/ using document root <none> and password file <none>
I20260811 16:09:05.442080 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:05.442289 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:05.442613 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:05.444089 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/master-0-root/instance:
uuid: "b135671b0d134fa794415a671f54ae13"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.449414 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260811 16:09:05.453327 25703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.454340 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260811 16:09:05.454670 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/master-0-root
uuid: "b135671b0d134fa794415a671f54ae13"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.454941 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:05.468125 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:05.469406 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:05.512037 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.254:33065
I20260811 16:09:05.512174 25763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.254:33065 every 8 connection(s)
I20260811 16:09:05.516353 25764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:05.529695 25764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13: Bootstrap starting.
I20260811 16:09:05.534989 25764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:05.539882 25764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13: No bootstrap required, opened a new log
I20260811 16:09:05.542223 25764 raft_consensus.cc:348] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b135671b0d134fa794415a671f54ae13" member_type: VOTER }
I20260811 16:09:05.542712 25764 raft_consensus.cc:374] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:05.542905 25764 raft_consensus.cc:729] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b135671b0d134fa794415a671f54ae13, State: Initialized, Role: FOLLOWER
I20260811 16:09:05.543565 25764 consensus_queue.cc:260] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b135671b0d134fa794415a671f54ae13" member_type: VOTER }
I20260811 16:09:05.544023 25764 raft_consensus.cc:388] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:09:05.544220 25764 raft_consensus.cc:482] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:09:05.544437 25764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:05.549808 25764 raft_consensus.cc:504] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b135671b0d134fa794415a671f54ae13" member_type: VOTER }
I20260811 16:09:05.550385 25764 leader_election.cc:302] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b135671b0d134fa794415a671f54ae13; no voters: 
I20260811 16:09:05.551692 25764 leader_election.cc:288] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 16:09:05.552228 25767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:05.553893 25767 raft_consensus.cc:686] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 1 LEADER]: Becoming Leader. State: Replica: b135671b0d134fa794415a671f54ae13, State: Running, Role: LEADER
I20260811 16:09:05.554669 25767 consensus_queue.cc:237] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b135671b0d134fa794415a671f54ae13" member_type: VOTER }
I20260811 16:09:05.555001 25764 sys_catalog.cc:564] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:09:05.563164 25769 sys_catalog.cc:455] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b135671b0d134fa794415a671f54ae13. Latest consensus state: current_term: 1 leader_uuid: "b135671b0d134fa794415a671f54ae13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b135671b0d134fa794415a671f54ae13" member_type: VOTER } }
I20260811 16:09:05.564174 25769 sys_catalog.cc:458] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [sys.catalog]: This master's current role is: LEADER
I20260811 16:09:05.563068 25768 sys_catalog.cc:455] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b135671b0d134fa794415a671f54ae13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b135671b0d134fa794415a671f54ae13" member_type: VOTER } }
I20260811 16:09:05.565132 25768 sys_catalog.cc:458] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [sys.catalog]: This master's current role is: LEADER
I20260811 16:09:05.566706 25777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:09:05.571915 25777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:09:05.574323 12383 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:09:05.581841 25777 catalog_manager.cc:1347] Generated new cluster ID: b567be2d9be54417ae95cb223ec50c17
I20260811 16:09:05.582216 25777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:09:05.619856 25777 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:09:05.621748 25777 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:09:05.637660 25777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13: Generated new TSK 0
I20260811 16:09:05.638396 25777 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:09:05.705904 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:05.712875 25788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.714133 25789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.719108 25791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:05.719228 12383 server_base.cc:1034] running on GCE node
I20260811 16:09:05.720705 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:05.720942 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:05.721125 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464545721106 us; error 0 us; skew 500 ppm
I20260811 16:09:05.721801 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:05.724910 12383 webserver.cc:460] Webserver started at http://127.12.23.193:42779/ using document root <none> and password file <none>
I20260811 16:09:05.725461 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:05.725684 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:05.725967 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:05.727900 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-0-root/instance:
uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.733430 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260811 16:09:05.738153 25797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.739257 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260811 16:09:05.739624 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.739924 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:05.753198 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:05.754498 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:05.756453 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:09:05.759028 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:09:05.759337 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260811 16:09:05.759598 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:09:05.759789 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.806201 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:44215
I20260811 16:09:05.806314 25862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:44215 every 8 connection(s)
I20260811 16:09:05.811631 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:05.820233 25867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.821906 25868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.826951 25871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:05.828282 12383 server_base.cc:1034] running on GCE node
I20260811 16:09:05.830459 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:05.830752 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:05.830955 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464545830938 us; error 0 us; skew 500 ppm
I20260811 16:09:05.831504 25863 heartbeater.cc:347] Connected to a master server at 127.12.23.254:33065
I20260811 16:09:05.831666 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:05.832106 25863 heartbeater.cc:464] Registering TS with master...
I20260811 16:09:05.833207 25863 heartbeater.cc:511] Master 127.12.23.254:33065 requested a full tablet report, sending...
I20260811 16:09:05.835430 12383 webserver.cc:460] Webserver started at http://127.12.23.194:40177/ using document root <none> and password file <none>
I20260811 16:09:05.836076 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:05.836023 25723 ts_manager.cc:194] Registered new tserver with Master: 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215)
I20260811 16:09:05.836447 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:05.836810 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:05.838466 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-1-root/instance:
uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.838536 25723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58612
I20260811 16:09:05.847044 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260811 16:09:05.851709 25877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.852741 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:09:05.853096 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-1-root
uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.853379 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:05.873208 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:05.874532 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:05.876194 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:09:05.878711 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:09:05.878895 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.879221 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:09:05.879388 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.924836 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.194:41571
I20260811 16:09:05.924975 25950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.194:41571 every 8 connection(s)
I20260811 16:09:05.930025 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:05.938344 25956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.939529 25957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:05.942806 25959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:05.942860 12383 server_base.cc:1034] running on GCE node
I20260811 16:09:05.944585 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:05.944882 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:05.945109 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464545945093 us; error 0 us; skew 500 ppm
I20260811 16:09:05.945815 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:05.946205 25951 heartbeater.cc:347] Connected to a master server at 127.12.23.254:33065
I20260811 16:09:05.946720 25951 heartbeater.cc:464] Registering TS with master...
I20260811 16:09:05.947788 25951 heartbeater.cc:511] Master 127.12.23.254:33065 requested a full tablet report, sending...
I20260811 16:09:05.949256 12383 webserver.cc:460] Webserver started at http://127.12.23.195:33199/ using document root <none> and password file <none>
I20260811 16:09:05.949988 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:05.950196 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:05.950491 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:05.950448 25723 ts_manager.cc:194] Registered new tserver with Master: 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:05.952054 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-2-root/instance:
uuid: "6afde416bee7452ea475f554ae0c23f1"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.952740 25723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58618
I20260811 16:09:05.958220 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.003s
I20260811 16:09:05.962172 25965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.963059 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260811 16:09:05.963505 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-2-root
uuid: "6afde416bee7452ea475f554ae0c23f1"
format_stamp: "Formatted at 2026-08-11 16:09:05 on dist-test-slave-chsk"
I20260811 16:09:05.963836 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1786464125124352-12383-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:05.985006 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:05.986424 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:05.988020 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:09:05.990383 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:09:05.990624 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:05.990900 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:09:05.991073 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:06.038111 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.195:41965
I20260811 16:09:06.038260 26033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.195:41965 every 8 connection(s)
I20260811 16:09:06.056545 26034 heartbeater.cc:347] Connected to a master server at 127.12.23.254:33065
I20260811 16:09:06.057152 26034 heartbeater.cc:464] Registering TS with master...
I20260811 16:09:06.058029 26034 heartbeater.cc:511] Master 127.12.23.254:33065 requested a full tablet report, sending...
I20260811 16:09:06.060190 25723 ts_manager.cc:194] Registered new tserver with Master: 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.060686 12383 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018929754s
I20260811 16:09:06.062088 25723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58632
I20260811 16:09:06.063187 12383 test_util.cc:268] Using random seed: -1330904302
I20260811 16:09:06.092032 25723 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58634:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:09:06.095374 25723 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:09:06.186884 25993 tablet_service.cc:1467] Processing CreateTablet for tablet 00c4833950fd4e178e2f59dc4a63775b (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:06.188750 25993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c4833950fd4e178e2f59dc4a63775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.189291 25991 tablet_service.cc:1467] Processing CreateTablet for tablet 7eabf16a76804ca1866e4814b8d12f8c (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:06.190943 25991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eabf16a76804ca1866e4814b8d12f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.191732 25989 tablet_service.cc:1467] Processing CreateTablet for tablet 518256f8b05144248e6ffafe35869ce3 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:06.190862 25988 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5a54a498da4f07868519c15ea656e7 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:06.193341 25989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518256f8b05144248e6ffafe35869ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.195510 25990 tablet_service.cc:1467] Processing CreateTablet for tablet 6043c686b0be4818a63257efeffd3fd5 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:06.197552 25990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6043c686b0be4818a63257efeffd3fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.200515 25992 tablet_service.cc:1467] Processing CreateTablet for tablet b1e0086806384f03b5e2db4f7115a3c2 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:06.202495 25992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e0086806384f03b5e2db4f7115a3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.207953 25988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5a54a498da4f07868519c15ea656e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.210774 25987 tablet_service.cc:1467] Processing CreateTablet for tablet 17268c3586524c7bb1106e997b61d9cc (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:06.212405 25987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17268c3586524c7bb1106e997b61d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.213016 25986 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2a6992855f4b24bbeea39db1aa3f5f (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:06.214650 25986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2a6992855f4b24bbeea39db1aa3f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.220810 25985 tablet_service.cc:1467] Processing CreateTablet for tablet 91a115366d8e4c0b9cfbdf1a8262810a (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:06.222612 25985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a115366d8e4c0b9cfbdf1a8262810a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.260023 25907 tablet_service.cc:1467] Processing CreateTablet for tablet b1e0086806384f03b5e2db4f7115a3c2 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:06.260470 25908 tablet_service.cc:1467] Processing CreateTablet for tablet 00c4833950fd4e178e2f59dc4a63775b (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:06.262022 25904 tablet_service.cc:1467] Processing CreateTablet for tablet 518256f8b05144248e6ffafe35869ce3 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:06.263401 25906 tablet_service.cc:1467] Processing CreateTablet for tablet 7eabf16a76804ca1866e4814b8d12f8c (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:06.255007 26051 tablet_bootstrap.cc:492] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.262066 25905 tablet_service.cc:1467] Processing CreateTablet for tablet 6043c686b0be4818a63257efeffd3fd5 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:06.262074 25907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e0086806384f03b5e2db4f7115a3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.266505 25906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eabf16a76804ca1866e4814b8d12f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.267174 25904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518256f8b05144248e6ffafe35869ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.267982 25908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c4833950fd4e178e2f59dc4a63775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.269918 25902 tablet_service.cc:1467] Processing CreateTablet for tablet 17268c3586524c7bb1106e997b61d9cc (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:06.264557 25903 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5a54a498da4f07868519c15ea656e7 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:06.272300 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5a54a498da4f07868519c15ea656e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.272563 25900 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2a6992855f4b24bbeea39db1aa3f5f (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:06.274091 25900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2a6992855f4b24bbeea39db1aa3f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.275285 26051 tablet_bootstrap.cc:654] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.276568 25899 tablet_service.cc:1467] Processing CreateTablet for tablet 91a115366d8e4c0b9cfbdf1a8262810a (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:06.278184 25899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a115366d8e4c0b9cfbdf1a8262810a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.279642 25902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17268c3586524c7bb1106e997b61d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.283542 25905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6043c686b0be4818a63257efeffd3fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.317766 26051 tablet_bootstrap.cc:492] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:06.318614 26051 ts_tablet_manager.cc:1397] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.017s
I20260811 16:09:06.319159 25825 tablet_service.cc:1467] Processing CreateTablet for tablet 00c4833950fd4e178e2f59dc4a63775b (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:06.321374 25825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c4833950fd4e178e2f59dc4a63775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.324899 25824 tablet_service.cc:1467] Processing CreateTablet for tablet b1e0086806384f03b5e2db4f7115a3c2 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:06.328526 26053 tablet_bootstrap.cc:492] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.329650 25820 tablet_service.cc:1467] Processing CreateTablet for tablet 5b5a54a498da4f07868519c15ea656e7 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:06.328604 25823 tablet_service.cc:1467] Processing CreateTablet for tablet 7eabf16a76804ca1866e4814b8d12f8c (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:06.332304 25820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b5a54a498da4f07868519c15ea656e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.328550 25821 tablet_service.cc:1467] Processing CreateTablet for tablet 518256f8b05144248e6ffafe35869ce3 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:06.333987 25821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518256f8b05144248e6ffafe35869ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.329651 25822 tablet_service.cc:1467] Processing CreateTablet for tablet 6043c686b0be4818a63257efeffd3fd5 (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:06.335794 25823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eabf16a76804ca1866e4814b8d12f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.336490 25824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e0086806384f03b5e2db4f7115a3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.336599 26053 tablet_bootstrap.cc:654] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.339646 25822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6043c686b0be4818a63257efeffd3fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.344693 26051 raft_consensus.cc:348] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.345661 25817 tablet_service.cc:1467] Processing CreateTablet for tablet 91a115366d8e4c0b9cfbdf1a8262810a (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:06.347333 25817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a115366d8e4c0b9cfbdf1a8262810a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.347015 25818 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2a6992855f4b24bbeea39db1aa3f5f (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:06.349066 25818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2a6992855f4b24bbeea39db1aa3f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.346067 26051 raft_consensus.cc:374] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.380399 26051 raft_consensus.cc:729] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.381795 26051 consensus_queue.cc:260] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.353039 25819 tablet_service.cc:1467] Processing CreateTablet for tablet 17268c3586524c7bb1106e997b61d9cc (DEFAULT_TABLE table=test-workload [id=43a626fc377e4718b12d1a105093a371]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:06.385774 25819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17268c3586524c7bb1106e997b61d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:06.434386 26053 tablet_bootstrap.cc:492] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.435110 26053 ts_tablet_manager.cc:1397] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.032s
I20260811 16:09:06.435916 26057 tablet_bootstrap.cc:492] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.438256 26053 raft_consensus.cc:348] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.447872 26053 raft_consensus.cc:374] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.448236 26053 raft_consensus.cc:729] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.449301 26053 consensus_queue.cc:260] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.450838 26057 tablet_bootstrap.cc:654] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.458632 26034 heartbeater.cc:503] Master 127.12.23.254:33065 was elected leader, sending a full tablet report...
I20260811 16:09:06.458748 25951 heartbeater.cc:503] Master 127.12.23.254:33065 was elected leader, sending a full tablet report...
I20260811 16:09:06.459256 26053 ts_tablet_manager.cc:1428] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.009s
I20260811 16:09:06.460516 26053 tablet_bootstrap.cc:492] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.467796 26053 tablet_bootstrap.cc:654] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.468585 26051 ts_tablet_manager.cc:1428] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.150s	user 0.013s	sys 0.005s
I20260811 16:09:06.469871 26051 tablet_bootstrap.cc:492] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.473708 26053 tablet_bootstrap.cc:492] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.474411 26053 ts_tablet_manager.cc:1397] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260811 16:09:06.476452 26057 tablet_bootstrap.cc:492] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:06.477298 26057 ts_tablet_manager.cc:1397] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260811 16:09:06.477535 26053 raft_consensus.cc:348] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.478392 26053 raft_consensus.cc:374] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.478701 26053 raft_consensus.cc:729] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.476539 26051 tablet_bootstrap.cc:654] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.479501 26053 consensus_queue.cc:260] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.481019 26057 raft_consensus.cc:348] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.481952 26057 raft_consensus.cc:374] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.482028 26053 ts_tablet_manager.cc:1428] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260811 16:09:06.482479 26057 raft_consensus.cc:729] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.483516 26053 tablet_bootstrap.cc:492] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.483431 26057 consensus_queue.cc:260] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.491859 26051 tablet_bootstrap.cc:492] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:06.492331 26053 tablet_bootstrap.cc:654] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.492534 26051 ts_tablet_manager.cc:1397] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260811 16:09:06.496364 26051 raft_consensus.cc:348] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.497538 26051 raft_consensus.cc:374] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.497925 26051 raft_consensus.cc:729] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.499066 26051 consensus_queue.cc:260] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.502632 26051 ts_tablet_manager.cc:1428] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260811 16:09:06.504017 26051 tablet_bootstrap.cc:492] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.513796 26053 tablet_bootstrap.cc:492] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.513974 26051 tablet_bootstrap.cc:654] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.514460 26053 ts_tablet_manager.cc:1397] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260811 16:09:06.517992 26053 raft_consensus.cc:348] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.519263 26053 raft_consensus.cc:374] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.519694 26053 raft_consensus.cc:729] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.520767 26053 consensus_queue.cc:260] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.524066 25863 heartbeater.cc:503] Master 127.12.23.254:33065 was elected leader, sending a full tablet report...
I20260811 16:09:06.524708 26057 ts_tablet_manager.cc:1428] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.047s	user 0.024s	sys 0.021s
I20260811 16:09:06.525933 26057 tablet_bootstrap.cc:492] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.526400 26051 tablet_bootstrap.cc:492] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:06.526441 26053 ts_tablet_manager.cc:1428] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260811 16:09:06.527173 26051 ts_tablet_manager.cc:1397] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260811 16:09:06.527804 26053 tablet_bootstrap.cc:492] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.530283 26051 raft_consensus.cc:348] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.531108 26051 raft_consensus.cc:374] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.531461 26051 raft_consensus.cc:729] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.532357 26058 raft_consensus.cc:482] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.532940 26058 raft_consensus.cc:504] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.535377 26053 tablet_bootstrap.cc:654] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.538861 26058 leader_election.cc:288] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
W20260811 16:09:06.545185 26035 tablet.cc:2369] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:09:06.557242 26051 consensus_queue.cc:260] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.572643 26051 ts_tablet_manager.cc:1428] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.004s
I20260811 16:09:06.574172 26059 raft_consensus.cc:482] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.574815 26057 tablet_bootstrap.cc:654] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.575749 26059 raft_consensus.cc:504] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.574194 26051 tablet_bootstrap.cc:492] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.588037 26053 tablet_bootstrap.cc:492] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.588865 26053 ts_tablet_manager.cc:1397] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.021s
I20260811 16:09:06.609074 26058 raft_consensus.cc:482] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.609844 26058 raft_consensus.cc:504] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.611853 26059 leader_election.cc:288] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.612350 26058 leader_election.cc:288] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:06.599855 26051 tablet_bootstrap.cc:654] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.619464 26053 raft_consensus.cc:348] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.620460 26053 raft_consensus.cc:374] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.620762 26053 raft_consensus.cc:729] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.621541 26053 consensus_queue.cc:260] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.622205 26057 tablet_bootstrap.cc:492] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:06.622972 26057 ts_tablet_manager.cc:1397] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.004s
I20260811 16:09:06.627313 26057 raft_consensus.cc:348] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.630862 26057 raft_consensus.cc:374] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.631336 26057 raft_consensus.cc:729] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.632447 26057 consensus_queue.cc:260] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.637393 26053 ts_tablet_manager.cc:1428] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.048s	user 0.001s	sys 0.009s
I20260811 16:09:06.637981 26057 ts_tablet_manager.cc:1428] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260811 16:09:06.638834 26053 tablet_bootstrap.cc:492] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.639484 26057 tablet_bootstrap.cc:492] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.647037 26053 tablet_bootstrap.cc:654] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.647038 26057 tablet_bootstrap.cc:654] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.650368 26051 tablet_bootstrap.cc:492] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:06.651265 26051 ts_tablet_manager.cc:1397] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.005s
I20260811 16:09:06.655705 26051 raft_consensus.cc:348] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.656790 26051 raft_consensus.cc:374] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.657158 26051 raft_consensus.cc:729] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.658349 26051 consensus_queue.cc:260] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.661995 26051 ts_tablet_manager.cc:1428] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260811 16:09:06.663450 26051 tablet_bootstrap.cc:492] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.667395 26057 tablet_bootstrap.cc:492] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:06.668169 26057 ts_tablet_manager.cc:1397] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.014s
I20260811 16:09:06.671739 26057 raft_consensus.cc:348] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.672392 26057 raft_consensus.cc:374] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.672668 26057 raft_consensus.cc:729] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.673007 26051 tablet_bootstrap.cc:654] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.673470 26057 consensus_queue.cc:260] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.676177 26057 ts_tablet_manager.cc:1428] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260811 16:09:06.677378 26057 tablet_bootstrap.cc:492] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.680943 26051 tablet_bootstrap.cc:492] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:06.681623 26051 ts_tablet_manager.cc:1397] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260811 16:09:06.681804 26053 tablet_bootstrap.cc:492] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.682531 26053 ts_tablet_manager.cc:1397] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.019s
I20260811 16:09:06.685739 26051 raft_consensus.cc:348] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.686679 26051 raft_consensus.cc:374] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.686074 26053 raft_consensus.cc:348] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.687024 26051 raft_consensus.cc:729] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.687294 26053 raft_consensus.cc:374] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.687556 26057 tablet_bootstrap.cc:654] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.687911 26053 raft_consensus.cc:729] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.688143 26051 consensus_queue.cc:260] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.688838 26053 consensus_queue.cc:260] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.691612 26051 ts_tablet_manager.cc:1428] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260811 16:09:06.692207 26053 ts_tablet_manager.cc:1428] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260811 16:09:06.692878 26051 tablet_bootstrap.cc:492] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.693985 26053 tablet_bootstrap.cc:492] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.700901 26051 tablet_bootstrap.cc:654] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.704351 26053 tablet_bootstrap.cc:654] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.719501 26053 tablet_bootstrap.cc:492] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.720504 26053 ts_tablet_manager.cc:1397] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.014s
I20260811 16:09:06.725025 26053 raft_consensus.cc:348] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.726351 26053 raft_consensus.cc:374] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.726871 26053 raft_consensus.cc:729] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
W20260811 16:09:06.728533 25779 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:09:06.728085 26053 consensus_queue.cc:260] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.732009 26053 ts_tablet_manager.cc:1428] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260811 16:09:06.733819 26053 tablet_bootstrap.cc:492] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.743502 26053 tablet_bootstrap.cc:654] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.750104 26057 tablet_bootstrap.cc:492] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:06.750864 26057 ts_tablet_manager.cc:1397] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.044s
I20260811 16:09:06.751581 26051 tablet_bootstrap.cc:492] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:06.752063 26051 ts_tablet_manager.cc:1397] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.028s
I20260811 16:09:06.752905 26059 raft_consensus.cc:482] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.753559 26059 raft_consensus.cc:504] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.754479 26057 raft_consensus.cc:348] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.755491 26057 raft_consensus.cc:374] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.756001 26057 raft_consensus.cc:729] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.756306 26059 leader_election.cc:288] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965), 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215)
I20260811 16:09:06.757285 26059 raft_consensus.cc:482] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.758008 26059 raft_consensus.cc:504] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.759409 26057 consensus_queue.cc:260] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.760571 26059 leader_election.cc:288] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.762390 26057 ts_tablet_manager.cc:1428] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260811 16:09:06.763700 26057 tablet_bootstrap.cc:492] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.763831 26053 tablet_bootstrap.cc:492] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:06.764447 26053 ts_tablet_manager.cc:1397] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.008s
I20260811 16:09:06.755600 26051 raft_consensus.cc:348] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.767330 26051 raft_consensus.cc:374] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.767675 26051 raft_consensus.cc:729] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.769682 26051 consensus_queue.cc:260] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.808444 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:06.809430 25922 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:06.810770 25968 leader_election.cc:302] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:06.813329 26080 raft_consensus.cc:2781] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:06.813792 26080 raft_consensus.cc:482] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:06.814144 26080 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.816917 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.817234 25834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.818701 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
W20260811 16:09:06.819180 25966 leader_election.cc:341] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:06.819581 25921 raft_consensus.cc:2454] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:06.821341 25968 leader_election.cc:302] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
W20260811 16:09:06.823800 25966 leader_election.cc:341] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:06.823998 26080 raft_consensus.cc:504] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.826294 26080 leader_election.cc:288] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:06.826902 26080 raft_consensus.cc:2781] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:06.827257 26080 raft_consensus.cc:482] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:06.827853 26080 raft_consensus.cc:3037] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.828023 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:06.829176 25921 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.827171 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
W20260811 16:09:06.831046 25966 leader_election.cc:341] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:06.836508 26080 raft_consensus.cc:504] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.838956 25921 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:06.840150 26057 tablet_bootstrap.cc:654] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.840991 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:06.841780 25922 raft_consensus.cc:3037] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.840276 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
W20260811 16:09:06.845484 25966 leader_election.cc:341] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:06.846573 26057 tablet_bootstrap.cc:492] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:06.847234 26057 ts_tablet_manager.cc:1397] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.000s
I20260811 16:09:06.847597 25968 leader_election.cc:302] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:06.849350 26082 raft_consensus.cc:482] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.849893 26082 raft_consensus.cc:504] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.850446 26057 raft_consensus.cc:348] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.851336 26057 raft_consensus.cc:374] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.851639 26057 raft_consensus.cc:729] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.852886 25922 raft_consensus.cc:2454] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:06.853502 26063 raft_consensus.cc:482] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.854295 26063 raft_consensus.cc:504] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.854655 25968 leader_election.cc:302] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:06.854727 26082 leader_election.cc:288] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:06.855856 26080 leader_election.cc:288] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:06.855862 26082 raft_consensus.cc:2781] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:06.856586 26080 raft_consensus.cc:2781] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:06.856892 26063 leader_election.cc:288] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.857069 26080 raft_consensus.cc:686] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:06.856756 26082 raft_consensus.cc:686] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:06.858060 26080 consensus_queue.cc:237] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.858460 26082 consensus_queue.cc:237] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.853507 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.860451 25835 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:06.861829 25966 leader_election.cc:302] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:06.862627 26063 raft_consensus.cc:482] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.863338 26063 raft_consensus.cc:504] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.867278 26058 raft_consensus.cc:2781] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:06.866197 26063 leader_election.cc:288] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.867779 26058 raft_consensus.cc:482] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:06.873073 26058 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.852523 26057 consensus_queue.cc:260] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.877053 26057 ts_tablet_manager.cc:1428] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260811 16:09:06.878484 26057 tablet_bootstrap.cc:492] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.879841 26063 raft_consensus.cc:482] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.880475 26063 raft_consensus.cc:504] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.882787 26063 leader_election.cc:288] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.886641 26057 tablet_bootstrap.cc:654] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.891579 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:06.892426 25922 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:06.871831 26078 raft_consensus.cc:482] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:06.872462 26051 ts_tablet_manager.cc:1428] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.120s	user 0.009s	sys 0.004s
I20260811 16:09:06.894989 26051 tablet_bootstrap.cc:492] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:06.902840 26078 raft_consensus.cc:504] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.906199 26078 leader_election.cc:288] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:06.915319 26053 raft_consensus.cc:348] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.916559 26053 raft_consensus.cc:374] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.916879 26053 raft_consensus.cc:729] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.917876 26053 consensus_queue.cc:260] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:06.920320 25966 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.193:44215, user_credentials={real_user=slave}} blocked reactor thread for 58596.9us
I20260811 16:09:06.928237 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.931566 26057 tablet_bootstrap.cc:492] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:06.932432 26057 ts_tablet_manager.cc:1397] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.029s
I20260811 16:09:06.922923 26051 tablet_bootstrap.cc:654] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.956565 26058 raft_consensus.cc:504] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.947479 26057 raft_consensus.cc:348] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.958493 26057 raft_consensus.cc:374] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:06.959316 26057 raft_consensus.cc:729] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:06.960500 26057 consensus_queue.cc:260] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:06.960852 26053 ts_tablet_manager.cc:1428] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.196s	user 0.012s	sys 0.005s
I20260811 16:09:06.965906 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:06.966302 26053 tablet_bootstrap.cc:492] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:06.966718 25835 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.970541 26058 leader_election.cc:288] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:06.971565 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:06.972311 25922 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:06.988440 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.989302 25922 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:06.989506 25834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.989356 25833 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:06.989820 26053 tablet_bootstrap.cc:654] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:06.990528 25968 leader_election.cc:302] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:06.991835 26058 raft_consensus.cc:2781] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:06.992278 26058 raft_consensus.cc:686] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:06.992977 26058 consensus_queue.cc:237] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:06.993391 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:06.993870 25723 catalog_manager.cc:5495] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
W20260811 16:09:06.995260 25879 leader_election.cc:341] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:06.996482 25879 leader_election.cc:302] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:06.997375 26078 raft_consensus.cc:2741] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260811 16:09:06.997419 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:06.998309 25921 raft_consensus.cc:2454] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
W20260811 16:09:06.997517 25879 leader_election.cc:341] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.001961 25800 leader_election.cc:302] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.002436 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.003654 26063 raft_consensus.cc:2781] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:07.004181 26063 raft_consensus.cc:482] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:07.003794 25921 raft_consensus.cc:2379] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bfa3b3b690b43f8b3980437b3ac03ec in current term 1: Already voted for candidate 6afde416bee7452ea475f554ae0c23f1 in this term.
I20260811 16:09:07.004591 26063 raft_consensus.cc:3037] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.005842 26057 ts_tablet_manager.cc:1428] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260811 16:09:07.007823 26057 tablet_bootstrap.cc:492] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:06.998016 25723 catalog_manager.cc:5495] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:07.010842 25835 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:07.017148 26057 tablet_bootstrap.cc:654] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:07.013686 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6043c686b0be4818a63257efeffd3fd5" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.024310 26051 tablet_bootstrap.cc:492] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:07.027187 26051 ts_tablet_manager.cc:1397] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.018s
I20260811 16:09:07.028991 26063 raft_consensus.cc:504] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.029775 26057 tablet_bootstrap.cc:492] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:07.030448 26057 ts_tablet_manager.cc:1397] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260811 16:09:07.030802 26051 raft_consensus.cc:348] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.031720 26051 raft_consensus.cc:374] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.027048 25922 raft_consensus.cc:2454] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:07.031991 26058 raft_consensus.cc:482] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:07.032027 26051 raft_consensus.cc:729] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.032567 26058 raft_consensus.cc:504] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.032868 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.024298 26053 tablet_bootstrap.cc:492] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:07.033656 25921 raft_consensus.cc:3037] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.034252 25800 leader_election.cc:302] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.036219 26063 leader_election.cc:288] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.037828 26063 raft_consensus.cc:2781] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:07.038456 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:07.048532 26063 raft_consensus.cc:482] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:07.033754 26051 consensus_queue.cc:260] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.042534 26004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.049633 26000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.043527 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.050412 26000 raft_consensus.cc:2454] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:07.051484 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.044494 26002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.052006 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.052433 26063 raft_consensus.cc:3037] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.053905 25800 leader_election.cc:302] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.052220 25997 raft_consensus.cc:3037] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.054073 25881 leader_election.cc:302] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:07.052107 26051 ts_tablet_manager.cc:1428] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
W20260811 16:09:07.055698 25881 leader_election.cc:341] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.056183 25881 leader_election.cc:302] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:07.056725 26051 tablet_bootstrap.cc:492] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:07.057174 26059 raft_consensus.cc:2726] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:07.057857 26059 raft_consensus.cc:2726] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:07.044904 25921 raft_consensus.cc:2454] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:07.045770 26053 ts_tablet_manager.cc:1397] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.011s
I20260811 16:09:07.046326 26058 leader_election.cc:288] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.046732 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.033643 26057 raft_consensus.cc:348] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.048658 25835 raft_consensus.cc:2454] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:07.063597 26053 raft_consensus.cc:348] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.049094 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6043c686b0be4818a63257efeffd3fd5" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.065348 26100 raft_consensus.cc:482] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:07.065555 26057 raft_consensus.cc:374] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.041446 26006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.065979 26057 raft_consensus.cc:729] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.066352 26006 raft_consensus.cc:2454] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
W20260811 16:09:07.065775 25968 leader_election.cc:341] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.067003 26057 consensus_queue.cc:260] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.065869 26100 raft_consensus.cc:504] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.067999 25966 leader_election.cc:302] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.068786 25881 leader_election.cc:302] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:07.069464 26058 raft_consensus.cc:2781] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:07.069648 26078 raft_consensus.cc:2781] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:07.070003 26058 raft_consensus.cc:482] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:07.070154 26078 raft_consensus.cc:482] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:07.071007 26078 raft_consensus.cc:3037] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.073244 26063 raft_consensus.cc:504] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.075574 26063 leader_election.cc:288] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.076154 26063 raft_consensus.cc:3037] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.076308 26100 leader_election.cc:288] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.071007 26058 raft_consensus.cc:3037] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.080163 26051 tablet_bootstrap.cc:654] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:07.083461 26057 ts_tablet_manager.cc:1428] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.053s	user 0.022s	sys 0.000s
I20260811 16:09:07.083586 26053 raft_consensus.cc:374] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.084324 26053 raft_consensus.cc:729] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.085253 26057 tablet_bootstrap.cc:492] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:07.085584 26053 consensus_queue.cc:260] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.090638 26053 ts_tablet_manager.cc:1428] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260811 16:09:07.091908 26053 tablet_bootstrap.cc:492] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:07.094770 26051 tablet_bootstrap.cc:492] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:07.095383 26051 ts_tablet_manager.cc:1397] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.000s
I20260811 16:09:07.096141 26057 tablet_bootstrap.cc:654] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:07.097247 26078 raft_consensus.cc:504] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.098332 26051 raft_consensus.cc:348] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.099079 26051 raft_consensus.cc:374] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.099483 26051 raft_consensus.cc:729] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.100900 26063 raft_consensus.cc:2726] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:07.101172 26006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.070027 25997 raft_consensus.cc:2454] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:07.101837 26006 raft_consensus.cc:3037] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.107527 26078 leader_election.cc:288] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.110108 26080 raft_consensus.cc:482] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:07.114607 26080 raft_consensus.cc:504] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:07.115620 25800 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.195:41965, user_credentials={real_user=slave}} blocked reactor thread for 61824.6us
I20260811 16:09:07.116573 26053 tablet_bootstrap.cc:654] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:07.117612 26080 leader_election.cc:288] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.110095 26057 tablet_bootstrap.cc:492] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:07.118680 26057 ts_tablet_manager.cc:1397] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.008s
I20260811 16:09:07.119849 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
W20260811 16:09:07.121549 25966 leader_election.cc:341] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.111320 26058 raft_consensus.cc:504] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.101783 26051 consensus_queue.cc:260] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.110772 26006 raft_consensus.cc:2454] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:07.121675 26057 raft_consensus.cc:348] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.126091 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.124557 26058 leader_election.cc:288] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.126461 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.124858 25920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.124680 26051 ts_tablet_manager.cc:1428] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260811 16:09:07.128346 26051 tablet_bootstrap.cc:492] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:07.123524 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6043c686b0be4818a63257efeffd3fd5" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.128716 25835 raft_consensus.cc:3037] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.129158 25997 raft_consensus.cc:3037] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.134087 25881 leader_election.cc:302] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.134862 26051 tablet_bootstrap.cc:654] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
W20260811 16:09:07.128377 25968 leader_election.cc:341] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.138075 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6043c686b0be4818a63257efeffd3fd5" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.138417 25835 raft_consensus.cc:2454] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:07.138823 25921 raft_consensus.cc:3037] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.126482 26057 raft_consensus.cc:374] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.139565 26057 raft_consensus.cc:729] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.140125 25966 leader_election.cc:302] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.141155 25800 leader_election.cc:302] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.142218 26057 consensus_queue.cc:260] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.142468 26058 raft_consensus.cc:2781] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:07.143487 26102 raft_consensus.cc:2781] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:07.143586 26058 raft_consensus.cc:686] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.144160 26102 raft_consensus.cc:686] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.145171 26102 consensus_queue.cc:237] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.147174 26063 raft_consensus.cc:482] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:07.147962 26063 raft_consensus.cc:504] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.121790 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.149242 25922 raft_consensus.cc:2454] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:07.145049 26058 consensus_queue.cc:237] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.150930 25968 leader_election.cc:302] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:07.151981 26063 leader_election.cc:288] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.153129 26080 raft_consensus.cc:2781] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 16:09:07.154984 25800 leader_election.cc:341] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.154986 26006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.159528 26080 raft_consensus.cc:482] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:07.160132 26080 raft_consensus.cc:3037] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.158042 26078 raft_consensus.cc:2781] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:07.161192 26078 raft_consensus.cc:686] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:07.162146 26078 consensus_queue.cc:237] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:07.164346 25800 leader_election.cc:341] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.166014 25800 leader_election.cc:302] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.168097 26104 raft_consensus.cc:2726] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:07.168726 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.169452 25835 raft_consensus.cc:3037] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.170353 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.170823 25921 raft_consensus.cc:2454] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:07.171193 25922 raft_consensus.cc:2454] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:07.172013 26057 ts_tablet_manager.cc:1428] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260811 16:09:07.173095 26057 tablet_bootstrap.cc:492] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:07.178604 26006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
W20260811 16:09:07.180433 25800 leader_election.cc:341] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.181257 25800 leader_election.cc:302] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.179826 25721 catalog_manager.cc:5495] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.181921 25835 raft_consensus.cc:2454] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:07.185452 26102 raft_consensus.cc:2781] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:07.186415 26102 raft_consensus.cc:686] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.187422 26102 consensus_queue.cc:237] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.188637 26057 tablet_bootstrap.cc:654] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:07.191617 25800 leader_election.cc:302] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:07.196285 26063 raft_consensus.cc:2781] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:07.196854 26063 raft_consensus.cc:482] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:07.197316 26063 raft_consensus.cc:3037] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.203032 26057 tablet_bootstrap.cc:492] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:07.203691 26057 ts_tablet_manager.cc:1397] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.005s
I20260811 16:09:07.206785 26057 raft_consensus.cc:348] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.207599 26057 raft_consensus.cc:374] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.207880 26057 raft_consensus.cc:729] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.208714 26057 consensus_queue.cc:260] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.206491 26063 raft_consensus.cc:504] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.211565 26057 ts_tablet_manager.cc:1428] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260811 16:09:07.212716 26063 leader_election.cc:288] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.214887 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.215660 25922 raft_consensus.cc:3037] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.220060 25997 raft_consensus.cc:2454] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:07.223321 26006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.223897 25922 raft_consensus.cc:2454] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:07.225251 26053 tablet_bootstrap.cc:492] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:07.225592 25800 leader_election.cc:302] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.225884 26053 ts_tablet_manager.cc:1397] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.007s
I20260811 16:09:07.226570 26063 raft_consensus.cc:2781] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:07.221761 26080 raft_consensus.cc:504] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.227912 26063 raft_consensus.cc:686] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.229154 26053 raft_consensus.cc:348] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.230079 26053 raft_consensus.cc:374] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.230350 26053 raft_consensus.cc:729] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.230433 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
W20260811 16:09:07.226641 25800 leader_election.cc:341] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:07.231163 25835 raft_consensus.cc:3037] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.231101 26053 consensus_queue.cc:260] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.231326 26063 consensus_queue.cc:237] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.233417 26053 ts_tablet_manager.cc:1428] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260811 16:09:07.230427 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.234735 25922 raft_consensus.cc:3037] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.239605 25835 raft_consensus.cc:2454] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:07.241051 25966 leader_election.cc:302] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:07.241286 25720 catalog_manager.cc:5495] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 1 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.243629 26080 leader_election.cc:288] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.246757 25719 catalog_manager.cc:5495] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.244387 26058 raft_consensus.cc:2781] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:07.245189 25922 raft_consensus.cc:2454] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:07.249837 26058 raft_consensus.cc:686] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.247201 26051 tablet_bootstrap.cc:492] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:07.251329 26051 ts_tablet_manager.cc:1397] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.123s	user 0.043s	sys 0.062s
I20260811 16:09:07.250815 26058 consensus_queue.cc:237] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.253703 25721 catalog_manager.cc:5495] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:07.254662 26051 raft_consensus.cc:348] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.255877 26051 raft_consensus.cc:374] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:07.256201 26051 raft_consensus.cc:729] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:07.257164 26051 consensus_queue.cc:260] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.259466 26051 ts_tablet_manager.cc:1428] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:09:07.278123 25720 catalog_manager.cc:5495] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 1 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.279711 25720 catalog_manager.cc:5495] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 1 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.288942 25721 catalog_manager.cc:5495] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:07.314932 25835 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.322861 26058 consensus_queue.cc:1035] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.335706 26058 consensus_queue.cc:1035] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.359985 26058 consensus_queue.cc:1035] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.371583 26058 consensus_queue.cc:1035] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.373112 26078 raft_consensus.cc:482] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:07.373740 26078 raft_consensus.cc:504] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.376854 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:07.377347 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:07.377810 25833 raft_consensus.cc:2379] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in current term 1: Already voted for candidate 6afde416bee7452ea475f554ae0c23f1 in this term.
I20260811 16:09:07.380560 25881 leader_election.cc:302] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:07.381356 26059 raft_consensus.cc:3037] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.381778 26078 leader_election.cc:288] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.385360 26082 raft_consensus.cc:482] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:07.385936 26082 raft_consensus.cc:504] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.388165 26082 leader_election.cc:288] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.388950 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:07.390257 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:07.390977 26059 raft_consensus.cc:2726] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:07.391021 25922 raft_consensus.cc:2379] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6afde416bee7452ea475f554ae0c23f1 in current term 1: Already voted for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in this term.
I20260811 16:09:07.392647 25968 leader_election.cc:302] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.393404 26082 raft_consensus.cc:3037] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:07.399889 26082 raft_consensus.cc:2726] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:07.467275 25997 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:07.467969 25997 raft_consensus.cc:595] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:07.473454 25997 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:07.473996 25997 raft_consensus.cc:595] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:07.479791 25997 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:07.480347 25997 raft_consensus.cc:595] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:07.488675 25997 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:07.489228 25997 raft_consensus.cc:595] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.505246 25835 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60134
I20260811 16:09:07.505815 25835 raft_consensus.cc:595] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.511612 25835 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60134
I20260811 16:09:07.512243 25835 raft_consensus.cc:595] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.518286 25997 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:07.518889 25997 raft_consensus.cc:595] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:07.535322 25922 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
mode: GRACEFUL
new_leader_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:53374
I20260811 16:09:07.535969 25922 raft_consensus.cc:595] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Received request to transfer leadership to TS 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:07.544158 26082 consensus_queue.cc:1035] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.549626 26082 consensus_queue.cc:1035] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.559307 26083 raft_consensus.cc:979] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:07.559835 26083 raft_consensus.cc:1067] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:07.562242 25833 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46220
I20260811 16:09:07.562893 25833 raft_consensus.cc:482] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.563352 25833 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.572232 25833 raft_consensus.cc:504] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:07.574409 25833 leader_election.cc:288] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.575488 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.576123 25922 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.577425 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.578230 25997 raft_consensus.cc:3032] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.578567 25997 raft_consensus.cc:729] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.579382 25997 consensus_queue.cc:260] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:07.580458 25997 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.584520 25922 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:07.585639 25800 leader_election.cc:302] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.586393 26063 raft_consensus.cc:2781] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.586367 25997 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:07.587281 26063 raft_consensus.cc:686] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.588124 26063 consensus_queue.cc:237] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:07.594564 25720 catalog_manager.cc:5495] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.601063 26059 consensus_queue.cc:1035] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.603210 26063 consensus_queue.cc:1035] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.610226 26059 raft_consensus.cc:979] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: : Instructing follower 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:07.610720 26059 raft_consensus.cc:1067] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Signalling peer 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:07.614125 26102 raft_consensus.cc:979] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.614722 26102 raft_consensus.cc:1067] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.615706 26006 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:49834
I20260811 16:09:07.617720 26006 raft_consensus.cc:482] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.617826 25921 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:38002
I20260811 16:09:07.618199 26006 raft_consensus.cc:3037] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.618537 25921 raft_consensus.cc:482] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.618932 25921 raft_consensus.cc:3037] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.620240 26102 consensus_queue.cc:1035] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.624697 26059 consensus_queue.cc:1035] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.627405 26104 consensus_queue.cc:1035] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.634963 25921 raft_consensus.cc:504] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.644620 25920 raft_consensus.cc:1226] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Rejecting Update request from peer 4bfa3b3b690b43f8b3980437b3ac03ec for earlier term 1. Current term is 2. Ops: []
I20260811 16:09:07.647747 26063 consensus_queue.cc:1046] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.650355 26058 consensus_queue.cc:1035] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.651456 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.651824 26104 raft_consensus.cc:3032] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.652213 26104 raft_consensus.cc:729] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.653158 26104 consensus_queue.cc:260] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.654261 25921 leader_election.cc:288] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.654268 26104 raft_consensus.cc:3037] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.642506 26006 raft_consensus.cc:504] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.665616 26082 raft_consensus.cc:979] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:07.666340 26082 raft_consensus.cc:1067] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:07.668938 25835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46220
I20260811 16:09:07.669842 25835 raft_consensus.cc:482] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.670348 25835 raft_consensus.cc:3037] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.706713 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.706817 26086 consensus_queue.cc:1035] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.707577 25833 raft_consensus.cc:3037] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.708928 26086 consensus_queue.cc:1035] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.709301 25835 raft_consensus.cc:504] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.710505 25834 raft_consensus.cc:1226] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Rejecting Update request from peer 6afde416bee7452ea475f554ae0c23f1 for earlier term 1. Current term is 2. Ops: []
W20260811 16:09:07.713668 25879 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:44215, user_credentials={real_user=slave}} blocked reactor thread for 98502.1us
I20260811 16:09:07.714603 26063 consensus_queue.cc:1035] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.716172 25835 leader_election.cc:288] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.717168 26082 consensus_queue.cc:1046] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.718190 26082 raft_consensus.cc:3032] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.718621 26082 raft_consensus.cc:729] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.719113 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.720614 26082 consensus_queue.cc:260] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.721102 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e0086806384f03b5e2db4f7115a3c2" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.721796 25921 raft_consensus.cc:3037] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.721983 26082 raft_consensus.cc:3037] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.724634 26006 leader_election.cc:288] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:07.728871 26063 consensus_queue.cc:1035] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:07.732434 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17268c3586524c7bb1106e997b61d9cc" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.734866 25833 raft_consensus.cc:2454] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 2.
I20260811 16:09:07.756338 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a115366d8e4c0b9cfbdf1a8262810a" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.757421 25917 raft_consensus.cc:3032] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.757850 25917 raft_consensus.cc:729] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:07.758970 25917 consensus_queue.cc:260] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.739497 25834 raft_consensus.cc:1226] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Rejecting Update request from peer 9d0896cdd6f4426b9dc792cb6ea0e767 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260811 16:09:07.772130 26030 debug-util.cc:398] Leaking SignalData structure 0x7b08001625c0 after lost signal to thread 12388
I20260811 16:09:07.772495 25966 leader_election.cc:302] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
W20260811 16:09:07.773504 26030 debug-util.cc:398] Leaking SignalData structure 0x7b0800136320 after lost signal to thread 25763
I20260811 16:09:07.774151 25917 raft_consensus.cc:3037] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.775460 26086 raft_consensus.cc:2781] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.776185 26086 raft_consensus.cc:686] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 2 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.777359 26086 consensus_queue.cc:237] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.788177 26058 raft_consensus.cc:979] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.788820 26058 raft_consensus.cc:1067] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.766604 26082 consensus_queue.cc:1035] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260811 16:09:07.793682 25835 raft_consensus.cc:2454] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.794564 25916 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:37996
I20260811 16:09:07.794904 25879 leader_election.cc:302] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:07.796162 25916 raft_consensus.cc:482] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.796232 26059 raft_consensus.cc:2781] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.796654 25916 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.796823 26059 raft_consensus.cc:686] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:07.797816 26059 consensus_queue.cc:237] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.805071 26003 raft_consensus.cc:2454] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:07.805039 26063 consensus_queue.cc:1035] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:07.808368 25917 raft_consensus.cc:2454] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 2.
I20260811 16:09:07.809119 25800 leader_election.cc:302] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:07.810155 26063 raft_consensus.cc:2781] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.812112 25921 raft_consensus.cc:2454] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:07.813532 25920 raft_consensus.cc:1226] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Rejecting Update request from peer 6afde416bee7452ea475f554ae0c23f1 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260811 16:09:07.838210 25719 catalog_manager.cc:5495] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 1 to 2, leader changed from 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194) to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 2 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:07.840827 26082 raft_consensus.cc:979] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.841281 26063 raft_consensus.cc:686] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.820174 25916 raft_consensus.cc:504] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.843672 26063 consensus_queue.cc:237] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.844743 25916 leader_election.cc:288] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.845530 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.845852 26082 raft_consensus.cc:1067] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.848863 25835 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.846577 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.849879 26003 raft_consensus.cc:3032] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.850206 26003 raft_consensus.cc:729] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.851274 26003 consensus_queue.cc:260] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.852226 26003 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.857623 25720 catalog_manager.cc:5495] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.857542 25835 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.863667 25879 leader_election.cc:302] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.864395 25916 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:37996
I20260811 16:09:07.865264 26059 raft_consensus.cc:2781] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.865451 25916 raft_consensus.cc:482] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.865885 26059 raft_consensus.cc:686] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:07.866030 25916 raft_consensus.cc:3037] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.866889 26059 consensus_queue.cc:237] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.871104 26143 raft_consensus.cc:979] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.871743 26143 raft_consensus.cc:1067] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:07.871649 25721 catalog_manager.cc:5495] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.874163 25922 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:38002
I20260811 16:09:07.873965 25916 raft_consensus.cc:504] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.874876 25922 raft_consensus.cc:482] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.875306 25922 raft_consensus.cc:3037] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.876374 25916 leader_election.cc:288] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.877699 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.878443 25997 raft_consensus.cc:3032] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.878866 25997 raft_consensus.cc:729] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.879757 25997 consensus_queue.cc:260] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.880628 26003 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.880995 25997 raft_consensus.cc:3037] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.883991 25922 raft_consensus.cc:504] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.885315 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2a6992855f4b24bbeea39db1aa3f5f" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.886031 25835 raft_consensus.cc:3037] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.888067 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:07.888830 25833 raft_consensus.cc:3032] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.889200 25833 raft_consensus.cc:729] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.890103 25833 consensus_queue.cc:260] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.891494 25833 raft_consensus.cc:3037] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.897287 25997 raft_consensus.cc:2454] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.898864 25881 leader_election.cc:302] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.899397 25922 leader_election.cc:288] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.900279 26059 raft_consensus.cc:2781] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.899637 25720 catalog_manager.cc:5495] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.900868 26059 raft_consensus.cc:686] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:07.901961 25835 raft_consensus.cc:2454] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.901894 26059 consensus_queue.cc:237] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.904778 25833 raft_consensus.cc:2454] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.906391 25879 leader_election.cc:302] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:07.907452 26135 raft_consensus.cc:2781] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.907550 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b5a54a498da4f07868519c15ea656e7" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.908061 26135 raft_consensus.cc:686] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:07.908336 25997 raft_consensus.cc:3037] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.909111 26135 consensus_queue.cc:237] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.916770 25997 raft_consensus.cc:2454] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:07.921151 25720 catalog_manager.cc:5495] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.923208 25720 catalog_manager.cc:5495] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:07.956809 26080 raft_consensus.cc:979] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:07.957437 26082 raft_consensus.cc:1067] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:07.959389 25833 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46220
I20260811 16:09:07.960042 25833 raft_consensus.cc:482] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:07.960438 25833 raft_consensus.cc:3037] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.967274 25833 raft_consensus.cc:504] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.970039 25833 leader_election.cc:288] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:07.970309 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:07.971118 25997 raft_consensus.cc:3032] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:07.971488 25997 raft_consensus.cc:729] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:07.971321 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eabf16a76804ca1866e4814b8d12f8c" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:07.972157 25922 raft_consensus.cc:3037] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.972473 25997 consensus_queue.cc:260] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.973500 25997 raft_consensus.cc:3037] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:07.979758 25997 raft_consensus.cc:2454] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:07.980919 25800 leader_election.cc:302] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:07.981722 26063 raft_consensus.cc:2781] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:07.982257 26063 raft_consensus.cc:686] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:07.983052 26063 consensus_queue.cc:237] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:07.983295 25922 raft_consensus.cc:2454] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:07.991040 25720 catalog_manager.cc:5495] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:08.167980 25997 raft_consensus.cc:1261] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.169435 26063 consensus_queue.cc:1035] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.174587 25922 raft_consensus.cc:1261] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.178279 26102 consensus_queue.cc:1035] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:08.226986 25833 raft_consensus.cc:1261] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.228466 26135 consensus_queue.cc:1035] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.245715 26003 raft_consensus.cc:1261] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.246055 25997 raft_consensus.cc:3037] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:08.248396 26102 consensus_queue.cc:1035] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:08.256361 25997 raft_consensus.cc:1261] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.258251 26146 consensus_queue.cc:1035] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:08.270099 25922 raft_consensus.cc:1261] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.271602 26104 consensus_queue.cc:1035] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:08.278460 25916 raft_consensus.cc:1261] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.280862 26082 consensus_queue.cc:1035] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:08.281282 25833 raft_consensus.cc:1261] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.297895 26003 raft_consensus.cc:1261] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.299961 26059 consensus_queue.cc:1035] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.304809 26082 consensus_queue.cc:1035] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:08.313002 25835 raft_consensus.cc:1261] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.315515 26135 consensus_queue.cc:1035] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:08.412209 26003 raft_consensus.cc:1261] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.413785 26135 consensus_queue.cc:1035] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.423528 25835 raft_consensus.cc:1261] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.426216 26135 consensus_queue.cc:1035] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.450874 26003 raft_consensus.cc:1261] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.452733 26135 consensus_queue.cc:1035] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.464418 25835 raft_consensus.cc:1261] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.466521 26059 consensus_queue.cc:1035] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:08.548740 26003 raft_consensus.cc:1261] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.550484 26102 consensus_queue.cc:1035] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:08.562500 25922 raft_consensus.cc:1261] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:08.564383 26143 consensus_queue.cc:1035] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:10.537679 12383 test_util.cc:268] Using random seed: -1326429778
I20260811 16:09:10.588480 25723 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59720:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:09:10.592671 25723 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:09:10.660959 25824 tablet_service.cc:1467] Processing CreateTablet for tablet ab51c5fb16f04c4c9ddba187aa85ce84 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:10.661706 25900 tablet_service.cc:1467] Processing CreateTablet for tablet ab51c5fb16f04c4c9ddba187aa85ce84 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:10.662529 25824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab51c5fb16f04c4c9ddba187aa85ce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.663069 25900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab51c5fb16f04c4c9ddba187aa85ce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.665303 25990 tablet_service.cc:1467] Processing CreateTablet for tablet 34a4228415c448638d06b2788822ca25 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:10.665787 25988 tablet_service.cc:1467] Processing CreateTablet for tablet ab51c5fb16f04c4c9ddba187aa85ce84 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:10.666834 25990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a4228415c448638d06b2788822ca25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.668574 25907 tablet_service.cc:1467] Processing CreateTablet for tablet 34a4228415c448638d06b2788822ca25 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:10.670060 25907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a4228415c448638d06b2788822ca25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.673316 25987 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7b3c7501bb47238f1c160a7f8b6a03 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:10.674803 25987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7b3c7501bb47238f1c160a7f8b6a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.680054 25905 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7b3c7501bb47238f1c160a7f8b6a03 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:10.681643 25905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7b3c7501bb47238f1c160a7f8b6a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.684238 25902 tablet_service.cc:1467] Processing CreateTablet for tablet eceec669f4e14d85a455397c7e0527fe (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:10.685621 25902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eceec669f4e14d85a455397c7e0527fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.687985 25993 tablet_service.cc:1467] Processing CreateTablet for tablet eceec669f4e14d85a455397c7e0527fe (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:10.689703 25985 tablet_service.cc:1467] Processing CreateTablet for tablet 71f3435cc46f46be84756e9a8f17664d (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:10.693506 25989 tablet_service.cc:1467] Processing CreateTablet for tablet 14373aee361a4727a9b60eee7e56eefb (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:10.696199 25821 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7b3c7501bb47238f1c160a7f8b6a03 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:10.696697 25908 tablet_service.cc:1467] Processing CreateTablet for tablet 17bd95fe39c44f75957f42a183f27e39 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:10.697779 25821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7b3c7501bb47238f1c160a7f8b6a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.698199 25908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17bd95fe39c44f75957f42a183f27e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.700224 25903 tablet_service.cc:1467] Processing CreateTablet for tablet 71f3435cc46f46be84756e9a8f17664d (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:10.701686 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f3435cc46f46be84756e9a8f17664d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.704241 25817 tablet_service.cc:1467] Processing CreateTablet for tablet eceec669f4e14d85a455397c7e0527fe (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:10.706418 25906 tablet_service.cc:1467] Processing CreateTablet for tablet 14373aee361a4727a9b60eee7e56eefb (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:10.708050 25906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14373aee361a4727a9b60eee7e56eefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.712162 25992 tablet_service.cc:1467] Processing CreateTablet for tablet 65cecc9c46bf4d71ad22d45c85cb318a (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:10.712903 25986 tablet_service.cc:1467] Processing CreateTablet for tablet 17bd95fe39c44f75957f42a183f27e39 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:10.714670 25823 tablet_service.cc:1467] Processing CreateTablet for tablet 34a4228415c448638d06b2788822ca25 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:10.716722 25899 tablet_service.cc:1467] Processing CreateTablet for tablet 65cecc9c46bf4d71ad22d45c85cb318a (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:10.718356 25899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65cecc9c46bf4d71ad22d45c85cb318a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.695134 25989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14373aee361a4727a9b60eee7e56eefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.720923 25993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eceec669f4e14d85a455397c7e0527fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.725099 25986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17bd95fe39c44f75957f42a183f27e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.724787 25820 tablet_service.cc:1467] Processing CreateTablet for tablet 71f3435cc46f46be84756e9a8f17664d (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:10.727237 25904 tablet_service.cc:1467] Processing CreateTablet for tablet 7dae071d44e548dfa19017737770ac93 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:10.728751 25904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dae071d44e548dfa19017737770ac93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.729176 25822 tablet_service.cc:1467] Processing CreateTablet for tablet 65cecc9c46bf4d71ad22d45c85cb318a (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:10.727531 25818 tablet_service.cc:1467] Processing CreateTablet for tablet 14373aee361a4727a9b60eee7e56eefb (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:10.730604 25992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65cecc9c46bf4d71ad22d45c85cb318a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.733315 25988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab51c5fb16f04c4c9ddba187aa85ce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.735531 25822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65cecc9c46bf4d71ad22d45c85cb318a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.737159 25818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14373aee361a4727a9b60eee7e56eefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.737396 25991 tablet_service.cc:1467] Processing CreateTablet for tablet 7dae071d44e548dfa19017737770ac93 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:10.739084 25991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dae071d44e548dfa19017737770ac93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.740281 25985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f3435cc46f46be84756e9a8f17664d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.743592 25817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eceec669f4e14d85a455397c7e0527fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.745253 25823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a4228415c448638d06b2788822ca25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.746762 25820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f3435cc46f46be84756e9a8f17664d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.775056 25825 tablet_service.cc:1467] Processing CreateTablet for tablet 17bd95fe39c44f75957f42a183f27e39 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:10.776989 25825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17bd95fe39c44f75957f42a183f27e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.784499 25819 tablet_service.cc:1467] Processing CreateTablet for tablet 7dae071d44e548dfa19017737770ac93 (DEFAULT_TABLE table=soft_deleted_table [id=912902ebccc946c28efe50c332309729]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:10.785992 25819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dae071d44e548dfa19017737770ac93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:10.808681 26173 tablet_bootstrap.cc:492] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:10.842556 26174 tablet_bootstrap.cc:492] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:10.857430 26173 tablet_bootstrap.cc:654] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:10.874010 26174 tablet_bootstrap.cc:654] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
W20260811 16:09:10.882812 25779 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:09:10.894017 26173 tablet_bootstrap.cc:492] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:10.894757 26173 ts_tablet_manager.cc:1397] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.000s
I20260811 16:09:10.923954 26172 tablet_bootstrap.cc:492] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:10.926112 26174 tablet_bootstrap.cc:492] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:10.926823 26174 ts_tablet_manager.cc:1397] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.008s
I20260811 16:09:10.931277 26172 tablet_bootstrap.cc:654] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:10.934401 26174 raft_consensus.cc:348] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:10.940490 26173 raft_consensus.cc:348] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:10.948829 26172 tablet_bootstrap.cc:492] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:10.955545 26173 raft_consensus.cc:374] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:10.955876 26172 ts_tablet_manager.cc:1397] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.005s
I20260811 16:09:10.956069 26174 raft_consensus.cc:374] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:10.956748 26174 raft_consensus.cc:729] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:10.960428 26174 consensus_queue.cc:260] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:10.963511 26174 ts_tablet_manager.cc:1428] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260811 16:09:10.964804 26174 tablet_bootstrap.cc:492] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:10.964982 26172 raft_consensus.cc:348] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:10.966809 26172 raft_consensus.cc:374] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:10.967250 26172 raft_consensus.cc:729] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:10.968135 26172 consensus_queue.cc:260] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:10.970906 26172 ts_tablet_manager.cc:1428] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260811 16:09:10.955981 26173 raft_consensus.cc:729] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:10.976094 26172 tablet_bootstrap.cc:492] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:10.975979 26173 consensus_queue.cc:260] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:10.978854 26173 ts_tablet_manager.cc:1428] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260811 16:09:10.982508 26173 tablet_bootstrap.cc:492] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:10.984675 26172 tablet_bootstrap.cc:654] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:10.974776 26174 tablet_bootstrap.cc:654] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:10.992949 26173 tablet_bootstrap.cc:654] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.006197 26173 tablet_bootstrap.cc:492] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.006881 26173 ts_tablet_manager.cc:1397] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260811 16:09:11.021281 26174 tablet_bootstrap.cc:492] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.021185 26173 raft_consensus.cc:348] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.021996 26174 ts_tablet_manager.cc:1397] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.007s
I20260811 16:09:11.022315 26173 raft_consensus.cc:374] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.022774 26173 raft_consensus.cc:729] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.023810 26173 consensus_queue.cc:260] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.030687 26173 ts_tablet_manager.cc:1428] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260811 16:09:11.035640 26174 raft_consensus.cc:348] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.038862 26174 raft_consensus.cc:374] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.038321 26173 tablet_bootstrap.cc:492] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.040346 26174 raft_consensus.cc:729] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.041066 26172 tablet_bootstrap.cc:492] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.041931 26172 ts_tablet_manager.cc:1397] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.028s
I20260811 16:09:11.041424 26174 consensus_queue.cc:260] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.044639 26174 ts_tablet_manager.cc:1428] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260811 16:09:11.047204 26172 raft_consensus.cc:348] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.048368 26172 raft_consensus.cc:374] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.048758 26172 raft_consensus.cc:729] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.049714 26172 consensus_queue.cc:260] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.052335 26173 tablet_bootstrap.cc:654] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.052431 26172 ts_tablet_manager.cc:1428] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260811 16:09:11.053848 26172 tablet_bootstrap.cc:492] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:11.056427 26174 tablet_bootstrap.cc:492] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.061723 26172 tablet_bootstrap.cc:654] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.064435 26174 tablet_bootstrap.cc:654] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.074996 26165 raft_consensus.cc:482] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.075927 26165 raft_consensus.cc:504] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.090957 26165 leader_election.cc:288] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.095767 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.098052 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.131577 26149 raft_consensus.cc:482] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.132656 26149 raft_consensus.cc:504] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:11.111230 25800 leader_election.cc:341] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:09:11.136926 25800 leader_election.cc:341] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.137610 25800 leader_election.cc:302] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:11.140504 26063 raft_consensus.cc:2726] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.168291 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
W20260811 16:09:11.171351 25881 leader_election.cc:341] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.174734 26149 leader_election.cc:288] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.182597 26173 tablet_bootstrap.cc:492] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.183010 26155 raft_consensus.cc:482] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.183372 26173 ts_tablet_manager.cc:1397] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.054s
I20260811 16:09:11.183574 26155 raft_consensus.cc:504] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.185611 26174 tablet_bootstrap.cc:492] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.186177 26174 ts_tablet_manager.cc:1397] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.130s	user 0.045s	sys 0.072s
I20260811 16:09:11.186987 26173 raft_consensus.cc:348] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.187935 26173 raft_consensus.cc:374] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.187947 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.188336 26173 raft_consensus.cc:729] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.189237 26173 consensus_queue.cc:260] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:11.189924 25966 leader_election.cc:341] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.189363 26174 raft_consensus.cc:348] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.190773 26174 raft_consensus.cc:374] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.191104 26174 raft_consensus.cc:729] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.191203 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.192862 26155 leader_election.cc:288] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
W20260811 16:09:11.193189 25968 leader_election.cc:341] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.191962 26174 consensus_queue.cc:260] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.193681 25968 leader_election.cc:302] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:11.194893 26172 tablet_bootstrap.cc:492] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.195492 26172 ts_tablet_manager.cc:1397] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.142s	user 0.050s	sys 0.064s
I20260811 16:09:11.196906 26165 raft_consensus.cc:482] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.197446 26165 raft_consensus.cc:504] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.200309 26165 leader_election.cc:288] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.199730 26172 raft_consensus.cc:348] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.200919 26172 raft_consensus.cc:374] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.201076 26155 raft_consensus.cc:2726] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.201354 26172 raft_consensus.cc:729] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.195497 26174 ts_tablet_manager.cc:1428] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260811 16:09:11.203293 26172 consensus_queue.cc:260] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.203936 26174 tablet_bootstrap.cc:492] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.211293 26173 ts_tablet_manager.cc:1428] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.008s
I20260811 16:09:11.214303 26172 ts_tablet_manager.cc:1428] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260811 16:09:11.217715 26173 tablet_bootstrap.cc:492] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.223122 26172 tablet_bootstrap.cc:492] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
W20260811 16:09:11.224344 25800 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:41571, user_credentials={real_user=slave}} blocked reactor thread for 87460.1us
I20260811 16:09:11.228768 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.229167 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.231945 26174 tablet_bootstrap.cc:654] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.236232 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.241851 26173 tablet_bootstrap.cc:654] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
W20260811 16:09:11.244022 25879 leader_election.cc:341] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.244737 25879 leader_election.cc:302] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:11.245882 26149 raft_consensus.cc:2726] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 16:09:11.252481 25800 leader_election.cc:341] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.263857 26172 tablet_bootstrap.cc:654] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.263516 26174 tablet_bootstrap.cc:492] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.266094 26174 ts_tablet_manager.cc:1397] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.021s
W20260811 16:09:11.254143 25800 leader_election.cc:341] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.309752 25800 leader_election.cc:302] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
W20260811 16:09:11.313607 25800 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.23.194:41571, user_credentials={real_user=slave}} blocked reactor thread for 59489.4us
I20260811 16:09:11.314394 26173 tablet_bootstrap.cc:492] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.314894 26063 raft_consensus.cc:2726] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.316256 26173 ts_tablet_manager.cc:1397] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.012s
I20260811 16:09:11.318892 26174 raft_consensus.cc:348] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.321168 26174 raft_consensus.cc:374] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.321655 26174 raft_consensus.cc:729] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.323182 26174 consensus_queue.cc:260] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.326740 26174 ts_tablet_manager.cc:1428] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260811 16:09:11.326386 26173 raft_consensus.cc:348] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.329463 26173 raft_consensus.cc:374] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.329681 26174 tablet_bootstrap.cc:492] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.329985 26173 raft_consensus.cc:729] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.331266 26173 consensus_queue.cc:260] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.338905 26173 ts_tablet_manager.cc:1428] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.002s
I20260811 16:09:11.341720 26173 tablet_bootstrap.cc:492] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.348402 26172 tablet_bootstrap.cc:492] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.349552 26172 ts_tablet_manager.cc:1397] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.003s
I20260811 16:09:11.352383 26173 tablet_bootstrap.cc:654] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.363601 26172 raft_consensus.cc:348] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.364787 26172 raft_consensus.cc:374] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.365149 26172 raft_consensus.cc:729] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.365970 26173 tablet_bootstrap.cc:492] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.366793 26173 ts_tablet_manager.cc:1397] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260811 16:09:11.366114 26172 consensus_queue.cc:260] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.366883 26174 tablet_bootstrap.cc:654] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.371773 26172 ts_tablet_manager.cc:1428] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.006s
I20260811 16:09:11.371376 26173 raft_consensus.cc:348] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.372543 26173 raft_consensus.cc:374] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.372915 26173 raft_consensus.cc:729] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.374418 26172 tablet_bootstrap.cc:492] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:11.373958 26173 consensus_queue.cc:260] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.377818 26173 ts_tablet_manager.cc:1428] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260811 16:09:11.378895 26184 raft_consensus.cc:482] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.379783 26173 tablet_bootstrap.cc:492] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.379678 26184 raft_consensus.cc:504] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.384163 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.385560 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
W20260811 16:09:11.391701 25881 leader_election.cc:341] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:09:11.392820 25879 leader_election.cc:341] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.393373 25879 leader_election.cc:302] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:11.400435 26149 raft_consensus.cc:2726] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.406949 26184 leader_election.cc:288] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.416034 26173 tablet_bootstrap.cc:654] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.425833 26172 tablet_bootstrap.cc:654] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.427848 26174 tablet_bootstrap.cc:492] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.431551 26173 tablet_bootstrap.cc:492] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.432214 26173 ts_tablet_manager.cc:1397] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.001s
I20260811 16:09:11.431651 26174 ts_tablet_manager.cc:1397] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.103s	user 0.023s	sys 0.011s
I20260811 16:09:11.435622 26173 raft_consensus.cc:348] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.436538 26173 raft_consensus.cc:374] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.436849 26173 raft_consensus.cc:729] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.438113 26172 tablet_bootstrap.cc:492] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.437916 26173 consensus_queue.cc:260] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.438913 26172 ts_tablet_manager.cc:1397] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.012s
I20260811 16:09:11.441008 26173 ts_tablet_manager.cc:1428] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:09:11.439100 26174 raft_consensus.cc:348] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.443351 26174 raft_consensus.cc:374] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.443684 26174 raft_consensus.cc:729] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.444188 26173 tablet_bootstrap.cc:492] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.446074 26174 consensus_queue.cc:260] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.443580 26172 raft_consensus.cc:348] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.447381 26172 raft_consensus.cc:374] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.450677 26172 raft_consensus.cc:729] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.450217 26174 ts_tablet_manager.cc:1428] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260811 16:09:11.451548 26186 raft_consensus.cc:482] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.452455 26186 raft_consensus.cc:504] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.455554 26186 leader_election.cc:288] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.457448 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dae071d44e548dfa19017737770ac93" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.458825 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dae071d44e548dfa19017737770ac93" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
W20260811 16:09:11.459914 25966 leader_election.cc:341] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.459916 25922 raft_consensus.cc:2454] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.462430 25968 leader_election.cc:302] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:11.466470 26173 tablet_bootstrap.cc:654] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.454053 26172 consensus_queue.cc:260] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.467579 26174 tablet_bootstrap.cc:492] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.468041 26186 raft_consensus.cc:2781] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.475587 26186 raft_consensus.cc:482] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.476099 26186 raft_consensus.cc:3037] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.480297 26172 ts_tablet_manager.cc:1428] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.006s
I20260811 16:09:11.486853 26174 tablet_bootstrap.cc:654] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.489130 26172 tablet_bootstrap.cc:492] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:11.493360 26173 tablet_bootstrap.cc:492] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.494074 26173 ts_tablet_manager.cc:1397] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.001s
I20260811 16:09:11.498013 26173 raft_consensus.cc:348] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.498956 26173 raft_consensus.cc:374] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.499294 26173 raft_consensus.cc:729] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.500274 26173 consensus_queue.cc:260] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.501588 26155 raft_consensus.cc:482] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.502236 26155 raft_consensus.cc:504] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.502704 26172 tablet_bootstrap.cc:654] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.506033 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.505808 26186 raft_consensus.cc:504] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.506775 26185 raft_consensus.cc:482] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.507403 26185 raft_consensus.cc:504] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.509111 26186 leader_election.cc:288] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.509971 25833 raft_consensus.cc:2454] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.510694 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dae071d44e548dfa19017737770ac93" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.511516 25922 raft_consensus.cc:3037] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.516299 26185 leader_election.cc:288] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.517810 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.519219 25916 raft_consensus.cc:2454] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:11.522728 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dae071d44e548dfa19017737770ac93" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:11.525000 25966 leader_election.cc:302] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:11.525609 25922 raft_consensus.cc:2454] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:11.526140 26186 raft_consensus.cc:2781] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.526695 26186 raft_consensus.cc:482] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.527119 26186 raft_consensus.cc:3037] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.527398 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.528460 26172 tablet_bootstrap.cc:492] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.527400 25968 leader_election.cc:302] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.529224 26172 ts_tablet_manager.cc:1397] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.014s
I20260811 16:09:11.533174 25800 leader_election.cc:302] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.534049 26185 raft_consensus.cc:2781] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.534415 26185 raft_consensus.cc:482] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.534754 26185 raft_consensus.cc:3037] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.537272 26155 leader_election.cc:288] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.540293 26155 raft_consensus.cc:2781] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.540963 26155 raft_consensus.cc:686] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:11.542419 26155 consensus_queue.cc:237] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.544703 26186 raft_consensus.cc:504] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:11.539479 25966 leader_election.cc:341] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.546792 26003 raft_consensus.cc:2379] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bfa3b3b690b43f8b3980437b3ac03ec in current term 1: Already voted for candidate 6afde416bee7452ea475f554ae0c23f1 in this term.
I20260811 16:09:11.547323 26186 leader_election.cc:288] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.550207 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.551764 25916 raft_consensus.cc:3037] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.553555 26172 raft_consensus.cc:348] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.558228 26172 raft_consensus.cc:374] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.558583 26172 raft_consensus.cc:729] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.539242 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.561676 26172 consensus_queue.cc:260] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.554301 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:11.574532 25916 raft_consensus.cc:2454] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:11.576402 26174 tablet_bootstrap.cc:492] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.579756 26174 ts_tablet_manager.cc:1397] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.010s
I20260811 16:09:11.576915 26185 raft_consensus.cc:504] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.580425 25968 leader_election.cc:302] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.581431 26186 raft_consensus.cc:2781] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.581857 26184 raft_consensus.cc:482] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.581982 26186 raft_consensus.cc:686] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:11.582355 26185 leader_election.cc:288] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.582683 26184 raft_consensus.cc:504] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.583194 26186 consensus_queue.cc:237] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.584401 26172 ts_tablet_manager.cc:1428] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260811 16:09:11.587668 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.588419 26003 raft_consensus.cc:2454] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:11.589872 26184 leader_election.cc:288] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.593884 25833 raft_consensus.cc:2379] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6afde416bee7452ea475f554ae0c23f1 in current term 1: Already voted for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in this term.
I20260811 16:09:11.596493 26172 tablet_bootstrap.cc:492] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:11.596978 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.597887 25922 raft_consensus.cc:2379] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4bfa3b3b690b43f8b3980437b3ac03ec in current term 1: Already voted for candidate 6afde416bee7452ea475f554ae0c23f1 in this term.
I20260811 16:09:11.591502 25881 leader_election.cc:302] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.592819 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.600548 25835 raft_consensus.cc:2454] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:11.600625 26174 raft_consensus.cc:348] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.601507 26174 raft_consensus.cc:374] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.601823 26174 raft_consensus.cc:729] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.602653 26174 consensus_queue.cc:260] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.603300 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:11.603889 26149 raft_consensus.cc:2781] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.604557 26149 raft_consensus.cc:482] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.605177 26149 raft_consensus.cc:3037] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.605822 26174 ts_tablet_manager.cc:1428] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260811 16:09:11.606205 25800 leader_election.cc:302] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:11.607120 26185 raft_consensus.cc:2726] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.616186 26185 raft_consensus.cc:482] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.616870 26185 raft_consensus.cc:504] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.619762 26185 leader_election.cc:288] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.621706 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dae071d44e548dfa19017737770ac93" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.622694 25922 raft_consensus.cc:2379] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bfa3b3b690b43f8b3980437b3ac03ec in current term 1: Already voted for candidate 6afde416bee7452ea475f554ae0c23f1 in this term.
I20260811 16:09:11.624643 26174 tablet_bootstrap.cc:492] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.627681 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dae071d44e548dfa19017737770ac93" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.629776 26149 raft_consensus.cc:504] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.632917 26174 tablet_bootstrap.cc:654] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.633935 25720 catalog_manager.cc:5495] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:11.636548 26172 tablet_bootstrap.cc:654] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.638005 26149 leader_election.cc:288] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.636376 25800 leader_election.cc:302] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:11.637388 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:11.645085 25835 raft_consensus.cc:3037] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.645934 26185 raft_consensus.cc:3037] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.651181 26063 raft_consensus.cc:482] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.651954 26063 raft_consensus.cc:504] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.653247 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:11.654417 26003 raft_consensus.cc:3037] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.654925 26063 leader_election.cc:288] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.661661 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.664389 26001 raft_consensus.cc:2454] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:11.665796 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.666879 25916 raft_consensus.cc:2454] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:11.668546 25800 leader_election.cc:302] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:11.669324 26173 ts_tablet_manager.cc:1428] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.175s	user 0.025s	sys 0.056s
I20260811 16:09:11.670287 26165 raft_consensus.cc:2781] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.671170 26165 raft_consensus.cc:482] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.671689 26165 raft_consensus.cc:3037] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.673800 26173 tablet_bootstrap.cc:492] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.682089 26172 tablet_bootstrap.cc:492] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.682643 26173 tablet_bootstrap.cc:654] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.682785 26172 ts_tablet_manager.cc:1397] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.003s
I20260811 16:09:11.685509 26185 raft_consensus.cc:2726] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.688068 25835 raft_consensus.cc:2454] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:11.688767 26003 raft_consensus.cc:2454] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:11.694239 25879 leader_election.cc:302] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.696555 26207 raft_consensus.cc:2781] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.697180 26207 raft_consensus.cc:686] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:11.698338 26207 consensus_queue.cc:237] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.700371 26174 tablet_bootstrap.cc:492] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.701517 26174 ts_tablet_manager.cc:1397] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.009s
I20260811 16:09:11.704769 26172 raft_consensus.cc:348] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.706193 26172 raft_consensus.cc:374] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.706754 26172 raft_consensus.cc:729] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.708060 26172 consensus_queue.cc:260] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.723685 26165 raft_consensus.cc:504] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.726986 26185 raft_consensus.cc:482] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.734141 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.735870 25916 raft_consensus.cc:3037] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.737901 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:11.738726 26003 raft_consensus.cc:3037] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.747241 26185 raft_consensus.cc:504] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.745143 25719 catalog_manager.cc:5495] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:11.748672 26003 raft_consensus.cc:2454] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:11.750576 25800 leader_election.cc:302] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:11.750699 26185 leader_election.cc:288] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.751755 26063 raft_consensus.cc:2781] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.753897 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.754266 26165 leader_election.cc:288] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.756130 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:11.756989 26001 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:11.706740 26174 raft_consensus.cc:348] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.758718 25800 leader_election.cc:302] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:11.758975 26203 raft_consensus.cc:482] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.754938 25917 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 0.
I20260811 16:09:11.760049 26172 ts_tablet_manager.cc:1428] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260811 16:09:11.759882 26203 raft_consensus.cc:504] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.747097 25916 raft_consensus.cc:2454] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 1.
I20260811 16:09:11.765167 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.766176 25835 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.767299 26172 tablet_bootstrap.cc:492] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:11.768177 25966 leader_election.cc:302] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:11.769299 26155 raft_consensus.cc:2781] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.769793 26203 leader_election.cc:288] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.769850 26155 raft_consensus.cc:482] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.774806 26155 raft_consensus.cc:3037] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.766491 26173 tablet_bootstrap.cc:492] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.776157 26173 ts_tablet_manager.cc:1397] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.007s
I20260811 16:09:11.759052 26174 raft_consensus.cc:374] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.778606 26174 raft_consensus.cc:729] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.779810 26173 raft_consensus.cc:348] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.779554 26174 consensus_queue.cc:260] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.783473 26174 ts_tablet_manager.cc:1428] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.082s	user 0.010s	sys 0.000s
I20260811 16:09:11.785018 26174 tablet_bootstrap.cc:492] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.768392 26185 raft_consensus.cc:2781] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.786075 26185 raft_consensus.cc:482] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.787422 26185 raft_consensus.cc:3037] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.780781 26173 raft_consensus.cc:374] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.792436 26173 raft_consensus.cc:729] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.788501 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.793382 26173 consensus_queue.cc:260] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.796132 26173 ts_tablet_manager.cc:1428] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260811 16:09:11.798221 26063 raft_consensus.cc:686] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:11.802089 26173 tablet_bootstrap.cc:492] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: Bootstrap starting.
I20260811 16:09:11.804232 26063 consensus_queue.cc:237] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.810721 26173 tablet_bootstrap.cc:654] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.793990 25916 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.811655 26174 tablet_bootstrap.cc:654] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.802359 26155 raft_consensus.cc:504] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.786278 26172 tablet_bootstrap.cc:654] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.826735 26174 tablet_bootstrap.cc:492] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.827538 26174 ts_tablet_manager.cc:1397] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.006s
I20260811 16:09:11.831120 26174 raft_consensus.cc:348] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.832039 26174 raft_consensus.cc:374] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.832317 26174 raft_consensus.cc:729] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.834414 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:11.834235 26174 consensus_queue.cc:260] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.834889 26185 raft_consensus.cc:504] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.835356 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.836153 25916 raft_consensus.cc:3037] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.836356 25835 raft_consensus.cc:2379] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6afde416bee7452ea475f554ae0c23f1 in current term 1: Already voted for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in this term.
I20260811 16:09:11.837358 26185 leader_election.cc:288] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:11.837771 26174 ts_tablet_manager.cc:1428] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260811 16:09:11.840847 26173 tablet_bootstrap.cc:492] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: No bootstrap required, opened a new log
I20260811 16:09:11.841904 26173 ts_tablet_manager.cc:1397] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.006s
I20260811 16:09:11.842288 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:11.843300 26001 raft_consensus.cc:2379] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4bfa3b3b690b43f8b3980437b3ac03ec in current term 1: Already voted for candidate 6afde416bee7452ea475f554ae0c23f1 in this term.
I20260811 16:09:11.843236 26172 tablet_bootstrap.cc:492] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.844640 26172 ts_tablet_manager.cc:1397] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.002s
I20260811 16:09:11.838778 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.845264 26173 raft_consensus.cc:348] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.846170 26173 raft_consensus.cc:374] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.846459 26173 raft_consensus.cc:729] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.847555 26174 tablet_bootstrap.cc:492] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: Bootstrap starting.
I20260811 16:09:11.848531 25800 leader_election.cc:302] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec; no voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:11.853191 26172 raft_consensus.cc:348] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.854131 26172 raft_consensus.cc:374] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.854410 26172 raft_consensus.cc:729] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.854723 26174 tablet_bootstrap.cc:654] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.855280 26172 consensus_queue.cc:260] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.856323 26173 consensus_queue.cc:260] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.858371 26185 raft_consensus.cc:2726] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:09:11.858606 26172 ts_tablet_manager.cc:1428] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260811 16:09:11.860091 26172 tablet_bootstrap.cc:492] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: Bootstrap starting.
I20260811 16:09:11.865614 25720 catalog_manager.cc:5495] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:11.868323 26172 tablet_bootstrap.cc:654] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:11.876297 26173 ts_tablet_manager.cc:1428] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260811 16:09:11.887548 26203 raft_consensus.cc:482] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.888226 26203 raft_consensus.cc:504] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.889115 26155 leader_election.cc:288] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.889424 26172 tablet_bootstrap.cc:492] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: No bootstrap required, opened a new log
I20260811 16:09:11.892383 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.896524 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.894806 26186 raft_consensus.cc:482] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:11.896983 26203 leader_election.cc:288] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.897571 25917 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.897379 26186 raft_consensus.cc:504] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:11.898339 25779 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:09:11.899078 25968 leader_election.cc:302] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.896832 26172 ts_tablet_manager.cc:1397] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.000s
W20260811 16:09:11.899854 25966 leader_election.cc:341] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:11.900832 26186 leader_election.cc:288] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.901474 26186 raft_consensus.cc:2781] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.901661 25916 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:11.901866 26186 raft_consensus.cc:482] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.902264 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:11.903016 25835 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.903805 25968 leader_election.cc:302] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:11.904347 25966 leader_election.cc:302] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:11.905236 26155 raft_consensus.cc:2781] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.902420 26186 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.907354 26203 raft_consensus.cc:2781] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:11.907795 26203 raft_consensus.cc:482] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:11.908164 26203 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.905948 25719 catalog_manager.cc:5495] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 1 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:11.910522 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" is_pre_election: true
I20260811 16:09:11.912053 25916 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 0.
I20260811 16:09:11.909359 26172 raft_consensus.cc:348] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.913857 26172 raft_consensus.cc:374] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.914119 26172 raft_consensus.cc:729] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.916179 26172 consensus_queue.cc:260] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.924986 26172 ts_tablet_manager.cc:1428] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260811 16:09:11.931901 26203 raft_consensus.cc:504] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.931782 26186 raft_consensus.cc:504] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.934311 26186 leader_election.cc:288] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.937091 26203 leader_election.cc:288] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:11.936964 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.937407 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:11.937876 25916 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.938197 25835 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.939644 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:11.940351 25833 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.943663 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:11.944494 25917 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:11.947867 25916 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:11.949338 25968 leader_election.cc:302] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.952893 26186 raft_consensus.cc:2781] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.953747 26186 raft_consensus.cc:686] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:11.948408 26174 tablet_bootstrap.cc:492] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: No bootstrap required, opened a new log
I20260811 16:09:11.954723 26186 consensus_queue.cc:237] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.955821 26174 ts_tablet_manager.cc:1397] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.020s
I20260811 16:09:11.959022 26203 consensus_queue.cc:1035] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 16:09:11.959161 26174 raft_consensus.cc:348] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.964749 26174 raft_consensus.cc:374] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:11.965054 26174 raft_consensus.cc:729] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Initialized, Role: FOLLOWER
I20260811 16:09:11.965991 26174 consensus_queue.cc:260] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.972162 26174 ts_tablet_manager.cc:1428] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260811 16:09:11.926191 26155 raft_consensus.cc:686] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:11.976250 26155 consensus_queue.cc:237] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:11.981539 25917 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:11.983042 25968 leader_election.cc:302] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:11.983419 25835 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:11.984251 26223 raft_consensus.cc:2781] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:11.985169 25833 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 1.
I20260811 16:09:12.014412 26223 raft_consensus.cc:686] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:12.015723 26223 consensus_queue.cc:237] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.019449 26232 consensus_queue.cc:1035] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.021556 25721 catalog_manager.cc:5495] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:12.038733 26207 raft_consensus.cc:482] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:12.039438 26207 raft_consensus.cc:504] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.041841 26207 leader_election.cc:288] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.043821 25834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:12.044693 25834 raft_consensus.cc:2454] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:12.044592 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:12.045650 26001 raft_consensus.cc:2454] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:12.047237 25881 leader_election.cc:302] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.048511 26207 raft_consensus.cc:2781] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:12.048887 26207 raft_consensus.cc:482] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:12.049207 26207 raft_consensus.cc:3037] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:12.058887 26207 raft_consensus.cc:504] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.058449 25719 catalog_manager.cc:5495] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:12.061822 26207 leader_election.cc:288] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.060770 25719 catalog_manager.cc:5495] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:12.062691 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.062706 25834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:12.063446 26001 raft_consensus.cc:3037] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:12.063634 25834 raft_consensus.cc:3037] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:12.073666 25834 raft_consensus.cc:2454] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:12.075091 25879 leader_election.cc:302] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.078838 26149 raft_consensus.cc:2781] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:12.079452 26149 raft_consensus.cc:686] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.080255 26149 consensus_queue.cc:237] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.083925 26001 raft_consensus.cc:2454] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:12.089998 25719 catalog_manager.cc:5495] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.103101 26149 raft_consensus.cc:482] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:12.103726 26149 raft_consensus.cc:504] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.105981 26149 leader_election.cc:288] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.106642 25834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14373aee361a4727a9b60eee7e56eefb" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" is_pre_election: true
I20260811 16:09:12.106673 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14373aee361a4727a9b60eee7e56eefb" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1" is_pre_election: true
I20260811 16:09:12.107755 26001 raft_consensus.cc:2454] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:12.107688 25834 raft_consensus.cc:2454] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 0.
I20260811 16:09:12.109107 25881 leader_election.cc:302] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.109998 26149 raft_consensus.cc:2781] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:12.110378 26149 raft_consensus.cc:482] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:12.110677 26149 raft_consensus.cc:3037] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:12.116990 26149 raft_consensus.cc:504] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.119128 26149 leader_election.cc:288] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.120229 25834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14373aee361a4727a9b60eee7e56eefb" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:12.120361 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14373aee361a4727a9b60eee7e56eefb" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.120860 25834 raft_consensus.cc:3037] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:12.121455 26001 raft_consensus.cc:3037] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:12.129439 25834 raft_consensus.cc:2454] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:12.130393 26001 raft_consensus.cc:2454] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 1.
I20260811 16:09:12.131891 25881 leader_election.cc:302] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.132848 26149 raft_consensus.cc:2781] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:12.133612 26149 raft_consensus.cc:686] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.134567 26149 consensus_queue.cc:237] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.136009 26223 consensus_queue.cc:1035] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.147372 25719 catalog_manager.cc:5495] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.154893 26155 consensus_queue.cc:1035] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.168931 26149 consensus_queue.cc:1035] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:12.191836 26184 consensus_queue.cc:1035] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.269637 26215 consensus_queue.cc:1035] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.282852 26215 consensus_queue.cc:1035] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.294137 25916 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:53374
I20260811 16:09:12.295197 25916 raft_consensus.cc:595] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:12.306500 25916 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "34a4228415c448638d06b2788822ca25"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:53374
I20260811 16:09:12.307282 25916 raft_consensus.cc:595] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:12.313726 26001 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:12.314962 26001 raft_consensus.cc:595] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:12.321313 26003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:12.321913 26003 raft_consensus.cc:595] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 4bfa3b3b690b43f8b3980437b3ac03ec
I20260811 16:09:12.328223 26003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:12.328833 26003 raft_consensus.cc:595] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:12.339816 25834 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60134
I20260811 16:09:12.340556 25834 raft_consensus.cc:595] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:12.347440 26003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
mode: GRACEFUL
new_leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:60340
I20260811 16:09:12.348058 26003 raft_consensus.cc:595] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Received request to transfer leadership to TS 9d0896cdd6f4426b9dc792cb6ea0e767
I20260811 16:09:12.396463 26155 consensus_queue.cc:1035] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:12.409795 26186 consensus_queue.cc:1035] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.420053 26186 raft_consensus.cc:979] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.420588 26186 raft_consensus.cc:1067] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.425395 25835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46220
I20260811 16:09:12.426131 25835 raft_consensus.cc:482] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.426604 25835 raft_consensus.cc:3037] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.428244 26186 consensus_queue.cc:1035] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.436465 25835 raft_consensus.cc:504] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.443809 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:12.444567 25916 raft_consensus.cc:3037] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.452988 26186 consensus_queue.cc:1035] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:12.453531 25916 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.454694 25835 leader_election.cc:288] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.456447 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eceec669f4e14d85a455397c7e0527fe" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.458666 26003 raft_consensus.cc:3032] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.459100 26003 raft_consensus.cc:729] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:12.459362 25800 leader_election.cc:302] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.460528 26063 raft_consensus.cc:2781] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.460201 26003 consensus_queue.cc:260] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.461113 26063 raft_consensus.cc:686] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:12.461553 26003 raft_consensus.cc:3037] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.462558 26063 consensus_queue.cc:237] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.478230 26232 raft_consensus.cc:979] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.478816 26232 raft_consensus.cc:1067] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.481349 25834 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46220
I20260811 16:09:12.481993 25834 raft_consensus.cc:482] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.482425 25834 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.484318 26223 consensus_queue.cc:1035] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.493889 26184 consensus_queue.cc:1035] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:12.477969 26003 raft_consensus.cc:2454] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.501958 25719 catalog_manager.cc:5495] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.510162 26155 consensus_queue.cc:1035] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.518335 25834 raft_consensus.cc:504] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.519712 25832 raft_consensus.cc:1226] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Rejecting Update request from peer 6afde416bee7452ea475f554ae0c23f1 for earlier term 1. Current term is 2. Ops: []
I20260811 16:09:12.520800 25834 leader_election.cc:288] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.523206 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:12.523902 25917 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.529026 26003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.532359 26207 raft_consensus.cc:979] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.534418 26207 raft_consensus.cc:1067] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.542281 25833 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "34a4228415c448638d06b2788822ca25"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46232
I20260811 16:09:12.544212 25833 raft_consensus.cc:482] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.544638 26149 consensus_queue.cc:1035] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:12.544664 25833 raft_consensus.cc:3037] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.533234 26232 consensus_queue.cc:1046] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:12.562968 26003 raft_consensus.cc:3032] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.566803 26003 raft_consensus.cc:729] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:12.558887 25917 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.569746 25800 leader_election.cc:302] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.570638 26063 raft_consensus.cc:2781] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.571209 26063 raft_consensus.cc:686] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:12.572104 26063 consensus_queue.cc:237] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.567852 26003 consensus_queue.cc:260] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.574579 26003 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.581195 26186 raft_consensus.cc:979] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:12.581856 26186 raft_consensus.cc:1067] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:12.583858 25922 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:37996
I20260811 16:09:12.584489 25922 raft_consensus.cc:482] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.584863 25922 raft_consensus.cc:3037] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.587262 25833 raft_consensus.cc:504] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.595855 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:12.596695 25917 raft_consensus.cc:3032] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.597045 25917 raft_consensus.cc:729] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.598094 25997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a4228415c448638d06b2788822ca25" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.597867 25917 consensus_queue.cc:260] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.599905 25917 raft_consensus.cc:3037] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.602423 26155 raft_consensus.cc:979] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:12.603026 26155 raft_consensus.cc:1067] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:12.616767 25916 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:37996
I20260811 16:09:12.617496 25916 raft_consensus.cc:482] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.617930 25916 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.620434 25721 catalog_manager.cc:5495] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.594691 25833 leader_election.cc:288] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.627460 26003 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.629395 25922 raft_consensus.cc:504] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
W20260811 16:09:12.630297 26232 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260811 16:09:12.634943 25917 raft_consensus.cc:2454] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.640218 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:12.640924 25835 raft_consensus.cc:3037] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.641140 25800 leader_election.cc:302] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:12.642506 26185 raft_consensus.cc:2781] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.643018 26185 raft_consensus.cc:686] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:12.643245 25916 raft_consensus.cc:504] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.643956 26185 consensus_queue.cc:237] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.645711 25916 leader_election.cc:288] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.651712 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:12.652456 25833 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.652549 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.653339 26001 raft_consensus.cc:3032] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.653633 26001 raft_consensus.cc:729] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:12.656266 26207 consensus_queue.cc:1035] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:12.654471 26001 consensus_queue.cc:260] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.655083 25835 raft_consensus.cc:2454] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:12.659821 26001 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.660214 25879 leader_election.cc:302] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.661329 26207 raft_consensus.cc:2781] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.661832 26207 raft_consensus.cc:686] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.663403 26207 consensus_queue.cc:237] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.670924 25833 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:12.672592 25879 leader_election.cc:302] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.676792 26184 raft_consensus.cc:2781] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.695966 26001 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:12.697173 25922 leader_election.cc:288] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.692305 26149 consensus_queue.cc:1035] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 16:09:12.695778 25721 catalog_manager.cc:5495] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.699393 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bd95fe39c44f75957f42a183f27e39" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.710374 26001 raft_consensus.cc:3032] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.710999 26001 raft_consensus.cc:729] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:12.712181 26001 consensus_queue.cc:260] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.714162 26001 raft_consensus.cc:3037] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
W20260811 16:09:12.727674 25879 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:44215, user_credentials={real_user=slave}} blocked reactor thread for 49807.5us
I20260811 16:09:12.709775 26184 raft_consensus.cc:686] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.739835 26184 consensus_queue.cc:237] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.734026 26001 raft_consensus.cc:2454] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:12.737625 26207 raft_consensus.cc:979] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: : Instructing follower 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.746436 26257 raft_consensus.cc:1067] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Signalling peer 4bfa3b3b690b43f8b3980437b3ac03ec to start an election
I20260811 16:09:12.752265 25833 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
 from {username='slave'} at 127.0.0.1:46232
I20260811 16:09:12.752936 25833 raft_consensus.cc:482] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.753345 25833 raft_consensus.cc:3037] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.753808 25721 catalog_manager.cc:5495] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.756711 25721 catalog_manager.cc:5495] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.763031 25833 raft_consensus.cc:504] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.765750 25833 leader_election.cc:288] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Requested vote from peers 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.766189 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:12.766938 25922 raft_consensus.cc:3032] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.767364 25922 raft_consensus.cc:729] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.768096 25922 consensus_queue.cc:260] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.769181 25922 raft_consensus.cc:3037] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.777890 25922 raft_consensus.cc:2454] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.778765 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab51c5fb16f04c4c9ddba187aa85ce84" candidate_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.778995 25800 leader_election.cc:302] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.779605 26001 raft_consensus.cc:3037] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.779927 26185 raft_consensus.cc:2781] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.780459 26185 raft_consensus.cc:686] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Leader. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:12.781409 26185 consensus_queue.cc:237] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.788791 26001 raft_consensus.cc:2454] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bfa3b3b690b43f8b3980437b3ac03ec in term 2.
I20260811 16:09:12.788793 25719 catalog_manager.cc:5495] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec reported cstate change: term changed from 1 to 2, leader changed from 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194) to 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193). New cstate: current_term: 2 leader_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.896281 26215 raft_consensus.cc:979] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: : Instructing follower 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:12.896853 26185 raft_consensus.cc:1067] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Signalling peer 9d0896cdd6f4426b9dc792cb6ea0e767 to start an election
I20260811 16:09:12.898797 25922 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
 from {username='slave'} at 127.0.0.1:38002
I20260811 16:09:12.899434 25922 raft_consensus.cc:482] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:12.899811 25922 raft_consensus.cc:3037] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.908418 25922 raft_consensus.cc:504] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.910970 25922 leader_election.cc:288] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195:41965)
I20260811 16:09:12.911580 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:12.912573 25833 raft_consensus.cc:3032] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:12.912925 25833 raft_consensus.cc:729] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:12.911693 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65cecc9c46bf4d71ad22d45c85cb318a" candidate_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
I20260811 16:09:12.913681 26001 raft_consensus.cc:3037] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.913846 25833 consensus_queue.cc:260] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.915884 25833 raft_consensus.cc:3037] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:12.923475 26001 raft_consensus.cc:2454] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:12.925237 25881 leader_election.cc:302] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:12.925686 25833 raft_consensus.cc:2454] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d0896cdd6f4426b9dc792cb6ea0e767 in term 2.
I20260811 16:09:12.926445 26257 raft_consensus.cc:2781] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:12.926972 26257 raft_consensus.cc:686] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Leader. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:12.927958 26257 consensus_queue.cc:237] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:12.937538 25719 catalog_manager.cc:5495] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 reported cstate change: term changed from 1 to 2, leader changed from 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193) to 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:12.969775 26001 raft_consensus.cc:1261] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:12.971302 26185 consensus_queue.cc:1035] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:12.985103 25922 raft_consensus.cc:1261] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:12.987028 26215 consensus_queue.cc:1035] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.016605 26001 raft_consensus.cc:1261] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.018047 26185 consensus_queue.cc:1035] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:13.027827 25922 raft_consensus.cc:1261] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.029690 26185 consensus_queue.cc:1035] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:13.048038 26001 raft_consensus.cc:3037] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:13.058135 26001 raft_consensus.cc:1261] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.059670 26259 consensus_queue.cc:1035] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.068629 26001 raft_consensus.cc:1261] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.070881 26257 consensus_queue.cc:1035] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:13.077960 25922 raft_consensus.cc:1261] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.080253 26185 consensus_queue.cc:1035] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.098918 25833 raft_consensus.cc:1261] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.103535 26257 consensus_queue.cc:1035] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.208801 25997 raft_consensus.cc:1261] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.210299 26257 consensus_queue.cc:1035] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.219226 25833 raft_consensus.cc:1261] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.224390 26257 consensus_queue.cc:1035] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:13.267814 25922 raft_consensus.cc:1261] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.269308 26259 consensus_queue.cc:1035] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.280973 25997 raft_consensus.cc:1261] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 4bfa3b3b690b43f8b3980437b3ac03ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.285058 26215 consensus_queue.cc:1035] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.315482 25997 raft_consensus.cc:1261] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.317050 26257 consensus_queue.cc:1035] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:13.328142 25833 raft_consensus.cc:1261] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Refusing update from remote peer 9d0896cdd6f4426b9dc792cb6ea0e767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:13.330257 26257 consensus_queue.cc:1035] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:15.355749 25723 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59720:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260811 16:09:15.378868 25723 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59720:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260811 16:09:15.401050 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
W20260811 16:09:15.594573 26293 log.cc:924] Time spent T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: Append to log took a long time: real 0.098s	user 0.005s	sys 0.000s
W20260811 16:09:15.686717 25800 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:41571, user_credentials={real_user=slave}} blocked reactor thread for 51843.8us
I20260811 16:09:15.706229 26320 tablet.cc:1722] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.691727 26313 tablet.cc:1722] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.784092 26322 tablet.cc:1722] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.793102 26336 tablet.cc:1722] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.800972 26329 tablet.cc:1722] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.806936 25835 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
mode: GRACEFUL
new_leader_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:60148
I20260811 16:09:15.808544 25835 raft_consensus.cc:595] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Received request to transfer leadership to TS 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:15.762348 26327 tablet.cc:1722] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.793102 26330 tablet.cc:1722] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260811 16:09:15.844489 25968 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:41571, user_credentials={real_user=slave}} blocked reactor thread for 46643.4us
W20260811 16:09:15.856937 26035 tablet_mm_ops.cc:140] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:34a4228415c448638d06b2788822ca25)
W20260811 16:09:15.908617 25864 tablet_mm_ops.cc:305] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:34a4228415c448638d06b2788822ca25)
W20260811 16:09:15.926117 25864 tablet_mm_ops.cc:221] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:34a4228415c448638d06b2788822ca25)
I20260811 16:09:15.829000 26332 tablet.cc:1722] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260811 16:09:15.928999 26334 log.cc:924] Time spent T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260811 16:09:15.928822 26341 tablet.cc:1722] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.944434 26348 tablet.cc:1722] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260811 16:09:15.950750 26342 log.cc:924] Time spent T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260811 16:09:15.952805 26337 log.cc:924] Time spent T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260811 16:09:15.958257 26320 tablet.cc:1722] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.931968 26339 tablet.cc:1722] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.981781 26329 tablet.cc:1722] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.985139 26322 tablet.cc:1722] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.955456 26344 tablet.cc:1722] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:15.989384 26348 tablet.cc:1722] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.027513 26313 tablet.cc:1722] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260811 16:09:16.030908 26347 log.cc:924] Time spent T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260811 16:09:15.991910 26327 tablet.cc:1722] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.038106 26329 tablet.cc:1722] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.038465 26332 tablet.cc:1722] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.045032 26336 tablet.cc:1722] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.053027 26339 tablet.cc:1722] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.066835 26344 tablet.cc:1722] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.059346 26330 tablet.cc:1722] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.072487 26336 tablet.cc:1722] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.086135 25723 catalog_manager.cc:5587] TS 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571) does not have the latest schema for tablet 71f3435cc46f46be84756e9a8f17664d (table soft_deleted_table [id=912902ebccc946c28efe50c332309729]). Expected version 1 got 0
I20260811 16:09:16.089221 25723 catalog_manager.cc:5587] TS 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571) does not have the latest schema for tablet 65cecc9c46bf4d71ad22d45c85cb318a (table soft_deleted_table [id=912902ebccc946c28efe50c332309729]). Expected version 1 got 0
I20260811 16:09:16.090171 25723 catalog_manager.cc:5587] TS 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571) does not have the latest schema for tablet 17bd95fe39c44f75957f42a183f27e39 (table soft_deleted_table [id=912902ebccc946c28efe50c332309729]). Expected version 1 got 0
I20260811 16:09:16.094552 25917 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
mode: GRACEFUL
new_leader_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:53380
I20260811 16:09:16.095705 25917 raft_consensus.cc:595] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Received request to transfer leadership to TS 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:16.097295 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260811 16:09:16.098012 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:16.100075 26344 tablet.cc:1722] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.106746 26348 tablet.cc:1722] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:16.118989 25833 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b"
dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
mode: GRACEFUL
new_leader_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:60148
I20260811 16:09:16.119831 25833 raft_consensus.cc:595] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Received request to transfer leadership to TS 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:16.122879 25917 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3"
dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
mode: GRACEFUL
new_leader_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:53380
I20260811 16:09:16.123569 25917 raft_consensus.cc:595] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Received request to transfer leadership to TS 6afde416bee7452ea475f554ae0c23f1
I20260811 16:09:16.125017 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260811 16:09:16.125689 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:16.133944 25723 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13: soft_deleted_table [id=912902ebccc946c28efe50c332309729] alter complete (version 1)
I20260811 16:09:16.136606 26317 raft_consensus.cc:979] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: : Instructing follower 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.137212 26317 raft_consensus.cc:1067] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Signalling peer 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.138999 26004 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:49848
I20260811 16:09:16.139779 26004 raft_consensus.cc:482] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:16.140168 26004 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.148729 26004 raft_consensus.cc:504] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.150782 26004 leader_election.cc:288] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:16.152004 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:16.152797 25917 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.155867 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7b3c7501bb47238f1c160a7f8b6a03" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:16.156728 25833 raft_consensus.cc:3032] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:16.156924 25833 raft_consensus.cc:729] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:16.157517 25833 consensus_queue.cc:260] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.158406 25833 raft_consensus.cc:3037] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.160977 25917 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.162216 25968 leader_election.cc:302] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:16.163115 26295 raft_consensus.cc:2781] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:16.163614 26295 raft_consensus.cc:686] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:16.164284 25833 raft_consensus.cc:2454] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.164477 26295 consensus_queue.cc:237] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.171994 25723 catalog_manager.cc:5495] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 2 to 3, leader changed from 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193) to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:16.235760 26305 raft_consensus.cc:979] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: : Instructing follower 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.236312 26305 raft_consensus.cc:1067] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Signalling peer 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.237859 25997 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:49834
I20260811 16:09:16.238307 25997 raft_consensus.cc:482] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:16.238782 25997 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.246630 25997 raft_consensus.cc:504] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.248469 25997 leader_election.cc:288] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:16.249318 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:16.249598 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518256f8b05144248e6ffafe35869ce3" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:16.249971 25833 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.250277 25917 raft_consensus.cc:3032] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:16.250578 25917 raft_consensus.cc:729] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:16.251416 25917 consensus_queue.cc:260] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.252712 25917 raft_consensus.cc:3037] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.257678 25833 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.259371 25966 leader_election.cc:302] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:16.259985 25917 raft_consensus.cc:2454] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.260393 26295 raft_consensus.cc:2781] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:16.261042 26295 raft_consensus.cc:686] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:16.261968 26295 consensus_queue.cc:237] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.270956 25723 catalog_manager.cc:5495] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 2 to 3, leader changed from 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194) to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:16.407684 26300 raft_consensus.cc:979] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: : Instructing follower 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.408255 26305 raft_consensus.cc:1067] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Signalling peer 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.409780 25997 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:49834
I20260811 16:09:16.410293 25997 raft_consensus.cc:482] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:16.410557 25997 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.415834 25997 raft_consensus.cc:504] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.417429 25997 leader_election.cc:288] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:16.418676 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:16.418779 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f3435cc46f46be84756e9a8f17664d" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:16.419365 25833 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.419507 25917 raft_consensus.cc:3032] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:16.419906 25917 raft_consensus.cc:729] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d0896cdd6f4426b9dc792cb6ea0e767, State: Running, Role: LEADER
I20260811 16:09:16.420855 25917 consensus_queue.cc:260] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.421907 25917 raft_consensus.cc:3037] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.425105 25833 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.426389 25966 leader_election.cc:302] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bfa3b3b690b43f8b3980437b3ac03ec, 6afde416bee7452ea475f554ae0c23f1; no voters: 
I20260811 16:09:16.427198 26295 raft_consensus.cc:2781] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:16.427615 25917 raft_consensus.cc:2454] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.427662 26295 raft_consensus.cc:686] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:16.428788 26295 consensus_queue.cc:237] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } }
I20260811 16:09:16.435396 25723 catalog_manager.cc:5495] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 2 to 3, leader changed from 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194) to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:16.469681 26317 raft_consensus.cc:979] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: : Instructing follower 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.470381 26297 raft_consensus.cc:1067] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Signalling peer 6afde416bee7452ea475f554ae0c23f1 to start an election
I20260811 16:09:16.472165 25997 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b"
dest_uuid: "6afde416bee7452ea475f554ae0c23f1"
 from {username='slave'} at 127.0.0.1:49848
I20260811 16:09:16.472657 25997 raft_consensus.cc:482] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:16.472883 25997 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.478353 25997 raft_consensus.cc:504] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:16.480304 25997 leader_election.cc:288] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215), 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571)
I20260811 16:09:16.481285 25833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec"
I20260811 16:09:16.481642 25917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c4833950fd4e178e2f59dc4a63775b" candidate_uuid: "6afde416bee7452ea475f554ae0c23f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767"
I20260811 16:09:16.481983 25833 raft_consensus.cc:3032] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:16.482343 25917 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.482347 25833 raft_consensus.cc:729] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4bfa3b3b690b43f8b3980437b3ac03ec, State: Running, Role: LEADER
I20260811 16:09:16.483445 25833 consensus_queue.cc:260] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:16.484694 25833 raft_consensus.cc:3037] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:16.488484 25917 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.489473 25833 raft_consensus.cc:2454] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afde416bee7452ea475f554ae0c23f1 in term 3.
I20260811 16:09:16.489838 25968 leader_election.cc:302] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afde416bee7452ea475f554ae0c23f1, 9d0896cdd6f4426b9dc792cb6ea0e767; no voters: 
I20260811 16:09:16.490764 26295 raft_consensus.cc:2781] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:16.491240 26295 raft_consensus.cc:686] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Becoming Leader. State: Replica: 6afde416bee7452ea475f554ae0c23f1, State: Running, Role: LEADER
I20260811 16:09:16.492067 26295 consensus_queue.cc:237] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } }
I20260811 16:09:16.499565 25723 catalog_manager.cc:5495] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 reported cstate change: term changed from 2 to 3, leader changed from 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193) to 6afde416bee7452ea475f554ae0c23f1 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "6afde416bee7452ea475f554ae0c23f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afde416bee7452ea475f554ae0c23f1" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:16.680356 25833 raft_consensus.cc:1261] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:16.681532 26295 consensus_queue.cc:1035] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:16.692214 25917 raft_consensus.cc:1261] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:16.702083 26358 consensus_queue.cc:1035] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260811 16:09:16.716991 25833 raft_consensus.cc:1261] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:09:16.718297 26358 consensus_queue.cc:1035] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:16.727603 25917 raft_consensus.cc:1261] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:09:16.730038 26340 consensus_queue.cc:1035] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:16.911968 25917 raft_consensus.cc:1261] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:09:16.913416 26295 consensus_queue.cc:1035] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:16.921674 25833 raft_consensus.cc:1261] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260811 16:09:16.923341 26340 consensus_queue.cc:1035] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:16.986414 25917 raft_consensus.cc:1261] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:16.988673 26358 consensus_queue.cc:1035] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0896cdd6f4426b9dc792cb6ea0e767" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:09:17.000603 25833 raft_consensus.cc:1261] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Refusing update from remote peer 6afde416bee7452ea475f554ae0c23f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:17.002275 26295 consensus_queue.cc:1035] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfa3b3b690b43f8b3980437b3ac03ec" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:17.126855 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:17.134027 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:17.134606 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:17.140291 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:17.140925 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:18.141968 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:18.147383 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:18.147895 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:18.152626 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:18.153087 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:19.154068 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:19.160113 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:19.160650 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:19.166301 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:19.166821 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:20.167872 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:20.173154 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:20.173688 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:20.178496 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:20.178944 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:21.179992 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:21.185564 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:21.186081 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:21.190908 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:21.191412 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:22.192629 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:22.198644 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:22.199287 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:22.204851 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:22.205320 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:23.206373 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:23.211483 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:23.212000 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:23.217422 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:23.217898 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:24.219017 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:24.224738 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:24.225306 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:24.229835 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:24.230289 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:25.231355 12383 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260811 16:09:25.236625 12383 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260811 16:09:25.237155 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:25.242081 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:25.242519 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:26.316524 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
I20260811 16:09:26.372346 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:26.373484 12383 tablet_replica.cc:330] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.375078 12383 raft_consensus.cc:2229] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.376088 12383 raft_consensus.cc:2258] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.379263 12383 tablet_replica.cc:330] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.380025 12383 raft_consensus.cc:2229] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.380625 12383 raft_consensus.cc:2258] T 14373aee361a4727a9b60eee7e56eefb P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.383839 12383 tablet_replica.cc:330] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.384459 12383 raft_consensus.cc:2229] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.385511 12383 raft_consensus.cc:2258] T 34a4228415c448638d06b2788822ca25 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.388397 12383 tablet_replica.cc:330] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.389235 12383 raft_consensus.cc:2229] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.390443 12383 raft_consensus.cc:2258] T eceec669f4e14d85a455397c7e0527fe P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.393208 12383 tablet_replica.cc:330] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.393843 12383 raft_consensus.cc:2229] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.394389 12383 raft_consensus.cc:2258] T 17bd95fe39c44f75957f42a183f27e39 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.397833 12383 tablet_replica.cc:330] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.398692 12383 raft_consensus.cc:2229] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.399549 12383 raft_consensus.cc:2258] T 65cecc9c46bf4d71ad22d45c85cb318a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.402323 12383 tablet_replica.cc:330] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.402897 12383 raft_consensus.cc:2229] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.403568 12383 raft_consensus.cc:2258] T 518256f8b05144248e6ffafe35869ce3 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.406607 12383 tablet_replica.cc:330] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.407397 12383 raft_consensus.cc:2229] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.408519 12383 raft_consensus.cc:2258] T ab51c5fb16f04c4c9ddba187aa85ce84 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.411437 12383 tablet_replica.cc:330] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.412420 12383 raft_consensus.cc:2229] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.413559 12383 raft_consensus.cc:2258] T b1e0086806384f03b5e2db4f7115a3c2 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.416344 12383 tablet_replica.cc:330] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.417210 12383 raft_consensus.cc:2229] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.417785 12383 raft_consensus.cc:2258] T 71f3435cc46f46be84756e9a8f17664d P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.420439 12383 tablet_replica.cc:330] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.421142 12383 raft_consensus.cc:2229] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.421747 12383 raft_consensus.cc:2258] T 5b5a54a498da4f07868519c15ea656e7 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.424470 12383 tablet_replica.cc:330] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.425136 12383 raft_consensus.cc:2229] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.425753 12383 raft_consensus.cc:2258] T 7dae071d44e548dfa19017737770ac93 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.428655 12383 tablet_replica.cc:330] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.429364 12383 raft_consensus.cc:2229] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.430092 12383 raft_consensus.cc:2258] T 91a115366d8e4c0b9cfbdf1a8262810a P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.430652 25879 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 165 similar messages]
I20260811 16:09:26.434566 12383 tablet_replica.cc:330] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
W20260811 16:09:26.435339 25879 consensus_peers.cc:487] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.436046 12383 raft_consensus.cc:2229] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.437474 12383 raft_consensus.cc:2258] T 7eabf16a76804ca1866e4814b8d12f8c P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.440780 12383 tablet_replica.cc:330] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.441497 12383 raft_consensus.cc:2229] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.442186 12383 raft_consensus.cc:2258] T 1a2a6992855f4b24bbeea39db1aa3f5f P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.445338 12383 tablet_replica.cc:330] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.446018 12383 raft_consensus.cc:2229] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.446699 12383 raft_consensus.cc:2258] T 17268c3586524c7bb1106e997b61d9cc P 4bfa3b3b690b43f8b3980437b3ac03ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.449896 12383 tablet_replica.cc:330] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.450541 12383 raft_consensus.cc:2229] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.451696 12383 raft_consensus.cc:2258] T 6043c686b0be4818a63257efeffd3fd5 P 4bfa3b3b690b43f8b3980437b3ac03ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.454484 12383 tablet_replica.cc:330] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec: stopping tablet replica
I20260811 16:09:26.455122 12383 raft_consensus.cc:2229] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.456081 12383 raft_consensus.cc:2258] T 00c4833950fd4e178e2f59dc4a63775b P 4bfa3b3b690b43f8b3980437b3ac03ec [term 3 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.463227 25879 consensus_peers.cc:487] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:26.487408 25879 consensus_peers.cc:487] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.516291 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
W20260811 16:09:26.521658 25966 consensus_peers.cc:487] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:26.557446 25879 consensus_peers.cc:487] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.569918 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:09:26.579282 25966 consensus_peers.cc:487] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:26.608933 25879 consensus_peers.cc:487] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:26.615337 25968 consensus_peers.cc:487] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 -> Peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Couldn't send request to peer 9d0896cdd6f4426b9dc792cb6ea0e767. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.617234 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:26.618235 12383 tablet_replica.cc:330] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.619377 12383 raft_consensus.cc:2229] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.620592 12383 raft_consensus.cc:2258] T 14373aee361a4727a9b60eee7e56eefb P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.623042 25966 consensus_peers.cc:487] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.623991 12383 tablet_replica.cc:330] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.624789 12383 raft_consensus.cc:2229] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.625540 12383 raft_consensus.cc:2258] T 34a4228415c448638d06b2788822ca25 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.628294 12383 tablet_replica.cc:330] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.629045 12383 raft_consensus.cc:2229] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.629635 12383 raft_consensus.cc:2258] T eceec669f4e14d85a455397c7e0527fe P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.632264 12383 tablet_replica.cc:330] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.632952 12383 raft_consensus.cc:2229] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.633534 12383 raft_consensus.cc:2258] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.636189 12383 tablet_replica.cc:330] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.636828 12383 raft_consensus.cc:2229] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.637540 12383 raft_consensus.cc:2258] T 91a115366d8e4c0b9cfbdf1a8262810a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.640983 12383 tablet_replica.cc:330] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.641916 12383 raft_consensus.cc:2229] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.642716 12383 raft_consensus.cc:2258] T 7dae071d44e548dfa19017737770ac93 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.642828 25966 consensus_peers.cc:487] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.646245 12383 tablet_replica.cc:330] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.647776 12383 raft_consensus.cc:2229] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.648468 12383 raft_consensus.cc:2258] T b1e0086806384f03b5e2db4f7115a3c2 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.652015 12383 tablet_replica.cc:330] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.652781 12383 raft_consensus.cc:2229] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.653357 12383 raft_consensus.cc:2258] T 6043c686b0be4818a63257efeffd3fd5 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.656939 12383 tablet_replica.cc:330] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.657577 12383 raft_consensus.cc:2229] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.658623 12383 raft_consensus.cc:2258] T 17268c3586524c7bb1106e997b61d9cc P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.661167 12383 tablet_replica.cc:330] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.661836 12383 raft_consensus.cc:2229] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.662922 12383 raft_consensus.cc:2258] T 1a2a6992855f4b24bbeea39db1aa3f5f P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.665778 12383 tablet_replica.cc:330] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.666456 12383 raft_consensus.cc:2229] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.667001 12383 raft_consensus.cc:2258] T 7eabf16a76804ca1866e4814b8d12f8c P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.669471 12383 tablet_replica.cc:330] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.670056 12383 raft_consensus.cc:2229] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.670526 12383 raft_consensus.cc:2258] T 71f3435cc46f46be84756e9a8f17664d P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.673308 12383 tablet_replica.cc:330] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.673871 12383 raft_consensus.cc:2229] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.674952 12383 raft_consensus.cc:2258] T 5b5a54a498da4f07868519c15ea656e7 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.677440 12383 tablet_replica.cc:330] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.677959 12383 raft_consensus.cc:2229] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.678507 12383 raft_consensus.cc:2258] T ab51c5fb16f04c4c9ddba187aa85ce84 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.681056 12383 tablet_replica.cc:330] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.681778 12383 raft_consensus.cc:2229] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.682267 12383 raft_consensus.cc:2258] T 518256f8b05144248e6ffafe35869ce3 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.685148 12383 tablet_replica.cc:330] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.685989 12383 raft_consensus.cc:2229] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.687278 12383 raft_consensus.cc:2258] T 65cecc9c46bf4d71ad22d45c85cb318a P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.687726 25968 consensus_peers.cc:487] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 -> Peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Couldn't send request to peer 9d0896cdd6f4426b9dc792cb6ea0e767. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.689946 12383 tablet_replica.cc:330] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.690521 12383 raft_consensus.cc:2229] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.691426 12383 raft_consensus.cc:2258] T 17bd95fe39c44f75957f42a183f27e39 P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.693846 12383 tablet_replica.cc:330] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767: stopping tablet replica
I20260811 16:09:26.694279 12383 raft_consensus.cc:2229] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.694732 12383 raft_consensus.cc:2258] T 00c4833950fd4e178e2f59dc4a63775b P 9d0896cdd6f4426b9dc792cb6ea0e767 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.732863 25968 consensus_peers.cc:487] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 -> Peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Couldn't send request to peer 9d0896cdd6f4426b9dc792cb6ea0e767. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:41571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:26.743059 25966 consensus_peers.cc:487] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.746073 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
W20260811 16:09:26.753650 25966 consensus_peers.cc:487] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 -> Peer 4bfa3b3b690b43f8b3980437b3ac03ec (127.12.23.193:44215): Couldn't send request to peer 4bfa3b3b690b43f8b3980437b3ac03ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:44215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:26.772532 25968 consensus_peers.cc:487] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 -> Peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Couldn't send request to peer 9d0896cdd6f4426b9dc792cb6ea0e767. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:41571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.796088 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
I20260811 16:09:26.833087 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:26.833935 12383 tablet_replica.cc:330] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.834918 12383 raft_consensus.cc:2229] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.835623 12383 raft_consensus.cc:2258] T 14373aee361a4727a9b60eee7e56eefb P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.838943 12383 tablet_replica.cc:330] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.839969 12383 raft_consensus.cc:2229] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.841158 12383 raft_consensus.cc:2258] T 3e7b3c7501bb47238f1c160a7f8b6a03 P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.843809 12383 tablet_replica.cc:330] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.844518 12383 raft_consensus.cc:2229] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.845171 12383 raft_consensus.cc:2258] T eceec669f4e14d85a455397c7e0527fe P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.848395 12383 tablet_replica.cc:330] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.849289 12383 raft_consensus.cc:2229] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.850054 12383 raft_consensus.cc:2258] T 17bd95fe39c44f75957f42a183f27e39 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:26.850664 25968 consensus_peers.cc:487] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 -> Peer 9d0896cdd6f4426b9dc792cb6ea0e767 (127.12.23.194:41571): Couldn't send request to peer 9d0896cdd6f4426b9dc792cb6ea0e767. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:41571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:26.852757 12383 tablet_replica.cc:330] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.853495 12383 raft_consensus.cc:2229] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.854010 12383 raft_consensus.cc:2258] T 65cecc9c46bf4d71ad22d45c85cb318a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.857017 12383 tablet_replica.cc:330] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.857640 12383 raft_consensus.cc:2229] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.858577 12383 raft_consensus.cc:2258] T 91a115366d8e4c0b9cfbdf1a8262810a P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.861048 12383 tablet_replica.cc:330] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.861744 12383 raft_consensus.cc:2229] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.862769 12383 raft_consensus.cc:2258] T 7dae071d44e548dfa19017737770ac93 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.865733 12383 tablet_replica.cc:330] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.866344 12383 raft_consensus.cc:2229] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.867357 12383 raft_consensus.cc:2258] T 71f3435cc46f46be84756e9a8f17664d P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.869705 12383 tablet_replica.cc:330] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.870350 12383 raft_consensus.cc:2229] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.870846 12383 raft_consensus.cc:2258] T 5b5a54a498da4f07868519c15ea656e7 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.873400 12383 tablet_replica.cc:330] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.874009 12383 raft_consensus.cc:2229] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.874495 12383 raft_consensus.cc:2258] T 6043c686b0be4818a63257efeffd3fd5 P 6afde416bee7452ea475f554ae0c23f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.876718 12383 tablet_replica.cc:330] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.877360 12383 raft_consensus.cc:2229] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.877885 12383 raft_consensus.cc:2258] T 17268c3586524c7bb1106e997b61d9cc P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.880189 12383 tablet_replica.cc:330] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.880748 12383 raft_consensus.cc:2229] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.881785 12383 raft_consensus.cc:2258] T 00c4833950fd4e178e2f59dc4a63775b P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.884270 12383 tablet_replica.cc:330] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.884888 12383 raft_consensus.cc:2229] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.885385 12383 raft_consensus.cc:2258] T 7eabf16a76804ca1866e4814b8d12f8c P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.887972 12383 tablet_replica.cc:330] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.888597 12383 raft_consensus.cc:2229] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.889120 12383 raft_consensus.cc:2258] T 1a2a6992855f4b24bbeea39db1aa3f5f P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.891558 12383 tablet_replica.cc:330] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.892161 12383 raft_consensus.cc:2229] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.892681 12383 raft_consensus.cc:2258] T b1e0086806384f03b5e2db4f7115a3c2 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.894908 12383 tablet_replica.cc:330] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.895537 12383 raft_consensus.cc:2229] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.896138 12383 raft_consensus.cc:2258] T 34a4228415c448638d06b2788822ca25 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.898474 12383 tablet_replica.cc:330] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.899024 12383 raft_consensus.cc:2229] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:26.899586 12383 raft_consensus.cc:2258] T ab51c5fb16f04c4c9ddba187aa85ce84 P 6afde416bee7452ea475f554ae0c23f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.901924 12383 tablet_replica.cc:330] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1: stopping tablet replica
I20260811 16:09:26.902463 12383 raft_consensus.cc:2229] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:26.903424 12383 raft_consensus.cc:2258] T 518256f8b05144248e6ffafe35869ce3 P 6afde416bee7452ea475f554ae0c23f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:26.972496 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:09:27.017212 12383 master.cc:537] Master@127.12.23.254:33065 shutting down...
I20260811 16:09:27.051578 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:27.052392 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:27.052832 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P b135671b0d134fa794415a671f54ae13: stopping tablet replica
I20260811 16:09:27.075953 12383 master.cc:552] Master@127.12.23.254:33065 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21710 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260811 16:09:27.137148 12383 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.23.254:42807
I20260811 16:09:27.138302 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:27.145901 26391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.146369 26392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.147039 26394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:27.148217 12383 server_base.cc:1034] running on GCE node
I20260811 16:09:27.149415 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:27.149605 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:27.149789 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464567149757 us; error 0 us; skew 500 ppm
I20260811 16:09:27.150342 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:27.157119 12383 webserver.cc:460] Webserver started at http://127.12.23.254:39171/ using document root <none> and password file <none>
I20260811 16:09:27.157768 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:27.157965 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:27.158365 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:27.159935 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/master-0-root/instance:
uuid: "ae082136390745ed91775d24bd6ed641"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.165325 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260811 16:09:27.169153 26401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.170208 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260811 16:09:27.170632 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/master-0-root
uuid: "ae082136390745ed91775d24bd6ed641"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.170943 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:27.207373 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:27.208738 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:27.254160 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.254:42807
I20260811 16:09:27.254278 26459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.254:42807 every 8 connection(s)
I20260811 16:09:27.258580 26460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.271739 26460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: Bootstrap starting.
I20260811 16:09:27.277149 26460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:27.282126 26460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: No bootstrap required, opened a new log
I20260811 16:09:27.284504 26460 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae082136390745ed91775d24bd6ed641" member_type: VOTER }
I20260811 16:09:27.285017 26460 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:27.285197 26460 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae082136390745ed91775d24bd6ed641, State: Initialized, Role: FOLLOWER
I20260811 16:09:27.285857 26460 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae082136390745ed91775d24bd6ed641" member_type: VOTER }
I20260811 16:09:27.286474 26460 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:09:27.286674 26460 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:09:27.286913 26460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:27.292222 26460 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae082136390745ed91775d24bd6ed641" member_type: VOTER }
I20260811 16:09:27.292732 26460 leader_election.cc:302] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae082136390745ed91775d24bd6ed641; no voters: 
I20260811 16:09:27.293866 26460 leader_election.cc:288] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 16:09:27.294463 26463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:27.296200 26463 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 LEADER]: Becoming Leader. State: Replica: ae082136390745ed91775d24bd6ed641, State: Running, Role: LEADER
I20260811 16:09:27.297071 26460 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:09:27.297000 26463 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae082136390745ed91775d24bd6ed641" member_type: VOTER }
I20260811 16:09:27.303526 26466 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae082136390745ed91775d24bd6ed641" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae082136390745ed91775d24bd6ed641" member_type: VOTER } }
I20260811 16:09:27.303550 26467 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae082136390745ed91775d24bd6ed641. Latest consensus state: current_term: 1 leader_uuid: "ae082136390745ed91775d24bd6ed641" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae082136390745ed91775d24bd6ed641" member_type: VOTER } }
I20260811 16:09:27.304528 26466 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [sys.catalog]: This master's current role is: LEADER
I20260811 16:09:27.304591 26467 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [sys.catalog]: This master's current role is: LEADER
I20260811 16:09:27.309854 26476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:09:27.316486 26476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:09:27.317653 12383 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260811 16:09:27.325960 26476 catalog_manager.cc:1347] Generated new cluster ID: 30e9d4cf80a144d59cb1d3caa67f8988
I20260811 16:09:27.326289 26476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:09:27.358851 26476 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:09:27.360777 26476 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:09:27.382463 26476 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: Generated new TSK 0
I20260811 16:09:27.383307 26476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:09:27.449635 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:27.456015 26485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.457217 26486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:27.459995 12383 server_base.cc:1034] running on GCE node
W20260811 16:09:27.460079 26488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:27.461440 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:27.461638 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:27.461860 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464567461825 us; error 0 us; skew 500 ppm
I20260811 16:09:27.462596 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:27.465325 12383 webserver.cc:460] Webserver started at http://127.12.23.193:37601/ using document root <none> and password file <none>
I20260811 16:09:27.465770 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:27.465922 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:27.466135 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:27.467520 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-0-root/instance:
uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.472357 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260811 16:09:27.476008 26495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.476871 12383 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260811 16:09:27.477195 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-0-root
uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.477481 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:27.492821 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:27.494158 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:27.495790 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:09:27.498436 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:09:27.498651 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.498899 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:09:27.499181 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.545763 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.193:45659
I20260811 16:09:27.545881 26563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.193:45659 every 8 connection(s)
I20260811 16:09:27.551462 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:27.559471 26568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.562033 26569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.563822 26571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:27.564921 12383 server_base.cc:1034] running on GCE node
I20260811 16:09:27.566124 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:27.566413 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:27.566598 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464567566582 us; error 0 us; skew 500 ppm
I20260811 16:09:27.567405 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:27.569005 26564 heartbeater.cc:347] Connected to a master server at 127.12.23.254:42807
I20260811 16:09:27.569650 26564 heartbeater.cc:464] Registering TS with master...
I20260811 16:09:27.570612 26564 heartbeater.cc:511] Master 127.12.23.254:42807 requested a full tablet report, sending...
I20260811 16:09:27.570945 12383 webserver.cc:460] Webserver started at http://127.12.23.194:40647/ using document root <none> and password file <none>
I20260811 16:09:27.571730 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:27.571971 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:27.572371 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:27.573494 26419 ts_manager.cc:194] Registered new tserver with Master: eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659)
I20260811 16:09:27.573982 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-1-root/instance:
uuid: "7f4016f7a11141209b201c76a3c4ac20"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.576071 26419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38810
I20260811 16:09:27.579983 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260811 16:09:27.584297 26576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.585428 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:09:27.585850 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-1-root
uuid: "7f4016f7a11141209b201c76a3c4ac20"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.586223 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:27.598618 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:27.600104 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:27.601575 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:09:27.604116 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:09:27.604308 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.604611 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:09:27.604748 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.651345 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.194:36691
I20260811 16:09:27.651444 26649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.194:36691 every 8 connection(s)
I20260811 16:09:27.656481 12383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:09:27.665102 26653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.666518 26654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:09:27.670320 26656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:09:27.673893 12383 server_base.cc:1034] running on GCE node
I20260811 16:09:27.674741 26650 heartbeater.cc:347] Connected to a master server at 127.12.23.254:42807
I20260811 16:09:27.675258 26650 heartbeater.cc:464] Registering TS with master...
I20260811 16:09:27.675364 12383 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260811 16:09:27.675678 12383 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260811 16:09:27.675884 12383 hybrid_clock.cc:648] HybridClock initialized: now 1786464567675870 us; error 0 us; skew 500 ppm
I20260811 16:09:27.676164 26650 heartbeater.cc:511] Master 127.12.23.254:42807 requested a full tablet report, sending...
I20260811 16:09:27.676566 12383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 16:09:27.679185 26419 ts_manager.cc:194] Registered new tserver with Master: 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:27.680356 12383 webserver.cc:460] Webserver started at http://127.12.23.195:40093/ using document root <none> and password file <none>
I20260811 16:09:27.681116 12383 fs_manager.cc:359] Metadata directory not provided
I20260811 16:09:27.681375 12383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:09:27.681690 12383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:09:27.681859 26419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38820
I20260811 16:09:27.683434 12383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-2-root/instance:
uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.688956 12383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260811 16:09:27.692806 26662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 16:09:27.693722 12383 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 16:09:27.694077 12383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-2-root
uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
format_stamp: "Formatted at 2026-08-11 16:09:27 on dist-test-slave-chsk"
I20260811 16:09:27.694532 12383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:09:27.723342 12383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 16:09:27.724735 12383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:09:27.726459 12383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:09:27.729804 12383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:09:27.730353 12383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260811 16:09:27.730799 12383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:09:27.731242 12383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.002s	sys 0.000s
I20260811 16:09:27.783772 12383 rpc_server.cc:307] RPC server started. Bound to: 127.12.23.195:36657
I20260811 16:09:27.783900 26726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.23.195:36657 every 8 connection(s)
I20260811 16:09:27.802840 26727 heartbeater.cc:347] Connected to a master server at 127.12.23.254:42807
I20260811 16:09:27.803457 26727 heartbeater.cc:464] Registering TS with master...
I20260811 16:09:27.804267 26727 heartbeater.cc:511] Master 127.12.23.254:42807 requested a full tablet report, sending...
I20260811 16:09:27.806756 26419 ts_manager.cc:194] Registered new tserver with Master: 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:27.807446 12383 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020251056s
I20260811 16:09:27.808887 26419 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38828
I20260811 16:09:27.810755 12383 test_util.cc:268] Using random seed: -1309156695
I20260811 16:09:27.841856 26419 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38840:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:09:27.845620 26419 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:09:27.922113 26526 tablet_service.cc:1467] Processing CreateTablet for tablet 635494ceded841e6ace043d339fd7a6b (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:27.923924 26526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 635494ceded841e6ace043d339fd7a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.928589 26525 tablet_service.cc:1467] Processing CreateTablet for tablet 935f4268d9e142ee8898807670bce390 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:27.930337 26525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 935f4268d9e142ee8898807670bce390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.933439 26523 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5fdda28ecb4f6eb1005d44adf02df8 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:27.935302 26523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5fdda28ecb4f6eb1005d44adf02df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.940086 26522 tablet_service.cc:1467] Processing CreateTablet for tablet ff9e3b2adae348278cc8dd0360b9583a (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:27.941213 26520 tablet_service.cc:1467] Processing CreateTablet for tablet 3b3d85f61f9b4d7092d97ee0e0b43020 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:27.941867 26522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9e3b2adae348278cc8dd0360b9583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.942752 26520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b3d85f61f9b4d7092d97ee0e0b43020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.944428 26521 tablet_service.cc:1467] Processing CreateTablet for tablet c754107e751346fab70e92236998beb8 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:27.945997 26521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c754107e751346fab70e92236998beb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.948637 26519 tablet_service.cc:1467] Processing CreateTablet for tablet 209555b832274fa58305de6823f1cdd6 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:27.950276 26519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209555b832274fa58305de6823f1cdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.952530 26517 tablet_service.cc:1467] Processing CreateTablet for tablet b5e9f11e62a544f399f4b8388dafa8c7 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:27.954111 26517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e9f11e62a544f399f4b8388dafa8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.956987 26518 tablet_service.cc:1467] Processing CreateTablet for tablet 6347ad743533454ea66d429fb6ad2cf2 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:27.958690 26518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6347ad743533454ea66d429fb6ad2cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.979065 26687 tablet_service.cc:1467] Processing CreateTablet for tablet c754107e751346fab70e92236998beb8 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:27.980441 26690 tablet_service.cc:1467] Processing CreateTablet for tablet 935f4268d9e142ee8898807670bce390 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:27.981909 26686 tablet_service.cc:1467] Processing CreateTablet for tablet 3b3d85f61f9b4d7092d97ee0e0b43020 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:27.982961 26689 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5fdda28ecb4f6eb1005d44adf02df8 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:27.983640 26687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c754107e751346fab70e92236998beb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.984449 26689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5fdda28ecb4f6eb1005d44adf02df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.985163 26686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b3d85f61f9b4d7092d97ee0e0b43020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.987478 26610 tablet_service.cc:1467] Processing CreateTablet for tablet 635494ceded841e6ace043d339fd7a6b (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:27.989030 26610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 635494ceded841e6ace043d339fd7a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.989945 26604 tablet_service.cc:1467] Processing CreateTablet for tablet 3b3d85f61f9b4d7092d97ee0e0b43020 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:27.992352 26688 tablet_service.cc:1467] Processing CreateTablet for tablet ff9e3b2adae348278cc8dd0360b9583a (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:27.993902 26688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9e3b2adae348278cc8dd0360b9583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:27.993547 26608 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5fdda28ecb4f6eb1005d44adf02df8 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:27.995937 26607 tablet_service.cc:1467] Processing CreateTablet for tablet ff9e3b2adae348278cc8dd0360b9583a (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:27.996439 26603 tablet_service.cc:1467] Processing CreateTablet for tablet 209555b832274fa58305de6823f1cdd6 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:27.998427 26605 tablet_service.cc:1467] Processing CreateTablet for tablet c754107e751346fab70e92236998beb8 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:27.999215 26602 tablet_service.cc:1467] Processing CreateTablet for tablet 6347ad743533454ea66d429fb6ad2cf2 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:28.000424 26691 tablet_service.cc:1467] Processing CreateTablet for tablet 635494ceded841e6ace043d339fd7a6b (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:28.001523 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b3d85f61f9b4d7092d97ee0e0b43020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.015028 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c754107e751346fab70e92236998beb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.004949 26684 tablet_service.cc:1467] Processing CreateTablet for tablet 6347ad743533454ea66d429fb6ad2cf2 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:28.006278 26685 tablet_service.cc:1467] Processing CreateTablet for tablet 209555b832274fa58305de6823f1cdd6 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:28.004951 26683 tablet_service.cc:1467] Processing CreateTablet for tablet b5e9f11e62a544f399f4b8388dafa8c7 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:27.992360 26609 tablet_service.cc:1467] Processing CreateTablet for tablet 935f4268d9e142ee8898807670bce390 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:28.020305 26609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 935f4268d9e142ee8898807670bce390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.012055 26601 tablet_service.cc:1467] Processing CreateTablet for tablet b5e9f11e62a544f399f4b8388dafa8c7 (DEFAULT_TABLE table=test-workload [id=d426d5a204f9475e9b1085ab2e6a1a24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:28.002166 26690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 935f4268d9e142ee8898807670bce390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.023809 26691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 635494ceded841e6ace043d339fd7a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.025645 26683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e9f11e62a544f399f4b8388dafa8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.027499 26685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209555b832274fa58305de6823f1cdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.031594 26684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6347ad743533454ea66d429fb6ad2cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.022954 26601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e9f11e62a544f399f4b8388dafa8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.035504 26602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6347ad743533454ea66d429fb6ad2cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.038786 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209555b832274fa58305de6823f1cdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.043541 26608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5fdda28ecb4f6eb1005d44adf02df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.047529 26607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9e3b2adae348278cc8dd0360b9583a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:28.097353 26743 tablet_bootstrap.cc:492] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.123703 26744 tablet_bootstrap.cc:492] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.126793 26743 tablet_bootstrap.cc:654] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.144604 26744 tablet_bootstrap.cc:654] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.135128 26745 tablet_bootstrap.cc:492] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.170697 26744 tablet_bootstrap.cc:492] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.171345 26744 ts_tablet_manager.cc:1397] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.012s
I20260811 16:09:28.174314 26745 tablet_bootstrap.cc:654] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.174770 26744 raft_consensus.cc:348] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.175670 26744 raft_consensus.cc:374] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.175968 26744 raft_consensus.cc:729] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.176599 26743 tablet_bootstrap.cc:492] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.177234 26743 ts_tablet_manager.cc:1397] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.000s
I20260811 16:09:28.176903 26744 consensus_queue.cc:260] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.180382 26650 heartbeater.cc:503] Master 127.12.23.254:42807 was elected leader, sending a full tablet report...
I20260811 16:09:28.180541 26745 tablet_bootstrap.cc:492] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.181124 26745 ts_tablet_manager.cc:1397] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.008s
I20260811 16:09:28.181453 26744 ts_tablet_manager.cc:1428] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260811 16:09:28.181011 26743 raft_consensus.cc:348] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.182251 26743 raft_consensus.cc:374] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.182621 26743 raft_consensus.cc:729] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.182869 26744 tablet_bootstrap.cc:492] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.183642 26743 consensus_queue.cc:260] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.185276 26745 raft_consensus.cc:348] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.186642 26745 raft_consensus.cc:374] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.186954 26745 raft_consensus.cc:729] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.187955 26745 consensus_queue.cc:260] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.191023 26744 tablet_bootstrap.cc:654] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.194936 26745 ts_tablet_manager.cc:1428] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.010s
I20260811 16:09:28.195966 26727 heartbeater.cc:503] Master 127.12.23.254:42807 was elected leader, sending a full tablet report...
I20260811 16:09:28.210016 26745 tablet_bootstrap.cc:492] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.212144 26744 tablet_bootstrap.cc:492] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.213104 26744 ts_tablet_manager.cc:1397] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.015s
I20260811 16:09:28.217440 26745 tablet_bootstrap.cc:654] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.217353 26744 raft_consensus.cc:348] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.218585 26744 raft_consensus.cc:374] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.218927 26744 raft_consensus.cc:729] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.219897 26564 heartbeater.cc:503] Master 127.12.23.254:42807 was elected leader, sending a full tablet report...
I20260811 16:09:28.219810 26744 consensus_queue.cc:260] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.222747 26744 ts_tablet_manager.cc:1428] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260811 16:09:28.223944 26744 tablet_bootstrap.cc:492] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.229879 26743 ts_tablet_manager.cc:1428] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.052s	user 0.015s	sys 0.025s
I20260811 16:09:28.230614 26744 tablet_bootstrap.cc:654] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.230760 26745 tablet_bootstrap.cc:492] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.231304 26743 tablet_bootstrap.cc:492] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.231550 26745 ts_tablet_manager.cc:1397] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260811 16:09:28.235308 26745 raft_consensus.cc:348] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.236202 26745 raft_consensus.cc:374] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.236516 26745 raft_consensus.cc:729] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.237423 26745 consensus_queue.cc:260] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.240115 26743 tablet_bootstrap.cc:654] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.240422 26745 ts_tablet_manager.cc:1428] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260811 16:09:28.241716 26745 tablet_bootstrap.cc:492] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.250345 26745 tablet_bootstrap.cc:654] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.250965 26744 tablet_bootstrap.cc:492] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.251845 26744 ts_tablet_manager.cc:1397] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.007s
I20260811 16:09:28.255998 26744 raft_consensus.cc:348] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.257045 26744 raft_consensus.cc:374] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.257340 26744 raft_consensus.cc:729] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.259615 26744 consensus_queue.cc:260] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.261956 26743 tablet_bootstrap.cc:492] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.262190 26744 ts_tablet_manager.cc:1428] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260811 16:09:28.262686 26743 ts_tablet_manager.cc:1397] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.007s
I20260811 16:09:28.266079 26745 tablet_bootstrap.cc:492] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.265908 26743 raft_consensus.cc:348] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.266695 26743 raft_consensus.cc:374] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.266729 26745 ts_tablet_manager.cc:1397] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260811 16:09:28.266983 26743 raft_consensus.cc:729] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.267926 26743 consensus_queue.cc:260] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.270103 26743 ts_tablet_manager.cc:1428] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260811 16:09:28.270020 26745 raft_consensus.cc:348] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.271106 26745 raft_consensus.cc:374] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.271504 26745 raft_consensus.cc:729] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.272616 26743 tablet_bootstrap.cc:492] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.272346 26745 consensus_queue.cc:260] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.271174 26744 tablet_bootstrap.cc:492] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.279421 26744 tablet_bootstrap.cc:654] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.280012 26745 ts_tablet_manager.cc:1428] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260811 16:09:28.281412 26745 tablet_bootstrap.cc:492] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.284359 26743 tablet_bootstrap.cc:654] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.288146 26751 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.288749 26751 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.300401 26745 tablet_bootstrap.cc:654] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.302688 26743 tablet_bootstrap.cc:492] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.303489 26743 ts_tablet_manager.cc:1397] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.002s
I20260811 16:09:28.304927 26751 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.307449 26743 raft_consensus.cc:348] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.308540 26743 raft_consensus.cc:374] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.308897 26743 raft_consensus.cc:729] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.310153 26743 consensus_queue.cc:260] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.313295 26743 ts_tablet_manager.cc:1428] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260811 16:09:28.314627 26743 tablet_bootstrap.cc:492] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
W20260811 16:09:28.316919 26477 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:09:28.322263 26743 tablet_bootstrap.cc:654] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.339273 26745 tablet_bootstrap.cc:492] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.340129 26745 ts_tablet_manager.cc:1397] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.009s
I20260811 16:09:28.344764 26745 raft_consensus.cc:348] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.345947 26745 raft_consensus.cc:374] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.346319 26745 raft_consensus.cc:729] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.347388 26745 consensus_queue.cc:260] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.351243 26745 ts_tablet_manager.cc:1428] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260811 16:09:28.352808 26745 tablet_bootstrap.cc:492] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.355772 26751 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.356657 26751 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.362393 26745 tablet_bootstrap.cc:654] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.363597 26751 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.370972 26753 raft_consensus.cc:482] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.371883 26753 raft_consensus.cc:504] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.385144 26753 leader_election.cc:288] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.398291 26744 tablet_bootstrap.cc:492] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.406267 26744 ts_tablet_manager.cc:1397] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.135s	user 0.030s	sys 0.067s
I20260811 16:09:28.408931 26743 tablet_bootstrap.cc:492] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.409665 26743 ts_tablet_manager.cc:1397] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.095s	user 0.041s	sys 0.031s
I20260811 16:09:28.410360 26751 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.411005 26751 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.413285 26743 raft_consensus.cc:348] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.414227 26743 raft_consensus.cc:374] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.414490 26751 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.414563 26743 raft_consensus.cc:729] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.416252 26743 consensus_queue.cc:260] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.418605 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.419965 26536 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.419086 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.421412 26535 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.423295 26581 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.420568 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.424605 26581 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.424794 26534 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.425937 26745 tablet_bootstrap.cc:492] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.426522 26745 ts_tablet_manager.cc:1397] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.050s
I20260811 16:09:28.426488 26751 raft_consensus.cc:2781] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.427300 26751 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.427779 26751 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.430016 26745 raft_consensus.cc:348] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.430976 26745 raft_consensus.cc:374] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.431327 26745 raft_consensus.cc:729] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.432205 26745 consensus_queue.cc:260] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.434810 26745 ts_tablet_manager.cc:1428] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260811 16:09:28.414940 26744 raft_consensus.cc:348] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.436019 26744 raft_consensus.cc:374] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.436324 26744 raft_consensus.cc:729] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.437151 26744 consensus_queue.cc:260] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.438796 26743 ts_tablet_manager.cc:1428] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260811 16:09:28.439993 26743 tablet_bootstrap.cc:492] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.441133 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.441993 26700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.442376 26581 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.442863 26700 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.444366 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.445652 26770 raft_consensus.cc:2781] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.446434 26753 raft_consensus.cc:482] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.451719 26771 raft_consensus.cc:2781] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.451656 26753 raft_consensus.cc:504] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.454391 26753 leader_election.cc:288] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.449677 26744 ts_tablet_manager.cc:1428] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.006s
W20260811 16:09:28.455806 26577 leader_election.cc:341] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.450328 26745 tablet_bootstrap.cc:492] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.442082 26701 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.458860 26770 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.459376 26770 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.460599 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.461005 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
W20260811 16:09:28.462790 26667 leader_election.cc:341] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.456197 26744 tablet_bootstrap.cc:492] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
W20260811 16:09:28.463726 26667 leader_election.cc:341] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.452324 26771 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.465597 26771 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.450560 26751 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.446771 26743 tablet_bootstrap.cc:654] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.470988 26744 tablet_bootstrap.cc:654] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.473618 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:28.474332 26745 tablet_bootstrap.cc:654] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.474387 26535 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.478569 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.479694 26623 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 0.
I20260811 16:09:28.481230 26771 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.483279 26664 leader_election.cc:302] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:28.485146 26753 raft_consensus.cc:2781] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.485741 26753 raft_consensus.cc:482] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.486156 26753 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.486968 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:28.488215 26534 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.481456 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.489109 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:28.489931 26751 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
W20260811 16:09:28.490631 26664 leader_election.cc:341] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.491195 26664 leader_election.cc:302] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
W20260811 16:09:28.491910 26577 leader_election.cc:341] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.492270 26771 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.485212 26535 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.497172 26581 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.498729 26745 tablet_bootstrap.cc:492] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.493893 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:28.499569 26745 ts_tablet_manager.cc:1397] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.015s
I20260811 16:09:28.500025 26701 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.504647 26745 raft_consensus.cc:348] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.506286 26745 raft_consensus.cc:374] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.506714 26745 raft_consensus.cc:729] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.509155 26770 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.513620 26776 raft_consensus.cc:2726] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:28.514957 26745 consensus_queue.cc:260] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.516022 26743 tablet_bootstrap.cc:492] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.512446 26771 raft_consensus.cc:2781] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.516597 26743 ts_tablet_manager.cc:1397] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.015s
I20260811 16:09:28.516978 26753 raft_consensus.cc:504] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.517628 26771 raft_consensus.cc:686] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:28.520512 26771 consensus_queue.cc:237] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.520512 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:28.522718 26534 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.524044 26581 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:28.521845 26743 raft_consensus.cc:348] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.525425 26743 raft_consensus.cc:374] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.525610 26751 raft_consensus.cc:2781] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.525740 26743 raft_consensus.cc:729] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.526235 26751 raft_consensus.cc:686] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:28.526614 26743 consensus_queue.cc:260] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.527211 26751 consensus_queue.cc:237] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.529222 26743 ts_tablet_manager.cc:1428] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260811 16:09:28.530017 26535 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.530355 26743 tablet_bootstrap.cc:492] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.532423 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:28.532847 26770 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.533169 26536 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.521828 26701 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.537990 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:28.538343 26743 tablet_bootstrap.cc:654] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.538863 26622 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.539184 26744 tablet_bootstrap.cc:492] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.539819 26744 ts_tablet_manager.cc:1397] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.006s
I20260811 16:09:28.543118 26752 raft_consensus.cc:482] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.543772 26752 raft_consensus.cc:504] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.546821 26752 leader_election.cc:288] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.551035 26622 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:28.551729 26753 leader_election.cc:288] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.559521 26664 leader_election.cc:302] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:28.560729 26745 ts_tablet_manager.cc:1428] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.003s
I20260811 16:09:28.563272 26745 tablet_bootstrap.cc:492] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.551272 26743 tablet_bootstrap.cc:492] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.557969 26535 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:28.565513 26743 ts_tablet_manager.cc:1397] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.003s
I20260811 16:09:28.561096 26536 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.561255 26753 raft_consensus.cc:2781] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.553930 26744 raft_consensus.cc:348] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.569132 26581 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.569479 26744 raft_consensus.cc:374] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.569862 26744 raft_consensus.cc:729] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.568989 26743 raft_consensus.cc:348] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.570744 26743 raft_consensus.cc:374] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.571096 26743 raft_consensus.cc:729] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.570798 26744 consensus_queue.cc:260] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.571193 26776 raft_consensus.cc:482] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.571593 26753 raft_consensus.cc:686] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:28.572041 26776 raft_consensus.cc:504] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.572106 26743 consensus_queue.cc:260] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.572947 26753 consensus_queue.cc:237] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.561607 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:28.575086 26743 ts_tablet_manager.cc:1428] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260811 16:09:28.575481 26701 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.576398 26776 leader_election.cc:288] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.576990 26751 raft_consensus.cc:2781] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.578080 26751 raft_consensus.cc:686] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:28.578950 26744 ts_tablet_manager.cc:1428] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260811 16:09:28.579120 26751 consensus_queue.cc:237] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.580209 26744 tablet_bootstrap.cc:492] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.576529 26743 tablet_bootstrap.cc:492] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.586465 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.594915 26418 catalog_manager.cc:5495] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:28.600122 26744 tablet_bootstrap.cc:654] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.600157 26743 tablet_bootstrap.cc:654] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.600837 26745 tablet_bootstrap.cc:654] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.588119 26622 raft_consensus.cc:2454] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 0.
I20260811 16:09:28.596891 26701 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.609104 26664 leader_election.cc:302] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:28.612138 26777 raft_consensus.cc:2781] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.612910 26777 raft_consensus.cc:482] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.613370 26777 raft_consensus.cc:3037] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.616704 26752 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.616626 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.617679 26752 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
W20260811 16:09:28.620741 26667 leader_election.cc:341] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.621932 26752 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.620741 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.623379 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
W20260811 16:09:28.625869 26496 leader_election.cc:341] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:09:28.627077 26496 leader_election.cc:341] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.642616 26744 tablet_bootstrap.cc:492] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.634845 26419 catalog_manager.cc:5495] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:28.643345 26744 ts_tablet_manager.cc:1397] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.010s
I20260811 16:09:28.646461 26744 raft_consensus.cc:348] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.647290 26744 raft_consensus.cc:374] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.647596 26744 raft_consensus.cc:729] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.648455 26744 consensus_queue.cc:260] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.650137 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.650259 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.651180 26744 ts_tablet_manager.cc:1428] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260811 16:09:28.652149 26496 leader_election.cc:341] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.652387 26744 tablet_bootstrap.cc:492] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.652720 26496 leader_election.cc:302] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
W20260811 16:09:28.654219 26496 leader_election.cc:341] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.654662 26496 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:28.655314 26752 raft_consensus.cc:2726] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:28.656335 26752 raft_consensus.cc:2726] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:28.658566 26777 raft_consensus.cc:504] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.663681 26777 leader_election.cc:288] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.664376 26744 tablet_bootstrap.cc:654] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.665094 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:28.666050 26623 raft_consensus.cc:3037] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.666388 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
W20260811 16:09:28.668403 26667 leader_election.cc:341] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:28.673249 26743 tablet_bootstrap.cc:492] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.674135 26743 ts_tablet_manager.cc:1397] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.008s
I20260811 16:09:28.674206 26745 tablet_bootstrap.cc:492] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.674963 26745 ts_tablet_manager.cc:1397] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.000s
I20260811 16:09:28.678887 26744 tablet_bootstrap.cc:492] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.679550 26744 ts_tablet_manager.cc:1397] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.006s
I20260811 16:09:28.677759 26743 raft_consensus.cc:348] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.680295 26743 raft_consensus.cc:374] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.680624 26743 raft_consensus.cc:729] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.681489 26743 consensus_queue.cc:260] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.682632 26744 raft_consensus.cc:348] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.683616 26744 raft_consensus.cc:374] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.683907 26744 raft_consensus.cc:729] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.684660 26623 raft_consensus.cc:2454] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:28.684795 26744 consensus_queue.cc:260] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.686035 26664 leader_election.cc:302] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:28.687467 26777 raft_consensus.cc:2781] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.687703 26743 ts_tablet_manager.cc:1428] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260811 16:09:28.687978 26744 ts_tablet_manager.cc:1428] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260811 16:09:28.688205 26777 raft_consensus.cc:686] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:28.688977 26743 tablet_bootstrap.cc:492] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.689076 26744 tablet_bootstrap.cc:492] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.689340 26777 consensus_queue.cc:237] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.681912 26745 raft_consensus.cc:348] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.694129 26745 raft_consensus.cc:374] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.694479 26745 raft_consensus.cc:729] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.695546 26745 consensus_queue.cc:260] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.696317 26744 tablet_bootstrap.cc:654] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.696426 26743 tablet_bootstrap.cc:654] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.698884 26745 ts_tablet_manager.cc:1428] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260811 16:09:28.700044 26745 tablet_bootstrap.cc:492] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.710289 26743 tablet_bootstrap.cc:492] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.710320 26744 tablet_bootstrap.cc:492] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.710680 26745 tablet_bootstrap.cc:654] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.711129 26744 ts_tablet_manager.cc:1397] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260811 16:09:28.712301 26417 catalog_manager.cc:5495] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:28.714339 26744 raft_consensus.cc:348] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.715178 26744 raft_consensus.cc:374] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.715463 26744 raft_consensus.cc:729] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.714705 26417 catalog_manager.cc:5495] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:28.711129 26743 ts_tablet_manager.cc:1397] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260811 16:09:28.716313 26744 consensus_queue.cc:260] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.716845 26745 tablet_bootstrap.cc:492] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.718691 26744 ts_tablet_manager.cc:1428] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260811 16:09:28.719769 26744 tablet_bootstrap.cc:492] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:28.721730 26743 raft_consensus.cc:348] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.722643 26743 raft_consensus.cc:374] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.722995 26743 raft_consensus.cc:729] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.723909 26743 consensus_queue.cc:260] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.725370 26744 tablet_bootstrap.cc:654] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.725875 26745 ts_tablet_manager.cc:1397] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.006s
I20260811 16:09:28.728870 26745 raft_consensus.cc:348] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.729594 26745 raft_consensus.cc:374] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.729864 26745 raft_consensus.cc:729] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.730644 26745 consensus_queue.cc:260] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.732614 26743 ts_tablet_manager.cc:1428] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260811 16:09:28.733212 26745 ts_tablet_manager.cc:1428] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260811 16:09:28.732822 26419 catalog_manager.cc:5495] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:28.734251 26745 tablet_bootstrap.cc:492] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:28.734351 26743 tablet_bootstrap.cc:492] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:28.737052 26744 tablet_bootstrap.cc:492] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:28.737672 26744 ts_tablet_manager.cc:1397] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260811 16:09:28.785578 26743 tablet_bootstrap.cc:654] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.786751 26745 tablet_bootstrap.cc:654] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:28.786465 26744 raft_consensus.cc:348] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.788219 26744 raft_consensus.cc:374] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.788552 26744 raft_consensus.cc:729] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.790356 26744 consensus_queue.cc:260] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.795542 26744 ts_tablet_manager.cc:1428] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.007s
I20260811 16:09:28.798563 26745 tablet_bootstrap.cc:492] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:28.799219 26745 ts_tablet_manager.cc:1397] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.006s
I20260811 16:09:28.799263 26743 tablet_bootstrap.cc:492] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:28.799842 26743 ts_tablet_manager.cc:1397] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.005s
I20260811 16:09:28.801576 26745 raft_consensus.cc:348] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.802217 26745 raft_consensus.cc:374] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.802381 26745 raft_consensus.cc:729] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.802986 26745 consensus_queue.cc:260] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.803443 26752 raft_consensus.cc:482] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.804085 26752 raft_consensus.cc:504] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.805100 26743 raft_consensus.cc:348] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.805876 26743 raft_consensus.cc:374] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:28.806129 26743 raft_consensus.cc:729] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:28.806279 26752 leader_election.cc:288] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.806813 26743 consensus_queue.cc:260] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.808573 26743 ts_tablet_manager.cc:1428] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260811 16:09:28.809618 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.809664 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.810542 26699 raft_consensus.cc:2454] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:28.810889 26745 ts_tablet_manager.cc:1428] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260811 16:09:28.810926 26623 raft_consensus.cc:2454] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:28.811786 26496 leader_election.cc:302] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.812682 26752 raft_consensus.cc:2781] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.813089 26752 raft_consensus.cc:482] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.813551 26752 raft_consensus.cc:3037] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.822712 26752 raft_consensus.cc:504] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.825731 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:28.826453 26623 raft_consensus.cc:3037] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.827047 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:28.827811 26699 raft_consensus.cc:3037] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.827941 26752 leader_election.cc:288] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.834798 26623 raft_consensus.cc:2454] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:28.836241 26496 leader_election.cc:302] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.836422 26699 raft_consensus.cc:2454] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:28.837215 26752 raft_consensus.cc:2781] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.838469 26752 raft_consensus.cc:686] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:28.839816 26752 consensus_queue.cc:237] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.847697 26418 catalog_manager.cc:5495] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 0 to 1, leader changed from <none> to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 1 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:28.861526 26777 raft_consensus.cc:482] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.862219 26777 raft_consensus.cc:504] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.864130 26777 leader_election.cc:288] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.865231 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.865289 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.865969 26535 raft_consensus.cc:2454] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 0.
I20260811 16:09:28.866098 26623 raft_consensus.cc:2454] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 0.
I20260811 16:09:28.867210 26667 leader_election.cc:302] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.867952 26777 raft_consensus.cc:2781] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.868384 26777 raft_consensus.cc:482] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.868651 26777 raft_consensus.cc:3037] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.874558 26777 raft_consensus.cc:504] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.876252 26777 leader_election.cc:288] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:28.877180 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:28.877328 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:28.877888 26535 raft_consensus.cc:3037] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.877952 26623 raft_consensus.cc:3037] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.883912 26623 raft_consensus.cc:2454] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:28.884054 26535 raft_consensus.cc:2454] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:28.885136 26664 leader_election.cc:302] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:28.885933 26777 raft_consensus.cc:2781] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.886566 26777 raft_consensus.cc:686] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:28.887480 26777 consensus_queue.cc:237] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.895869 26418 catalog_manager.cc:5495] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:28.903470 26751 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.904101 26751 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.904525 26771 consensus_queue.cc:1035] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:28.906327 26751 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.907490 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:28.907887 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:28.908236 26699 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.908790 26536 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:28.909494 26577 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:28.910291 26751 raft_consensus.cc:2781] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.910704 26751 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:28.911067 26751 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.919589 26751 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.922554 26751 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.923820 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:28.923861 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:28.924670 26536 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.925042 26699 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.931937 26699 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.933490 26577 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:28.933804 26536 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:28.934669 26751 raft_consensus.cc:2781] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:28.935213 26751 raft_consensus.cc:686] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:28.936124 26751 consensus_queue.cc:237] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.943792 26751 consensus_queue.cc:1035] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:28.946332 26418 catalog_manager.cc:5495] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:28.968931 26751 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:28.979256 26699 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:28.988279 26770 consensus_queue.cc:1035] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:28.992313 26752 raft_consensus.cc:482] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:28.992357 26770 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:28.993152 26752 raft_consensus.cc:504] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:28.995555 26752 leader_election.cc:288] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:28.996825 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:28.997618 26623 raft_consensus.cc:2454] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:28.998647 26496 leader_election.cc:302] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:28.999524 26752 raft_consensus.cc:2781] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:28.999298 26700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:29.000005 26752 raft_consensus.cc:482] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:29.000219 26700 raft_consensus.cc:2454] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:29.000447 26752 raft_consensus.cc:3037] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:29.000419 26770 consensus_queue.cc:1035] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:29.006847 26777 consensus_queue.cc:1035] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:29.021688 26752 raft_consensus.cc:504] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.030687 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:29.031025 26752 leader_election.cc:288] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:29.031487 26623 raft_consensus.cc:3037] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:29.031317 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:29.032255 26701 raft_consensus.cc:3037] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:29.038398 26776 consensus_queue.cc:1035] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:29.041802 26701 raft_consensus.cc:2454] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:29.045632 26496 leader_election.cc:302] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:29.055814 26752 raft_consensus.cc:2781] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:29.057447 26752 raft_consensus.cc:686] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:29.058367 26752 consensus_queue.cc:237] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.077679 26623 raft_consensus.cc:2454] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:29.082772 26416 catalog_manager.cc:5495] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 0 to 1, leader changed from <none> to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 1 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:29.093843 26776 consensus_queue.cc:1035] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.105053 26536 raft_consensus.cc:3037] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:29.117643 26776 consensus_queue.cc:1035] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.253571 26752 consensus_queue.cc:1035] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.265973 26806 consensus_queue.cc:1035] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:29.333926 26770 consensus_queue.cc:1035] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.347391 26623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:47426
I20260811 16:09:29.348229 26623 raft_consensus.cc:595] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Received request to transfer leadership to TS eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:29.349252 26771 consensus_queue.cc:1035] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:29.352371 26776 consensus_queue.cc:1035] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.360555 26623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "935f4268d9e142ee8898807670bce390"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:47426
I20260811 16:09:29.361281 26623 raft_consensus.cc:595] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Received request to transfer leadership to TS eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:29.368307 26623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:47426
I20260811 16:09:29.369005 26623 raft_consensus.cc:595] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Received request to transfer leadership to TS eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:29.373989 26776 consensus_queue.cc:1035] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.385849 26771 raft_consensus.cc:979] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:29.386394 26771 raft_consensus.cc:1067] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Signalling peer eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:29.388324 26536 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:52426
I20260811 16:09:29.389015 26536 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:29.389407 26536 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.399226 26536 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.399889 26699 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c754107e751346fab70e92236998beb8"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
mode: GRACEFUL
new_leader_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:38498
I20260811 16:09:29.400650 26699 raft_consensus.cc:595] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Received request to transfer leadership to TS 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:29.401503 26536 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:29.402743 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:29.403251 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:29.403569 26623 raft_consensus.cc:3032] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:29.403935 26699 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.404119 26623 raft_consensus.cc:729] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:29.405261 26623 consensus_queue.cc:260] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.406793 26623 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.412237 26699 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:29.413932 26496 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:29.414832 26806 raft_consensus.cc:2781] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:29.415383 26806 raft_consensus.cc:686] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:29.415524 26623 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:29.416352 26806 consensus_queue.cc:237] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.424782 26536 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
mode: GRACEFUL
new_leader_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:52434
I20260811 16:09:29.425506 26536 raft_consensus.cc:595] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Received request to transfer leadership to TS 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:29.425218 26418 catalog_manager.cc:5495] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 1 to 2, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 2 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:29.432225 26699 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "209555b832274fa58305de6823f1cdd6"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
mode: GRACEFUL
new_leader_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:38498
I20260811 16:09:29.432924 26699 raft_consensus.cc:595] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Received request to transfer leadership to TS 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:29.439121 26699 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
mode: GRACEFUL
new_leader_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:38498
I20260811 16:09:29.439736 26699 raft_consensus.cc:595] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Received request to transfer leadership to TS 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:29.445137 26623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:47426
I20260811 16:09:29.445835 26623 raft_consensus.cc:595] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Received request to transfer leadership to TS 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:29.450021 26806 consensus_queue.cc:1035] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:29.463111 26836 consensus_queue.cc:1035] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:29.477340 26753 raft_consensus.cc:979] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: : Instructing follower 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:29.477839 26776 raft_consensus.cc:1067] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Signalling peer 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:29.479619 26623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "209555b832274fa58305de6823f1cdd6"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:47412
I20260811 16:09:29.480317 26623 raft_consensus.cc:482] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:29.480643 26623 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.487489 26623 raft_consensus.cc:504] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.489310 26623 leader_election.cc:288] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:29.490262 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:29.490530 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:29.490989 26536 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.491251 26699 raft_consensus.cc:3032] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:29.491653 26699 raft_consensus.cc:729] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:29.492372 26699 consensus_queue.cc:260] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.493481 26699 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.497493 26536 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:29.499024 26581 leader_election.cc:302] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:29.499852 26699 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:29.500030 26751 raft_consensus.cc:2781] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:29.500669 26751 raft_consensus.cc:686] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:29.501452 26751 consensus_queue.cc:237] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.508525 26418 catalog_manager.cc:5495] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 1 to 2, leader changed from 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195) to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:29.541484 26753 raft_consensus.cc:979] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: : Instructing follower 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:29.542006 26776 raft_consensus.cc:1067] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Signalling peer 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:29.543560 26623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:47412
I20260811 16:09:29.544158 26623 raft_consensus.cc:482] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:29.544433 26623 raft_consensus.cc:3037] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.550203 26623 raft_consensus.cc:504] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.552013 26623 leader_election.cc:288] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:29.553084 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:29.553058 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:29.554021 26699 raft_consensus.cc:3032] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:29.554072 26536 raft_consensus.cc:3037] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.554479 26699 raft_consensus.cc:729] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:29.555426 26699 consensus_queue.cc:260] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.556895 26699 raft_consensus.cc:3037] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.562451 26536 raft_consensus.cc:2454] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:29.563987 26581 leader_election.cc:302] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:29.564431 26699 raft_consensus.cc:2454] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:29.564771 26751 raft_consensus.cc:2781] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:29.565335 26751 raft_consensus.cc:686] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:29.566226 26751 consensus_queue.cc:237] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.573510 26418 catalog_manager.cc:5495] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 1 to 2, leader changed from 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195) to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:29.652948 26772 raft_consensus.cc:979] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:29.653486 26751 raft_consensus.cc:1067] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Signalling peer eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:29.655004 26536 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:52426
I20260811 16:09:29.655568 26536 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:29.655900 26536 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.661590 26536 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.663437 26536 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:29.664495 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:29.664703 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:29.665154 26623 raft_consensus.cc:3032] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:29.665340 26699 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.665508 26623 raft_consensus.cc:729] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:29.666378 26623 consensus_queue.cc:260] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.667514 26623 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.719570 26699 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:29.681354 26623 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:29.780638 26496 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:29.781867 26806 raft_consensus.cc:2781] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:29.782428 26806 raft_consensus.cc:686] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:29.783394 26806 consensus_queue.cc:237] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.861579 26622 raft_consensus.cc:1261] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:29.863240 26806 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:29.897274 26772 raft_consensus.cc:979] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:29.897871 26751 raft_consensus.cc:1067] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Signalling peer 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:29.901484 26700 raft_consensus.cc:1261] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:29.903596 26806 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:29.906023 26701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:38474
I20260811 16:09:29.906615 26701 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:29.906926 26701 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.916062 26701 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.918799 26701 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:29.965358 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:29.966861 26622 raft_consensus.cc:3032] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:29.968477 26622 raft_consensus.cc:729] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:29.969594 26622 consensus_queue.cc:260] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:29.971290 26622 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.972138 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:29.972877 26536 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:29.973202 26535 raft_consensus.cc:1261] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:29.975739 26839 consensus_queue.cc:1035] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:29.985111 26701 raft_consensus.cc:1261] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:29.988554 26839 consensus_queue.cc:1035] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:29.993285 26536 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 2.
I20260811 16:09:29.994807 26667 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:29.987118 26622 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 2.
I20260811 16:09:30.000573 26840 raft_consensus.cc:2781] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:30.001128 26840 raft_consensus.cc:686] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:30.002236 26751 raft_consensus.cc:979] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:30.003026 26751 raft_consensus.cc:1067] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Signalling peer eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:30.002640 26840 consensus_queue.cc:237] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.005497 26534 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "935f4268d9e142ee8898807670bce390"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:52426
I20260811 16:09:30.006174 26534 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:30.006336 26536 raft_consensus.cc:1261] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.006690 26534 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.008095 26839 consensus_queue.cc:1035] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.009646 26836 raft_consensus.cc:979] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: : Instructing follower 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:30.015574 26806 raft_consensus.cc:1067] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Signalling peer 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:30.014792 26534 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.020953 26623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:47422
I20260811 16:09:30.021680 26623 raft_consensus.cc:482] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:30.022114 26623 raft_consensus.cc:3037] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.026552 26840 raft_consensus.cc:979] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: : Instructing follower 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:30.027132 26776 raft_consensus.cc:1067] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Signalling peer 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:30.028257 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:30.029451 26622 raft_consensus.cc:3032] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:30.029618 26621 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c754107e751346fab70e92236998beb8"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:47412
I20260811 16:09:30.030344 26621 raft_consensus.cc:482] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:30.030701 26621 raft_consensus.cc:3037] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.017695 26534 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:30.029768 26622 raft_consensus.cc:729] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:30.034605 26622 consensus_queue.cc:260] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.036038 26622 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.037343 26698 raft_consensus.cc:1261] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.039093 26771 consensus_queue.cc:1035] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.041337 26621 raft_consensus.cc:504] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.044317 26418 catalog_manager.cc:5495] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 1 to 2, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 2 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:30.047844 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:30.048556 26701 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.048935 26621 leader_election.cc:288] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:30.050455 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:30.051258 26698 raft_consensus.cc:3032] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:30.051607 26698 raft_consensus.cc:729] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:30.052255 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c754107e751346fab70e92236998beb8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:30.052954 26536 raft_consensus.cc:3037] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.052546 26698 consensus_queue.cc:260] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.054049 26698 raft_consensus.cc:3037] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.056321 26623 raft_consensus.cc:504] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.059176 26701 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:30.060525 26496 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:30.060879 26623 leader_election.cc:288] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:30.061700 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:30.062214 26698 raft_consensus.cc:2454] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:30.063235 26836 raft_consensus.cc:2781] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:30.063529 26577 leader_election.cc:302] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:30.063815 26836 raft_consensus.cc:686] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:30.064513 26771 raft_consensus.cc:2781] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:30.065083 26771 raft_consensus.cc:686] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:30.064854 26836 consensus_queue.cc:237] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.066056 26771 consensus_queue.cc:237] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.062398 26699 raft_consensus.cc:3037] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.070528 26416 catalog_manager.cc:5495] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 1 to 2, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 2 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:30.068661 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:30.078462 26534 raft_consensus.cc:3032] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:30.078802 26534 raft_consensus.cc:729] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:30.079718 26534 consensus_queue.cc:260] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.080255 26536 raft_consensus.cc:2454] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:30.046744 26622 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:30.081200 26534 raft_consensus.cc:3037] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:30.077694 26699 raft_consensus.cc:2454] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:30.088436 26577 leader_election.cc:302] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:30.089078 26534 raft_consensus.cc:2454] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:30.089484 26771 raft_consensus.cc:2781] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:30.090090 26771 raft_consensus.cc:686] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:30.089944 26418 catalog_manager.cc:5495] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 1 to 2, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 2 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:30.089670 26417 catalog_manager.cc:5495] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 1 to 2, leader changed from 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195) to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:30.091046 26771 consensus_queue.cc:237] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:30.106026 26418 catalog_manager.cc:5495] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 1 to 2, leader changed from eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193) to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:30.218796 26622 raft_consensus.cc:1261] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.220250 26836 consensus_queue.cc:1035] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.229867 26699 raft_consensus.cc:1261] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.231777 26842 consensus_queue.cc:1035] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:30.429315 26622 raft_consensus.cc:1261] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.431123 26776 consensus_queue.cc:1035] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.441248 26534 raft_consensus.cc:1261] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.443168 26840 consensus_queue.cc:1035] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.451524 26699 raft_consensus.cc:1261] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.452818 26771 consensus_queue.cc:1035] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.462963 26534 raft_consensus.cc:1261] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.464402 26839 consensus_queue.cc:1035] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.484967 26622 raft_consensus.cc:1261] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.486725 26752 consensus_queue.cc:1035] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.496011 26699 raft_consensus.cc:1261] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.498530 26836 consensus_queue.cc:1035] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:30.503664 26534 raft_consensus.cc:1261] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.505293 26839 consensus_queue.cc:1035] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:30.516764 26699 raft_consensus.cc:1261] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:30.518352 26772 consensus_queue.cc:1035] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260811 16:09:30.975896 26723 debug-util.cc:398] Leaking SignalData structure 0x7b0800086500 after lost signal to thread 12388
W20260811 16:09:30.977360 26723 debug-util.cc:398] Leaking SignalData structure 0x7b0800228f40 after lost signal to thread 26459
W20260811 16:09:30.979043 26723 debug-util.cc:398] Leaking SignalData structure 0x7b080027de60 after lost signal to thread 26563
W20260811 16:09:30.980482 26723 debug-util.cc:398] Leaking SignalData structure 0x7b08001beae0 after lost signal to thread 26649
W20260811 16:09:30.981791 26723 debug-util.cc:398] Leaking SignalData structure 0x7b08003e5440 after lost signal to thread 26726
I20260811 16:09:32.558969 12383 test_util.cc:268] Using random seed: -1304408606
I20260811 16:09:32.615746 26416 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38846:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 16:09:32.620318 26416 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:09:32.698526 26518 tablet_service.cc:1467] Processing CreateTablet for tablet 511028f653fd48fb82b71b3d76bd8617 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:32.699121 26607 tablet_service.cc:1467] Processing CreateTablet for tablet 511028f653fd48fb82b71b3d76bd8617 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:32.700973 26518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511028f653fd48fb82b71b3d76bd8617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.701089 26607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511028f653fd48fb82b71b3d76bd8617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.704288 26687 tablet_service.cc:1467] Processing CreateTablet for tablet 511028f653fd48fb82b71b3d76bd8617 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260811 16:09:32.704424 26604 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae0c2ca166849dd9d77f02dd6038eae (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:32.706250 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae0c2ca166849dd9d77f02dd6038eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.706377 26687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511028f653fd48fb82b71b3d76bd8617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.709429 26520 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae0c2ca166849dd9d77f02dd6038eae (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:32.718400 26686 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae0c2ca166849dd9d77f02dd6038eae (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260811 16:09:32.720240 26686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae0c2ca166849dd9d77f02dd6038eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.721292 26605 tablet_service.cc:1467] Processing CreateTablet for tablet 9a22d07c623444568e6a9513e9cc7297 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:32.723124 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a22d07c623444568e6a9513e9cc7297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.725044 26522 tablet_service.cc:1467] Processing CreateTablet for tablet 9a22d07c623444568e6a9513e9cc7297 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:32.728004 26520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae0c2ca166849dd9d77f02dd6038eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.731608 26522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a22d07c623444568e6a9513e9cc7297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.736363 26690 tablet_service.cc:1467] Processing CreateTablet for tablet 9a22d07c623444568e6a9513e9cc7297 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260811 16:09:32.738234 26690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a22d07c623444568e6a9513e9cc7297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.739253 26864 tablet_bootstrap.cc:492] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:32.747344 26864 tablet_bootstrap.cc:654] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:32.748157 26607 tablet_service.cc:1467] Processing CreateTablet for tablet 60076cbaf47641159a21865874adf19b (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:32.749820 26607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60076cbaf47641159a21865874adf19b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.749432 26526 tablet_service.cc:1467] Processing CreateTablet for tablet 60076cbaf47641159a21865874adf19b (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:32.752065 26526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60076cbaf47641159a21865874adf19b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.768636 26609 tablet_service.cc:1467] Processing CreateTablet for tablet 41e776c97435431b839987b1805cb2ac (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:32.770305 26519 tablet_service.cc:1467] Processing CreateTablet for tablet 41e776c97435431b839987b1805cb2ac (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:32.768679 26684 tablet_service.cc:1467] Processing CreateTablet for tablet 60076cbaf47641159a21865874adf19b (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260811 16:09:32.772049 26519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41e776c97435431b839987b1805cb2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.772894 26684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60076cbaf47641159a21865874adf19b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.770366 26609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41e776c97435431b839987b1805cb2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.787384 26691 tablet_service.cc:1467] Processing CreateTablet for tablet 41e776c97435431b839987b1805cb2ac (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260811 16:09:32.789363 26691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41e776c97435431b839987b1805cb2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.793766 26602 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb3fb8487e5488a905109c66faae138 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:32.795635 26602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb3fb8487e5488a905109c66faae138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.803233 26685 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb3fb8487e5488a905109c66faae138 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:32.805274 26685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb3fb8487e5488a905109c66faae138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.809674 26603 tablet_service.cc:1467] Processing CreateTablet for tablet f5b6cda931874bd3b674397f0b23e34f (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:32.811767 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5b6cda931874bd3b674397f0b23e34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.817404 26689 tablet_service.cc:1467] Processing CreateTablet for tablet f5b6cda931874bd3b674397f0b23e34f (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:32.823312 26683 tablet_service.cc:1467] Processing CreateTablet for tablet 73fc1c78e6ad450ba70757a62e634f95 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:32.825232 26689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5b6cda931874bd3b674397f0b23e34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.838635 26605 tablet_service.cc:1467] Processing CreateTablet for tablet 73fc1c78e6ad450ba70757a62e634f95 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:32.845557 26525 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb3fb8487e5488a905109c66faae138 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260811 16:09:32.848163 26525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb3fb8487e5488a905109c66faae138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.848100 26521 tablet_service.cc:1467] Processing CreateTablet for tablet f5b6cda931874bd3b674397f0b23e34f (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260811 16:09:32.849659 26521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5b6cda931874bd3b674397f0b23e34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.855392 26683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fc1c78e6ad450ba70757a62e634f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.856421 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fc1c78e6ad450ba70757a62e634f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.862386 26517 tablet_service.cc:1467] Processing CreateTablet for tablet 73fc1c78e6ad450ba70757a62e634f95 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260811 16:09:32.880182 26517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fc1c78e6ad450ba70757a62e634f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.863111 26523 tablet_service.cc:1467] Processing CreateTablet for tablet b663ae89c86143608a335a4d775f0508 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:32.884187 26523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b663ae89c86143608a335a4d775f0508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:32.944350 26867 tablet_bootstrap.cc:492] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:32.967324 26864 tablet_bootstrap.cc:492] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:32.968380 26864 ts_tablet_manager.cc:1397] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.231s	user 0.010s	sys 0.035s
I20260811 16:09:32.968664 26608 tablet_service.cc:1467] Processing CreateTablet for tablet b663ae89c86143608a335a4d775f0508 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:32.972050 26608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b663ae89c86143608a335a4d775f0508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:33.040024 26864 raft_consensus.cc:348] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.041600 26864 raft_consensus.cc:374] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.042021 26864 raft_consensus.cc:729] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
W20260811 16:09:33.041834 26402 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.194:36691, user_credentials={real_user=slave}} blocked reactor thread for 44506.3us
I20260811 16:09:33.050237 26868 tablet_bootstrap.cc:492] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
W20260811 16:09:33.119481 26405 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.23.193:45659, user_credentials={real_user=slave}} blocked reactor thread for 57090.8us
I20260811 16:09:33.142916 26868 tablet_bootstrap.cc:654] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.043103 26864 consensus_queue.cc:260] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.186479 26864 ts_tablet_manager.cc:1428] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.216s	user 0.004s	sys 0.007s
W20260811 16:09:33.187302 26496 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:36691, user_credentials={real_user=slave}} blocked reactor thread for 90062.6us
I20260811 16:09:33.176980 26867 tablet_bootstrap.cc:654] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.164697 26684 tablet_service.cc:1467] Processing CreateTablet for tablet b663ae89c86143608a335a4d775f0508 (DEFAULT_TABLE table=soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260811 16:09:33.191960 26864 tablet_bootstrap.cc:492] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.200131 26684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b663ae89c86143608a335a4d775f0508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:09:33.238806 26867 tablet_bootstrap.cc:492] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.239576 26867 ts_tablet_manager.cc:1397] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.296s	user 0.010s	sys 0.013s
I20260811 16:09:33.241789 26868 tablet_bootstrap.cc:492] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.242445 26868 ts_tablet_manager.cc:1397] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.193s	user 0.036s	sys 0.018s
I20260811 16:09:33.245576 26868 raft_consensus.cc:348] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.246364 26868 raft_consensus.cc:374] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.246678 26868 raft_consensus.cc:729] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.247380 26867 raft_consensus.cc:348] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.252501 26867 raft_consensus.cc:374] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.240396 26864 tablet_bootstrap.cc:654] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.247622 26868 consensus_queue.cc:260] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.257493 26868 ts_tablet_manager.cc:1428] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260811 16:09:33.257948 26867 raft_consensus.cc:729] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.261619 26867 consensus_queue.cc:260] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.265915 26864 tablet_bootstrap.cc:492] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:33.266618 26864 ts_tablet_manager.cc:1397] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.005s
I20260811 16:09:33.269810 26864 raft_consensus.cc:348] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.270697 26864 raft_consensus.cc:374] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.271023 26864 raft_consensus.cc:729] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.271951 26864 consensus_queue.cc:260] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.273262 26867 ts_tablet_manager.cc:1428] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260811 16:09:33.273837 26868 tablet_bootstrap.cc:492] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.275094 26864 ts_tablet_manager.cc:1428] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260811 16:09:33.282523 26868 tablet_bootstrap.cc:654] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.289534 26867 tablet_bootstrap.cc:492] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.289700 26864 tablet_bootstrap.cc:492] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.290958 26866 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.292927 26866 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.297191 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.298063 26868 tablet_bootstrap.cc:492] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.298874 26868 ts_tablet_manager.cc:1397] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
W20260811 16:09:33.299861 26577 leader_election.cc:341] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.300189 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:33.300390 26866 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
W20260811 16:09:33.302910 26581 leader_election.cc:341] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.303440 26581 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:33.304281 26867 tablet_bootstrap.cc:654] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.305006 26866 raft_consensus.cc:2726] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:33.306135 26866 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.306632 26866 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.310153 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.310679 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:33.310961 26701 raft_consensus.cc:2454] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.309021 26864 tablet_bootstrap.cc:654] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
W20260811 16:09:33.312287 26581 leader_election.cc:341] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.312723 26866 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.313253 26577 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:33.316548 26868 raft_consensus.cc:348] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.317509 26868 raft_consensus.cc:374] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.317847 26868 raft_consensus.cc:729] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.318840 26866 raft_consensus.cc:2781] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.319492 26866 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.319928 26866 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.327764 26864 tablet_bootstrap.cc:492] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:33.328500 26864 ts_tablet_manager.cc:1397] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.009s
I20260811 16:09:33.329834 26866 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.332056 26864 raft_consensus.cc:348] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.333006 26864 raft_consensus.cc:374] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.333132 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:33.333411 26864 raft_consensus.cc:729] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.334406 26867 tablet_bootstrap.cc:492] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
W20260811 16:09:33.334924 26581 leader_election.cc:341] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.335197 26867 ts_tablet_manager.cc:1397] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.046s	user 0.034s	sys 0.004s
I20260811 16:09:33.334446 26864 consensus_queue.cc:260] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.335901 26868 consensus_queue.cc:260] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.338734 26867 raft_consensus.cc:348] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.339772 26867 raft_consensus.cc:374] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.340199 26867 raft_consensus.cc:729] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.341183 26867 consensus_queue.cc:260] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.342021 26752 raft_consensus.cc:482] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.342603 26752 raft_consensus.cc:504] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.343876 26867 ts_tablet_manager.cc:1428] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260811 16:09:33.344862 26752 leader_election.cc:288] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.345024 26867 tablet_bootstrap.cc:492] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.346834 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.347078 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:33.347892 26868 ts_tablet_manager.cc:1428] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
W20260811 16:09:33.348536 26496 leader_election.cc:341] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.349076 26868 tablet_bootstrap.cc:492] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.351497 26866 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
W20260811 16:09:33.354997 26496 leader_election.cc:341] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.355660 26496 leader_election.cc:302] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:33.357594 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:33.358321 26701 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.358997 26868 tablet_bootstrap.cc:654] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.359328 26752 raft_consensus.cc:2726] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:33.371457 26864 ts_tablet_manager.cc:1428] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260811 16:09:33.371587 26868 tablet_bootstrap.cc:492] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.374159 26868 ts_tablet_manager.cc:1397] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.012s
I20260811 16:09:33.377597 26867 tablet_bootstrap.cc:654] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.379347 26864 tablet_bootstrap.cc:492] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.378880 26868 raft_consensus.cc:348] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.379844 26868 raft_consensus.cc:374] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.380173 26868 raft_consensus.cc:729] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.380939 26868 consensus_queue.cc:260] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.382025 26701 raft_consensus.cc:2454] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:33.383780 26868 ts_tablet_manager.cc:1428] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260811 16:09:33.383791 26577 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:33.385064 26868 tablet_bootstrap.cc:492] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.385778 26866 raft_consensus.cc:2781] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.386529 26866 raft_consensus.cc:686] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:33.388211 26866 consensus_queue.cc:237] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.392848 26868 tablet_bootstrap.cc:654] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
W20260811 16:09:33.394212 26477 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260811 16:09:33.409595 26867 tablet_bootstrap.cc:492] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.410421 26867 ts_tablet_manager.cc:1397] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.019s
I20260811 16:09:33.415102 26418 catalog_manager.cc:5495] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:33.416121 26867 raft_consensus.cc:348] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.422675 26864 tablet_bootstrap.cc:654] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.422914 26867 raft_consensus.cc:374] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.427793 26867 raft_consensus.cc:729] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.428612 26868 tablet_bootstrap.cc:492] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.429225 26868 ts_tablet_manager.cc:1397] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.023s
I20260811 16:09:33.428831 26867 consensus_queue.cc:260] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.431808 26867 ts_tablet_manager.cc:1428] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.002s
I20260811 16:09:33.432622 26868 raft_consensus.cc:348] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.433306 26867 tablet_bootstrap.cc:492] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.433537 26868 raft_consensus.cc:374] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.433995 26868 raft_consensus.cc:729] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.435714 26868 consensus_queue.cc:260] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.438958 26864 tablet_bootstrap.cc:492] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:33.439646 26864 ts_tablet_manager.cc:1397] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.007s
I20260811 16:09:33.443123 26868 ts_tablet_manager.cc:1428] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260811 16:09:33.444450 26868 tablet_bootstrap.cc:492] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.448594 26866 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.449354 26866 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.453745 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
W20260811 16:09:33.455919 26581 leader_election.cc:341] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.457413 26866 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.461731 26867 tablet_bootstrap.cc:654] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.462467 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.463974 26699 raft_consensus.cc:2454] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.462397 26864 raft_consensus.cc:348] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.465427 26864 raft_consensus.cc:374] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.465269 26577 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:33.465898 26864 raft_consensus.cc:729] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.466351 26866 raft_consensus.cc:2781] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.467278 26866 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.467811 26866 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.466795 26864 consensus_queue.cc:260] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.470602 26868 tablet_bootstrap.cc:654] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.473277 26864 ts_tablet_manager.cc:1428] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260811 16:09:33.474622 26864 tablet_bootstrap.cc:492] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.480610 26868 tablet_bootstrap.cc:492] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.481297 26868 ts_tablet_manager.cc:1397] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.007s
I20260811 16:09:33.482191 26864 tablet_bootstrap.cc:654] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.484722 26868 raft_consensus.cc:348] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.485646 26868 raft_consensus.cc:374] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.486018 26868 raft_consensus.cc:729] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.487964 26868 consensus_queue.cc:260] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.488088 26866 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.489246 26867 tablet_bootstrap.cc:492] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.489853 26867 ts_tablet_manager.cc:1397] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.005s
I20260811 16:09:33.492236 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:33.493860 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
W20260811 16:09:33.500806 26581 leader_election.cc:341] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.501039 26699 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.494097 26867 raft_consensus.cc:348] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.501552 26867 raft_consensus.cc:374] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.501875 26867 raft_consensus.cc:729] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.502753 26867 consensus_queue.cc:260] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.493635 26752 raft_consensus.cc:482] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.504326 26752 raft_consensus.cc:504] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.504884 26864 tablet_bootstrap.cc:492] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:33.495656 26868 ts_tablet_manager.cc:1428] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260811 16:09:33.505599 26864 ts_tablet_manager.cc:1397] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.002s
I20260811 16:09:33.506424 26868 tablet_bootstrap.cc:492] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.509570 26771 raft_consensus.cc:482] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.506466 26752 leader_election.cc:288] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.509128 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.508002 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:33.510946 26701 raft_consensus.cc:2454] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:33.510114 26771 raft_consensus.cc:504] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.513976 26771 leader_election.cc:288] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.515707 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.516355 26867 ts_tablet_manager.cc:1428] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260811 16:09:33.515374 26496 leader_election.cc:302] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:33.516444 26701 raft_consensus.cc:2454] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.517699 26867 tablet_bootstrap.cc:492] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.517890 26752 raft_consensus.cc:2781] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.519520 26752 raft_consensus.cc:482] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.519881 26752 raft_consensus.cc:3037] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.517904 26577 leader_election.cc:302] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:33.517725 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:33.523990 26534 raft_consensus.cc:2454] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.524500 26870 raft_consensus.cc:482] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.525017 26870 raft_consensus.cc:504] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.526890 26867 tablet_bootstrap.cc:654] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.527297 26870 leader_election.cc:288] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.523747 26771 raft_consensus.cc:2781] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.491132 26866 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.528218 26771 raft_consensus.cc:482] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.528710 26771 raft_consensus.cc:3037] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.529680 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.519567 26868 tablet_bootstrap.cc:654] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
W20260811 16:09:33.531209 26496 leader_election.cc:341] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.528218 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
W20260811 16:09:33.532778 26496 leader_election.cc:341] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.533241 26496 leader_election.cc:302] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:33.534459 26870 raft_consensus.cc:2726] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:33.536847 26699 raft_consensus.cc:2454] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:33.508739 26864 raft_consensus.cc:348] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.539547 26864 raft_consensus.cc:374] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.539865 26864 raft_consensus.cc:729] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.540269 26577 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:33.540723 26864 consensus_queue.cc:260] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.541819 26866 raft_consensus.cc:2781] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.538467 26752 raft_consensus.cc:504] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.543227 26623 raft_consensus.cc:2454] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:33.544765 26771 raft_consensus.cc:504] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.546252 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:33.546947 26701 raft_consensus.cc:3037] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.547330 26771 leader_election.cc:288] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.549472 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:33.550434 26698 raft_consensus.cc:3037] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.552558 26870 raft_consensus.cc:482] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.552345 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:33.553066 26870 raft_consensus.cc:504] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.553591 26534 raft_consensus.cc:3037] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.555961 26870 leader_election.cc:288] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.557216 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:33.558297 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.552345 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:33.559588 26622 raft_consensus.cc:3037] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:09:33.559728 26496 leader_election.cc:341] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
W20260811 16:09:33.564643 26496 leader_election.cc:341] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.565622 26496 leader_election.cc:302] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:33.566821 26870 raft_consensus.cc:2726] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:33.575520 26701 raft_consensus.cc:2454] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:33.575750 26867 tablet_bootstrap.cc:492] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.576570 26867 ts_tablet_manager.cc:1397] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.014s
I20260811 16:09:33.561410 26752 leader_election.cc:288] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.578661 26698 raft_consensus.cc:2454] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:33.582865 26496 leader_election.cc:302] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:33.583530 26867 raft_consensus.cc:348] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.584236 26864 ts_tablet_manager.cc:1428] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260811 16:09:33.597451 26867 raft_consensus.cc:374] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.597832 26867 raft_consensus.cc:729] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.598474 26864 tablet_bootstrap.cc:492] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.598795 26867 consensus_queue.cc:260] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.601755 26867 ts_tablet_manager.cc:1428] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260811 16:09:33.603073 26867 tablet_bootstrap.cc:492] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.605335 26868 tablet_bootstrap.cc:492] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.606102 26868 ts_tablet_manager.cc:1397] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.100s	user 0.037s	sys 0.004s
I20260811 16:09:33.607694 26870 raft_consensus.cc:2781] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.608373 26870 raft_consensus.cc:686] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:33.609367 26870 consensus_queue.cc:237] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.596241 26534 raft_consensus.cc:2454] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:33.610226 26868 raft_consensus.cc:348] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.615442 26868 raft_consensus.cc:374] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.615002 26866 raft_consensus.cc:686] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:33.615934 26868 raft_consensus.cc:729] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.617905 26622 raft_consensus.cc:2454] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:33.620500 26866 consensus_queue.cc:237] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.625732 26867 tablet_bootstrap.cc:654] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.622289 26577 leader_election.cc:302] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:33.627801 26868 consensus_queue.cc:260] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.631412 26893 raft_consensus.cc:2781] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.632004 26893 raft_consensus.cc:686] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:33.635883 26864 tablet_bootstrap.cc:654] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.635737 26893 consensus_queue.cc:237] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.640342 26417 catalog_manager.cc:5495] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 0 to 1, leader changed from <none> to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 1 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:33.677114 26868 ts_tablet_manager.cc:1428] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.004s
I20260811 16:09:33.694834 26868 tablet_bootstrap.cc:492] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.699191 26867 tablet_bootstrap.cc:492] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.700008 26867 ts_tablet_manager.cc:1397] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.040s
I20260811 16:09:33.702164 26418 catalog_manager.cc:5495] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:33.703843 26867 raft_consensus.cc:348] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.704972 26867 raft_consensus.cc:374] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.705386 26867 raft_consensus.cc:729] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.706476 26867 consensus_queue.cc:260] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.709123 26840 raft_consensus.cc:482] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.709662 26840 raft_consensus.cc:504] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.712963 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
W20260811 16:09:33.714473 26667 leader_election.cc:341] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.717309 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
W20260811 16:09:33.719133 26664 leader_election.cc:341] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.719682 26664 leader_election.cc:302] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:33.720757 26840 leader_election.cc:288] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:33.724901 26840 raft_consensus.cc:2726] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:33.727866 26416 catalog_manager.cc:5495] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:33.732635 26867 ts_tablet_manager.cc:1428] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260811 16:09:33.734265 26870 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.736377 26870 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.740768 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:33.743196 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.744222 26698 raft_consensus.cc:2379] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb0248cfd87a403bbda2f551a86e5e3e in current term 1: Already voted for candidate 7f4016f7a11141209b201c76a3c4ac20 in this term.
I20260811 16:09:33.745486 26496 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:33.744405 26870 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.746701 26896 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.748337 26867 tablet_bootstrap.cc:492] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.757252 26867 tablet_bootstrap.cc:654] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.757593 26896 raft_consensus.cc:2726] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:33.759397 26868 tablet_bootstrap.cc:654] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.770561 26864 tablet_bootstrap.cc:492] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:33.771064 26864 ts_tablet_manager.cc:1397] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.173s	user 0.044s	sys 0.064s
I20260811 16:09:33.773241 26896 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.773829 26896 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.774362 26864 raft_consensus.cc:348] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.775188 26864 raft_consensus.cc:374] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.775460 26864 raft_consensus.cc:729] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.776028 26896 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.776237 26864 consensus_queue.cc:260] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.777449 26867 tablet_bootstrap.cc:492] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.778059 26867 ts_tablet_manager.cc:1397] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.004s
I20260811 16:09:33.778498 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:33.779464 26622 raft_consensus.cc:2454] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:33.780974 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.781304 26867 raft_consensus.cc:348] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.782127 26867 raft_consensus.cc:374] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.782411 26867 raft_consensus.cc:729] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.783285 26867 consensus_queue.cc:260] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.783792 26496 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
W20260811 16:09:33.784978 26496 leader_election.cc:341] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.785902 26867 ts_tablet_manager.cc:1428] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260811 16:09:33.786952 26867 tablet_bootstrap.cc:492] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.787616 26864 ts_tablet_manager.cc:1428] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260811 16:09:33.787807 26896 raft_consensus.cc:2781] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.788453 26896 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.788919 26896 raft_consensus.cc:3037] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.793587 26867 tablet_bootstrap.cc:654] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.797134 26864 tablet_bootstrap.cc:492] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.803756 26896 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.806087 26864 tablet_bootstrap.cc:654] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.806187 26867 tablet_bootstrap.cc:492] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.808188 26867 ts_tablet_manager.cc:1397] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260811 16:09:33.811389 26867 raft_consensus.cc:348] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.812235 26867 raft_consensus.cc:374] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.812644 26867 raft_consensus.cc:729] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.813580 26867 consensus_queue.cc:260] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.816115 26867 ts_tablet_manager.cc:1428] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260811 16:09:33.817107 26867 tablet_bootstrap.cc:492] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: Bootstrap starting.
I20260811 16:09:33.821794 26868 tablet_bootstrap.cc:492] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.822467 26868 ts_tablet_manager.cc:1397] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.013s
I20260811 16:09:33.823375 26896 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.824056 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:33.824796 26622 raft_consensus.cc:3037] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.825853 26868 raft_consensus.cc:348] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.826351 26867 tablet_bootstrap.cc:654] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.826741 26868 raft_consensus.cc:374] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.827116 26868 raft_consensus.cc:729] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.828191 26868 consensus_queue.cc:260] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.832818 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:33.835842 26866 raft_consensus.cc:482] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.836655 26866 raft_consensus.cc:504] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
W20260811 16:09:33.837967 26496 leader_election.cc:341] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.843233 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.843423 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:33.844098 26868 ts_tablet_manager.cc:1428] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260811 16:09:33.844185 26534 raft_consensus.cc:2454] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.844189 26698 raft_consensus.cc:2454] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.845937 26581 leader_election.cc:302] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:33.846920 26893 raft_consensus.cc:2781] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.847313 26893 raft_consensus.cc:482] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.847611 26893 raft_consensus.cc:3037] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.844841 26866 leader_election.cc:288] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.845474 26868 tablet_bootstrap.cc:492] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
I20260811 16:09:33.854801 26622 raft_consensus.cc:2454] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
I20260811 16:09:33.856401 26496 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:33.857285 26896 raft_consensus.cc:2781] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.857827 26896 raft_consensus.cc:686] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:33.858762 26896 consensus_queue.cc:237] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.859333 26893 raft_consensus.cc:504] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.863473 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:33.859481 26868 tablet_bootstrap.cc:654] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.864336 26534 raft_consensus.cc:3037] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.869254 26864 tablet_bootstrap.cc:492] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:33.870133 26864 ts_tablet_manager.cc:1397] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.018s
I20260811 16:09:33.873950 26864 raft_consensus.cc:348] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.874378 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:33.875417 26698 raft_consensus.cc:3037] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.874938 26864 raft_consensus.cc:374] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.876055 26864 raft_consensus.cc:729] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.877207 26864 consensus_queue.cc:260] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.881942 26418 catalog_manager.cc:5495] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 0 to 1, leader changed from <none> to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 1 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:33.888001 26893 leader_election.cc:288] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.891798 26698 raft_consensus.cc:2454] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:33.892911 26864 ts_tablet_manager.cc:1428] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.005s
I20260811 16:09:33.893256 26577 leader_election.cc:302] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:33.894219 26893 raft_consensus.cc:2781] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.894697 26893 raft_consensus.cc:686] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:33.896974 26534 raft_consensus.cc:2454] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:33.895624 26893 consensus_queue.cc:237] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.900569 26867 tablet_bootstrap.cc:492] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: No bootstrap required, opened a new log
I20260811 16:09:33.902608 26867 ts_tablet_manager.cc:1397] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.027s
I20260811 16:09:33.905085 26864 tablet_bootstrap.cc:492] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:33.906605 26867 raft_consensus.cc:348] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.907779 26868 tablet_bootstrap.cc:492] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.907807 26867 raft_consensus.cc:374] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.908488 26867 raft_consensus.cc:729] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.908519 26868 ts_tablet_manager.cc:1397] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.009s
I20260811 16:09:33.909241 26901 raft_consensus.cc:482] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.909368 26867 consensus_queue.cc:260] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.909791 26901 raft_consensus.cc:504] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.911182 26867 ts_tablet_manager.cc:1428] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260811 16:09:33.911993 26901 leader_election.cc:288] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:33.912048 26868 raft_consensus.cc:348] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.913923 26868 raft_consensus.cc:374] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.914074 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:33.914916 26534 raft_consensus.cc:2454] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 0.
I20260811 16:09:33.914302 26868 raft_consensus.cc:729] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.916086 26667 leader_election.cc:302] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:33.916728 26868 consensus_queue.cc:260] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.917042 26901 raft_consensus.cc:2781] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.919092 26868 ts_tablet_manager.cc:1428] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260811 16:09:33.918859 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:33.920517 26868 tablet_bootstrap.cc:492] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: Bootstrap starting.
W20260811 16:09:33.922290 26664 leader_election.cc:341] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.917642 26901 raft_consensus.cc:482] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.923803 26901 raft_consensus.cc:3037] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.927786 26868 tablet_bootstrap.cc:654] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:33.929533 26866 consensus_queue.cc:1035] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:33.936614 26866 consensus_queue.cc:1035] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:33.939747 26868 tablet_bootstrap.cc:492] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: No bootstrap required, opened a new log
I20260811 16:09:33.940480 26868 ts_tablet_manager.cc:1397] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260811 16:09:33.943264 26868 raft_consensus.cc:348] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.944169 26868 raft_consensus.cc:374] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:33.944480 26868 raft_consensus.cc:729] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Initialized, Role: FOLLOWER
I20260811 16:09:33.945315 26868 consensus_queue.cc:260] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.945511 26417 catalog_manager.cc:5495] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:33.948086 26868 ts_tablet_manager.cc:1428] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260811 16:09:33.957340 26901 raft_consensus.cc:504] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.960304 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:33.960397 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:33.961175 26535 raft_consensus.cc:3037] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:09:33.962059 26664 leader_election.cc:341] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:33.980134 26866 raft_consensus.cc:482] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:33.980914 26866 raft_consensus.cc:504] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.960954 26901 leader_election.cc:288] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:33.984571 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:33.984797 26535 raft_consensus.cc:2454] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:33.985806 26534 raft_consensus.cc:2454] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:33.987077 26667 leader_election.cc:302] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:33.987802 26581 leader_election.cc:302] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:33.989856 26901 raft_consensus.cc:2781] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:33.991449 26893 raft_consensus.cc:2781] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:33.991822 26901 raft_consensus.cc:686] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:33.994287 26893 raft_consensus.cc:482] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:33.995985 26901 consensus_queue.cc:237] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:33.996706 26893 raft_consensus.cc:3037] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:33.997225 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:33.997715 26866 leader_election.cc:288] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:33.998167 26698 raft_consensus.cc:2454] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 0.
I20260811 16:09:34.006024 26864 tablet_bootstrap.cc:654] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:34.022832 26896 consensus_queue.cc:1035] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.031214 26896 raft_consensus.cc:482] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:34.031747 26896 raft_consensus.cc:504] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.033981 26896 leader_election.cc:288] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.036610 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:34.037621 26701 raft_consensus.cc:2454] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 0.
I20260811 16:09:34.045852 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:34.046072 26496 leader_election.cc:302] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:34.048738 26417 catalog_manager.cc:5495] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 1 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:34.042469 26893 raft_consensus.cc:504] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.052083 26870 raft_consensus.cc:2781] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:09:34.052613 26870 raft_consensus.cc:482] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:09:34.052973 26870 raft_consensus.cc:3037] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.056358 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:34.057196 26536 raft_consensus.cc:3037] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:09:34.052111 26496 leader_election.cc:341] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:34.065941 26866 consensus_queue.cc:1035] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:34.074967 26752 consensus_queue.cc:1035] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.089249 26870 raft_consensus.cc:504] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.093286 26870 leader_election.cc:288] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.094563 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:34.095307 26699 raft_consensus.cc:3037] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.100126 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:34.101312 26699 raft_consensus.cc:2454] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 1.
W20260811 16:09:34.101836 26496 leader_election.cc:341] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260811 16:09:34.102666 26496 leader_election.cc:302] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:34.102756 26536 raft_consensus.cc:2454] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:34.104389 26870 raft_consensus.cc:2781] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:34.104247 26581 leader_election.cc:302] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:34.105000 26870 raft_consensus.cc:686] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:34.105698 26891 raft_consensus.cc:2781] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:09:34.106266 26891 raft_consensus.cc:686] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:34.105929 26870 consensus_queue.cc:237] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.107097 26891 consensus_queue.cc:237] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.109977 26535 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.118816 26864 tablet_bootstrap.cc:492] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:34.119664 26864 ts_tablet_manager.cc:1397] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.215s	user 0.013s	sys 0.007s
I20260811 16:09:34.123418 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:34.124359 26701 raft_consensus.cc:3037] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.127319 26890 consensus_queue.cc:1035] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.141659 26893 leader_election.cc:288] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.147826 26864 raft_consensus.cc:348] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.149183 26864 raft_consensus.cc:374] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:34.149556 26864 raft_consensus.cc:729] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:34.150599 26864 consensus_queue.cc:260] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.156190 26893 consensus_queue.cc:1035] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:34.168601 26864 ts_tablet_manager.cc:1428] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260811 16:09:34.154080 26701 raft_consensus.cc:2454] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:34.176165 26890 consensus_queue.cc:1035] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.190847 26417 catalog_manager.cc:5495] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 1 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:34.204803 26418 catalog_manager.cc:5495] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 0 to 1, leader changed from <none> to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 1 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:34.205801 26864 tablet_bootstrap.cc:492] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: Bootstrap starting.
I20260811 16:09:34.217322 26864 tablet_bootstrap.cc:654] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: Neither blocks nor log segments found. Creating new log.
I20260811 16:09:34.243458 26864 tablet_bootstrap.cc:492] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: No bootstrap required, opened a new log
I20260811 16:09:34.244007 26864 ts_tablet_manager.cc:1397] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.010s
I20260811 16:09:34.246675 26864 raft_consensus.cc:348] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.247431 26864 raft_consensus.cc:374] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:09:34.247751 26864 raft_consensus.cc:729] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Initialized, Role: FOLLOWER
I20260811 16:09:34.248394 26864 consensus_queue.cc:260] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.250334 26864 ts_tablet_manager.cc:1428] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260811 16:09:34.266610 26890 raft_consensus.cc:482] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:34.267089 26890 raft_consensus.cc:504] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.269002 26890 leader_election.cc:288] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.269817 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:34.270198 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:34.271279 26701 raft_consensus.cc:2379] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f4016f7a11141209b201c76a3c4ac20 in current term 1: Already voted for candidate eb0248cfd87a403bbda2f551a86e5e3e in this term.
I20260811 16:09:34.272420 26577 leader_election.cc:302] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:34.273270 26893 raft_consensus.cc:3037] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.282426 26893 raft_consensus.cc:2726] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:34.287108 26901 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:34.287803 26901 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.289752 26901 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:34.290609 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:34.290930 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:34.292070 26623 raft_consensus.cc:2379] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 624a7a5cb3ee439a8bc640b2184c8c56 in current term 1: Already voted for candidate eb0248cfd87a403bbda2f551a86e5e3e in this term.
I20260811 16:09:34.293231 26664 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:34.294179 26901 raft_consensus.cc:3037] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.300493 26901 raft_consensus.cc:2726] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:34.361505 26893 raft_consensus.cc:482] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:34.362370 26893 raft_consensus.cc:504] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.364832 26893 leader_election.cc:288] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.365517 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:34.365518 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:34.367408 26534 raft_consensus.cc:2379] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f4016f7a11141209b201c76a3c4ac20 in current term 1: Already voted for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in this term.
I20260811 16:09:34.368382 26581 leader_election.cc:302] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:34.369072 26893 raft_consensus.cc:3037] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:09:34.374919 26893 raft_consensus.cc:2726] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:09:34.420197 26870 consensus_queue.cc:1035] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.428375 26623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:47426
I20260811 16:09:34.429153 26623 raft_consensus.cc:595] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Received request to transfer leadership to TS eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:34.442287 26699 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
mode: GRACEFUL
new_leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:38498
I20260811 16:09:34.442302 26896 consensus_queue.cc:1035] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.442968 26699 raft_consensus.cc:595] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Received request to transfer leadership to TS eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:34.456374 26893 consensus_queue.cc:1035] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:34.459092 26622 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "60076cbaf47641159a21865874adf19b"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:47426
I20260811 16:09:34.459760 26622 raft_consensus.cc:595] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Received request to transfer leadership to TS eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:34.486584 26893 consensus_queue.cc:1035] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.498996 26901 consensus_queue.cc:1035] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.501192 26535 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
mode: GRACEFUL
new_leader_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:52434
I20260811 16:09:34.503358 26535 raft_consensus.cc:595] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Received request to transfer leadership to TS 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:34.528859 26894 consensus_queue.cc:1035] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.529971 26896 consensus_queue.cc:1035] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.533943 26901 consensus_queue.cc:1035] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:34.553282 26535 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b663ae89c86143608a335a4d775f0508"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
mode: GRACEFUL
new_leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:52434
I20260811 16:09:34.554879 26535 raft_consensus.cc:595] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Received request to transfer leadership to TS 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:34.573767 26890 raft_consensus.cc:979] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:34.574280 26890 raft_consensus.cc:1067] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Signalling peer eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:34.577091 26771 consensus_queue.cc:1035] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:09:34.580601 26533 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:52426
I20260811 16:09:34.581398 26533 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:34.583313 26533 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.600838 26890 raft_consensus.cc:979] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:34.601516 26890 raft_consensus.cc:1067] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Signalling peer eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:34.603905 26535 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "60076cbaf47641159a21865874adf19b"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:52426
I20260811 16:09:34.603998 26896 consensus_queue.cc:1035] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 16:09:34.606271 26535 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:34.606870 26535 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.619779 26840 raft_consensus.cc:979] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: : Instructing follower eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:34.620503 26840 raft_consensus.cc:1067] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Signalling peer eb0248cfd87a403bbda2f551a86e5e3e to start an election
I20260811 16:09:34.623090 26536 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
 from {username='slave'} at 127.0.0.1:52430
I20260811 16:09:34.623828 26536 raft_consensus.cc:482] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:34.624313 26536 raft_consensus.cc:3037] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.636238 26533 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.644343 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:34.645035 26623 raft_consensus.cc:3032] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:34.645546 26623 raft_consensus.cc:729] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:34.645428 26870 raft_consensus.cc:979] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: : Instructing follower 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:34.646600 26623 consensus_queue.cc:260] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.648304 26535 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.647957 26870 raft_consensus.cc:1067] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Signalling peer 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:34.654706 26698 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b663ae89c86143608a335a4d775f0508"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:38484
I20260811 16:09:34.655377 26698 raft_consensus.cc:482] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:34.655719 26621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:34.656116 26623 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.656503 26621 raft_consensus.cc:3032] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:34.656738 26535 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.656872 26621 raft_consensus.cc:729] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:34.655748 26698 raft_consensus.cc:3037] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.657725 26700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:34.658432 26700 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.657866 26621 consensus_queue.cc:260] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.659577 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:34.660274 26699 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.645006 26536 raft_consensus.cc:504] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.664661 26620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:34.665328 26620 raft_consensus.cc:3037] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.667685 26621 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.672796 26700 raft_consensus.cc:2454] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:34.674319 26496 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:34.675103 26896 raft_consensus.cc:2781] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:34.675717 26896 raft_consensus.cc:686] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:34.676610 26896 consensus_queue.cc:237] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.648023 26533 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.674853 26620 raft_consensus.cc:2454] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:34.682156 26536 leader_election.cc:288] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Requested vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:34.684028 26699 raft_consensus.cc:2454] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:34.684837 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:34.685499 26701 raft_consensus.cc:3032] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:34.685804 26701 raft_consensus.cc:729] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:34.686298 26698 raft_consensus.cc:504] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.686707 26701 consensus_queue.cc:260] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.687985 26701 raft_consensus.cc:3037] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.689335 26418 catalog_manager.cc:5495] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 1 to 2, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 2 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:34.690238 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:34.692936 26622 raft_consensus.cc:3037] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.693209 26496 leader_election.cc:302] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:34.696750 26896 raft_consensus.cc:2781] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:34.697265 26896 raft_consensus.cc:686] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:34.698091 26896 consensus_queue.cc:237] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.701740 26622 raft_consensus.cc:2454] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 2.
I20260811 16:09:34.692188 26621 raft_consensus.cc:2454] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:34.707763 26664 leader_election.cc:302] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:34.708854 26943 raft_consensus.cc:2781] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:34.709352 26943 raft_consensus.cc:686] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:34.703359 26496 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:34.710259 26943 consensus_queue.cc:237] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.712369 26870 raft_consensus.cc:2781] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:34.712888 26870 raft_consensus.cc:686] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Leader. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:34.713760 26870 consensus_queue.cc:237] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.704495 26701 raft_consensus.cc:2454] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:34.690763 26698 leader_election.cc:288] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:34.703655 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:34.715582 26536 raft_consensus.cc:3032] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:34.715919 26536 raft_consensus.cc:729] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:34.716771 26536 consensus_queue.cc:260] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.717990 26536 raft_consensus.cc:3037] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.720196 26419 catalog_manager.cc:5495] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 1 to 2, leader changed from 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195) to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 2 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:34.726703 26623 raft_consensus.cc:2454] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb0248cfd87a403bbda2f551a86e5e3e in term 2.
I20260811 16:09:34.734547 26536 raft_consensus.cc:2454] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 2.
I20260811 16:09:34.738440 26417 catalog_manager.cc:5495] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 1 to 2, leader changed from eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193) to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 2 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:34.746220 26419 catalog_manager.cc:5495] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e reported cstate change: term changed from 1 to 2, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193). New cstate: current_term: 2 leader_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:34.985224 26752 raft_consensus.cc:979] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: : Instructing follower 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:34.985757 26870 raft_consensus.cc:1067] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Signalling peer 7f4016f7a11141209b201c76a3c4ac20 to start an election
I20260811 16:09:34.987593 26623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
 from {username='slave'} at 127.0.0.1:47422
I20260811 16:09:34.988197 26623 raft_consensus.cc:482] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:34.988540 26623 raft_consensus.cc:3037] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:34.996717 26623 raft_consensus.cc:504] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:34.998731 26623 leader_election.cc:288] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:35.000782 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:35.001130 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:35.001588 26536 raft_consensus.cc:3032] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:35.001857 26701 raft_consensus.cc:3037] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:35.002105 26536 raft_consensus.cc:729] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:35.003239 26536 consensus_queue.cc:260] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:35.004671 26536 raft_consensus.cc:3037] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:35.011934 26701 raft_consensus.cc:2454] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:35.013036 26536 raft_consensus.cc:2454] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:35.013669 26577 leader_election.cc:302] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:35.015488 26866 raft_consensus.cc:2781] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:09:35.016031 26866 raft_consensus.cc:686] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:35.016954 26866 consensus_queue.cc:237] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:35.025139 26417 catalog_manager.cc:5495] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 1 to 2, leader changed from eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193) to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 2 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:35.092537 26536 raft_consensus.cc:1261] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.094043 26943 consensus_queue.cc:1035] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.108253 26623 raft_consensus.cc:1261] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.110076 26942 consensus_queue.cc:1035] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.171394 26623 raft_consensus.cc:1261] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.172887 26752 consensus_queue.cc:1035] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.188815 26701 raft_consensus.cc:1261] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.191304 26623 raft_consensus.cc:1261] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.192919 26896 consensus_queue.cc:1035] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.194375 26896 consensus_queue.cc:1035] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.204195 26700 raft_consensus.cc:1261] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.213148 26701 raft_consensus.cc:1261] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.214100 26896 consensus_queue.cc:1035] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.218093 26896 consensus_queue.cc:1035] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.232049 26623 raft_consensus.cc:1261] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Refusing update from remote peer eb0248cfd87a403bbda2f551a86e5e3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.239692 26896 consensus_queue.cc:1035] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:35.559108 26700 raft_consensus.cc:1261] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.560801 26866 consensus_queue.cc:1035] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260811 16:09:35.567934 26533 raft_consensus.cc:1261] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260811 16:09:35.571110 26771 consensus_queue.cc:1035] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:37.560286 26417 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38846:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260811 16:09:37.585120 26417 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38846:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260811 16:09:37.617251 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:37.820760 27000 tablet.cc:1722] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260811 16:09:37.892112 26992 log.cc:924] Time spent T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260811 16:09:37.911475 26996 log.cc:924] Time spent T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
W20260811 16:09:37.914861 27003 log.cc:924] Time spent T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260811 16:09:37.936774 27017 tablet.cc:1722] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:37.959167 27021 tablet.cc:1722] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:37.980108 27018 tablet.cc:1722] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:37.935526 27015 tablet.cc:1722] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.005476 27017 tablet.cc:1722] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260811 16:09:38.015827 26496 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.194:36691, user_credentials={real_user=slave}} blocked reactor thread for 63007.2us
W20260811 16:09:38.018546 26581 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:45659, user_credentials={real_user=slave}} blocked reactor thread for 85220.9us
I20260811 16:09:38.027649 27024 tablet.cc:1722] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.029873 27012 tablet.cc:1722] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.031749 27023 tablet.cc:1722] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.035367 27026 tablet.cc:1722] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.023748 27000 tablet.cc:1722] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.057403 27030 tablet.cc:1722] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.065125 26620 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "209555b832274fa58305de6823f1cdd6"
dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
mode: GRACEFUL
new_leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:56380
I20260811 16:09:38.065896 26620 raft_consensus.cc:595] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Received request to transfer leadership to TS 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:38.081435 26417 catalog_manager.cc:5587] TS eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659) does not have the latest schema for tablet 60076cbaf47641159a21865874adf19b (table soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]). Expected version 1 got 0
I20260811 16:09:38.090003 26417 catalog_manager.cc:5587] TS eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659) does not have the latest schema for tablet 511028f653fd48fb82b71b3d76bd8617 (table soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]). Expected version 1 got 0
I20260811 16:09:38.127434 27032 tablet.cc:1722] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.130314 27015 tablet.cc:1722] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.134982 27031 tablet.cc:1722] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.096648 27023 tablet.cc:1722] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.133031 26418 catalog_manager.cc:5587] TS 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691) does not have the latest schema for tablet f5b6cda931874bd3b674397f0b23e34f (table soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925]). Expected version 1 got 0
I20260811 16:09:38.138114 27026 tablet.cc:1722] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.149026 27032 tablet.cc:1722] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.142629 27012 tablet.cc:1722] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.160858 27032 tablet.cc:1722] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.118206 27017 tablet.cc:1722] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.172408 27024 tablet.cc:1722] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.149133 27021 tablet.cc:1722] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.183888 27000 tablet.cc:1722] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.198669 27031 tablet.cc:1722] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.204504 27025 raft_consensus.cc:979] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: : Instructing follower 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:38.205084 27025 raft_consensus.cc:1067] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Signalling peer 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:38.211050 26698 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "209555b832274fa58305de6823f1cdd6"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:38474
I20260811 16:09:38.211750 26698 raft_consensus.cc:482] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:38.212117 26698 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:38.229099 26534 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b"
dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
mode: GRACEFUL
new_leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:55832
I20260811 16:09:38.196126 27018 tablet.cc:1722] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.229866 26534 raft_consensus.cc:595] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Received request to transfer leadership to TS 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:38.213956 27032 tablet.cc:1722] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260811 16:09:38.232115 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260811 16:09:38.232820 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:38.244987 26698 raft_consensus.cc:504] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:38.247303 26698 leader_election.cc:288] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:38.248211 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:38.248945 26534 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:38.249109 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:38.249979 26622 raft_consensus.cc:3032] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:38.250252 26622 raft_consensus.cc:729] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:38.250957 26622 consensus_queue.cc:260] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:38.252050 26622 raft_consensus.cc:3037] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:38.256696 26534 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 3.
I20260811 16:09:38.257948 26667 leader_election.cc:302] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:38.259012 27022 raft_consensus.cc:2781] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:38.259673 27022 raft_consensus.cc:686] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:38.260059 26622 raft_consensus.cc:2454] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 3.
I20260811 16:09:38.260665 27022 consensus_queue.cc:237] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:38.258761 26419 catalog_manager.cc:6040] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: soft_deleted_table [id=0b51a19dd9284c14b1b98df727bca925] alter complete (version 1)
I20260811 16:09:38.571050 26993 raft_consensus.cc:979] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: : Instructing follower 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:38.571645 26993 raft_consensus.cc:1067] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Signalling peer 624a7a5cb3ee439a8bc640b2184c8c56 to start an election
I20260811 16:09:38.575322 26699 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b"
dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
 from {username='slave'} at 127.0.0.1:38484
I20260811 16:09:38.575940 26699 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:09:38.576313 26699 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:38.590842 26699 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:38.594341 26699 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:38.594715 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:38.594341 26618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:38.596025 26534 raft_consensus.cc:3032] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:38.596206 26618 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:38.596657 26534 raft_consensus.cc:729] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:38.596015 26418 catalog_manager.cc:5495] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 2 to 3, leader changed from 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194) to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:38.597750 26534 consensus_queue.cc:260] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:38.599344 26534 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:38.604857 26618 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 3.
I20260811 16:09:38.606406 26664 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:38.607319 27022 raft_consensus.cc:2781] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:38.607836 27022 raft_consensus.cc:686] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:38.608716 27022 consensus_queue.cc:237] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:38.612511 26534 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 3.
I20260811 16:09:38.618104 26418 catalog_manager.cc:5495] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 2 to 3, leader changed from eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193) to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:38.658668 26618 raft_consensus.cc:1261] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:38.660077 27022 consensus_queue.cc:1035] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:38.671497 26534 raft_consensus.cc:1261] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:38.673470 27022 consensus_queue.cc:1035] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:09:39.112782 26534 raft_consensus.cc:1261] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:39.114285 27022 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:39.129489 26618 raft_consensus.cc:1261] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:39.131256 27022 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260811 16:09:39.433143 26559 debug-util.cc:398] Leaking SignalData structure 0x7b08000efba0 after lost signal to thread 12388
W20260811 16:09:39.434448 26559 debug-util.cc:398] Leaking SignalData structure 0x7b080019ca80 after lost signal to thread 26459
W20260811 16:09:39.435787 26559 debug-util.cc:398] Leaking SignalData structure 0x7b0800007e40 after lost signal to thread 26563
W20260811 16:09:39.436914 26559 debug-util.cc:398] Leaking SignalData structure 0x7b080032f9e0 after lost signal to thread 26649
W20260811 16:09:39.438007 26559 debug-util.cc:398] Leaking SignalData structure 0x7b080020b360 after lost signal to thread 26726
I20260811 16:09:39.468506 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:39.473675 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:39.474121 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:40.475165 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:40.480659 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:40.481139 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:41.484566 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:41.502447 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:41.503328 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:42.505203 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:42.517510 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:42.518106 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:43.601307 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:43.609148 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:43.609694 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:44.610834 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:44.616071 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:44.616503 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:09:44.639003 26559 debug-util.cc:398] Leaking SignalData structure 0x7b0800179760 after lost signal to thread 12388
W20260811 16:09:44.640268 26559 debug-util.cc:398] Leaking SignalData structure 0x7b08003305c0 after lost signal to thread 26459
W20260811 16:09:44.641513 26559 debug-util.cc:398] Leaking SignalData structure 0x7b0800369d40 after lost signal to thread 26563
W20260811 16:09:44.642665 26559 debug-util.cc:398] Leaking SignalData structure 0x7b08000ebc80 after lost signal to thread 26649
W20260811 16:09:44.643833 26559 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5140 after lost signal to thread 26726
I20260811 16:09:45.680099 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:45.686506 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:45.686924 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260811 16:09:45.779310 26559 debug-util.cc:398] Leaking SignalData structure 0x7b08002b46c0 after lost signal to thread 12388
W20260811 16:09:45.780851 26559 debug-util.cc:398] Leaking SignalData structure 0x7b080018f4a0 after lost signal to thread 26459
W20260811 16:09:45.782366 26559 debug-util.cc:398] Leaking SignalData structure 0x7b0800249ec0 after lost signal to thread 26563
W20260811 16:09:45.783610 26559 debug-util.cc:398] Leaking SignalData structure 0x7b08001961c0 after lost signal to thread 26649
W20260811 16:09:45.784725 26559 debug-util.cc:398] Leaking SignalData structure 0x7b080016d980 after lost signal to thread 26726
I20260811 16:09:46.687920 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:46.693274 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:46.693753 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:48.236735 27084 raft_consensus.cc:482] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.237890 27084 raft_consensus.cc:504] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
W20260811 16:09:48.262199 26665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.000s	sys 0.013s
W20260811 16:09:48.263025 26665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.000s	sys 0.013s
I20260811 16:09:48.266494 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.267113 27084 leader_election.cc:288] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.316416 27079 raft_consensus.cc:482] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
I20260811 16:09:48.317641 27079 raft_consensus.cc:504] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.321493 27079 leader_election.cc:288] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.372921 12383 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260811 16:09:48.407241 27083 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.569078 27083 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.566372 27079 raft_consensus.cc:482] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
I20260811 16:09:48.575762 27083 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.576840 27083 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.578819 27083 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.584933 27083 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.478138 27086 raft_consensus.cc:482] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
W20260811 16:09:48.530095 26664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.014s	sys 0.012s
I20260811 16:09:48.544173 27088 raft_consensus.cc:482] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
I20260811 16:09:48.578050 27079 raft_consensus.cc:504] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.586984 27088 raft_consensus.cc:504] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.586572 27086 raft_consensus.cc:504] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
W20260811 16:09:48.553028 26667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.000s	sys 0.017s
W20260811 16:09:48.591563 26667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.276s	user 0.001s	sys 0.018s
I20260811 16:09:48.592607 27090 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.593442 27090 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.553916 27091 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.595011 27091 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
W20260811 16:09:48.596978 26581 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.23.193:45659, user_credentials={real_user=slave}} blocked reactor thread for 59445.7us
I20260811 16:09:48.597749 27091 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.591048 27088 leader_election.cc:288] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.599483 27088 raft_consensus.cc:482] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
I20260811 16:09:48.600126 27088 raft_consensus.cc:504] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.560865 27095 raft_consensus.cc:482] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.591058 27086 leader_election.cc:288] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.602830 27095 raft_consensus.cc:504] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.606081 27086 raft_consensus.cc:482] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
I20260811 16:09:48.607065 27086 raft_consensus.cc:504] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.608301 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.608302 27095 leader_election.cc:288] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.555895 27094 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.609905 27094 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.611090 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.612335 27094 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.616528 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.605208 27088 leader_election.cc:288] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.623188 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.624218 26532 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 3.
W20260811 16:09:48.590502 26664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.014s	sys 0.013s
I20260811 16:09:48.628311 27079 leader_election.cc:288] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.633847 26618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.635725 26620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.637892 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.638243 27099 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.640211 27079 raft_consensus.cc:482] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.640496 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.609402 27086 leader_election.cc:288] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.647035 27085 raft_consensus.cc:482] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.641979 27088 raft_consensus.cc:482] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f4016f7a11141209b201c76a3c4ac20)
I20260811 16:09:48.663043 27088 raft_consensus.cc:504] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.652633 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.653787 26697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.651938 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.653981 26694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.654747 27079 raft_consensus.cc:504] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.641326 26581 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:48.635344 27090 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.666445 27079 leader_election.cc:288] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.667073 27079 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.656193 26577 leader_election.cc:302] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.656368 26695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.655555 27095 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.657018 27086 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.657788 27100 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.651037 26616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.667657 27079 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.667963 27097 raft_consensus.cc:2781] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 16:09:48.671667 27097 raft_consensus.cc:482] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.672112 27097 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:09:48.672200 27093 raft_consensus.cc:2726] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.675933 27079 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.676469 27095 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.677639 26698 raft_consensus.cc:2454] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 1.
I20260811 16:09:48.647106 27099 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.681780 27086 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.683077 26694 raft_consensus.cc:2454] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:48.684515 27100 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.685603 26697 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:48.686774 27100 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.693207 27092 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.694142 27094 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.693883 27092 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.694778 27094 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.694865 27085 raft_consensus.cc:504] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.696919 27092 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.697292 27085 leader_election.cc:288] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.698305 26577 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.699050 26695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.696971 27094 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.699808 26695 raft_consensus.cc:2454] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:48.700459 27094 raft_consensus.cc:2781] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:09:48.700976 27094 raft_consensus.cc:482] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.701349 27094 raft_consensus.cc:3037] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:48.702313 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.690171 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.704038 26532 raft_consensus.cc:2454] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:48.703866 27097 raft_consensus.cc:504] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.705060 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.706207 27097 leader_election.cc:288] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 4 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.706111 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.706888 26577 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:48.707636 27098 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.708966 26581 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 
I20260811 16:09:48.709403 27098 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.710599 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.699924 27095 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.711261 26534 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:09:48.711740 27098 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.711838 27086 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.708060 26697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.701326 27088 leader_election.cc:288] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.714058 27091 raft_consensus.cc:2781] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.714205 26577 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.714509 27091 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.714862 27091 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.715041 27093 raft_consensus.cc:2781] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.715512 26577 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.715584 27093 raft_consensus.cc:482] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.716596 27099 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.716894 26616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.718346 27093 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.718771 26616 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 2.
I20260811 16:09:48.717530 27086 raft_consensus.cc:482] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.719871 27086 raft_consensus.cc:504] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.721347 26697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.722854 27086 leader_election.cc:288] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.723881 26621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.724289 26623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.724699 26615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.713644 26698 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 2.
I20260811 16:09:48.725947 26618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.726601 26614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.713624 27092 raft_consensus.cc:2781] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.727311 27092 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 624a7a5cb3ee439a8bc640b2184c8c56)
I20260811 16:09:48.720780 27099 raft_consensus.cc:2781] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.727775 27092 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.728653 26616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.728048 26614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.730156 27094 raft_consensus.cc:504] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.730957 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.728669 27099 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.732399 27094 leader_election.cc:288] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.732585 27099 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.733114 26664 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:48.733243 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.734090 27086 raft_consensus.cc:2781] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.734339 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.734656 27086 raft_consensus.cc:482] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.735174 27086 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.735098 26622 raft_consensus.cc:2454] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 1.
I20260811 16:09:48.740464 27091 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.744549 26664 leader_election.cc:302] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:48.762980 27093 raft_consensus.cc:504] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.763825 27088 raft_consensus.cc:2781] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:09:48.764241 27088 raft_consensus.cc:482] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.764626 27088 raft_consensus.cc:3037] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:48.764745 26693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.766235 26620 raft_consensus.cc:1226] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 2. Current term is 3. Ops: []
I20260811 16:09:48.745402 27086 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.748281 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b3d85f61f9b4d7092d97ee0e0b43020" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.767350 27093 leader_election.cc:288] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.748852 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6347ad743533454ea66d429fb6ad2cf2" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.746860 27092 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.768458 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.768610 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.769783 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb3fb8487e5488a905109c66faae138" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.769863 26536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.770022 26620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:48.770336 27092 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.749202 26533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.770792 27086 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.749768 26530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73fc1c78e6ad450ba70757a62e634f95" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.750203 26531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae0c2ca166849dd9d77f02dd6038eae" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.772189 27099 raft_consensus.cc:504] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.750989 26527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.773592 26620 raft_consensus.cc:2379] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 624a7a5cb3ee439a8bc640b2184c8c56 in current term 3: Already voted for candidate 7f4016f7a11141209b201c76a3c4ac20 in this term.
I20260811 16:09:48.751323 26616 raft_consensus.cc:2454] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 2.
I20260811 16:09:48.751503 26697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e776c97435431b839987b1805cb2ac" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.752113 26528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.752807 26694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b6cda931874bd3b674397f0b23e34f" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.751247 26529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" is_pre_election: true
I20260811 16:09:48.776178 26527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.753284 26695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "635494ceded841e6ace043d339fd7a6b" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.755002 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a22d07c623444568e6a9513e9cc7297" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.777436 26698 raft_consensus.cc:1226] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 2. Current term is 3. Ops: []
I20260811 16:09:48.759536 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209555b832274fa58305de6823f1cdd6" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.778065 27099 leader_election.cc:288] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.779389 26664 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: 
I20260811 16:09:48.780088 26527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.780210 27088 raft_consensus.cc:504] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.780629 27086 raft_consensus.cc:2781] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.759838 12383 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260811 16:09:48.781246 27086 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.781668 27086 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.781720 26616 raft_consensus.cc:1226] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 2. Current term is 3. Ops: []
I20260811 16:09:48.783846 26616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.785758 26534 raft_consensus.cc:2454] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4016f7a11141209b201c76a3c4ac20 in term 4.
I20260811 16:09:48.786561 26532 raft_consensus.cc:1226] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Rejecting Update request from peer 624a7a5cb3ee439a8bc640b2184c8c56 for earlier term 3. Current term is 4. Ops: []
I20260811 16:09:48.787014 26581 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56
I20260811 16:09:48.787833 27088 leader_election.cc:288] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.788700 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" is_pre_election: true
I20260811 16:09:48.789703 27099 raft_consensus.cc:2781] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 16:09:48.790254 27099 raft_consensus.cc:686] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 LEADER]: Becoming Leader. State: Replica: 7f4016f7a11141209b201c76a3c4ac20, State: Running, Role: LEADER
I20260811 16:09:48.791466 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b663ae89c86143608a335a4d775f0508" candidate_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20" is_pre_election: true
I20260811 16:09:48.792246 26698 raft_consensus.cc:1226] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 1. Current term is 2. Ops: []
I20260811 16:09:48.791460 27099 consensus_queue.cc:237] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.794337 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:48.795753 26667 leader_election.cc:302] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.796689 27098 raft_consensus.cc:2726] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.796689 26496 leader_election.cc:302] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.797168 26667 leader_election.cc:302] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.797797 27102 raft_consensus.cc:2726] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.798468 27098 raft_consensus.cc:2726] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.781805 12383 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260811 16:09:48.799104 26496 leader_election.cc:302] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.799949 27091 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.800015 27102 raft_consensus.cc:2726] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.800769 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.801596 26496 leader_election.cc:302] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.801815 26667 leader_election.cc:302] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.800714 26577 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20; no voters: eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.804615 27102 raft_consensus.cc:2726] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:09:48.804832 27098 raft_consensus.cc:2726] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.804912 27091 raft_consensus.cc:2781] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:09:48.805506 27091 raft_consensus.cc:482] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:48.805886 27091 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.805994 27102 consensus_queue.cc:1046] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260811 16:09:48.806321 26496 leader_election.cc:302] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.807485 27104 raft_consensus.cc:2726] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:09:48.807590 27086 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.808866 26701 raft_consensus.cc:1226] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 2. Current term is 3. Ops: []
I20260811 16:09:48.805905 26667 leader_election.cc:302] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.810014 27086 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:48.810864 27103 raft_consensus.cc:3032] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:48.811283 27103 raft_consensus.cc:729] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:48.811534 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7f4016f7a11141209b201c76a3c4ac20"
I20260811 16:09:48.811723 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.812168 26577 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.812381 27103 consensus_queue.cc:260] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.812947 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9e3b2adae348278cc8dd0360b9583a" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.813019 27092 raft_consensus.cc:2726] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.813856 27103 raft_consensus.cc:3037] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.818440 27091 raft_consensus.cc:504] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.819502 27086 raft_consensus.cc:2726] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.833318 27091 leader_election.cc:288] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Requested vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195:36657)
I20260811 16:09:48.821641 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511028f653fd48fb82b71b3d76bd8617" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.835752 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.837803 26701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.838330 26532 raft_consensus.cc:2454] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in term 3.
I20260811 16:09:48.838768 26701 raft_consensus.cc:2379] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f4016f7a11141209b201c76a3c4ac20 in current term 3: Already voted for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in this term.
I20260811 16:09:48.820837 26667 leader_election.cc:302] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.821836 27102 consensus_queue.cc:1046] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:48.838007 26417 catalog_manager.cc:5495] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 reported cstate change: term changed from 3 to 4, leader changed from 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195) to 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194). New cstate: current_term: 4 leader_uuid: "7f4016f7a11141209b201c76a3c4ac20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: UNKNOWN } } }
I20260811 16:09:48.839951 27102 raft_consensus.cc:3032] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:48.840322 27102 raft_consensus.cc:729] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:48.840482 26577 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.841269 27102 consensus_queue.cc:260] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.842195 26577 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.823009 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5e9f11e62a544f399f4b8388dafa8c7" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.843076 27099 raft_consensus.cc:2726] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.825457 26496 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.823930 26699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "935f4268d9e142ee8898807670bce390" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.844290 26699 raft_consensus.cc:2379] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f4016f7a11141209b201c76a3c4ac20 in current term 3: Already voted for candidate 624a7a5cb3ee439a8bc640b2184c8c56 in this term.
I20260811 16:09:48.827757 26695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60076cbaf47641159a21865874adf19b" candidate_uuid: "7f4016f7a11141209b201c76a3c4ac20" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "624a7a5cb3ee439a8bc640b2184c8c56"
I20260811 16:09:48.845027 27102 raft_consensus.cc:3037] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.846663 27103 raft_consensus.cc:2726] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.847354 27091 raft_consensus.cc:2726] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.849517 26496 leader_election.cc:302] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0248cfd87a403bbda2f551a86e5e3e; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.850816 27104 raft_consensus.cc:2726] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.852810 26577 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.853854 27091 raft_consensus.cc:2726] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.853888 27086 raft_consensus.cc:2726] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.855736 26577 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.856511 26667 leader_election.cc:302] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.856618 27091 raft_consensus.cc:2726] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.857892 26577 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f4016f7a11141209b201c76a3c4ac20; no voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.859222 27086 raft_consensus.cc:2726] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.859004 27091 raft_consensus.cc:2726] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.859813 26667 leader_election.cc:302] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.864149 27086 raft_consensus.cc:2726] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.865403 26667 leader_election.cc:302] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.866197 27086 raft_consensus.cc:2726] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.868140 27086 consensus_queue.cc:1046] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:48.868212 26667 leader_election.cc:302] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.869176 27088 raft_consensus.cc:2726] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:09:48.869637 26667 leader_election.cc:302] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56, eb0248cfd87a403bbda2f551a86e5e3e; no voters: 7f4016f7a11141209b201c76a3c4ac20
I20260811 16:09:48.870540 27088 raft_consensus.cc:2781] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:09:48.871012 27088 raft_consensus.cc:686] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Becoming Leader. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:48.871078 27098 raft_consensus.cc:3032] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Stepping down as leader of term 3
I20260811 16:09:48.871511 27098 raft_consensus.cc:729] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:48.872241 27088 consensus_queue.cc:237] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.872654 27098 consensus_queue.cc:260] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.873076 27104 consensus_queue.cc:1046] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260811 16:09:48.874150 27098 raft_consensus.cc:3037] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Advancing to term 4
I20260811 16:09:48.874430 27104 consensus_queue.cc:1046] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:48.875619 27101 raft_consensus.cc:3032] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:48.875983 27101 raft_consensus.cc:729] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:48.876756 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5fdda28ecb4f6eb1005d44adf02df8" candidate_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb0248cfd87a403bbda2f551a86e5e3e"
I20260811 16:09:48.877007 27101 consensus_queue.cc:260] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.880910 27101 raft_consensus.cc:3037] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:48.875643 27104 raft_consensus.cc:3032] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:48.886523 27104 raft_consensus.cc:729] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:48.887984 27104 consensus_queue.cc:260] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.889747 27104 raft_consensus.cc:3037] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:48.891111 26667 leader_election.cc:302] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:48.892172 27088 raft_consensus.cc:2726] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260811 16:09:48.904594 26417 catalog_manager.cc:5495] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 reported cstate change: term changed from 2 to 3, leader changed from eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193) to 624a7a5cb3ee439a8bc640b2184c8c56 (127.12.23.195). New cstate: current_term: 3 leader_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } health_report { overall_health: HEALTHY } } }
I20260811 16:09:48.937192 26622 raft_consensus.cc:1226] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 1. Current term is 2. Ops: []
I20260811 16:09:48.938803 27101 consensus_queue.cc:1046] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:48.939925 27102 raft_consensus.cc:3032] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Stepping down as leader of term 1
I20260811 16:09:48.940254 27102 raft_consensus.cc:729] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:48.941020 27102 consensus_queue.cc:260] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:48.942348 27102 raft_consensus.cc:3037] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:09:48.996102 26622 raft_consensus.cc:1226] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Rejecting Update request from peer eb0248cfd87a403bbda2f551a86e5e3e for earlier term 2. Current term is 3. Ops: []
I20260811 16:09:48.997686 27102 consensus_queue.cc:1046] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:48.998840 27101 raft_consensus.cc:3032] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:48.999209 27101 raft_consensus.cc:729] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb0248cfd87a403bbda2f551a86e5e3e, State: Running, Role: LEADER
I20260811 16:09:49.000142 27101 consensus_queue.cc:260] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:49.001780 27101 raft_consensus.cc:3037] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:49.155360 26622 raft_consensus.cc:1226] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Rejecting Update request from peer 624a7a5cb3ee439a8bc640b2184c8c56 for earlier term 2. Current term is 3. Ops: []
I20260811 16:09:49.156633 27088 consensus_queue.cc:1046] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:49.157616 27098 raft_consensus.cc:3032] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 16:09:49.157938 27098 raft_consensus.cc:729] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 624a7a5cb3ee439a8bc640b2184c8c56, State: Running, Role: LEADER
I20260811 16:09:49.158777 27098 consensus_queue.cc:260] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:49.160166 27098 raft_consensus.cc:3037] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:09:49.242599 26695 raft_consensus.cc:1261] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 4 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:09:49.244045 27091 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:49.254566 26532 raft_consensus.cc:1261] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Refusing update from remote peer 7f4016f7a11141209b201c76a3c4ac20: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260811 16:09:49.256289 27092 consensus_queue.cc:1035] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260811 16:09:49.335053 26532 raft_consensus.cc:1261] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:49.336393 27098 consensus_queue.cc:1035] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 16:09:49.346172 26622 raft_consensus.cc:1261] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Refusing update from remote peer 624a7a5cb3ee439a8bc640b2184c8c56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260811 16:09:49.348214 27098 consensus_queue.cc:1035] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260811 16:09:49.662928 26723 debug-util.cc:398] Leaking SignalData structure 0x7b08002368e0 after lost signal to thread 12388
W20260811 16:09:49.664351 26723 debug-util.cc:398] Leaking SignalData structure 0x7b08000777c0 after lost signal to thread 26459
W20260811 16:09:49.665730 26723 debug-util.cc:398] Leaking SignalData structure 0x7b0800369520 after lost signal to thread 26563
W20260811 16:09:49.666774 26723 debug-util.cc:398] Leaking SignalData structure 0x7b080022fa20 after lost signal to thread 26649
W20260811 16:09:49.667868 26723 debug-util.cc:398] Leaking SignalData structure 0x7b0800255a60 after lost signal to thread 26726
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:589: Failure
Expected equality of these values:
  leader.second
    Which is: 4
  3
I20260811 16:09:49.839077 12383 tablet_server.cc:178] TabletServer@127.12.23.193:0 shutting down...
W20260811 16:09:49.876669 26667 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
W20260811 16:09:49.889232 26667 consensus_peers.cc:487] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:49.909632 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:49.910934 12383 tablet_replica.cc:330] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.912415 12383 raft_consensus.cc:2229] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.913467 12383 raft_consensus.cc:2258] T b663ae89c86143608a335a4d775f0508 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.926882 12383 tablet_replica.cc:330] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.927995 12383 raft_consensus.cc:2229] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.928643 12383 raft_consensus.cc:2258] T 60076cbaf47641159a21865874adf19b P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.931977 12383 tablet_replica.cc:330] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.933547 12383 raft_consensus.cc:2229] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:49.934830 12383 raft_consensus.cc:2258] T 8ae0c2ca166849dd9d77f02dd6038eae P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.938370 12383 tablet_replica.cc:330] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
W20260811 16:09:49.938216 26581 consensus_peers.cc:487] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:49.939460 12383 raft_consensus.cc:2229] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.940097 12383 raft_consensus.cc:2258] T 9bb3fb8487e5488a905109c66faae138 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.943024 12383 tablet_replica.cc:330] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.943866 12383 raft_consensus.cc:2229] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.944284 12383 raft_consensus.cc:2258] T 511028f653fd48fb82b71b3d76bd8617 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.947547 12383 tablet_replica.cc:330] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.948280 12383 raft_consensus.cc:2229] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.948855 12383 raft_consensus.cc:2258] T 3b3d85f61f9b4d7092d97ee0e0b43020 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.951752 12383 tablet_replica.cc:330] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.952514 12383 raft_consensus.cc:2229] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.953207 12383 raft_consensus.cc:2258] T f5b6cda931874bd3b674397f0b23e34f P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.956255 12383 tablet_replica.cc:330] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.956930 12383 raft_consensus.cc:2229] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.957329 12383 raft_consensus.cc:2258] T ff9e3b2adae348278cc8dd0360b9583a P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.960400 12383 tablet_replica.cc:330] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.961037 12383 raft_consensus.cc:2229] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.961556 12383 raft_consensus.cc:2258] T 635494ceded841e6ace043d339fd7a6b P eb0248cfd87a403bbda2f551a86e5e3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.965566 12383 tablet_replica.cc:330] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.966358 12383 raft_consensus.cc:2229] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.966820 12383 raft_consensus.cc:2258] T 935f4268d9e142ee8898807670bce390 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.970430 12383 tablet_replica.cc:330] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.971094 12383 raft_consensus.cc:2229] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.971735 12383 raft_consensus.cc:2258] T 41e776c97435431b839987b1805cb2ac P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.974472 12383 tablet_replica.cc:330] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.975095 12383 raft_consensus.cc:2229] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.975716 12383 raft_consensus.cc:2258] T 73fc1c78e6ad450ba70757a62e634f95 P eb0248cfd87a403bbda2f551a86e5e3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.978219 12383 tablet_replica.cc:330] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.978821 12383 raft_consensus.cc:2229] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.979494 12383 raft_consensus.cc:2258] T 6347ad743533454ea66d429fb6ad2cf2 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.982550 12383 tablet_replica.cc:330] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.983125 12383 raft_consensus.cc:2229] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.983603 12383 raft_consensus.cc:2258] T 9a22d07c623444568e6a9513e9cc7297 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.986228 12383 tablet_replica.cc:330] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.986893 12383 raft_consensus.cc:2229] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.987484 12383 raft_consensus.cc:2258] T c754107e751346fab70e92236998beb8 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.990410 12383 tablet_replica.cc:330] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.991017 12383 raft_consensus.cc:2229] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.991503 12383 raft_consensus.cc:2258] T 3c5fdda28ecb4f6eb1005d44adf02df8 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.994180 12383 tablet_replica.cc:330] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.994729 12383 raft_consensus.cc:2229] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.995378 12383 raft_consensus.cc:2258] T 209555b832274fa58305de6823f1cdd6 P eb0248cfd87a403bbda2f551a86e5e3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:49.998035 12383 tablet_replica.cc:330] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e: stopping tablet replica
I20260811 16:09:49.998554 12383 raft_consensus.cc:2229] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:49.999078 12383 raft_consensus.cc:2258] T b5e9f11e62a544f399f4b8388dafa8c7 P eb0248cfd87a403bbda2f551a86e5e3e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:50.023644 26581 consensus_peers.cc:487] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.080924 12383 tablet_server.cc:194] TabletServer@127.12.23.193:0 shutdown complete.
W20260811 16:09:50.108160 26667 consensus_peers.cc:487] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.114245 26581 consensus_peers.cc:487] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.143298 26581 consensus_peers.cc:487] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.146252 26581 consensus_peers.cc:487] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.146714 26581 consensus_peers.cc:487] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.151587 12383 tablet_server.cc:178] TabletServer@127.12.23.194:0 shutting down...
W20260811 16:09:50.162797 26667 consensus_peers.cc:487] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.167845 26664 consensus_peers.cc:487] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Couldn't send request to peer 7f4016f7a11141209b201c76a3c4ac20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.173609 26581 consensus_peers.cc:487] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 16:09:50.183117 26581 consensus_peers.cc:487] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 -> Peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Couldn't send request to peer eb0248cfd87a403bbda2f551a86e5e3e. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.207974 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:50.208938 12383 tablet_replica.cc:330] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.210098 12383 raft_consensus.cc:2229] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.210718 12383 raft_consensus.cc:2258] T b663ae89c86143608a335a4d775f0508 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.213562 12383 tablet_replica.cc:330] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.214368 12383 raft_consensus.cc:2229] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.215015 12383 raft_consensus.cc:2258] T 8ae0c2ca166849dd9d77f02dd6038eae P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.217747 12383 tablet_replica.cc:330] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.218452 12383 raft_consensus.cc:2229] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.219700 12383 raft_consensus.cc:2258] T 9bb3fb8487e5488a905109c66faae138 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.223232 12383 tablet_replica.cc:330] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.224283 12383 raft_consensus.cc:2229] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.224907 12383 raft_consensus.cc:2258] T 60076cbaf47641159a21865874adf19b P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.228083 12383 tablet_replica.cc:330] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.228988 12383 raft_consensus.cc:2229] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.230268 12383 raft_consensus.cc:2258] T c754107e751346fab70e92236998beb8 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:50.231017 26664 consensus_peers.cc:487] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Couldn't send request to peer 7f4016f7a11141209b201c76a3c4ac20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.233198 12383 tablet_replica.cc:330] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.233995 12383 raft_consensus.cc:2229] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.234680 12383 raft_consensus.cc:2258] T 9a22d07c623444568e6a9513e9cc7297 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.237625 12383 tablet_replica.cc:330] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.238320 12383 raft_consensus.cc:2229] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.239358 12383 raft_consensus.cc:2258] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.242004 12383 tablet_replica.cc:330] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.242686 12383 raft_consensus.cc:2229] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.243377 12383 raft_consensus.cc:2258] T 511028f653fd48fb82b71b3d76bd8617 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.247064 12383 tablet_replica.cc:330] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.247800 12383 raft_consensus.cc:2229] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.248214 27123 raft_consensus.cc:482] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb0248cfd87a403bbda2f551a86e5e3e)
I20260811 16:09:50.249089 12383 raft_consensus.cc:2258] T f5b6cda931874bd3b674397f0b23e34f P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.248862 27123 raft_consensus.cc:504] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:50.251286 27123 leader_election.cc:288] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
I20260811 16:09:50.252627 12383 tablet_replica.cc:330] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.254485 12383 raft_consensus.cc:2229] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.255251 12383 raft_consensus.cc:2258] T ff9e3b2adae348278cc8dd0360b9583a P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:09:50.256062 26667 leader_election.cc:334] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111)
W20260811 16:09:50.257417 26664 leader_election.cc:334] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260811 16:09:50.257910 26664 leader_election.cc:302] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:50.258720 27123 raft_consensus.cc:2726] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260811 16:09:50.259073 12383 tablet_replica.cc:330] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.259884 12383 raft_consensus.cc:2229] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.260391 12383 raft_consensus.cc:2258] T 935f4268d9e142ee8898807670bce390 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.263505 12383 tablet_replica.cc:330] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.264384 12383 raft_consensus.cc:2229] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.265295 12383 raft_consensus.cc:2258] T 635494ceded841e6ace043d339fd7a6b P 7f4016f7a11141209b201c76a3c4ac20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.268235 12383 tablet_replica.cc:330] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.268882 12383 raft_consensus.cc:2229] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.269387 12383 raft_consensus.cc:2258] T 209555b832274fa58305de6823f1cdd6 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.272110 12383 tablet_replica.cc:330] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.272680 12383 raft_consensus.cc:2229] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.273710 12383 raft_consensus.cc:2258] T 41e776c97435431b839987b1805cb2ac P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.276331 12383 tablet_replica.cc:330] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.276921 12383 raft_consensus.cc:2229] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.277915 12383 raft_consensus.cc:2258] T 73fc1c78e6ad450ba70757a62e634f95 P 7f4016f7a11141209b201c76a3c4ac20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.280428 12383 tablet_replica.cc:330] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.281086 12383 raft_consensus.cc:2229] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.282101 12383 raft_consensus.cc:2258] T 6347ad743533454ea66d429fb6ad2cf2 P 7f4016f7a11141209b201c76a3c4ac20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.284610 12383 tablet_replica.cc:330] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.285372 12383 raft_consensus.cc:2229] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.285993 12383 raft_consensus.cc:2258] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.288853 12383 tablet_replica.cc:330] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20: stopping tablet replica
I20260811 16:09:50.289443 12383 raft_consensus.cc:2229] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.289940 12383 raft_consensus.cc:2258] T b5e9f11e62a544f399f4b8388dafa8c7 P 7f4016f7a11141209b201c76a3c4ac20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.305316 27123 raft_consensus.cc:482] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:09:50.306059 27123 raft_consensus.cc:504] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb0248cfd87a403bbda2f551a86e5e3e" member_type: VOTER last_known_addr { host: "127.12.23.193" port: 45659 } } peers { permanent_uuid: "7f4016f7a11141209b201c76a3c4ac20" member_type: VOTER last_known_addr { host: "127.12.23.194" port: 36691 } } peers { permanent_uuid: "624a7a5cb3ee439a8bc640b2184c8c56" member_type: VOTER last_known_addr { host: "127.12.23.195" port: 36657 } }
I20260811 16:09:50.308651 27123 leader_election.cc:288] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659), 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691)
W20260811 16:09:50.313145 26664 leader_election.cc:334] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260811 16:09:50.313812 26667 leader_election.cc:334] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eb0248cfd87a403bbda2f551a86e5e3e (127.12.23.193:45659): Network error: Client connection negotiation failed: client connection to 127.12.23.193:45659: connect: Connection refused (error 111)
I20260811 16:09:50.314318 26667 leader_election.cc:302] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624a7a5cb3ee439a8bc640b2184c8c56; no voters: 7f4016f7a11141209b201c76a3c4ac20, eb0248cfd87a403bbda2f551a86e5e3e
I20260811 16:09:50.315086 27123 raft_consensus.cc:2726] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 16:09:50.344524 12383 tablet_server.cc:194] TabletServer@127.12.23.194:0 shutdown complete.
W20260811 16:09:50.385687 26664 consensus_peers.cc:487] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 -> Peer 7f4016f7a11141209b201c76a3c4ac20 (127.12.23.194:36691): Couldn't send request to peer 7f4016f7a11141209b201c76a3c4ac20. Status: Network error: Client connection negotiation failed: client connection to 127.12.23.194:36691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:09:50.386384 12383 tablet_server.cc:178] TabletServer@127.12.23.195:0 shutting down...
I20260811 16:09:50.425103 12383 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260811 16:09:50.426069 12383 tablet_replica.cc:330] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.426853 12383 raft_consensus.cc:2229] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.427968 12383 raft_consensus.cc:2258] T b663ae89c86143608a335a4d775f0508 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.430580 12383 tablet_replica.cc:330] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.431339 12383 raft_consensus.cc:2229] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.431895 12383 raft_consensus.cc:2258] T 8ae0c2ca166849dd9d77f02dd6038eae P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.434289 12383 tablet_replica.cc:330] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.434973 12383 raft_consensus.cc:2229] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.435640 12383 raft_consensus.cc:2258] T 9bb3fb8487e5488a905109c66faae138 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.437952 12383 tablet_replica.cc:330] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.438632 12383 raft_consensus.cc:2229] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.439226 12383 raft_consensus.cc:2258] T 511028f653fd48fb82b71b3d76bd8617 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.441457 12383 tablet_replica.cc:330] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.442119 12383 raft_consensus.cc:2229] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.442651 12383 raft_consensus.cc:2258] T 3b3d85f61f9b4d7092d97ee0e0b43020 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.445142 12383 tablet_replica.cc:330] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.445765 12383 raft_consensus.cc:2229] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.446297 12383 raft_consensus.cc:2258] T 60076cbaf47641159a21865874adf19b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.448678 12383 tablet_replica.cc:330] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.449267 12383 raft_consensus.cc:2229] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.449719 12383 raft_consensus.cc:2258] T 635494ceded841e6ace043d339fd7a6b P 624a7a5cb3ee439a8bc640b2184c8c56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.452030 12383 tablet_replica.cc:330] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.452672 12383 raft_consensus.cc:2229] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.453624 12383 raft_consensus.cc:2258] T 935f4268d9e142ee8898807670bce390 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.455904 12383 tablet_replica.cc:330] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.456566 12383 raft_consensus.cc:2229] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.457213 12383 raft_consensus.cc:2258] T 9a22d07c623444568e6a9513e9cc7297 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.459507 12383 tablet_replica.cc:330] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.460122 12383 raft_consensus.cc:2229] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.460626 12383 raft_consensus.cc:2258] T c754107e751346fab70e92236998beb8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.462922 12383 tablet_replica.cc:330] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.463706 12383 raft_consensus.cc:2229] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.464210 12383 raft_consensus.cc:2258] T 73fc1c78e6ad450ba70757a62e634f95 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.467064 12383 tablet_replica.cc:330] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.467751 12383 raft_consensus.cc:2229] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.468290 12383 raft_consensus.cc:2258] T 41e776c97435431b839987b1805cb2ac P 624a7a5cb3ee439a8bc640b2184c8c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.470634 12383 tablet_replica.cc:330] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.471190 12383 raft_consensus.cc:2229] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.471662 12383 raft_consensus.cc:2258] T 6347ad743533454ea66d429fb6ad2cf2 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.474016 12383 tablet_replica.cc:330] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.474581 12383 raft_consensus.cc:2229] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.475111 12383 raft_consensus.cc:2258] T 3c5fdda28ecb4f6eb1005d44adf02df8 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.477432 12383 tablet_replica.cc:330] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.477981 12383 raft_consensus.cc:2229] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.478849 12383 raft_consensus.cc:2258] T 209555b832274fa58305de6823f1cdd6 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.481149 12383 tablet_replica.cc:330] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.481658 12383 raft_consensus.cc:2229] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.482185 12383 raft_consensus.cc:2258] T b5e9f11e62a544f399f4b8388dafa8c7 P 624a7a5cb3ee439a8bc640b2184c8c56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.485373 12383 tablet_replica.cc:330] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.486047 12383 raft_consensus.cc:2229] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.486544 12383 raft_consensus.cc:2258] T f5b6cda931874bd3b674397f0b23e34f P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.488878 12383 tablet_replica.cc:330] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56: stopping tablet replica
I20260811 16:09:50.489364 12383 raft_consensus.cc:2229] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 16:09:50.489799 12383 raft_consensus.cc:2258] T ff9e3b2adae348278cc8dd0360b9583a P 624a7a5cb3ee439a8bc640b2184c8c56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.559639 12383 tablet_server.cc:194] TabletServer@127.12.23.195:0 shutdown complete.
I20260811 16:09:50.602365 12383 master.cc:537] Master@127.12.23.254:42807 shutting down...
I20260811 16:09:50.632756 12383 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:09:50.633466 12383 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:09:50.633876 12383 tablet_replica.cc:330] T 00000000000000000000000000000000 P ae082136390745ed91775d24bd6ed641: stopping tablet replica
I20260811 16:09:50.656797 12383 master.cc:552] Master@127.12.23.254:42807 shutdown complete.
I20260811 16:09:50.697476 12383 test_util.cc:175] -----------------------------------------------
I20260811 16:09:50.697796 12383 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNOHenV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1786464125124352-12383-0
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (23564 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (45274 ms total)

[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (465345 ms total)
[  PASSED  ] 4 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true

 2 FAILED TESTS
I20260811 16:09:50.705559 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:221: suppressed but not reported on 2307 messages since previous log ~34 seconds ago
I20260811 16:09:50.705840 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:305: suppressed but not reported on 2307 messages since previous log ~34 seconds ago
I20260811 16:09:50.706054 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:140: suppressed but not reported on 2303 messages since previous log ~34 seconds ago
I20260811 16:09:50.706290 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 44 messages since previous log ~66 seconds ago
I20260811 16:09:50.706486 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 44 messages since previous log ~67 seconds ago
I20260811 16:09:50.706738 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/heartbeater.cc:644: suppressed but not reported on 11 messages since previous log ~203 seconds ago
I20260811 16:09:50.707024 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 18 messages since previous log ~0 seconds ago
I20260811 16:09:50.707278 12383 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 107 messages since previous log ~44 seconds ago